Home Anthropic launches AI ‘Computer Use’ where Claude can control PCs

Anthropic launches AI ‘Computer Use’ where Claude can control PCs

The technology company behind the chatbot Claude, Anthropic, has unveiled a new feature called ‘Computer Use’ which is where the AI can control a user’s PC.

The details emerged through an announcement on Tuesday (October 22) with the company sharing its “groundbreaking new capability in public beta” which is now available on the API.

With this tool, developers “can direct Claude to use computers the way people do – by looking at a screen, moving a cursor, clicking buttons, and typing text.”

This is the first AI model to offer computer use in public beta, but the team says it’s still very much in an experimental phase as it can sometimes be cumbersome and error-prone.

While it hasn’t yet been perfected, the tool has been released early for feedback from developers.

What is Anthropic’s new ‘computer use’ feature?

With computer use, Claude can generate computer actions to fulfill user instructions. This could include a demand like ‘use data from my computer and online to fill out this form.’

This will then lead the AI to fill out the required form while collecting the necessary information from the user’s computer.

To enable Claude to gain these computer skills, the company has built an API that allows the AI to perceive and interact with computer interfaces.

Developers can then integrate this API to allow Claude to translate instructions into computer commands.

The feature is very much a work in progress as the company aims to learn from the initial deployments of the technology.

The current use of the feature is described as being “imperfect.” Some actions like scrolling, dragging, and zooming are current challenges for Claude.

While the thought of an AI taking over someone’s personal computer could sound alarm bells, the company says it is taking “a proactive approach” to promoting its safe deployment.

As computer use could potentially provide a new vector for familiar threats like spam, misinformation, or fraud, Anthropic has developed new classifiers. These will identify when the feature is being used and whether harm is occurring.

Featured Image: Via Anthropic announcement

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech, gambling and blockchain industries for major developments, new product and brand launches, AI breakthroughs, game releases and other newsworthy events. Editors assign relevant stories to in-house staff writers with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Sophie Atkinson
Tech Journalist

Sophie Atkinson is a UK-based journalist and content writer, as well as a founder of a content agency which focuses on storytelling through social media marketing. She kicked off her career with a Print Futures Award which champions young talent working in print, paper and publishing. Heading straight into a regional newsroom, after graduating with a BA (Hons) degree in Journalism, Sophie started by working for Reach PLC. Now, with five years experience in journalism and many more in content marketing, Sophie works as a freelance writer and marketer. Her areas of specialty span a wide range, including technology, business,…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.