Anthropic publicly releases AI tool that can take over the user’s mouse cursor
Anthropic is one of the first to go beyond just screen vision.
AI software company Anthropic has announced a new tool that can take control of the user's mouse cursor and perform basic tasks on their computer.
Announced alongside other improvements to Anthropic's Claude and Haiku models, the tool is straightforwardly called "Computer Use." It's available exclusively with the company's mid-range 3.5 Sonnet model right now, via the API. Users can give multi-step instructions (Anthropic claims it can go for tens or even hundreds of steps) to accomplish tasks on the user's computer by "looking at a screen, moving a cursor, clicking buttons, and typing text."
Here's how Anthropic says it works:
What's Your Reaction?
