What does computer use mean for AI agents?

Computer use is the capability that lets an AI agent operate a computer the way a person does, by looking at the screen and sending mouse and keyboard input. The term comes from the AI labs' developer tools, where it names a specific feature: give the model screenshots, let it reply with actions, and run those actions on a real or virtual machine.

The developer definition

In Anthropic's API, computer use is a toolset. One entry in a request gives the model a set of member tools, such as taking a screenshot, clicking and typing, and your application executes each call in an environment you control. OpenAI's guide frames it as a loop as well: the model returns code or actions, your harness runs them in a browser or desktop, and the output goes back to the model until the task is done.

How it is measured

The common yardstick is OSWorld, a benchmark of 369 tasks on real computers that involve web and desktop apps, file operations and workflows across several applications. Scores are reported on different versions and setups, so treat any single headline number with care.

How the products have shifted

The category moves fast enough that products come and go within a year. OpenAI's help centre now says ChatGPT agent is no longer available and points to ChatGPT Work and its cloud browser. ByteDance archived its UI-TARS-desktop repository in November 2026. When you read an older article on computer use, check that the product it describes still exists.

Computer use in everyday apps

For most people computer use now arrives inside an app rather than an API. Anthropic ships it in Claude's desktop app. Our agent, superbot, can drive a computer and do the work there, with its screen shown in the chat, and it asks before it uses yours. The details of who acts where are on the full desktop access page of this site.

Three questions to ask about any agent

• Does it act on my own screen or a computer of its own?
• What does it need from my operating system, and can I take that back?
• Can I watch it and stop it at any moment?