Microsoft has added a new feature called “Use Computer” to Copilot Studio that allows AI agents to interact with websites and desktop applications. Copilot Studio, like the OpenAI Operator before it and a similar feature in Anthropic Claude, can use websites and local software as tools to automate work tasks.
Image source: microsoft.com
«Using a computer allows agents to interact with websites and desktop applications by clicking buttons, selecting menus, and entering text into on-screen fields. Agents perform tasks even when there is no API to directly connect to the system. If a human can use the application, so can an agent,” Microsoft said about the new feature.
In Copilot Studio, you can create AI agents that can automate data entry, conduct market research, or process accounting documents. The AI, Microsoft says, is trained to detect when the placement of buttons in apps or websites changes and continues to work without interruption.
Earlier, Microsoft added a similar Actions feature to the consumer version of Copilot — actions are performed in the background when a person is busy with other tasks. Copilot can book tables at a restaurant, buy tickets for events and buy goods in online stores. However, the capabilities of Actions are limited to established Microsoft partners, and Copilot Studio offers free work with a larger number of sites and applications.