GitHub Copilot adds desktop app control in public preview

Where computer use is available

GitHub announced computer use in public preview for GitHub Copilot CLI and the GitHub Copilot app on macOS and Windows. It lets Copilot interact with desktop applications, including reading accessible content, clicking controls, entering text, scrolling, and navigating workflows across applications.

That may help with GUI-only or legacy software that lacks an API, command-line interface, or MCP integration. GitHub's examples include summarizing browser notifications, updating a presentation, and moving information through a desktop workflow.

Sources: GitHub Copilot can now interact with desktop apps with computer use - GitHub Changelog

Approval, permissions, and controls

Copilot asks for approval before controlling an app. Users can review or reset apps they have chosen to always allow, and organization-managed settings can disable the feature. On macOS, setup also requires Accessibility and Screen Recording permissions.

In Copilot CLI, run /computer on to enable the feature, /computer show to check its status, or /computer off to disable it. In the Copilot app, open Settings, select Computer Use, and turn on Enable Computer Use; GitHub also documents /computer on there.

For more reliable tasks, GitHub recommends specifying the desired outcome, the applications involved, and any important constraints. The announcement does not state plan eligibility or pricing.

Sources: GitHub Copilot can now interact with desktop apps with computer use - GitHub Changelog