Product Guide
Computer use
Computer use lets an agent operate an app through the screen, keyboard, and mouse when a direct integration is not available.
When it is used
Interface prefers direct, structured integrations when they exist. Computer use is for apps that only expose a visual interface or for work that must happen inside an app you are already signed into.
macOS access
Computer use reads macOS system state so the agent can understand your desktop and act when you approve. Interface requests the standard macOS permissions needed for each capability.
- Open windows — see which windows are open, their titles, and which app owns them.
- Running apps — see which applications are running and focus the right one.
- App contents — read what is visible inside an app through screen capture and accessibility APIs.
- Files — list and open local files when you ask the agent to work with documents on your Mac.
- Window layout — resize, move, and arrange windows as part of workspace orchestration.
Best practices
Keep the target app visible, describe the exact result you want, and review any final action that sends, submits, deletes, purchases, or changes shared data.