Computer Use

Use Computer Use only for tasks that require a live desktop interface or visual verification. Prefer a purpose-built integration or command-line tool when it can complete and verify the task.

Use only the native desktop runtime. It operates on one approved application and one observed window at a time; it never accepts a free-form screen target.

Operating Loop

Follow this loop for every task:

1. Discover the canonical application and the correct window.
2. Observe the window and identify the requested state from current evidence.
3. Define the next expected visible or accessible state change.
4. Choose one action channel and perform the smallest useful action.
5. Inspect the replacement observation before deciding the next action.
6. Observe the final state and verify every requested outcome before reporting success.

Treat dispatched: true or an intermediate acknowledgement only as evidence that input was sent, not that the application completed the operation. If the final state is incomplete or uncertain, report that accurately.

Discover the Target

1. Call list_apps and select the canonical App ID.
2. Call list_windows, optionally limited by that App ID.
3. Match the target by title, content, and observed state. When several windows are plausible, observe them read-only until one matches; never choose only because it is first or most recent.
4. Keep using the matched window_id until an action explicitly hands off to another window.

Use launch_app with a canonical App ID. If the application is not listed, use an explicit absolute executable path on Windows or application-bundle path on macOS. After launch, list its windows again because launch completion does not prove that a usable window already exists.

When the runtime reports a missing system permission, stop and ask the user to grant it. Do not retry until the user confirms the permission was granted.

Read an Observation