# ComputerUse

Front door for driving this Mac: anything with a DOM, AX, CLI, or API handle routes to...

- Repository: https://github.com/danielmiessler/LifeOS (19669 stars)
- Category: Design
- License: MIT
- Last updated: 2026-10-28
- Runs scripts: yes, review before use

## Install

Claude Code: `npx skills add danielmiessler/LifeOS --skill ComputerUse -g -a claude-code -y`
Codex: `npx skills add danielmiessler/LifeOS --skill ComputerUse -g -a codex -y`
Cursor: `npx skills add danielmiessler/LifeOS --skill ComputerUse -g -a cursor -y`
Gemini CLI: `npx skills add danielmiessler/LifeOS --skill ComputerUse -g -a gemini-cli -y`

## Description

Front door for driving this Mac: anything with a DOM, AX, CLI, or API handle routes to Interceptor; pixel-only GUI work goes to a vision agent, OpenAI Astra via codex exec or a tool-less Claude acting through Interceptor's bridge, picked per task class by a measured bake-off, under a deny list, step caps, and a read-back that decides pass/fail. USE WHEN computer use, drive the computer, control the mac, operate this app for me, do it in the GUI, pixel-only app, no API for this, canvas UI, computer-use bake-off, Claude vs OpenAI computer use. NOT FOR DOM/AX handles or web verification (Interceptor), scraping (a scraping skill, BrightData).

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# ComputerUse

**Contents:** Ideal State · Intent Routing · The routing table · The supervised run · Data & Config · Gotchas · Examples

One skill routes every computer-use task by a rule you can read, then supervises the run so the vision leg never grades itself, never sees what it must not, and never runs away.

## Ideal State

- Every task is routed by the readable rule before anything runs: verification and anything with a DOM, AX, CLI or API handle go to Interceptor, and only pixel-only work goes to the measured vision pick.
- A vision run's verdict comes only from its declared verifier, never from the agent's own report, and no run starts without one.
- The vision leg never sees a running credential app, a visible communications app or a denied host, never acts outside its allowlisted app, and stops at its step and wall-clock caps.
- Send, buy, delete, publish or confirm happens only when the principal named that exact action, and every refusal is reported rather than worked around.

## Intent Routing

| Intent | Trigger | File |
|--------|---------|------|
| **Drive** | "do this in the GUI", "drive <app>", "computer use for <task>" | `Intents/Drive.md` |
| **Probe** | "is Astra computer use working", "probe the vision leg" | `Intents/Probe.md` |
| **BakeOff** | "bake-off", "which vision agent is better", "Claude vs OpenAI computer use", "re-score the vision legs" | `Intents/BakeOff.md` |

The rest: https://github.com/danielmiessler/LifeOS/blob/HEAD/LifeOS/install/skills/ComputerUse/SKILL.md