ComputerUse
Front door for driving this Mac: anything with a DOM, AX, CLI, or API handle routes to...
Install
npx skills add danielmiessler/LifeOS --skill ComputerUse -g -a claude-code -y- Repository
- danielmiessler/LifeOS19.7k
- Category
- Design
- Updated
- 8d ago
- License
- MIT
- Context cost
- Mediumabout 2,872 tokens
- Runs scripts
- Yes, review before use
What it does
Front door for driving this Mac: anything with a DOM, AX, CLI, or API handle routes to Interceptor; pixel-only GUI work goes to a vision agent, OpenAI Astra via codex exec or a tool-less Claude acting through Interceptor's bridge, picked per task class by a measured bake-off, under a deny list, step caps, and a read-back that decides pass/fail. USE WHEN computer use, drive the computer, control the mac, operate this app for me, do it in the GUI, pixel-only app, no API for this, canvas UI, computer-use bake-off, Claude vs OpenAI computer use. NOT FOR DOM/AX handles or web verification (Interceptor), scraping (a scraping skill, BrightData).
ComputerUse
Contents: Ideal State · Intent Routing · The routing table · The supervised run · Data & Config · Gotchas · Examples
One skill routes every computer-use task by a rule you can read, then supervises the run so the vision leg never grades itself, never sees what it must not, and never runs away.
Ideal State
- Every task is routed by the readable rule before anything runs: verification and anything with a DOM, AX, CLI or API handle go to Interceptor, and only pixel-only work goes to the measured vision pick.
- A vision run's verdict comes only from its declared verifier, never from the agent's own report, and no run starts without one.
- The vision leg never sees a running credential app, a visible communications app or a denied host, never acts outside its allowlisted app, and stops at its step and wall-clock caps.
- Send, buy, delete, publish or confirm happens only when the principal named that exact action, and every refusal is reported rather than worked around.
Intent Routing
| Intent | Trigger | File |
|---|---|---|
| Drive | "do this in the GUI", "drive <app>", "computer use for <task>" | Intents/Drive.md |
| Probe | "is Astra computer use working", "probe the vision leg" | Intents/Probe.md |
| BakeOff | "bake-off", "which vision agent is better", "Claude vs OpenAI computer use", "re-score the vision legs" | Intents/BakeOff.md |
