# Jev Computer Use

Use when driving a desktop GUI through a computer-use driver, windows, menus, native...

- Repository: https://github.com/kerpopule/hermes-jev-skills (1275 stars)
- Category: Engineering
- License: MIT
- Last updated: 2026-10-29
- Runs scripts: yes, review before use

## Install

Claude Code: `npx skills add kerpopule/hermes-jev-skills --skill jev-computer-use -g -a claude-code -y`
Codex: `npx skills add kerpopule/hermes-jev-skills --skill jev-computer-use -g -a codex -y`
Cursor: `npx skills add kerpopule/hermes-jev-skills --skill jev-computer-use -g -a cursor -y`
Gemini CLI: `npx skills add kerpopule/hermes-jev-skills --skill jev-computer-use -g -a gemini-cli -y`

## Description

Use when driving a desktop GUI through a computer-use driver, windows, menus, native apps, OS dialogs. You build a table of safe actions; Jev picks the next one in about 0.4 seconds.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Computer use with Jev

You stay the planner and the hands. Jev is only the fast "which one next?" in the middle. It returns an id from a table **you** built, so it cannot invent coordinates, text, selectors or tool calls. The worst a wrong answer can do is pick another action you already judged safe.

Web pages belong to `jev-browser-use`. This skill is for desktop apps and OS surfaces, driven through whatever computer-use driver you have (CUA Driver over MCP, the platform's native computer-use tool, an accessibility bridge).

## First choice on a Mac: Co-Agent does the loop for you

If Co-Agent is installed (its engine answers on `http://127.0.0.1:8792`), let it drive.
It already holds the Mac's Accessibility and Screen Recording permissions, runs this same
loop natively (fresh observation, Jev picks one id from a closed menu, one action, a new
observation to verify) and adds what hand-built loops kept getting wrong:

- it hit-tests every click and brings a covered window forward (or refuses with
  `occluded`), instead of clicking whatever app is really on top;
- it reads apps with no accessibility tree (Epic Games Launcher, games, canvases) with
  on-device OCR, and clicks them in a way Unreal and WebKit accept;
- it applies the owner's policy per action with no dialog for ordinary input, and answers
  `needs_approval` with a ticket at once for purchases, deleting, sending, legal
  acceptance, sign-in and security settings; it never types credentials;
- it names a lock screen or a macOS permission prompt as `blocked` instead of hanging.

Agents with MCP use its tools `computer_status`, `computer_observe`, `computer_act` and
`computer_run`. Agents that shell out use the bundled client:

The rest: https://github.com/kerpopule/hermes-jev-skills/blob/HEAD/skills/jev-computer-use/SKILL.md
