Browser Automation

Browser automation for AI agents with two provider options. Both share the same core workflow: navigate, snapshot, interact using @e refs, re-snapshot after changes.

Provider	Runtime	Best For
agent-browser	Local (Playwright CLI)	Local testing, iOS Simulator, file:// URLs
agentic-browser	Cloud (inference.sh)	Video recording, cloud execution, parallel sessions

Default to agent-browser; use agentic-browser only when the task needs recording, cloud IPs, or more than 2 parallel sessions. They share the same @e ref workflow.

---

Core Workflow (Both Providers)

Every browser automation follows this pattern:

1. Navigate, Open a URL
2. Snapshot, Get @e refs for interactive elements
3. Interact, Use refs to click, fill, select
4. Re-snapshot, After navigation or DOM changes, get fresh refs

Important: Refs are invalidated after navigation. Always re-snapshot after clicking links/buttons, form submissions, or dynamic content loading.

---

Provider 1: agent-browser (Local CLI)

Quick Start

agent-browser open https://example.com/form
agent-browser snapshot -i
# Output: @e1 [input type="email"], @e2 [input type="password"], @e3 [button] "Submit"

agent-browser fill @e1 "user@example.com"
agent-browser fill @e2 "password123"
agent-browser click @e3
agent-browser wait --load networkidle
agent-browser snapshot -i  # Check result

Essential Commands

# Navigation
agent-browser open <url>              # Navigate
agent-browser close                   # Close browser

# Snapshot
agent-browser snapshot -i             # Interactive elements with refs
agent-browser snapshot -i -C          # Include cursor-interactive elements
agent-browser snapshot -s "#selector" # Scope to CSS selector