# Smoke Test

Run smoke tests against a deployed or local app based on your git diff.

- Repository: https://github.com/Skyvern-AI/skyvern (23329 stars)
- Category: Testing
- License: AGPL-3.0
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add Skyvern-AI/skyvern --skill smoke-test -g -a claude-code -y`
Codex: `npx skills add Skyvern-AI/skyvern --skill smoke-test -g -a codex -y`
Cursor: `npx skills add Skyvern-AI/skyvern --skill smoke-test -g -a cursor -y`
Gemini CLI: `npx skills add Skyvern-AI/skyvern --skill smoke-test -g -a gemini-cli -y`

## Description

Run smoke tests against a deployed or local app based on your git diff. Each test uses Skyvern browser tools (navigate, act, validate, screenshot) with Chrome DevTools MCP as fallback. Posts screenshot evidence as PR comments.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Smoke Test, CI-Oriented Validation via Skyvern Browser Tools

Read the diff, classify changes, start the app, and run targeted smoke tests via Skyvern browser tools with Chrome DevTools MCP as fallback.

<!-- NOTE: .agents/skills/smoke-test/SKILL.md is the repository canonical source.
     Keep the synchronized bundled copy in sync with it:
     skyvern/cli/skills/smoke-test/SKILL.md
     Steps 1-4 are copied from .agents/skills/qa/SKILL.md.
     If you fix bugs in /qa's diff-reading, classification, or app startup,
     mirror those fixes here. -->

You changed code. This skill reads the diff, generates targeted smoke tests, and runs
each one via Skyvern browser tools - navigate, act, validate, screenshot. If Skyvern
tools are unavailable (no Skyvern MCP), fall back to Chrome DevTools MCP, which connects
to a real Chrome instance and supports authenticated sessions. It is /qa's CI companion:
same diff-reading, same classification, same app startup, formatted for CI output and
PR comments with screenshot evidence on every test.

## Quick Start

```text
/smoke-test                              # Diff-driven, auto-detect everything
/smoke-test https://staging.example.com  # Explicit app URL
/smoke-test -- focus on the settings page
/smoke-test --pr 11488                   # Target a specific PR
```

## How It Works

1. Read git diff (reused from /qa)
2. Classify changes → identify testable surfaces (reused from /qa)
3. Choose validation strategy (reused from /qa)
4. Pick browser backend (Chrome DevTools MCP or Skyvern)
5. Handle auth (connect to authenticated session or bypass)
6. Start the app if needed (reused from /qa)
7. Generate 3-8 smoke test cases as action sequences (happy paths only)
8. Run each test via browser tools: navigate → act → validate → screenshot
9. Collect results with screenshot evidence
10. Report with embedded screenshots
11. Post to PR with images

## Step 1: Understand the Changes

### Get the diff

The rest: https://github.com/Skyvern-AI/skyvern/blob/HEAD/skyvern/cli/skills/smoke-test/SKILL.md