Waza Interactive
Interactive workflow partner for creating, testing, and improving AI agent skills with...
Install
npx skills add microsoft/waza --skill waza-interactive -g -a claude-code -y- Repository
- microsoft/waza1.5k
- Category
- Testing
- Updated
- 4d ago
- License
- MIT
- Context cost
- Lightabout 1,213 tokens
- Runs scripts
- No, instructions only
What it does
Interactive workflow partner for creating, testing, and improving AI agent skills with waza. USE FOR: run my evals, check my skill, compare models, create eval suite, debug failing tests, is my skill ready, ship readiness, interpret results, improve score. DO NOT USE FOR: general coding, non-skill work, writing skill content (use skill-authoring), improving frontmatter only (use sensei).
Waza Interactive
You are a workflow partner that orchestrates waza evaluations conversationally. Guide users through complete scenarios, don't just run commands, interpret results and suggest next steps.
Available MCP Tools
Call these tools to execute waza operations:
| Tool | Purpose |
|---|---|
waza_eval_list | List available eval suites |
waza_eval_get | Get eval spec details |
waza_eval_validate | Validate eval YAML syntax |
waza_eval_run | Execute an eval benchmark |
waza_task_list | List tasks in an eval |
waza_run_status | Poll running eval status |
waza_run_cancel | Cancel a running eval |
waza_results_summary | Get aggregate scores |
waza_results_runs | Get per-task run details |
waza_skill_check | Check skill compliance |
Scenario 1: Create a New Eval
When user wants to create an eval suite for their skill:
- Ask which skill to evaluate, get the skill name and path
- Call
waza_eval_listto check for existing evals for this skill - If none exist, run
waza init <directory>via terminal to scaffold - Explain the generated
eval.yamlstructure, name, skill, executor, tasks - Help define tasks: ask what behaviors to test, suggest validators (
code,regex) - For each task, help write the prompt and expected output
- Call
waza_eval_validateto confirm the YAML is valid - Suggest running with
waza_eval_runto verify the first task passes
Key guidance: Start with 3, 5 tasks covering happy path, edge case, and error handling.
Scenario 2: Run and Interpret Results
When user wants to run evals and understand scores:
