00 Arena Router
Use when the user wants to compare or benchmark multiple LLMs/agents arena-style but...
Install
npx skills add agentscope-ai/OpenJudge --skill 00-arena-router -g -a claude-code -y- Repository
- agentscope-ai/OpenJudge1k
- Category
- AI and agents
- Updated
- 5d ago
- License
- Apache-2.0
- Context cost
- Lightabout 855 tokens
- Runs scripts
- No, instructions only
What it does
Use when the user wants to compare or benchmark multiple LLMs/agents arena-style but it's unclear which specific workflow fits, a general-purpose win-rate comparison on a custom task, or a benchmark specifically about reference/citation hallucination rate. Also use when the user mentions model arena, agent arena, pairwise model comparison, win-rate ranking, or comparing models on a task and hasn't specified whether that task is generic or about citation accuracy. This skill is the entry router for the arena-eval suite: it asks one diagnostic question when needed, then recommends the workflow or workflows needed to cover the request.
Arena Eval Router
Entry router for the arena-eval suite. You diagnose what the user wants to
compare models on and route them to the appropriate sub-skill or both when
the request spans both evaluation goals. You don't run comparisons yourself, you're the triage desk.
Each sub-skill is self-contained: it carries inline everything it needs, so it can be installed and used on its own.
Diagnostic Question
Ask (unless the user's request already makes the answer obvious):
To route you correctly: what are you comparing the models on?
a) A custom task of your own choosing (chatbot quality, summarization,
coding, anything), you'll get win-rate rankings from a judge model
b) Specifically how often each model fabricates or hallucinates references
when asked to recommend citations
Shortcut rule: if the user already said "run an arena eval on my chatbot task" or "benchmark reference hallucination across these models", skip the question, the routing is already clear from their phrasing. Also skip the question when they explicitly ask for both general quality and citation accuracy; recommend both workflows.
