Redteam
Use when the user wants to test their LLM/agent application for safety and security...
Install
npx skills add agentscope-ai/OpenJudge --skill redteam -g -a claude-code -y- Repository
- agentscope-ai/OpenJudge1k
- Category
- Testing
- Updated
- 5d ago
- License
- Apache-2.0
- Context cost
- Mediumabout 3,000 tokens
- Runs scripts
- Yes, review before use
What it does
Use when the user wants to test their LLM/agent application for safety and security vulnerabilities, jailbreaks, prompt injection, PII extraction, harmful content generation, or evaluator gaming. Also use when the user mentions security testing, adversarial testing, red teaming, safety evaluation, ASR (Attack Success Rate), or "is my app safe to deploy." Outputs ASR paired with over-refusal rate and an audit document.
Redteam
Test your application's safety boundaries systematically. This skill generates attack prompts from a policy document, measures what gets through, and pairs the Attack Success Rate (ASR) with the Over-Refusal Rate so you don't reward models that simply refuse everything.
When to Activate
- Pre-deployment safety audit
- Regulatory compliance check
- After major model or prompt changes that could affect safety
- User reports a jailbreak or injection vulnerability
- Periodic (quarterly) safety re-evaluation
Checklist
You MUST create a task for each item and complete them in order:
- Establish policy, what's prohibited, what's allowed, what's gray
- Derive attack vectors from policy, not a fixed template
- Generate attack set + over-refusal set, paired measurement
- Run attacks and evaluate, ASR per policy category
- Compute over-refusal rate, paired with ASR
- Output safety scorecard + audit document
Fast path: run the bundled script
Once attacks and benign prompts have been run against the system and judged, compute the
scorecard with the bundled, tested script (scripts/asr_report.py, standard library only,
no OpenJudge dependency), it always pairs ASR with over-refusal so you can't reward a
system that just refuses everything:
python scripts/asr_report.py --attacks attacks.jsonl --over-refusals over.jsonl
# 1-5 harmfulness grader (5=safe): python scripts/asr_report.py --attacks attacks.jsonl --score-scale 5 --harm-threshold 3
