Adjudicate Regression
Use when deciding whether source and live reproduction evidence establish a new...
Install
npx skills add trailofbits/skills --skill adjudicate-regression -g -a claude-code -y- Repository
- trailofbits/skills7.9k
- Category
- Engineering
- Updated
- 7d ago
- License
- CC-BY-SA-4.0
- Context cost
- Lightabout 620 tokens
- Runs scripts
- No, instructions only
What it does
Use when deciding whether source and live reproduction evidence establish a new regression or an exclusion.
Adjudicate evidence
When to Use
Input: candidate, frozen sources, available reproduction/replay packages and registry assignment. Use a fresh context distinct from the reproducer and replayer. Early exclusions may lack experiments. Follow project guidance before target work.
When NOT to Use
Producing missing evidence; return the gap to the caller.
Decide
- Read the standard, labels and file contract. Verify seals. Inspect source, setup, PoC, actual logs and security assumptions, not only summaries.
- Identify the claimed defect and assess whether the change introduced it. Rule out incomplete fixes, latent/pre-existing bugs, intentional changes, unsupported expectations and unreachable scenarios with cited evidence. Establish attacker access and applicable protections for security findings.
- Confirm only when reproduction and independent replay ran the same PoC/input against live S0/S1 through real interfaces, showing correct behavior before and failure afterward. Explain supported behavior, reachability and patch causality. Assign severity/likelihood with reasons.
- Otherwise select an evidenced exclusion or
UNRESOLVED; state what remains unproved. ForUNRESOLVED, put the standard's concise paragraph separating observed gaps, plausible explanations and resolving checks inreasonso reports retain it. Incomplete fixes and existing bugs stay outside regression totals. Check known findings/issues/PRs before claiming novelty; report unknown if unavailable. - For requested deduplication, establish whether supplied candidates share a root cause. Preserve change mappings; never deduplicate unresolved claims into confirmation.
- Write and seal
decision.json; cite evidence for every conclusion. Record any blocker preventing adjudication.
