Reproduce Regression
Use when deploying before/after systems and building a live-system PoC for a regression...
Install
npx skills add trailofbits/skills --skill reproduce-regression -g -a claude-code -y- Repository
- trailofbits/skills7.9k
- Category
- Engineering
- Updated
- 7d ago
- License
- CC-BY-SA-4.0
- Context cost
- Lightabout 493 tokens
- Runs scripts
- No, instructions only
What it does
Use when deploying before/after systems and building a live-system PoC for a regression candidate.
Reproduce a candidate
When to Use
Input: sealed preparation/discovery packages, candidate and registry assignment. Follow project guidance before target work.
When NOT to Use
Independent verification of an existing PoC; use replay.
Reproduce
- Read the standard and file contract. Verify inputs; read security guidance. Stop execution if prerequisites fail.
- Build and run actual S0/S1 with required services. Trace the candidate to a real user/attacker entry point. Build/install CLIs and libraries; exercise supported interfaces. For build findings, execute the supported build workflow.
- Create and execute a portable PoC against both live deployments with identical input and comparable configuration. Record whether S0 behaves correctly and S1 exhibits the claimed failure. No mocks, extracted functions or simulated systems.
- Save setup, tool/dependency versions, sanitized configuration, input, PoC,
revisions, commands and separate logs. Record observations and false-positive
checks in
reproduce.json. If blocked, retain attempted setup and exact prerequisites. Build and deploy only inside your attempt directory, and list every build directory inbuild_dirs. - Release temporary resources without deleting evidence. Record their disposition, then seal the package.
Report Back
Keep detailed evidence in the sealed package. Return only:
- Status:
completeorblocked, matching the record. - Record: sealed
reproduce.jsonpath, or why none was produced. - Result: one sentence describing observed S0/S1 behavior.
- Blocker: missing prerequisite or required caller action, if blocked.
Completion means the experiment finished, not that the regression is confirmed.
Rationalizations to Reject
- “The unit test proves it”: synthetic tests cannot establish a regression.
