Loopx Benchmark
Operate or analyze LoopX-managed benchmark experiments through benchmark-toolkit...
Install
npx skills add loopx-project/loopx --skill loopx-benchmark -g -a claude-code -y- Repository
- loopx-project/loopx6.5k
- Category
- Engineering
- Updated
- 3d ago
- License
- Apache-2.0
- Context cost
- Mediumabout 3,000 tokens
- Runs scripts
- No, instructions only
What it does
Operate or analyze LoopX-managed benchmark experiments through benchmark-toolkit, including trajectory-based effectiveness and efficiency diagnosis, matched comparisons, run selection and integrity. Solving an assigned task under an existing runner does not by itself select this skill. Excludes casual benchmark discussion and ordinary software microbenchmarks.
LoopX Benchmark Workflow
Use this skill to operate or analyze a LoopX-managed benchmark experiment. The builtin
benchmark-toolkit capability owns provider-neutral experiment state and
integrity boundaries. This packaged skill is its task-triggered Agent playbook.
An assigned solver follows its task instructions and current execution contract. The words “benchmark”, “evaluation”, or “submission” in that task do not grant the operator role or require experiment-board discovery. Use this workflow when the requested work actually includes run management, analysis of an active run, or post-run analysis; an explicit request to use the skill still applies. Keep the solver's task-local validation and authorized submission path distinct from experiment management.
The capability is catalog-ready without a per-Goal enable switch. Installing this skill does not grant runner, shell, network, credential, private-evidence, or Goal mutation authority. Respect the selected todo's required capabilities, any external provider binding, host permissions, and user gates.
Capability surface
loopx capability show benchmark-toolkit --format json, catalog entry with usage hints, role boundaries, and the post-run case-insight template.loopx benchmark --help, subcommands (experiment-board-show, experiment-board-upsert, source-revision-fence, integrity-qualification, classify-artifacts).
Share a study through the public-safe contract
When another benchmark developer needs portable study data, use the capability's typed study flow rather than sharing a runner-specific ledger or raw evidence:
