# Loopx Benchmark

Operate or analyze LoopX-managed benchmark experiments through benchmark-toolkit...

- Repository: https://github.com/loopx-project/loopx (6526 stars)
- Category: Engineering
- License: Apache-2.0
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add loopx-project/loopx --skill loopx-benchmark -g -a claude-code -y`
Codex: `npx skills add loopx-project/loopx --skill loopx-benchmark -g -a codex -y`
Cursor: `npx skills add loopx-project/loopx --skill loopx-benchmark -g -a cursor -y`
Gemini CLI: `npx skills add loopx-project/loopx --skill loopx-benchmark -g -a gemini-cli -y`

## Description

Operate or analyze LoopX-managed benchmark experiments through benchmark-toolkit, including trajectory-based effectiveness and efficiency diagnosis, matched comparisons, run selection and integrity. Solving an assigned task under an existing runner does not by itself select this skill. Excludes casual benchmark discussion and ordinary software microbenchmarks.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# LoopX Benchmark Workflow

Use this skill to operate or analyze a LoopX-managed benchmark experiment. The builtin
`benchmark-toolkit` capability owns provider-neutral experiment state and
integrity boundaries. This packaged skill is its task-triggered Agent playbook.

An assigned solver follows its task instructions and current execution contract.
The words “benchmark”, “evaluation”, or “submission” in that task do not grant
the operator role or require experiment-board discovery. Use this workflow when
the requested work actually includes run management, analysis of an active run,
or post-run analysis; an explicit request to use the skill still applies. Keep
the solver's task-local validation and authorized submission path distinct from
experiment management.

The capability is catalog-ready without a per-Goal enable switch. Installing
this skill does not grant runner, shell, network, credential, private-evidence,
or Goal mutation authority. Respect the selected todo's required capabilities,
any external provider binding, host permissions, and user gates.

## Capability surface

- `loopx capability show benchmark-toolkit --format json`, catalog entry with
  usage hints, role boundaries, and the post-run case-insight template.
- `loopx benchmark --help`, subcommands (experiment-board-show,
  experiment-board-upsert, source-revision-fence, integrity-qualification,
  classify-artifacts).

## Share a study through the public-safe contract

When another benchmark developer needs portable study data, use the capability's
typed study flow rather than sharing a runner-specific ledger or raw evidence:

The rest: https://github.com/loopx-project/loopx/blob/HEAD/skills/loopx-benchmark/SKILL.md