Skills

Iterative Debugging

Run the baseline-free CaP iterative debugging (fix loop) pipeline on a user-supplied...

Install

npx skills add NVlabs/ASPIRE --skill iterative-debugging -g -a claude-code -y
Repository
NVlabs/ASPIRE925
Category
Testing
Updated
20d ago
License
Apache-2.0
Context cost
Lightabout 1,022 tokens
Runs scripts
Yes, review before use

What it does

Run the baseline-free CaP iterative debugging (fix loop) pipeline on a user-supplied list of benchmark tasks: inspect one initial observed scene per task, generate task-level code, debug failures on development seeds using recorded run artifacts, validate on the held-out partition, grade the skill library against what actually worked, and promote only those patterns a verifier could reproduce the fix from.

Iterative Debugging (Fix Loop)

For BEHAVIOR-1K (R1 Pro on Isaac Sim) use the sibling folder behavior/SKILL.md. It is a different protocol, not just different prompts: those tasks are long-horizon, so each seed grows its own policy one code block at a time, and the campaign freezes a skill library rather than a program. Everything below is for the tabletop benchmarks (LIBERO-Pro, Robosuite).

Use this skill to run a coordinated debugging campaign over any list of CaP benchmark tasks. No external baseline code or baseline output directory is used. Runs use the benchmark's own --init-mode (LIBERO: seeded, so development seeds 51, 65 and the held-out partition are distinct scenes; Robosuite uses saved).

Setup

  1. Complete benchmark setup for the target embodiment (docs/libero-pro.md, or docs/robosuite.md), including the pinned environment (for LIBERO: scripts/bootstrap_libero.sh → .venv-libero) and SAM3 authentication.
  2. Export the benchmark environment variables (for LIBERO: LIBERO_CONFIG_PATH="$PWD/.libero", MUJOCO_GL=egl, PYOPENGL_PLATFORM=egl, EGL_PLATFORM=device, TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1).
  3. Start perception services (scripts/supervise_services.sh) and a persistent coordinator session.
  4. Read docs/api-reference.md, docs/run-artifacts.md, and main-agent-prompt.md.

Run Order

Read the whole SKILL.md on GitHub

More in Testing