
Provider Health Monitoring
Monitors provider health, circuit breakers, latency percentiles and budget alerts.
Install
npx skills add cheaper-inference/OmniRoute --skill omni-resilience -g -a claude-code -y- Repository
- cheaper-inference/OmniRoute83.6k
- Category
- DevOps
- Updated
- 4d ago
- License
- MIT
- Context cost
- Lightabout 1,151 tokens
- Runs scripts
- No, instructions only
What it does
Monitor provider health, circuit-breaker states, p50/p95/p99 latency metrics, and budget guard alerts. Inspect connection cooldowns and model lockouts in real time.
Overview
Monitor provider health, circuit-breaker states, p50/p95/p99 latency metrics, and budget guard alerts. Inspect connection cooldowns and model lockouts in real time.
Authentication
All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.
Endpoints
GET /api/monitoring/health
System health check
Returns system health including uptime, memory, circuit breakers, rate limits
curl http://localhost:20128/api/monitoring/health \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/monitoring/compression
Get compression result-memo statistics
In-process compression result-memo observability snapshot, size, capacity, lifetime hits/misses/hitRate plus 1m/5m/15m/1h windowed rates. Lightweight (no DB, no provider reads) companion to GET /api/monitoring/health intended for frequent polling. Sent with Cache-Control: no-store, no-cache, must-revalidate. Counters reset on process restart.
curl http://localhost:20128/api/monitoring/compression \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/provider-metrics
GET provider metrics
curl http://localhost:20128/api/provider-metrics \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
Payloads
See the full OpenAPI specification at GET /api/openapi/spec or docs/openapi.yaml for detailed request/response schemas.
OmniRoute, Monitoring & Health
Requires OMNIROUTE_URL and OMNIROUTE_KEY. See entry-point SKILL for setup.
System health
curl $OMNIROUTE_URL/api/health \
-H "Authorization: Bearer $OMNIROUTE_KEY"

