# LLM Response Cache

Views cache statistics, clears entries and sets TTL and semantic similarity thresholds.

- Repository: https://github.com/cheaper-inference/OmniRoute (83611 stars)
- Category: DevOps
- License: MIT
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add cheaper-inference/OmniRoute --skill omni-cache -g -a claude-code -y`
Codex: `npx skills add cheaper-inference/OmniRoute --skill omni-cache -g -a codex -y`
Cursor: `npx skills add cheaper-inference/OmniRoute --skill omni-cache -g -a cursor -y`
Gemini CLI: `npx skills add cheaper-inference/OmniRoute --skill omni-cache -g -a gemini-cli -y`

## Description

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten -->

## Overview

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

## Authentication

All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development.

## Endpoints

### GET /api/cache

Get cache statistics

```bash
curl http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### DELETE /api/cache

Clear all caches

```bash
curl -X DELETE http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### GET /api/cache/stats

Get detailed cache statistics

Returns detailed statistics for all cache layers.

```bash
curl http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### DELETE /api/cache/stats

Clear cache statistics

```bash
curl -X DELETE http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### GET /api/cache/entries

GET cache › entries

```bash
curl http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### DELETE /api/cache/entries

DELETE cache › entries

```bash
curl -X DELETE http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### GET /api/cache/reasoning

GET cache › reasoning

```bash
curl http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

### DELETE /api/cache/reasoning

DELETE cache › reasoning

```bash
curl -X DELETE http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
```

## Payloads

See the full OpenAPI specification at `GET /api/openapi/spec` or `docs/openapi.yaml` for detailed request/response schemas.