Skills

LLM Council

Provider-agnostic multi-LLM deliberation.

Install

npx skills add rohitg00/pro-workflow --skill llm-council -g -a claude-code -y
Repository
rohitg00/pro-workflow2.9k
Category
AI and agents
Updated
1mo ago
License
See repository
Context cost
Lightabout 975 tokens
Runs scripts
Yes, review before use

What it does

Provider-agnostic multi-LLM deliberation. Three phases, independent responses, cross-model anonymized ranking, chairman synthesis. Credentials come from explicit plugin configuration or pro-workflow-specific CLI variables. Persists transcript to a wiki page when --wiki <slug> is passed. Use when the user wants multiple AI perspectives, consensus-building, or the "LLM Council" approach for high-stakes reviews, plan critique, or contested learning rules.

LLM Council

Karpathy's LLM Council pattern with Anthropic and OpenAI-compatible providers.

When to use

  • High-stakes plan review (/plan crosses N-file threshold)
  • Conflicting learning-rules → re-resolve via vote
  • User invokes /council "<query>" or /wiki council
  • Architecture decisions where you want multiple viewpoints captured
  • Persisting deliberation as a wiki page for future reference

Three phases

  1. Independent: each model answers in parallel
  2. Ranking: each model ranks anonymized peer responses
  3. Synthesis: chairman model reads all responses + rankings → final answer

Provider config

Configure optional keys in the plugin configuration dialog. Use the providers MCP server's run_provider_task tool with task: "council" and args: ["run", "<query>", "--provider", "openai"]. For provider status, pass args: ["providers"]. Never request keys in chat or read them from existing credentials or shell configuration.

For standalone CLI use, explicitly set a pro-workflow-specific variable below. The first configured provider is the default; --provider selects one explicitly. See provider configuration.

Standalone CLI variableProviderDefault base URL
PRO_WORKFLOW_ANTHROPIC_API_KEYAnthropichttps://api.anthropic.com
PRO_WORKFLOW_OPENAI_API_KEYOpenAIhttps://api.openai.com/v1
PRO_WORKFLOW_OPENROUTER_API_KEYOpenRouterhttps://openrouter.ai/api/v1
PRO_WORKFLOW_FIREWORKS_API_KEYFireworkshttps://api.fireworks.ai/inference/v1
LLM_COUNCIL_BASE_URL + PRO_WORKFLOW_LLM_COUNCIL_API_KEYCustom OpenAI-compat(user-supplied)

Override per-run with --provider openai|anthropic|openrouter|fireworks|custom.

Default model rosters per provider live in scripts/council.js and can be overridden via --models CSV and --chairman <id>.

Commands

Read the whole SKILL.md on GitHub

More in AI and agents