MiniCPM5 Deploy
Picks the inference backend for a MiniCPM5 model and routes to its serving guide.
Install
npx skills add OpenBMB/MiniCPM --skill minicpm5-deploy -g -a claude-code -y- Repository
- OpenBMB/MiniCPM11.8k
- Category
- AI and agents
- Updated
- 1mo ago
- License
- Apache-2.0
- Context cost
- Mediumabout 1,541 tokens
- Runs scripts
- No, instructions only
What it does
Pick the right inference backend for a MiniCPM5-1B or MiniCPM5-2B checkpoint and route to a backend-specific cookbook skill. Use when the user wants to deploy / serve / chat-with / benchmark a MiniCPM5 model and has not yet committed to a specific engine, or when they say "deploy MiniCPM5", "run MiniCPM5", "serve MiniCPM5", "MiniCPM5 推理", "部署 MiniCPM5".
Deploy MiniCPM5-1B and MiniCPM5-2B, backend router
You're being asked to deploy / serve / chat-with a MiniCPM5-1B or MiniCPM5-2B checkpoint. Your job is to pick exactly one backend skill below based on the user's hardware, format, and goal, then invoke that skill rather than improvising.
1. Required input from the user
Before picking a backend, you MUST know:
| Variable | Example | Where to ask |
|---|---|---|
MODEL_PATH | HF id openbmb/MiniCPM5-2B or openbmb/MiniCPM5-1B or a local path | "Which checkpoint? HF id or local path?" |
| Hardware | NVIDIA GPU / Apple Silicon / CPU only | infer from context, otherwise ask |
| Goal | "interactive chat" / "OpenAI server" / "Python script" / "benchmark" | infer from context |
Available checkpoints on Hugging Face
| Variant | HF repo | Use with |
|---|---|---|
| HF fp16 (recommended) | openbmb/MiniCPM5-2B or openbmb/MiniCPM5-1B | transformers / vllm (no --quantization) / vllm-ascend / sglang / any minicpm5-finetune-* |
| GGUF F16 / Q8_0 / Q4_K_M | openbmb/MiniCPM5-2B-GGUF or openbmb/MiniCPM5-1B-GGUF | minicpm5-deploy-llama-cpp / -ollama / -lmstudio |
| MLX (Apple Silicon) | openbmb/MiniCPM5-2B-MLX or openbmb/MiniCPM5-1B-MLX | minicpm5-deploy-mlx |
LiteRT-LM .litertlm (Android / iOS / desktop / IoT, CPU + GPU) | litert-community/MiniCPM5-2B or litert-community/MiniCPM5-1B | minicpm5-deploy-litert |
