Minicpm5 Deploy Lmstudio
Run MiniCPM5-1B or MiniCPM5-2B in LM Studio (desktop GUI) using either the GGUF runtime...
Install
npx skills add OpenBMB/MiniCPM --skill minicpm5-deploy-lmstudio -g -a claude-code -y- Repository
- OpenBMB/MiniCPM11.8k
- Category
- Design
- Updated
- 1mo ago
- License
- Apache-2.0
- Context cost
- Lightabout 972 tokens
- Runs scripts
- No, instructions only
What it does
Run MiniCPM5-1B or MiniCPM5-2B in LM Studio (desktop GUI) using either the GGUF runtime (cross-platform) or the MLX runtime (Apple Silicon, faster). Includes OpenAI-compatible local server. Use when the user mentions "LM Studio", desktop GUI inference, "lms" CLI, or wants a no-code chat UI for MiniCPM5.
Deploy MiniCPM5-1B and MiniCPM5-2B with LM Studio
Desktop GUI + OpenAI-compatible local server. On Apple Silicon ships two runtimes:
| Runtime | Format | When to use |
|---|---|---|
| GGUF (llama.cpp engine) | F16 / Q8_0 / Q4_K_M | cross-platform, same artifact as Ollama; Q4_K_M build |
| MLX (Apple Silicon only) | bf16 / 4-bit | ~60 % faster, automatic think/answer split via reasoning_content; Q4 build |
Required input
| Var | Example | Default |
|---|---|---|
| Runtime | gguf or mlx | mlx on Apple Silicon, gguf elsewhere |
QUANT | Q4_K_M (GGUF) or 4bit (MLX) | Q4_K_M / 4bit |
MODEL_NAME | minicpm5-2b | minicpm5-2b |
Steps
1. Install LM Studio + complete onboarding
brew install --cask lm-studio
open -a "LM Studio" # accept EULA + pick model source
⚠️ The first launch MUST be GUI,
lms(CLI) refuses withCannot find LM Studio installationuntil LM Studio has run interactively at least once.
2A. GGUF runtime path
mkdir -p ~/.lmstudio/models/openbmb/MiniCPM5-2B-GGUF
huggingface-cli download openbmb/MiniCPM5-2B-GGUF MiniCPM5-2B-${QUANT}.gguf \
--local-dir ~/.lmstudio/models/openbmb/MiniCPM5-2B-GGUF/
LMS="/Applications/LM Studio.app/Contents/Resources/app/.webpack/lms"
"$LMS" server start # binds 127.0.0.1:1234
"$LMS" load minicpm5-2b --gpu max --context-length 8192 -y
"$LMS" ps # verify the model is loaded
2B. MLX runtime path (Apple Silicon, recommended on Mac)
The MLX runtime needs an MLX-format checkpoint. The published MiniCPM5-2B MLX repo is openbmb/MiniCPM5-2B-MLX (4-bit affine); there is no separate -bf16 / -4bit variant. Either drop that one in as-is, or convert locally from openbmb/MiniCPM5-2B (see minicpm5-deploy-mlx). Then:
