Instructions to use Luigi/minicpm5-1b-cursor with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Luigi/minicpm5-1b-cursor with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luigi/minicpm5-1b-cursor:Q4_K_M # Run inference directly in the terminal: llama cli -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luigi/minicpm5-1b-cursor:Q4_K_M # Run inference directly in the terminal: llama cli -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Luigi/minicpm5-1b-cursor:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Luigi/minicpm5-1b-cursor:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Use Docker
docker model run hf.co/Luigi/minicpm5-1b-cursor:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use Luigi/minicpm5-1b-cursor with Ollama:
ollama run hf.co/Luigi/minicpm5-1b-cursor:Q4_K_M
- Unsloth Studio
How to use Luigi/minicpm5-1b-cursor with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luigi/minicpm5-1b-cursor to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luigi/minicpm5-1b-cursor to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Luigi/minicpm5-1b-cursor to start chatting
- Pi
How to use Luigi/minicpm5-1b-cursor with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Luigi/minicpm5-1b-cursor:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Luigi/minicpm5-1b-cursor with Docker Model Runner:
docker model run hf.co/Luigi/minicpm5-1b-cursor:Q4_K_M
- Lemonade
How to use Luigi/minicpm5-1b-cursor with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Luigi/minicpm5-1b-cursor:Q4_K_M
Run and chat with the model
lemonade run user.minicpm5-1b-cursor-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Luigi/minicpm5-1b-cursor with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Luigi/minicpm5-1b-cursor:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Luigi/minicpm5-1b-cursor with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luigi/minicpm5-1b-cursor:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Luigi/minicpm5-1b-cursor:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
MiniCPM5-1B-CURSOR โ agentic meeting summarizer (sub-1B on-device)
Fine-tune of openbmb/MiniCPM5-1B on the CURSOR protocol: a streaming agent that converts long meeting transcripts (zh-TW / en) into structured, fully-anchored meeting notes by emitting edit ops (ADD/UPD/DEL/CMP/NOP) against one evolving NOTES state โ no map-reduce, no ReAct loops.
Try it live: cursor-wasm-demo runs this model entirely in your browser via WASM โ watch the NOTES state build chunk by chunk, no server involved.
Checkpoints in this repo
| file | status | notes |
|---|---|---|
minicpm5-1b-cursor.Q4_K_M.gguf |
locked main (p15d) | the deployed checkpoint โ see results below |
minicpm5-1b-cursor-p20.Q4_K_M.gguf |
candidate, not yet locked | real-ASR-majority retrain, see below |
minicpm5-1b-cursor-p19c.Q4_K_M.gguf |
superseded experiment | coverage-focused dose, worse on the published T1 numbers than p15d |
minicpm5-1b-cursor-p13.Q4_K_M.gguf |
superseded | earlier round, kept for the historical record |
How p15d (locked main) was made
- Base: openbmb/MiniCPM5-1B (4k context, linear+full attention hybrid).
- Data: teacher traces from Gemma-4-31B-it (NVFP4, thinking ON), judge-filtered against a local gpt-oss-20b judge (only judge-verifiable teacher bullets become SFT targets), 100% synthetic transcripts (zh-TW + en, revision-dense meetings by design).
- Guards: two deterministic harness guards run at render time โ
promote_decision_summaries(decision-shaped SUMMARY bullets move into DECISIONS) andenforce_decision_chain(opposing-polarity bullets on one subject: keep the latest). - Verifier: paired with
Luigi/granite-4.0-350m-verifier(Apache-2.0, ~215MB), which gates DECISIONS/ACTIONS ops in-stream and re-verifies every final bullet against whole-transcript evidence. The verifier is required for the 0-inversion deployment number below โ the model alone measures 4/20.
Measured results (T1 tier, n=20, local judges, 3x majority)
| configuration | INVERT | FAITH | COVER | SYNTH |
|---|---|---|---|---|
| p15d, model-only (raw) | 4/20 | 3.57 | 3.00 | 2.30 |
| p15d + verifier, in-stream + sweep (deployed) | 0-2/20 | 4.43 | 2.85-3.80 | 2.35-3.40 |
| map-reduce baseline (Qwen3.5-9B) | 3/20 | 3.50 | 3.05 | 2.60 |
G1 capability screen: PASS both languages (with the guards). Verifier agreement with
gpt-oss-20b: 97% en / 92% zh on clean evidence (zh discrimination on real-ASR-noisy
evidence remains a known, documented gap โ see the agentic-summarizer repo's RESULTS.md
for the full retraining history and every measured negative on that front).
p20 (real-ASR-majority candidate, 2026-08-18): measured positive, not yet locked
p15d was trained on 100% synthetic transcripts. p20 continues from the p15d checkpoint on the first genuinely real-ASR-majority mix (58.9% real / 41.1% clean-synthetic) โ 23 real zh-TW-majority podcast transcripts (donated for this project, teacher-traced and judge-filtered the same way as the synthetic data), oversampled against a clean-synthetic minority.
Held-out real-meeting comparison (3 whole meetings withheld from training, never seen by either checkpoint during training):
| meeting | lang | p15d valid-op | p20 valid-op |
|---|---|---|---|
| q08 | zh-TW | 80% | 88% |
| ho4 | zh-TW | 100% | 100% (tie) |
| p02 | en | 86% | 100% |
p20 improves or ties valid-op on every held-out real meeting, and in spot checks avoided a fabrication p15d made on one of them (p15d invented a DECISIONS bullet โ "Use Linux as the preferred operating system" โ with no grounding in the source, a job-interview-prep podcast).
Caveat, stated plainly: n=3 held-out meetings is directional, not a ship-gate measurement. p20 is published here as a measured, honest candidate โ not a claim that it now supersedes p15d as the recommended deployment. Promoting it would need the same T1-tier (n=20) confirmation p15d itself was held to. Use p15d for anything you need a locked answer on; try p20 if your workload is real-ASR-majority zh-TW/en content specifically and you want to see the newer checkpoint's behavior on it.
Usage
llama.cpp server, greedy, thinking OFF (the model emits hybrid <think> unless disabled):
llama-server -m minicpm5-1b-cursor.Q4_K_M.gguf --n-gpu-layers 999 --ctx-size 4096 \
--parallel 1 --flash-attn on --jinja --reasoning off --temp 0
The client is the CURSOR harness (agentic-summarizer repo, eval/run_arms.py --arms cursor --base-url <server> --tokenizer openbmb/MiniCPM5-1B --budget 2048). The model
expects the exact system prompt and NOTES rendering the harness produces โ it is NOT a
general chat model.
Caveats (must accompany every reported number)
- zh T2 tier is synthetic; contested-zh (real, decision-bearing zh-TW meetings, as opposed to podcasts) remains the largest unmeasured gap in this project.
- Judge-noise floor +-0.4-0.5 (FAITH/SYNTH); n=20 per tier; reduced cells directional.
- On-device envelope: ~650 MB Q4_K_M, 4k context, per-step ~2.9k prefill tokens.
- p20's held-out comparison is n=3 meetings โ directional, not a ship-gate result.
- Downloads last month
- 122
4-bit
Model tree for Luigi/minicpm5-1b-cursor
Base model
openbmb/MiniCPM5-1B