CoolFace
Modelpublic

hudsongouge/minicpm5-1B-GLM-5.2-Agentic-v7

sourceHugging Faceotherupdated 3mo agoView on Hugging Face
1likes419downloads
Model Card

MiniCPM5-1B-Agentic-v7

Created by GLM-5.2. Model 7 of 8 in the agentic post-training series.

Variant: 3-way Soup

Evaluation

MetricScore
Real-World Tasks28.7% (3.44/12)
Unique Tasks Solved8/12

GGUFs available: f16, q80, q5km, q4km, q3km, q2k

Quantization Recommendations

This is a 1B model — heavier quantization degrades output quality significantly.

QuantQualitySizeRecommendation
f16Full~2.1GBBest quality
q8_0Excellent~1.1GBRecommended — near-identical to f16
q5kmGood~0.8GBReasoning OK, response may degrade on longer outputs
q4kmFair~0.7GBReasoning OK, response degrades into repetition
q3kmPoor~0.6GBNot recommended
q2_kPoor~0.5GBNot recommended

For production use, prefer q8_0 or f16. The model uses reasoning tokens; lower quantizations break the transition from reasoning to response.

Chat Template

The GGUF chat template defaults to enable_thinking=true, so the model will always produce reasoning followed by response. If your inference engine supports enable_thinking=false, you can skip reasoning for faster responses.