CoolFace
Modelpublic

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

sourceHugging Faceapache-2.0updated 12d agoView on Hugging Face
6likes2.2kdownloads
4 commits on main
cbb5f4112d ago

Update kv_config.json: re-measured with `optiq kv-cache` float32 sensitivity (the previous config was ranked on bfloat16 rounding noise). 8-bit layers [0, 1, 3] -> [0, 1, 4].

codelion
d4db0cf13d ago

Add kv_config.json: per-layer KV cache precision from `optiq kv-cache` (target 4.5 bits). Use with `optiq serve --kv-config kv_config.json`.

codelion
7a0b7e93mo ago

OptiQ mixed-precision 4/8-bit quant (5.805 bpw)

codelion
537d8a53mo ago

initial commit

codelion