CoolFace
Modelpublic

mlx-community/Qwen3.8-27B-OBLITERATED-OptiQ-4bit

sourceHugging Faceapache-2.0updated 11d agoView on Hugging Face
6likes3.4kdownloads
4 commits on main
8b6416f11d ago

Update kv_config.json: re-measured with `optiq kv-cache` float32 sensitivity (the previous config was ranked on bfloat16 rounding noise). 8-bit layers [15, 51] -> [19, 35].

codelion
c6acb4a13d ago

Add kv_config.json: per-layer KV cache precision from `optiq kv-cache` (target 4.5 bits). Use with `optiq serve --kv-config kv_config.json`.

codelion
aacbae11mo ago

OptiQ mixed-precision 4-bit quant

codelion
75ece201mo ago

initial commit

codelion