CoolFace
Modelpublic

mlx-community/Muse-Glimmer-30B-OptiQ-4bit

sourceHugging Faceapache-2.0updated 11d agoView on Hugging Face
8likes2.1kdownloads
4 commits on main
983773611d ago

Update kv_config.json: re-measured with `optiq kv-cache` float32 sensitivity (the previous config was ranked on bfloat16 rounding noise). 8-bit layers [3, 5, 14, 16, 21, 30, 39] -> [7, 8, 14, 17, 19, 21, 23].

codelion
e62c46313d ago

Add kv_config.json: per-layer KV cache precision from `optiq kv-cache` (target 4.5 bits). Use with `optiq serve --kv-config kv_config.json`.

codelion
b4a74fa2mo ago

Add files using upload-large-folder tool

codelion
f828d182mo ago

initial commit

codelion