CoolFace
Modelpublic

mlx-community/Macaw-OptiQ-4bit

sourceHugging Faceotherupdated 11d agoView on Hugging Face
2likes204downloads
5 commits on main
3a127a111d ago

Update kv_config.json: re-measured with `optiq kv-cache` float32 sensitivity (the previous config was ranked on bfloat16 rounding noise). 8-bit layers [27] -> [2].

codelion
00e322812d ago

Add kv_config.json: per-layer KV cache precision from `optiq kv-cache` (target 4.5 bits). Use with `optiq serve --kv-config kv_config.json`.

codelion
882395e1mo ago

Add optiq/metadata.json (reconstructed from config)

codelion
21bd6102mo ago

Upload folder using huggingface_hub

codelion
fee98ce2mo ago

initial commit

codelion