CoolFace
Modelpublic

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

sourceHugging Faceapache-2.0updated 12d agoView on Hugging Face
4likes23kdownloads
11 commits on main
4ddfc5b12d ago

Update kv_config.json: re-measured with `optiq kv-cache` float32 sensitivity (the previous config was ranked on bfloat16 rounding noise). 8-bit layers [2, 5, 9, 11] -> [7, 9, 10, 11].

codelion
058d0b714d ago

Add kv_config.json: per-layer KV cache precision from `optiq kv-cache` (target 4.5 bits). Use with `optiq serve --kv-config kv_config.json`.

codelion
49affa82mo ago

Sync chat template from google/gemma-4-31b-it (Google canonical, published 2026-07-09)

codelion
7f948263mo ago

index: register the bf16 vision tower so stock VLM loaders (mlx-vlm, oMLX, LM Studio) can find it

codelion
6a6fffb3mo ago

Correct BFCL + Capability: the AST checker could not match array-typed arguments

codelion
a16a8753mo ago

Card: put the comparison table in the same column order as every other OptiQ quant (ours, then uniform-4)

codelion
cb078543mo ago

Move OptiQ sidecars under optiq/ so *.safetensors loaders (mlx-vlm, LM Studio) skip them

codelion
76126a03mo ago

fix: audio_tower conv weights to MLX channel-last layout (full-VLM loader compat)

codelion
8a066843mo ago

docs: OptiQ brand spelling

codelion
3f57b693mo ago

OptIQ mixed-precision 4-bit (QAT MoE), Capability 71.32 (+0.19 vs uniform-4)

codelion
d446a033mo ago

initial commit

codelion