CoolFace
Modelpublic

Beinsezii/gemma-4-26B-A4B-it-GGUF-6.52BPW-static

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes35downloads
Model Card

This is currently a STATIC quant, because the imatrix tool seems to be broken with Gemma 4 (>100 ppl). I will update with an imatrix once I can verify correctness.

6.52 bpw, a mixture of Q6K, Q5K, and Q8_0

Fits ~75k F16 CTX + MMPROJ on a 24GiB GPU, or ~150k CTX without vision. Measured on a DE, not headless.