CoolFace
Modelpublic

pearsonkyle/gemma4-31b-imatrix-mtp-GGUF

sourceHugging Facegemmaupdated 3mo agoView on Hugging Face
3likes830downloads
19 commits on main
2b178763mo ago

README: add static PPL/KLD/top_p to the imatrix-vs-AWQ tool-call table

pearsonkyle
7b5edb73mo ago

Swap IQ2_M to AWQ build: +54% tool-argument accuracy and far tighter run-to-run variance vs plain 2-bit imatrix at the same 2.85 bpw. Static KLD/PPL slightly favored imatrix but mispredicted agentic tool-calling; AWQ chosen by a tool-call fidelity replay. README: add Method row, AWQ static column, tool-call table, how-it-was-made.

pearsonkyle
b527eea3mo ago

Ship Q4_K_M MTP drafter (zero acceptance penalty vs Q8_0, -156 MB); add drafter-quantization acceptance study + figure to README

pearsonkyle
3ef05113mo ago

README: correct Q5_K_S tool-error phrasing (on par with IQ4_XS)

pearsonkyle
b3444693mo ago

README: fill Q5_K_S agentic results (40% pass / 100% patch)

pearsonkyle
ef5c7ff3mo ago

README: replace Q5_K_M with Q5_K_S (24GB build), update MTP table

pearsonkyle
d7ab7fb3mo ago

Add Q5_K_S imatrix quant (5.55 bpw) — text+vision+MTP under 24GB

pearsonkyle
82a76e13mo ago

Add Q5_K_M imatrix quant (5.69 bpw)

pearsonkyle
4546c043mo ago

README: repoint self-links to renamed repo (gemma4-31b-imatrix-mtp-GGUF)

pearsonkyle
85407d33mo ago

Remove MTP/ subdir copy (drafter moved to root)

pearsonkyle
6e4f7153mo ago

README: MTP drafter moved to repo root; add -hf auto-discovery note

pearsonkyle
03253683mo ago

Move MTP drafter to repo root (mtp-gemma-4-31B-it.gguf) for -hf auto-discovery

pearsonkyle
131896a3mo ago

README: MTP drafter section + acceptance-rate table (n=1..4 x quant)

pearsonkyle
0b502b43mo ago

Add Q8_0 MTP drafter (gemma4-assistant) for speculative decoding

pearsonkyle
2e0c5dd3mo ago

Update README.md

pearsonkyle
2b084583mo ago

README: vision/mmproj docs + worked example; links point to renamed repo

pearsonkyle
392ae6c3mo ago

Add mecha.png vision demo asset

pearsonkyle
dd56cb13mo ago

Add Q8_0 vision mmproj (text+image support)

pearsonkyle
a1c99113mo ago

Squash history: keep current models (IQ2_M/IQ3_M/IQ4_XS) + calibration data

pearsonkyle