CoolFace
Modelpublic

unsloth/gemma-3-12b-it-qat-GGUF

sourceHugging Facegemmaupdated 1y agoView on Hugging Face
54likes41kdownloads
root
file.gitattributes4 KBdownload
fileconfig.json2 KBdownload
filegemma-3-12b-it-qat-BF16.gguf21.92 GBdownload
filegemma-3-12b-it-qat-IQ4_NL.gguf6.41 GBdownload
filegemma-3-12b-it-qat-IQ4_XS.gguf6.10 GBdownload
filegemma-3-12b-it-qat-Q2_K_L.gguf4.44 GBdownload
filegemma-3-12b-it-qat-Q2_K.gguf4.44 GBdownload
filegemma-3-12b-it-qat-Q3_K_M.gguf5.60 GBdownload
filegemma-3-12b-it-qat-Q3_K_S.gguf5.08 GBdownload
filegemma-3-12b-it-qat-Q4_0.gguf6.43 GBdownload
filegemma-3-12b-it-qat-Q4_1.gguf7.04 GBdownload
filegemma-3-12b-it-qat-Q4_K_M.gguf6.80 GBdownload
filegemma-3-12b-it-qat-Q4_K_S.gguf6.46 GBdownload
filegemma-3-12b-it-qat-Q5_K_M.gguf7.87 GBdownload
filegemma-3-12b-it-qat-Q5_K_S.gguf7.67 GBdownload
filegemma-3-12b-it-qat-Q6_K.gguf9.00 GBdownload
filegemma-3-12b-it-qat-Q8_0.gguf11.65 GBdownload
filegemma-3-12b-it-qat-UD-IQ1_M.gguf3.03 GBdownload
filegemma-3-12b-it-qat-UD-IQ1_S.gguf2.85 GBdownload
filegemma-3-12b-it-qat-UD-IQ2_M.gguf4.07 GBdownload
filegemma-3-12b-it-qat-UD-IQ2_XXS.gguf3.36 GBdownload
filegemma-3-12b-it-qat-UD-IQ3_XXS.gguf4.50 GBdownload
filegemma-3-12b-it-qat-UD-Q2_K_XL.gguf4.53 GBdownload
filegemma-3-12b-it-qat-UD-Q3_K_XL.gguf5.72 GBdownload
filegemma-3-12b-it-qat-UD-Q4_K_XL.gguf6.92 GBdownload
filegemma-3-12b-it-qat-UD-Q5_K_XL.gguf7.88 GBdownload
filegemma-3-12b-it-qat-UD-Q6_K_XL.gguf9.83 GBdownload
filegemma-3-12b-it-qat-UD-Q8_K_XL.gguf13.41 GBdownload
fileimatrix_unsloth.dat7.1 MBdownload
filemmproj-BF16.gguf814.6 MBdownload
filemmproj-F16.gguf814.6 MBdownload
filemmproj-F32.gguf1.56 GBdownload
fileREADME.md22 KBdownload

unsloth/gemma-3-12b-it-qat-GGUF · main · files are served by the source, never re-hosted here