CoolFace
Modelpublic

mradermacher/FFT-IBM-Granite-4.0-micro-i1-GGUF

sourceHugging Facemitupdated 8mo agoView on Hugging Face
1likes490downloads
root
file.gitattributes3 KBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ1_M.gguf866.8 MBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ1_S.gguf805.8 MBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ2_M.gguf1.16 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ2_S.gguf1.08 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ2_XS.gguf1.03 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ2_XXS.gguf968.3 MBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ3_M.gguf1.51 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ3_S.gguf1.47 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ3_XS.gguf1.40 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ3_XXS.gguf1.29 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ4_NL.gguf1.85 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-IQ4_XS.gguf1.76 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q2_K_S.gguf1.20 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q2_K.gguf1.28 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q3_K_L.gguf1.74 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q3_K_M.gguf1.61 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q3_K_S.gguf1.46 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q4_0.gguf1.85 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q4_1.gguf2.03 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q4_K_M.gguf1.96 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q4_K_S.gguf1.86 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q5_K_M.gguf2.27 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q5_K_S.gguf2.21 GBdownload
fileFFT-IBM-Granite-4.0-micro.i1-Q6_K.gguf2.60 GBdownload
fileFFT-IBM-Granite-4.0-micro.imatrix.gguf3.6 MBdownload
fileREADME.md6 KBdownload

mradermacher/FFT-IBM-Granite-4.0-micro-i1-GGUF · main · files are served by the source, never re-hosted here