CoolFace
Modelpublic

mradermacher/falcon-40b-instruct-i1-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
1likes6.9kdownloads
root
file.gitattributes3 KBdownload
filefalcon-40b-instruct.i1-IQ1_M.gguf9.34 GBdownload
filefalcon-40b-instruct.i1-IQ1_S.gguf9.05 GBdownload
filefalcon-40b-instruct.i1-IQ2_M.gguf13.98 GBdownload
filefalcon-40b-instruct.i1-IQ2_S.gguf12.96 GBdownload
filefalcon-40b-instruct.i1-IQ2_XS.gguf12.21 GBdownload
filefalcon-40b-instruct.i1-IQ2_XXS.gguf11.08 GBdownload
filefalcon-40b-instruct.i1-IQ3_M.gguf18.32 GBdownload
filefalcon-40b-instruct.i1-IQ3_S.gguf17.53 GBdownload
filefalcon-40b-instruct.i1-IQ3_XS.gguf17.00 GBdownload
filefalcon-40b-instruct.i1-IQ3_XXS.gguf15.75 GBdownload
filefalcon-40b-instruct.i1-IQ4_XS.gguf20.97 GBdownload
filefalcon-40b-instruct.i1-Q2_K.gguf15.15 GBdownload
filefalcon-40b-instruct.i1-Q3_K_L.gguf20.58 GBdownload
filefalcon-40b-instruct.i1-Q3_K_M.gguf19.18 GBdownload
filefalcon-40b-instruct.i1-Q3_K_S.gguf17.53 GBdownload
filefalcon-40b-instruct.i1-Q4_0.gguf22.28 GBdownload
filefalcon-40b-instruct.i1-Q4_K_M.gguf24.20 GBdownload
filefalcon-40b-instruct.i1-Q4_K_S.gguf22.64 GBdownload
filefalcon-40b-instruct.i1-Q5_K_M.gguf29.00 GBdownload
filefalcon-40b-instruct.i1-Q5_K_S.gguf27.45 GBdownload
filefalcon-40b-instruct.i1-Q6_K.gguf32.55 GBdownload
fileimatrix.dat13.1 MBdownload
fileREADME.md5 KBdownload

mradermacher/falcon-40b-instruct-i1-GGUF · main · files are served by the source, never re-hosted here