Modelpublic

tiiuae/Falcon-H1-34B-Instruct-GGUF

sourceHugging Faceotherupdated 1y agoView on Hugging Face

17likes5.1kdownloads

fileFalcon-H1-34B-Instruct-IQ1_M.gguf7.79 GBdownload

fileFalcon-H1-34B-Instruct-IQ1_S.gguf7.16 GBdownload

fileFalcon-H1-34B-Instruct-IQ2_M.gguf10.89 GBdownload

fileFalcon-H1-34B-Instruct-IQ2_S.gguf10.05 GBdownload

fileFalcon-H1-34B-Instruct-IQ2_XS.gguf9.71 GBdownload

fileFalcon-H1-34B-Instruct-IQ2_XXS.gguf8.84 GBdownload

fileFalcon-H1-34B-Instruct-IQ3_M.gguf14.23 GBdownload

fileFalcon-H1-34B-Instruct-IQ3_S.gguf13.99 GBdownload

fileFalcon-H1-34B-Instruct-IQ3_XS.gguf13.43 GBdownload

fileFalcon-H1-34B-Instruct-IQ3_XXS.gguf12.46 GBdownload

fileFalcon-H1-34B-Instruct-IQ4_NL.gguf17.99 GBdownload

fileFalcon-H1-34B-Instruct-IQ4_XS.gguf17.05 GBdownload

fileFalcon-H1-34B-Instruct-Q2_K_S.gguf11.17 GBdownload

fileFalcon-H1-34B-Instruct-Q2_K.gguf11.80 GBdownload

fileFalcon-H1-34B-Instruct-Q3_K_L.gguf16.15 GBdownload

fileFalcon-H1-34B-Instruct-Q3_K_M.gguf15.14 GBdownload

fileFalcon-H1-34B-Instruct-Q3_K_S.gguf13.97 GBdownload

fileFalcon-H1-34B-Instruct-Q3_K.gguf15.14 GBdownload

fileFalcon-H1-34B-Instruct-Q4_0.gguf17.97 GBdownload

fileFalcon-H1-34B-Instruct-Q4_1.gguf19.85 GBdownload

fileFalcon-H1-34B-Instruct-Q4_K_M.gguf18.94 GBdownload

fileFalcon-H1-34B-Instruct-Q4_K_S.gguf18.08 GBdownload

fileFalcon-H1-34B-Instruct-Q4_K.gguf18.94 GBdownload

fileFalcon-H1-34B-Instruct-Q5_0.gguf21.73 GBdownload

fileFalcon-H1-34B-Instruct-Q5_1.gguf23.61 GBdownload

fileFalcon-H1-34B-Instruct-Q5_K_M.gguf22.23 GBdownload

fileFalcon-H1-34B-Instruct-Q5_K_S.gguf21.73 GBdownload

fileFalcon-H1-34B-Instruct-Q5_K.gguf22.23 GBdownload

fileFalcon-H1-34B-Instruct-Q6_K.gguf25.72 GBdownload

fileFalcon-H1-34B-Instruct-Q8_0.gguf33.31 GBdownload

fileFalcon-H1-34B-Instruct-TQ1_0.gguf7.83 GBdownload

fileFalcon-H1-34B-Instruct-TQ2_0.gguf9.18 GBdownload

tiiuae/Falcon-H1-34B-Instruct-GGUF · main · files are served by the source, never re-hosted here