Modelpublic

tiiuae/Falcon-H1R-7B-GGUF

sourceHugging Faceotherupdated 9mo agoView on Hugging Face

76likes8kdownloads

fileFalcon-H1R-7B-BF16.gguf14.14 GBdownload

fileFalcon-H1R-7B-F16.gguf14.14 GBdownload

fileFalcon-H1R-7B-F32.gguf28.26 GBdownload

fileFalcon-H1R-7B-IQ2_M.gguf431.1 MBdownload

fileFalcon-H1R-7B-IQ3_M.gguf3.24 GBdownload

fileFalcon-H1R-7B-IQ3_S.gguf3.19 GBdownload

fileFalcon-H1R-7B-IQ3_XS.gguf3.08 GBdownload

fileFalcon-H1R-7B-IQ3_XXS.gguf431.1 MBdownload

fileFalcon-H1R-7B-IQ4_NL.gguf4.10 GBdownload

fileFalcon-H1R-7B-IQ4_XS.gguf3.90 GBdownload

fileFalcon-H1R-7B-Q2_K.gguf5.5 MBdownload

fileFalcon-H1R-7B-Q3_K_L.gguf3.65 GBdownload

fileFalcon-H1R-7B-Q3_K_M.gguf3.43 GBdownload

fileFalcon-H1R-7B-Q3_K_S.gguf3.19 GBdownload

fileFalcon-H1R-7B-Q3_K.gguf3.43 GBdownload

fileFalcon-H1R-7B-Q4_0.gguf4.08 GBdownload

fileFalcon-H1R-7B-Q4_1.gguf4.50 GBdownload

fileFalcon-H1R-7B-Q4_K_M.gguf4.28 GBdownload

fileFalcon-H1R-7B-Q4_K_S.gguf4.10 GBdownload

fileFalcon-H1R-7B-Q4_K.gguf4.28 GBdownload

fileFalcon-H1R-7B-Q5_0.gguf4.92 GBdownload

fileFalcon-H1R-7B-Q5_1.gguf5.33 GBdownload

fileFalcon-H1R-7B-Q5_K_M.gguf5.02 GBdownload

fileFalcon-H1R-7B-Q5_K_S.gguf4.92 GBdownload

fileFalcon-H1R-7B-Q5_K.gguf5.02 GBdownload

fileFalcon-H1R-7B-Q6_K.gguf5.80 GBdownload

fileFalcon-H1R-7B-Q8_0.gguf7.51 GBdownload

fileFalcon-H1R-7B-TQ1_0.gguf1.86 GBdownload

fileFalcon-H1R-7B-TQ2_0.gguf2.15 GBdownload

tiiuae/Falcon-H1R-7B-GGUF · main · files are served by the source, never re-hosted here