Modelpublic

tiiuae/Falcon-H1-Tiny-R-90M-GGUF

sourceHugging Faceotherupdated 8mo agoView on Hugging Face

12likes782downloads

fileFalcon-H1R-Tiny-90M-BF16.gguf207.2 MBdownload

fileFalcon-H1R-Tiny-90M-IQ2_M.gguf19.0 MBdownload

fileFalcon-H1R-Tiny-90M-IQ3_M.gguf53.2 MBdownload

fileFalcon-H1R-Tiny-90M-IQ3_S.gguf52.2 MBdownload

fileFalcon-H1R-Tiny-90M-IQ3_XS.gguf51.2 MBdownload

fileFalcon-H1R-Tiny-90M-IQ3_XXS.gguf19.0 MBdownload

fileFalcon-H1R-Tiny-90M-IQ4_NL.gguf63.9 MBdownload

fileFalcon-H1R-Tiny-90M-IQ4_XS.gguf61.2 MBdownload

fileFalcon-H1R-Tiny-90M-Q2_K.gguf45.1 MBdownload

fileFalcon-H1R-Tiny-90M-Q3_K_L.gguf56.3 MBdownload

fileFalcon-H1R-Tiny-90M-Q3_K_M.gguf54.3 MBdownload

fileFalcon-H1R-Tiny-90M-Q3_K_S.gguf52.0 MBdownload

fileFalcon-H1R-Tiny-90M-Q3_K.gguf54.3 MBdownload

fileFalcon-H1R-Tiny-90M-Q4_0.gguf63.5 MBdownload

fileFalcon-H1R-Tiny-90M-Q4_1.gguf69.0 MBdownload

fileFalcon-H1R-Tiny-90M-Q4_K_M.gguf64.9 MBdownload

fileFalcon-H1R-Tiny-90M-Q4_K_S.gguf63.7 MBdownload

fileFalcon-H1R-Tiny-90M-Q4_K.gguf64.9 MBdownload

fileFalcon-H1R-Tiny-90M-Q5_0.gguf74.4 MBdownload

fileFalcon-H1R-Tiny-90M-Q5_1.gguf79.8 MBdownload

fileFalcon-H1R-Tiny-90M-Q5_K_M.gguf75.1 MBdownload

fileFalcon-H1R-Tiny-90M-Q5_K_S.gguf74.4 MBdownload

fileFalcon-H1R-Tiny-90M-Q5_K.gguf75.1 MBdownload

fileFalcon-H1R-Tiny-90M-Q6_K.gguf85.9 MBdownload

fileFalcon-H1R-Tiny-90M-Q8_0.gguf110.8 MBdownload

fileFalcon-H1R-Tiny-90M-TQ1_0.gguf38.6 MBdownload

fileFalcon-H1R-Tiny-90M-TQ2_0.gguf42.0 MBdownload

tiiuae/Falcon-H1-Tiny-R-90M-GGUF · main · files are served by the source, never re-hosted here