Modelpublic

gaianet/Falcon3-7B-Instruct-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face

1likes230downloads

fileFalcon3-7B-Instruct-f16.gguf13.89 GBdownload

fileFalcon3-7B-Instruct-Q2_K.gguf2.69 GBdownload

fileFalcon3-7B-Instruct-Q3_K_L.gguf3.70 GBdownload

fileFalcon3-7B-Instruct-Q3_K_M.gguf3.43 GBdownload

fileFalcon3-7B-Instruct-Q3_K_S.gguf3.14 GBdownload

fileFalcon3-7B-Instruct-Q4_0.gguf4.01 GBdownload

fileFalcon3-7B-Instruct-Q4_K_M.gguf4.26 GBdownload

fileFalcon3-7B-Instruct-Q4_K_S.gguf4.03 GBdownload

fileFalcon3-7B-Instruct-Q5_0.gguf4.83 GBdownload

fileFalcon3-7B-Instruct-Q5_K_M.gguf4.96 GBdownload

fileFalcon3-7B-Instruct-Q5_K_S.gguf4.83 GBdownload

fileFalcon3-7B-Instruct-Q6_K.gguf5.70 GBdownload

fileFalcon3-7B-Instruct-Q8_0.gguf7.38 GBdownload

gaianet/Falcon3-7B-Instruct-GGUF · main · files are served by the source, never re-hosted here