Modelpublic

mradermacher/Fred-9B-v1.2-GGUF

sourceHugging Faceapache-2.0updated 15d agoView on Hugging Face

0likes572downloads

fileFred-9B-v1.2.f16.gguf17.14 GBdownload

fileFred-9B-v1.2.IQ4_XS.gguf4.99 GBdownload

fileFred-9B-v1.2.mmproj-f16.gguf875.6 MBdownload

fileFred-9B-v1.2.mmproj-Q8_0.gguf595.3 MBdownload

fileFred-9B-v1.2.Q2_K.gguf3.65 GBdownload

fileFred-9B-v1.2.Q3_K_L.gguf4.70 GBdownload

fileFred-9B-v1.2.Q3_K_M.gguf4.41 GBdownload

fileFred-9B-v1.2.Q3_K_S.gguf4.06 GBdownload

fileFred-9B-v1.2.Q4_K_M.gguf5.38 GBdownload

fileFred-9B-v1.2.Q4_K_S.gguf5.11 GBdownload

fileFred-9B-v1.2.Q5_K_M.gguf6.19 GBdownload

fileFred-9B-v1.2.Q5_K_S.gguf6.03 GBdownload

fileFred-9B-v1.2.Q6_K.gguf7.04 GBdownload

fileFred-9B-v1.2.Q8_0.gguf9.11 GBdownload

mradermacher/Fred-9B-v1.2-GGUF · main · files are served by the source, never re-hosted here