Modelpublic

mradermacher/Quest-9B-GGUF

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes694downloads

fileQuest-9B.f16.gguf16.69 GBdownload

fileQuest-9B.IQ4_XS.gguf4.87 GBdownload

fileQuest-9B.mmproj-f16.gguf875.6 MBdownload

fileQuest-9B.mmproj-Q8_0.gguf595.3 MBdownload

fileQuest-9B.Q2_K.gguf3.56 GBdownload

fileQuest-9B.Q3_K_L.gguf4.59 GBdownload

fileQuest-9B.Q3_K_M.gguf4.31 GBdownload

fileQuest-9B.Q3_K_S.gguf3.97 GBdownload

fileQuest-9B.Q4_K_M.gguf5.24 GBdownload

fileQuest-9B.Q4_K_S.gguf4.98 GBdownload

fileQuest-9B.Q5_K_M.gguf6.02 GBdownload

fileQuest-9B.Q5_K_S.gguf5.87 GBdownload

fileQuest-9B.Q6_K.gguf6.85 GBdownload

fileQuest-9B.Q8_0.gguf8.87 GBdownload

mradermacher/Quest-9B-GGUF · main · files are served by the source, never re-hosted here