Modelpublic

mradermacher/QUEST-4B-i1-GGUF

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes514downloads

fileQUEST-4B.i1-IQ1_M.gguf1.33 GBdownload

fileQUEST-4B.i1-IQ1_S.gguf1.27 GBdownload

fileQUEST-4B.i1-IQ2_M.gguf1.62 GBdownload

fileQUEST-4B.i1-IQ2_S.gguf1.54 GBdownload

fileQUEST-4B.i1-IQ2_XS.gguf1.52 GBdownload

fileQUEST-4B.i1-IQ2_XXS.gguf1.43 GBdownload

fileQUEST-4B.i1-IQ3_M.gguf2.01 GBdownload

fileQUEST-4B.i1-IQ3_S.gguf1.99 GBdownload

fileQUEST-4B.i1-IQ3_XS.gguf1.93 GBdownload

fileQUEST-4B.i1-IQ3_XXS.gguf1.77 GBdownload

fileQUEST-4B.i1-IQ4_NL.gguf2.43 GBdownload

fileQUEST-4B.i1-IQ4_XS.gguf2.34 GBdownload

fileQUEST-4B.i1-Q2_K_S.gguf1.73 GBdownload

fileQUEST-4B.i1-Q2_K.gguf1.78 GBdownload

fileQUEST-4B.i1-Q3_K_L.gguf2.26 GBdownload

fileQUEST-4B.i1-Q3_K_M.gguf2.11 GBdownload

fileQUEST-4B.i1-Q3_K_S.gguf1.93 GBdownload

fileQUEST-4B.i1-Q4_0.gguf2.37 GBdownload

fileQUEST-4B.i1-Q4_1.gguf2.58 GBdownload

fileQUEST-4B.i1-Q4_K_M.gguf2.52 GBdownload

fileQUEST-4B.i1-Q4_K_S.gguf2.39 GBdownload

fileQUEST-4B.i1-Q5_K_M.gguf2.86 GBdownload

fileQUEST-4B.i1-Q5_K_S.gguf2.78 GBdownload

fileQUEST-4B.i1-Q6_K.gguf3.23 GBdownload

fileQUEST-4B.imatrix.gguf3.5 MBdownload

mradermacher/QUEST-4B-i1-GGUF · main · files are served by the source, never re-hosted here