Modelpublic

DavidAU/Mistral-Small-Instruct-2409-22B-NEO-Imatrix-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

11likes1.6kdownloads

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ1_M.gguf4.91 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ1_S.gguf4.50 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ2_M.gguf7.10 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ2_S.gguf6.55 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ2_XS.gguf6.19 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ2_XXS.gguf5.58 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ3_M.gguf9.37 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ3_S.gguf9.02 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ3_XS.gguf8.55 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ3_XXS.gguf8.01 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-IQ4_XS.gguf11.12 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q2_K_S.gguf7.12 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q2_K.gguf7.70 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q3_K_L.gguf10.92 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q3_K_M.gguf10.02 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q3_K_S.gguf8.98 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q4_K_M.gguf12.42 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q4_K_S.gguf11.79 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q5_K_M.gguf14.64 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q5_K_S.gguf14.27 GBdownload

fileMistral-Sm-Instr-2409-22B-NEO-IMAT-D_AU-Q6_K.gguf17.00 GBdownload

DavidAU/Mistral-Small-Instruct-2409-22B-NEO-Imatrix-GGUF · main · files are served by the source, never re-hosted here