Modelpublic

bartowski/ai9stars_G9v3-3B-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face

12likes5.1kdownloads

fileai9stars_G9v3-3B-bf16.gguf5.57 GBdownload

fileai9stars_G9v3-3B-imatrix.gguf3.7 MBdownload

fileai9stars_G9v3-3B-IQ2_M.gguf1.15 GBdownload

fileai9stars_G9v3-3B-IQ3_M.gguf1.38 GBdownload

fileai9stars_G9v3-3B-IQ3_XS.gguf1.30 GBdownload

fileai9stars_G9v3-3B-IQ3_XXS.gguf1.22 GBdownload

fileai9stars_G9v3-3B-IQ4_NL.gguf1.67 GBdownload

fileai9stars_G9v3-3B-IQ4_XS.gguf1.59 GBdownload

fileai9stars_G9v3-3B-Q2_K_L.gguf1.42 GBdownload

fileai9stars_G9v3-3B-Q2_K.gguf1.18 GBdownload

fileai9stars_G9v3-3B-Q3_K_L.gguf1.53 GBdownload

fileai9stars_G9v3-3B-Q3_K_M.gguf1.46 GBdownload

fileai9stars_G9v3-3B-Q3_K_S.gguf1.34 GBdownload

fileai9stars_G9v3-3B-Q3_K_XL.gguf1.75 GBdownload

fileai9stars_G9v3-3B-Q4_0.gguf1.67 GBdownload

fileai9stars_G9v3-3B-Q4_1.gguf1.81 GBdownload

fileai9stars_G9v3-3B-Q4_K_L.gguf1.96 GBdownload

fileai9stars_G9v3-3B-Q4_K_M.gguf1.77 GBdownload

fileai9stars_G9v3-3B-Q4_K_S.gguf1.67 GBdownload

fileai9stars_G9v3-3B-Q5_K_L.gguf2.19 GBdownload

fileai9stars_G9v3-3B-Q5_K_M.gguf2.04 GBdownload

fileai9stars_G9v3-3B-Q5_K_S.gguf1.97 GBdownload

fileai9stars_G9v3-3B-Q6_K_L.gguf2.49 GBdownload

fileai9stars_G9v3-3B-Q6_K.gguf2.37 GBdownload

fileai9stars_G9v3-3B-Q8_0.gguf2.96 GBdownload

bartowski/ai9stars_G9v3-3B-GGUF · main · files are served by the source, never re-hosted here