Modelpublic

bartowski/kai-os_Grug-35B-A3B-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face

3likes2.3kdownloads

filekai-os_Grug-35B-A3B-imatrix.gguf183.3 MBdownload

filekai-os_Grug-35B-A3B-IQ2_M.gguf11.24 GBdownload

filekai-os_Grug-35B-A3B-IQ2_S.gguf10.25 GBdownload

filekai-os_Grug-35B-A3B-IQ2_XS.gguf10.06 GBdownload

filekai-os_Grug-35B-A3B-IQ2_XXS.gguf9.11 GBdownload

filekai-os_Grug-35B-A3B-IQ3_M.gguf15.74 GBdownload

filekai-os_Grug-35B-A3B-IQ3_XS.gguf15.10 GBdownload

filekai-os_Grug-35B-A3B-IQ3_XXS.gguf13.85 GBdownload

filekai-os_Grug-35B-A3B-IQ4_NL.gguf18.50 GBdownload

filekai-os_Grug-35B-A3B-IQ4_XS.gguf17.51 GBdownload

filekai-os_Grug-35B-A3B-Q2_K_L.gguf12.21 GBdownload

filekai-os_Grug-35B-A3B-Q2_K.gguf11.75 GBdownload

filekai-os_Grug-35B-A3B-Q3_K_L.gguf15.73 GBdownload

filekai-os_Grug-35B-A3B-Q3_K_M.gguf15.11 GBdownload

filekai-os_Grug-35B-A3B-Q3_K_S.gguf14.45 GBdownload

filekai-os_Grug-35B-A3B-Q3_K_XL.gguf16.14 GBdownload

filekai-os_Grug-35B-A3B-Q4_0.gguf18.57 GBdownload

filekai-os_Grug-35B-A3B-Q4_1.gguf20.46 GBdownload

filekai-os_Grug-35B-A3B-Q4_K_L.gguf20.27 GBdownload

filekai-os_Grug-35B-A3B-Q4_K_M.gguf19.92 GBdownload

filekai-os_Grug-35B-A3B-Q4_K_S.gguf19.18 GBdownload

filekai-os_Grug-35B-A3B-Q5_K_L.gguf23.59 GBdownload

filekai-os_Grug-35B-A3B-Q5_K_M.gguf23.30 GBdownload

filekai-os_Grug-35B-A3B-Q5_K_S.gguf22.50 GBdownload

filekai-os_Grug-35B-A3B-Q6_K_L.gguf28.22 GBdownload

filekai-os_Grug-35B-A3B-Q6_K.gguf27.99 GBdownload

filekai-os_Grug-35B-A3B-Q8_0.gguf34.38 GBdownload

bartowski/kai-os_Grug-35B-A3B-GGUF · main · files are served by the source, never re-hosted here