Modelpublic

bartowski/kai-os_Carnice-V3-GGUF

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

2likes4.2kdownloads

filekai-os_Carnice-V3-imatrix.gguf13.0 MBdownload

filekai-os_Carnice-V3-IQ2_M.gguf10.13 GBdownload

filekai-os_Carnice-V3-IQ2_S.gguf9.59 GBdownload

filekai-os_Carnice-V3-IQ2_XS.gguf9.30 GBdownload

filekai-os_Carnice-V3-IQ2_XXS.gguf8.75 GBdownload

filekai-os_Carnice-V3-IQ3_M.gguf12.95 GBdownload

filekai-os_Carnice-V3-IQ3_XS.gguf12.41 GBdownload

filekai-os_Carnice-V3-IQ3_XXS.gguf11.76 GBdownload

filekai-os_Carnice-V3-IQ4_NL.gguf15.20 GBdownload

filekai-os_Carnice-V3-IQ4_XS.gguf14.50 GBdownload

filekai-os_Carnice-V3-Q2_K_L.gguf12.18 GBdownload

filekai-os_Carnice-V3-Q2_K.gguf11.03 GBdownload

filekai-os_Carnice-V3-Q3_K_L.gguf14.23 GBdownload

filekai-os_Carnice-V3-Q3_K_M.gguf13.60 GBdownload

filekai-os_Carnice-V3-Q3_K_S.gguf12.78 GBdownload

filekai-os_Carnice-V3-Q3_K_XL.gguf15.27 GBdownload

filekai-os_Carnice-V3-Q4_0.gguf15.23 GBdownload

filekai-os_Carnice-V3-Q4_1.gguf16.60 GBdownload

filekai-os_Carnice-V3-Q4_K_L.gguf17.43 GBdownload

filekai-os_Carnice-V3-Q4_K_M.gguf16.55 GBdownload

filekai-os_Carnice-V3-Q4_K_S.gguf15.57 GBdownload

filekai-os_Carnice-V3-Q5_K_L.gguf20.06 GBdownload

filekai-os_Carnice-V3-Q5_K_M.gguf19.33 GBdownload

filekai-os_Carnice-V3-Q5_K_S.gguf18.33 GBdownload

filekai-os_Carnice-V3-Q6_K_L.gguf22.43 GBdownload

filekai-os_Carnice-V3-Q6_K.gguf21.85 GBdownload

filekai-os_Carnice-V3-Q8_0.gguf27.12 GBdownload

filemmproj-kai-os_Carnice-V3-bf16.gguf888.0 MBdownload

filemmproj-kai-os_Carnice-V3-f16.gguf884.6 MBdownload

bartowski/kai-os_Carnice-V3-GGUF · main · files are served by the source, never re-hosted here