Modelpublic

RichardErkhov/rtl-llm_-_codellama-7b-chisel-v2c-pymtl-bf16-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes576downloads

filecodellama-7b-chisel-v2c-pymtl-bf16.IQ3_M.gguf2.90 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.IQ3_S.gguf2.75 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.IQ3_XS.gguf2.60 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.IQ4_NL.gguf3.58 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.IQ4_XS.gguf3.40 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q2_K.gguf2.36 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q3_K_L.gguf3.35 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q3_K_M.gguf3.07 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q3_K_S.gguf2.75 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q3_K.gguf3.07 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q4_0.gguf3.56 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q4_1.gguf3.95 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q4_K_M.gguf3.80 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q4_K_S.gguf3.59 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q4_K.gguf3.80 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q5_0.gguf4.33 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q5_1.gguf4.72 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q5_K_M.gguf4.45 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q5_K_S.gguf4.33 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q5_K.gguf4.45 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q6_K.gguf5.15 GBdownload

filecodellama-7b-chisel-v2c-pymtl-bf16.Q8_0.gguf6.67 GBdownload

RichardErkhov/rtl-llm_-_codellama-7b-chisel-v2c-pymtl-bf16-gguf · main · files are served by the source, never re-hosted here