CoolFace
Modelpublic

RichardErkhov/zackli4ai_-_llama-3.2-3b-instruct-qlora-int4-eo8-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes1.3kdownloads
root
file.gitattributes3 KBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.IQ3_M.gguf1.49 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.IQ3_S.gguf1.44 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.IQ3_XS.gguf1.38 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.IQ4_NL.gguf1.79 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.IQ4_XS.gguf1.71 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q2_K.gguf1.27 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q3_K_L.gguf1.69 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q3_K_M.gguf1.57 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q3_K_S.gguf1.44 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q3_K.gguf1.57 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q4_0.gguf1.79 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q4_1.gguf1.95 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q4_K_M.gguf1.88 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q4_K_S.gguf1.80 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q4_K.gguf1.88 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q5_0.gguf2.11 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q5_1.gguf2.28 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q5_K_M.gguf2.16 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q5_K_S.gguf2.11 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q5_K.gguf2.16 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q6_K.gguf2.46 GBdownload
filellama-3.2-3b-instruct-qlora-int4-eo8.Q8_0.gguf3.19 GBdownload
fileREADME.md10 KBdownload

RichardErkhov/zackli4ai_-_llama-3.2-3b-instruct-qlora-int4-eo8-gguf · main · files are served by the source, never re-hosted here