CoolFace
Modelpublic

RichardErkhov/mjm4dl_-_model_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes709downloads
root
file.gitattributes4 KBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.IQ3_M.gguf3.52 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.IQ3_S.gguf3.43 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.IQ3_XS.gguf3.28 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.IQ4_NL.gguf4.38 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.IQ4_XS.gguf4.18 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q2_K.gguf2.96 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q3_K_L.gguf4.03 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q3_K_M.gguf3.74 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q3_K_S.gguf3.41 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q3_K.gguf3.74 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q4_0.gguf4.34 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q4_1.gguf4.78 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q4_K_M.gguf4.58 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q4_K_S.gguf4.37 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q4_K.gguf4.58 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q5_0.gguf5.21 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q5_1.gguf5.65 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q5_K_M.gguf5.34 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q5_K_S.gguf5.21 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q5_K.gguf5.34 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q6_K.gguf6.14 GBdownload
filemodel_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4.Q8_0.gguf7.95 GBdownload
fileREADME.md6 KBdownload

RichardErkhov/mjm4dl_-_model_XY_llama3_Meta-Llama-3-8B-Instruct_1_128_4-gguf · main · files are served by the source, never re-hosted here