CoolFace
Modelpublic

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
41likes148kdownloads
root
file.gitattributes3 KBdownload
fileMeta-Llama-3.1-70B-Instruct-GGUF_imatrix.dat23.8 MBdownload
fileMeta-Llama-3.1-70B-Instruct.IQ1_M.gguf15.60 GBdownload
fileMeta-Llama-3.1-70B-Instruct.IQ1_S.gguf14.29 GBdownload
fileMeta-Llama-3.1-70B-Instruct.IQ2_XS.gguf19.69 GBdownload
fileMeta-Llama-3.1-70B-Instruct.IQ3_XS.gguf27.29 GBdownload
fileMeta-Llama-3.1-70B-Instruct.IQ4_XS.gguf35.30 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q2_K.gguf24.56 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q3_K_L.gguf34.59 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q3_K_M.gguf31.91 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q3_K_S.gguf28.79 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q4_K_M.gguf39.60 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q4_K_S.gguf37.58 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q5_K_M.gguf46.52 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q5_K_S.gguf45.32 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00001-of-00006.gguf9.96 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00002-of-00006.gguf9.51 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00003-of-00006.gguf9.33 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00004-of-00006.gguf9.21 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00005-of-00006.gguf9.21 GBdownload
fileMeta-Llama-3.1-70B-Instruct.Q6_K.gguf-00006-of-00006.gguf6.69 GBdownload
fileREADME.md3 KBdownload

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF · main · files are served by the source, never re-hosted here