CoolFace
Modelpublic

MarsupialAI/Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF

sourceHugging Facellama3.1updated 2y agoView on Hugging Face
2likes1.2kdownloads
root
file.gitattributes3 KBdownload
filegroups_merged.txt196 KBdownload
fileLlama-3.1-Nemotron-70B-Instruct_fp16-00001-of-00004.gguf41.81 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_fp16-00002-of-00004.gguf41.88 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_fp16-00003-of-00004.gguf41.60 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_fp16-00004-of-00004.gguf6.14 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ2m.gguf22.46 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ2xxs.gguf17.79 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ3m.gguf29.74 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ3xxs.gguf25.58 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ4nl.gguf37.30 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_iQ4xs.gguf35.30 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q3km.gguf31.91 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q4km.gguf39.60 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q4ks.gguf37.58 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00001-of-00002.gguf41.85 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q5km.gguf-00002-of-00002.gguf4.67 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q5ks.gguf45.32 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00001-of-00002.gguf41.89 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct_Q6k.gguf-00002-of-00002.gguf12.03 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-imatrix.dat23.8 MBdownload
fileREADME.md369 Bdownload

MarsupialAI/Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF · main · files are served by the source, never re-hosted here