Modelpublic

second-state/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

sourceHugging Facellama3.1updated 2y agoView on Hugging Face

0likes654downloads

fileLlama-3.1-Nemotron-70B-Instruct-HF-f16-00001-of-00005.gguf27.90 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-f16-00002-of-00005.gguf27.53 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-f16-00003-of-00005.gguf27.81 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-f16-00004-of-00005.gguf27.53 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-f16-00005-of-00005.gguf20.65 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q2_K.gguf24.56 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L.gguf34.59 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M.gguf31.91 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S.gguf28.79 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q4_0.gguf37.22 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M.gguf39.60 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S.gguf37.58 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q5_0.gguf45.32 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M.gguf46.52 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S.gguf45.32 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q6_K-00001-of-00002.gguf27.79 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q6_K-00002-of-00002.gguf26.12 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q8_0-00001-of-00003.gguf27.76 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q8_0-00002-of-00003.gguf27.71 GBdownload

fileLlama-3.1-Nemotron-70B-Instruct-HF-Q8_0-00003-of-00003.gguf14.36 GBdownload

second-state/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF · main · files are served by the source, never re-hosted here