CoolFace
Modelpublic

mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-GGUF

sourceHugging Facellama3.1updated 1y agoView on Hugging Face
1likes1.7kdownloads
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.IQ4_XS.gguf35.64 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q2_K.gguf24.56 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q3_K_L.gguf34.59 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q3_K_M.gguf31.91 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q3_K_S.gguf28.79 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q4_K_M.gguf39.60 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q4_K_S.gguf37.58 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q5_K_M.gguf46.52 GBdownload
fileLlama-3.1-Nemotron-70B-Instruct-HF-abliterated.Q5_K_S.gguf45.32 GBdownload

mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-GGUF · main · files are served by the source, never re-hosted here