CoolFace
Modelpublic

bartowski/Rombos-LLM-V2.6-Nemotron-70b-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
1likes890downloads
root
dirRombos-LLM-V2.6-Nemotron-70b-Q5_K_M/
dirRombos-LLM-V2.6-Nemotron-70b-Q6_K/
dirRombos-LLM-V2.6-Nemotron-70b-Q8_0/
file.gitattributes4 KBdownload
fileREADME.md10 KBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ1_M.gguf15.60 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ2_M.gguf22.46 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ2_XS.gguf19.69 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ2_XXS.gguf17.79 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ3_M.gguf29.74 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ3_XXS.gguf25.58 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-IQ4_XS.gguf35.30 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q2_K_L.gguf25.52 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q2_K.gguf24.56 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q3_K_L.gguf34.59 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q3_K_M.gguf31.91 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q3_K_S.gguf28.79 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q3_K_XL.gguf35.45 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q4_0.gguf37.36 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q4_K_M.gguf39.60 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q4_K_S.gguf37.58 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b-Q5_K_S.gguf45.32 GBdownload
fileRombos-LLM-V2.6-Nemotron-70b.imatrix23.8 MBdownload

bartowski/Rombos-LLM-V2.6-Nemotron-70b-GGUF · main · files are served by the source, never re-hosted here