CoolFace
Modelpublic

mradermacher/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-i1-GGUF

sourceHugging Faceotherupdated 5mo agoView on Hugging Face
3likes1.4kdownloads
root
file.gitattributes4 KBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ1_M.gguf6.58 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ1_S.gguf6.58 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ2_M.gguf6.61 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ2_S.gguf6.60 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ2_XS.gguf6.60 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ2_XXS.gguf6.59 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ3_M.gguf6.69 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ3_S.gguf6.63 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ3_XS.gguf6.63 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ3_XXS.gguf6.62 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ4_NL.gguf6.66 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-IQ4_XS.gguf6.65 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q2_K_S.gguf6.66 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q2_K.gguf6.61 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q3_K_L.gguf7.62 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q3_K_M.gguf7.30 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q3_K_S.gguf6.63 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q4_0.gguf6.68 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q4_1.gguf7.36 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q4_K_M.gguf8.98 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q4_K_S.gguf8.07 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q5_K_M.gguf9.55 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q5_K_S.gguf8.77 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.i1-Q6_K.gguf12.27 GBdownload
fileNVIDIA-Nemotron-Labs-3-Elastic-12B-A2B.imatrix.gguf33.8 MBdownload
fileREADME.md7 KBdownload

mradermacher/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-i1-GGUF · main · files are served by the source, never re-hosted here