Modelpublic

Mungert/NVIDIA-Nemotron-Nano-12B-v2-GGUF

sourceHugging Faceotherupdated 1y agoView on Hugging Face

2likes1.8kdownloads

fileNVIDIA-Nemotron-Nano-12B-v2-bf16_q8_0.gguf16.10 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-bf16.gguf22.94 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-f16_q8_0.gguf16.10 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-imatrix.gguf4.9 MBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq1_m.gguf3.57 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq1_s.gguf3.17 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq2_m.gguf4.39 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq2_s.gguf4.16 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq2_xs.gguf4.07 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq2_xxs.gguf3.77 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq3_m.gguf5.73 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq3_xs.gguf5.39 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq3_xxs.gguf5.15 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq4_nl.gguf6.46 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-iq4_xs.gguf6.47 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q2_k_m.gguf4.52 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q2_k_s.gguf4.36 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q3_k_m.gguf5.81 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q3_k_s.gguf5.65 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q4_0.gguf7.09 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q4_1.gguf7.26 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q4_k_m.gguf7.40 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q4_k_s.gguf6.92 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q5_0.gguf8.37 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q5_1.gguf9.00 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q5_k_m.gguf8.57 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q6_k_m.gguf9.72 GBdownload

fileNVIDIA-Nemotron-Nano-12B-v2-q8_0.gguf12.19 GBdownload

Mungert/NVIDIA-Nemotron-Nano-12B-v2-GGUF · main · files are served by the source, never re-hosted here