Modelpublic

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF

sourceHugging Faceotherupdated 3mo agoView on Hugging Face

2likes331downloads

Model Card

NVIDIA Nemotron Labs 3 Elastic 23B A2.8B GGUF

A smaller, hacker-friendly GGUF build of NVIDIA Nemotron Elastic.

Built for llama.cpp, LM Studio, and other GGUF-compatible runtimes.

File	Notes	Rough VRAM target
`nemotron-elastic-12b-Q4_K_S.gguf`	Smaller 4-bit quant	~10GB VRAM
`nemotron-elastic-12b-Q4_K_M.gguf`	Better 4-bit quant	~10GB+ VRAM

Use Q4_K_S if you want the easier/smaller 4-bit file.

Use Q4_K_M if you want the better-quality 4-bit file and have a little more room.

Both files are intended for roughly 10GB VRAM class hardware, depending on context size, KV cache settings, and GPU offload.

Open LM Studio and search for:

text

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF