Modelpublic

rodrigomt/WEBGEN-4B-Preview-480B-Double-Distill-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face

1likes45downloads

Model Card

🧠 WEBGEN-4B-Preview-480B-Double-Distill GGUFs

Format	Description
F16	Full precision (16-bit), better quality, larger size ⚖️
Q8_K_XL	Quantized (8-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), smaller size, faster inference ⚡
Q4_K_XL	Quantized (4-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), smaller size, faster inference ⚡

Example with llama.cpp:

bash

./main -m ./gguf-file-name.gguf -p "Hello world!"