CoolFace
Modelpublic

prithivMLmods/Wolf-Rayet-2B-Prime3-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes129downloads
Model Card

Wolf-Rayet-2B-Prime3-GGUF

Wolf-Rayet-2B-Prime3 is a compact, coding-optimized language model built on the Qwen3 1.7B architecture, fine-tuned for high-accuracy code generation, debugging, and technical reasoning. With approximately 2 billion effective parameters, it offers a strong balance between performance and deployability—ideal for developers, educators, and engineers operating in resource-constrained or latency-sensitive environments.

Model Files

File NamePrecisionSize
Wolf-Rayet-2B-Prime3.BF16.ggufBF163.45 GB
Wolf-Rayet-2B-Prime3.F16.ggufFP163.45 GB
Wolf-Rayet-2B-Prime3.F32.ggufFP326.89 GB
Wolf-Rayet-2B-Prime3.Q2_K.ggufQ2_K778 MB
Wolf-Rayet-2B-Prime3.Q3KM.ggufQ3KM940 MB
Wolf-Rayet-2B-Prime3.Q4KM.ggufQ4KM1.11 GB
Wolf-Rayet-2B-Prime3.Q5KM.ggufQ5KM1.26 GB
Wolf-Rayet-2B-Prime3.Q8_0.ggufQ8_01.83 GB
config.jsonConfig File31 Bytes

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png