CoolFace
Modelpublic

prithivMLmods/Omega-Qwen2.5-Coder-3B-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes171downloads
Model Card

Omega-Qwen2.5-Coder-3B-GGUF

Omega-Qwen2.5-Coder-3B is a compact and high-efficiency code-focused model fine-tuned on Qwen2.5-Coder-3B-Instruct, using the symbolic-rich Open-Omega-Forge-1M dataset. Designed specifically for hard-coded tasks and deterministic computation, this model runs in a "thinking-disabled" mode—delivering precise, structured outputs with minimal hallucination, making it ideal for rigorous coding workflows and embedded logic applications.

Model Files

File NameSizePrecision
Omega-Qwen2.5-Coder-3B.BF16.gguf6.18 GBBF16
Omega-Qwen2.5-Coder-3B.F16.gguf6.18 GBF16
Omega-Qwen2.5-Coder-3B.F32.gguf12.3 GBF32
Omega-Qwen2.5-Coder-3B.Q2_K.gguf1.27 GBQ2_K
Omega-Qwen2.5-Coder-3B.Q3KL.gguf1.71 GBQ3KL
Omega-Qwen2.5-Coder-3B.Q3KM.gguf1.59 GBQ3KM
Omega-Qwen2.5-Coder-3B.Q3KS.gguf1.45 GBQ3KS
Omega-Qwen2.5-Coder-3B.Q4KM.gguf1.93 GBQ4KM
Omega-Qwen2.5-Coder-3B.Q4KS.gguf1.83 GBQ4KS
Omega-Qwen2.5-Coder-3B.Q5KM.gguf2.22 GBQ5KM
Omega-Qwen2.5-Coder-3B.Q5KS.gguf2.17 GBQ5KS
Omega-Qwen2.5-Coder-3B.Q6_K.gguf2.54 GBQ6_K
Omega-Qwen2.5-Coder-3B.Q8_0.gguf3.29 GBQ8_0

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png