Modelpublic

Soulfate24/Ornith-1.5-9B-MTP-ASHQ1-Remix-GGUF

sourceHugging Facemitupdated 17d agoView on Hugging Face

3likes6.8kdownloads

Model Card

Ornith-1.5-9B with MTP - ASHQ1-Remix

This is a GGUF quantized version of the original model.

📈 Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)

Model	Size	PPL	KLD	RMS Δp	top-p	Speed
Q8_0 (stock)	9333 MiB	9.0824	0.0058	2.26%	97.9%	244 t/s
Fidelity-48pc	8436 MiB	9.0227†	0.0087	2.58%	97.2%	260 t/s
Precision-42pc	7554 MiB	8.9957†	0.0094	2.72%	96.8%	324 t/s
Q6_K-imx (stock)	7209 MiB	8.9836†	0.0107	2.90%	96.4%	320 t/s
Quality-36pc	6388 MiB	8.9895†	0.0241	4.22%	94.5%	1313 t/s
Q5KM-imx (stock)	6335 MiB	8.6345†	0.0665	6.48%	90.7%	1219 t/s
Compact-33pc ⭐	5945 MiB	9.1332	0.0319	4.88%	93.1%	1219 t/s
Mini-30pc 🥈	5566 MiB	9.0189†	0.0425	5.65%	91.8%	1384 t/s
IQ4_XS-imx (stock)	5080 MiB	9.2758	0.0538	6.29%	90.7%	1506 t/s
Nano-27pc	4750 MiB	9.5968	0.0802	7.57%	87.9%	1249 t/s
Pico-24pc	4389 MiB	9.5871	0.1202	9.25%	85.1%	1384 t/s
IQ3_M-imx (stock)	4313 MiB	9.5973	0.1421	10.46%	84.3%	1384 t/s

ℹ️ About ASHQ1-Remix Suite

Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.

🔗 Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-RemixDouble-QuantizationSuite