Modelpublic

Soulfate24/Nanbeige4.2-3B-DSpark-ASHQ1-Remix-GGUF

sourceHugging Faceapache-2.0updated 17d agoView on Hugging Face

0likes1.3kdownloads

Model Card

Nanbeige4.2-3B with DSpark - ASHQ1-Remix

This is a GGUF quantized version of the original model.

📈 Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)

Model	Size	PPL	KLD	RMS Δp	top-p	Speed
Q8_0 (stock)	4229 MiB	34.4742	0.0105	2.39%	95.6%	353 t/s
Fidelity-48pc 🥈	3824 MiB	34.3246†	0.0247	3.42%	94.0%	371 t/s
Precision-42pc ⭐	3384 MiB	34.3791†	0.0331	3.94%	92.5%	382 t/s
Q6_K-imx (stock)	3266 MiB	34.4411†	0.0335	3.99%	92.4%	406 t/s
Quality-36pc	2849 MiB	34.6224	0.0743	5.80%	88.3%	466 t/s
Q5KM-imx (stock)	2849 MiB	34.6224	0.0743	5.80%	88.3%	470 t/s
Compact-33pc	2630 MiB	34.6636	0.1441	7.98%	83.8%	512 t/s
Mini-30pc	2391 MiB	33.5214†	0.1728	8.66%	81.8%	557 t/s
IQ4_XS-imx (stock)	2268 MiB	34.8506	0.1813	9.17%	81.2%	457 t/s
Nano-27pc ✗	2152 MiB	33.7551†	0.2191	10.12%	78.6%	453 t/s
IQ3_M-imx (stock)	1985 MiB	36.4366	0.4492	14.31%	70.5%	539 t/s
Pico-24pc ✗	1913 MiB	37.8642	0.3878	13.31%	72.6%	545 t/s

ℹ️ About ASHQ1-Remix Suite

Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.

🔗 Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-RemixDouble-QuantizationSuite