Kevletesteur/quant-vs-api-parity-harness
🔬 quant-vs-api-parity-harness Is your local quant actually as good as the full-precision API? This toolkit answered that question for a 284B MoE compressed to 2.9 bpw — verdict: indistinguishable on the real serving path (90.8% token-identical, 240/240 paired-QA parity, deep-derivation parity). 🎯 But the real product is the method: it caught 9 bugs in our own instruments before they could lie to us — including one that had us convinced the quant had lost factual recall when… See the full description on the dataset page: https://huggingface.co/datasets/Kevletesteur/quant-vs-api-parity-harness.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face