thaki-AI/daily-paper-2026-09-25-spec-decoding-acceptance-output-structure

The Draft Law: Measuring How Agentic Output Structure Sets Speculative-Decoding Acceptance and Net Per-Token Cost on Self-Hosted H200 TL;DR — An analytical paper deriving the draft law for speculative decoding on agentic traffic over a self-hosted single H200: expected accepted prefix length is set by the mean structural predictability of the output - schema-constrained tool-call, reasoning, and prose positions - and the net per-token saving is strictly increasing in the… See the full description on the dataset page: https://huggingface.co/datasets/thaki-AI/daily-paper-2026-09-25-spec-decoding-acceptance-output-structure.