CoolFace
Datasetpublic

GetGenetica/p12-p13-speculative-served-runtime-contract

P12/P13 Speculative Served Runtime Contract This dataset repo is a GetGenetica-owned benchmark contract package for the P12/P13 speculative decoding, long-context route, and diffusion-block runtime lane. It intentionally does not contain a measured served-runtime result. Current state: Contract ID: p12_p13_same_checkpoint_served_runtime_contract Benchmark scope: same_checkpoint_same_hardware_same_prompt_cohort Result state: blocked_missing_same_checkpoint_served_runtime_result… See the full description on the dataset page: https://huggingface.co/datasets/GetGenetica/p12-p13-speculative-served-runtime-contract.

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
0likes12downloads
Dataset Card

P12/P13 Speculative Served Runtime Contract

This dataset repo is a GetGenetica-owned benchmark contract package for the P12/P13 speculative decoding, long-context route, and diffusion-block runtime lane. It intentionally does not contain a measured served-runtime result.

Current state:

  • Contract ID: p12_p13_same_checkpoint_served_runtime_contract
  • Benchmark scope: same_checkpoint_same_hardware_same_prompt_cohort
  • Result state: blocked_missing_same_checkpoint_served_runtime_result
  • Expected result receipt: p12_p13_same_checkpoint_served_runtime_latest.json
  • Served result present: False

Required Arms

  • baseline_no_spec
  • p12_trained_kan_draft_speculative
  • p13_long_context_moe_route
  • diffusion_multi_commit_candidate

Required Metrics

  • same_checkpoint_served_tokens_per_second
  • same_checkpoint_wall_clock_ttft
  • same_checkpoint_quality_non_regression
  • trained_kan_draft_head_accept_rate
  • repair_cost_delta
  • long_context_served_tokens_per_second
  • moe_expert_route_ablation
  • real_kv_cache_realignment_execution
  • real_multihorizon_acceptance_breakdown
  • multi_commit_denoise_policy
  • loss_or_quality_guard
  • served_wall_clock_after_multicommit

Forbidden Substitutions

  • vendor_reported_mtp_speedup_as_served_result
  • synthetic_prefill_throughput_as_same_checkpoint_decode_speed
  • random_draft_acceptance_as_trained_kan_draft_acceptance
  • mechanical_block_verify_speedup_as_production_speedup
  • diffusion_mask_predict_parallelism_1p0_as_speedup

Result Validator

result_validation_contract.json is the runner-facing fail-closed contract for p12_p13_same_checkpoint_served_runtime_latest.json. It requires same checkpoint/hardware/prompt/tokenizer/generation settings, trained stacked-KAN draft acceptance, real KV realignment, multi-horizon acceptance, and real multi-commit diffusion evidence. Compact-cache or prefill-only evidence cannot be substituted for served speculative-decode speed.

Claim Boundary

This package proves only that the served-runtime benchmark contract is published and reproducible. It is not a speedup, cost-savings, quality-uplift, or SOTA claim. Public P12/P13 runtime claims remain blocked until the expected same-checkpoint served-runtime result receipt exists and passes all required metrics.