8 results

kv-cache-compression

inall models datasets apps agents people projects

Datasets

All datasets matching “kv-cache-compression”

Rohithreddybc /kv-cache-compression-mbe Matched-Budget Evaluation (MBE) — KV Cache Compression A standardized reporting protocol for KV cache compression in LLM inference. MBE is not a new task benchmark; it is a thin reporting layer that fixes which models, tasks, and budgets results are reported at, so that numbers from different papers become comparable. Manifest (mbe_manifest.json): the frozen evaluation specification — model suite, task suite (consuming existing benchmarks: LongBench, RULER, SCBench, GSM8K… See the full description on the dataset page: https://huggingface.co/datasets/Rohithreddybc/kv-cache-compression-mbe.texttext-generationn<1K0 likes20 downloads3mo agoHugging Face