CoolFace
Datasetpublic

RedHatAI/speculator_benchmarks

This dataset contains dataset splits for evaluating speculative decoding algorithms on different tasks. File: Coding: HumanEval.jsonl Math: math_reasoning.jsonl Question Answering: qa.jsonl MT_bench: question.jsonl Retrieval-Augmented Generation: rag.jsonl Summarization: summarization.jsonl Translation (German to English): translation.jsonl Writing: writing.jsonl The data comes from two sources: https://github.com/openai/human-eval (1). (The MIT License)… See the full description on the dataset page: https://huggingface.co/datasets/RedHatAI/speculator_benchmarks.

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
4likes4.4kdownloads
Dataset Card

This dataset contains dataset splits for evaluating speculative decoding algorithms on different tasks.

File:

  1. 1.Coding: HumanEval.jsonl
  2. 2.Math: math_reasoning.jsonl
  3. 3.Question Answering: qa.jsonl
  4. 4.MT_bench: question.jsonl
  5. 5.Retrieval-Augmented Generation: rag.jsonl
  6. 6.Summarization: summarization.jsonl
  7. 7.Translation (German to English): translation.jsonl
  8. 8.Writing: writing.jsonl

The data comes from two sources:

  1. 1.https://github.com/openai/human-eval (1). (The MIT License)
  2. 2.https://github.com/hemingkx/Spec-Bench (2-8) (Apache 2.0)