RedHatAI/speculator_benchmarks

This dataset contains dataset splits for evaluating speculative decoding algorithms on different tasks. File: Coding: HumanEval.jsonl Math: math_reasoning.jsonl Question Answering: qa.jsonl MT_bench: question.jsonl Retrieval-Augmented Generation: rag.jsonl Summarization: summarization.jsonl Translation (German to English): translation.jsonl Writing: writing.jsonl The data comes from two sources: https://github.com/openai/human-eval (1). (The MIT License)… See the full description on the dataset page: https://huggingface.co/datasets/RedHatAI/speculator_benchmarks.