datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
t3_data_V2legal_summarization
LegalSummarization
An MTEB dataset
Massive Text Embedding Benchmark
The dataset consistes of 439 pairs of contracts and their summarizations from https://tldrlegal.com and https://tosdr.org/.
Task category
t2t
Domains
Legal, Written
Reference
https://github.com/lauramanor/legal_summarization
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/legal_summarization.t3_dataset_main_npzmedical-dialogue-to-soap-summary
Dataset Card for Synthetic Medical Dialogues and SOAP Summaries
Dataset Description
Abstract
This dataset consists of 10,000 synthetic dialogues between a patient and clinician, created using the GPT-4 dataset from NoteChat, based on PubMed Central (PMC) case-reports. Accompanying these dialogues are SOAP summaries generated through GPT-4. The dataset is split into 9250 training, 500 validation, and 250 test entries, each containing a dialogue column, a SOAP… See the full description on the dataset page: https://huggingface.co/datasets/omi-health/medical-dialogue-to-soap-summary.speech-translation-and-summarization
English-Centric Multilingual Audio Dataset
This dataset contains generated article and summary audio for English-centric multilingual directions.
Each direction folder contains metadata JSONL files and corresponding audio files for few_shot and test splits.
Included directions
amharic_english / english_amharic
arabic_english / english_arabic
bengali_english / english_bengali
chinese_simplified_english / english_chinese_simplified
english_english
french_english /… See the full description on the dataset page: https://huggingface.co/datasets/McGill-NLP/speech-translation-and-summarization.irish-legislative-summaries
Irish Legislative Summaries ⚖️
Irish Legislative Summaries by Isaacus is a novel, challenging legal information retrieval evaluation dataset consisting of 500 Irish laws and their long titles, succinctly summarizing subject matter, scope, and purpose of legislation.
This dataset is meant to stress test the ability of an information retrieval model to retrieve relevant statutes to short queries describing them.
This dataset forms part of the Massive Legal Embeddings Benchmark (MLEB)… See the full description on the dataset page: https://huggingface.co/datasets/isaacus/irish-legislative-summaries.summarize_from_feedback_tldr_3_filteredThis is the query dataset taken directly from https://github.com/openai/summarize-from-feedback/tree/700967448d10004279f138666442bf1497d0e705#reddit-tldr-dataset
tiny-random-model-summaryexcerpt-summary-longctx
Excerpt Summary (Long-Context)
Book-excerpt summarization at seven context lengths (2K – 256K tokens), built for
long-context supervised fine-tuning and context-length stress-testing. Each example
asks a model to summarize a passage within a target word count; the reference summary
was generated by an LLM (see Provenance).
Usage
from datasets import load_dataset
# config name = context length: "2k", "8k", "16k", "32k", "64k", "128k", "256k"
ds =… See the full description on the dataset page: https://huggingface.co/datasets/lefft/excerpt-summary-longctx.summeval_pairsDataset paired from here:
https://github.com/Yale-LILY/SummEval
It's smaller than I thought. Perhaps one can squeeze out a few hundred comparisons for an llm.
United_States_State_Legislation_with_SummariesTest Push
Chinese-Patent-Summary高质量中文专利摘要数据集。
summarization-summeval-fr-p2p
SummEval FR
This dataset is a French translation of the original work SummEval.
The translation was made using DeepL from English to French.
We used a LLM to rate the quality of translations, we verified random samples rated above 9/10 manually and corrected all those rated under 9/10. We also checked the correlation of ROUGE and BLEU scores between SummEval and SummEvalFr. For more details about the quality checks of this dataset, please refer to our paper.
We use this dataset… See the full description on the dataset page: https://huggingface.co/datasets/lyon-nlp/summarization-summeval-fr-p2p.Chinese-Patent-Summary高质量中文专利摘要数据集。
box-attacklegal_case_document_summarization
Dataset Card for LegalCaseDocumentSummarization
Dataset Summary
[More Information Needed]
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation
Curation Rationale
[More Information Needed]… See the full description on the dataset page: https://huggingface.co/datasets/joelniklaus/legal_case_document_summarization.summedits
Factual Consistency in Summarization
Can you tell which edits of summaries are consistent, and which are inconsistent?
SummEdits Benchmark (Section 6-7)
We release the 6,348 samples of data for the 10 domains in the SummEdits. Each sample has entries for:
domain: out of the 10 domains in SummEdits,
id: a unique ID for the sample,
doc: the input document,
summary: the summary that is either consistent or inconsistent with the facts in the document,
label: 1 if the… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/summedits.bill_summary_us
Dataset Card for "bill_summary_us"
Dataset Summary
Dataset for summarization of summarization of US Congressional bills (bill_summary_us).
Supported Tasks and Leaderboards
More Information Needed
Languages
English
Dataset Structure
Data Instances
default
Data Fields
id: id of the bill in format(congress number + bill type + bill number + bill version).
congress: number of the congress.
bill_type: type of… See the full description on the dataset page: https://huggingface.co/datasets/dreamproit/bill_summary_us.openai-tldr-summarisation-preferences
Human feedback data
This is the version of the dataset used in https://arxiv.org/abs/2310.06452.
If starting a new project we would recommend using https://huggingface.co/datasets/openai/summarize_from_feedback.
See https://github.com/openai/summarize-from-feedback for original details of the dataset.
Here the data is formatted to enable huggingface transformers sequence classification models to be trained as reward functions.
airoboros-summarizationThis is my adaptation and cleaned version of the Booksum dataset to work with Airoboros by Jon Durbin
huggingface
I created this dataset for the purposes of improving the LLM capabilities with summarization. It's a core feature that I feel many applications rely on, yet we're still relying on older Longformer, RoBERTa, or BART solutions.
This dataset has been altered from the original as follows:
Cleaned up bad formatting, extra quotes at the beginning of summaries, extra line breaks, and… See the full description on the dataset page: https://huggingface.co/datasets/mattpscott/airoboros-summarization.reasoning-summaries-61k Reasoning Summaries · 61K cleaned samples
Reasoning summary dataset is a dataset that summarizes and adds extra metadata to a reasoning chain or a block from the reasoning chain (for models like qwen3.5+, gemma4, GLM-5.2)
About Dataset
This dataset is designed for training and evaluating reasoning summarization models.
The goal of the dataset is to convert long, messy, or highly detailed reasoning traces into short, user-friendly summaries that explain what the model was… See the full description on the dataset page: https://huggingface.co/datasets/Qyrou/reasoning-summaries-61k.light-batch-summarize-dialogue
Light dataset
Dialogues are preprocessed into a form:
<Character name>: <character line>
...
<Character name>: <character line>
Summarize the document
persian-summary-dataset
دیتاست خلاصهسازی فارسی
این دیتاست شامل ۱۰۶۳ نمونه برای خلاصهسازی معنایی متون فارسی است.
فرمت داده
هر نمونه شامل سه فیلد است:
instruction: دستور خلاصهسازی (بیش از ۴۰ دستور مختلف)
input: متن ورودی (بین ۱۰۰ تا ۴۰۰ کلمه)
output: خلاصه تولید شده (بین ۳۰ تا ۱۰۰ کلمه)
تعداد نمونهها
۱۰۶۳ نمونه با کیفیت بالا
حوزههای پوشش داده شده
اقتصادی (بانک، بورس، بیمه، تولید)
سیاسی (داخلی، خارجی، مذاکرات)
اجتماعی (آسیبشناسی، رفاه، اشتغال)
علمی و… See the full description on the dataset page: https://huggingface.co/datasets/msdos34/persian-summary-dataset.ESFT-summarytext-summarization-logsnews-qa-summarization
NewsQASum, a dataset for question answering and summarization of news
This dataset contains the CNN articles at the overlap between the newsqa question-answering
dataset and the CNN DailyMail summarization dataset. Each article is annotated with
a summary and a list of questions and corresponding answers.
Tasks: QA, summarization, text retrievalGenre: News storiesLanguage: English
meeting-summarization-sft-100k
Meeting Summarization SFT (100K)
100,000 ShareGPT conversations demonstrating structured meeting summarization across 22 meeting types. Each example converts a realistic meeting transcript into a well-organized summary with key decisions, action items, and discussion notes — in the format that professional teams actually use.
Motivation
Meeting transcription tools (Otter.ai, Fireflies, Zoom AI) generate raw text but struggle to produce usable summaries. Common… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/meeting-summarization-sft-100k.agentic-reasoning-trace-summaries-40k
Reasoning Summary JSON Dataset
We built this dataset to train models to turn long reasoning/work traces into short structured summaries.
Each example has a verbose trace in input and a compact JSON summary in output. The summary is shaped like the kind of progress update we want a model to produce while it is working: a title, a subtitle, a short summary, and the current task.
The dataset is JSONL with 43,734 rows. The rows are ordered from longest to shortest so long-context… See the full description on the dataset page: https://huggingface.co/datasets/Qyrou/agentic-reasoning-trace-summaries-40k.synthetic-persian-chatbot-summary-retrieval
Dataset Summary
Synthetic Persian Chatbot Summary Retrieval (SynPerChatbotSumSRetrieval) is a Persian (Farsi) dataset designed for the novel Summary Retrieval task, introduced as part of the FaMTEB (Farsi Massive Text Embedding Benchmark). This dataset was synthetically generated using the GPT-4o-mini Large Language Model and is derived from the Synthetic Persian Chatbot Dataset. The core task is to retrieve the correct, pre-generated summary that corresponds to a given user–chatbot… See the full description on the dataset page: https://huggingface.co/datasets/MCINext/synthetic-persian-chatbot-summary-retrieval.Book_Summary_Chinese
中文图书总结数据集
每个样本包含：
图书的一个章节、此章节的总结、图书名字，可以训练模型总结长文本的能力。数据主要来自较为著名的中文版小说。