datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
arxiv-summarization
Arxiv dataset for summarization
Dataset for summarization of long documents.Adapted from this repo.Note that original data are pre-tokenized so this dataset returns " ".join(text) and add "\n" for paragraphs. This dataset is compatible with the run_summarization.py script from Transformers if you add this line to the summarization_name_mapping variable:
"ccdv/arxiv-summarization": ("article", "abstract")
Data Fields
id: paper id
article: a string containing the body of… See the full description on the dataset page: https://huggingface.co/datasets/ccdv/arxiv-summarization.pubmed-summarization
PubMed dataset for summarization
Dataset for summarization of long documents.Adapted from this repo.Note that original data are pre-tokenized so this dataset returns " ".join(text) and add "\n" for paragraphs. This dataset is compatible with the run_summarization.py script from Transformers if you add this line to the summarization_name_mapping variable:
"ccdv/pubmed-summarization": ("article", "abstract")
Data Fields
id: paper id
article: a string containing the body… See the full description on the dataset page: https://huggingface.co/datasets/ccdv/pubmed-summarization.govreport-summarization
GovReport dataset for summarization
Dataset for summarization of long documents.Adapted from this repo and this paperThis dataset is compatible with the run_summarization.py script from Transformers if you add this line to the summarization_name_mapping variable:
"ccdv/govreport-summarization": ("report", "summary")
Data Fields
id: paper id
report: a string containing the body of the reportsummary: a string containing the summary of the report
Data Splits… See the full description on the dataset page: https://huggingface.co/datasets/ccdv/govreport-summarization.NLG-Abstractive-Summarization
SEA Abstractive Summarization
SEA Abstractive Summarization evaluates a model's ability to read a document, identify the key points within, and summarize them into a coherent and fluent text while paraphrasing the document. It is sampled from XL-Sum for Indonesian, Tamil, Thai, and Vietnamese.
Supported Tasks and Leaderboards
SEA Abstractive Summarization is designed for evaluating chat or instruction-tuned large language models (LLMs). It is part of the SEA-HELM… See the full description on the dataset page: https://huggingface.co/datasets/aisingapore/NLG-Abstractive-Summarization.task769_qed_summarization
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task769_qed_summarization
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task769_qed_summarization.CRAFT-Summarization
CRAFT-Summarization
This is a synthetic dataset generated with the CRAFT framework proposed in the paper CRAFT Your Dataset: Task-Specific Synthetic Data Generation Through Corpus Retrieval and Augmentation.
The correctness of the data has not been verified in detail, but training on this data and evaluating on human-curated summarization data proved highly beneficial.
4 synthetic dataset sizes (S, M, L, XL) are available, and training on them yields consistent improvement that… See the full description on the dataset page: https://huggingface.co/datasets/ingoziegler/CRAFT-Summarization.meeting-summarization-sft-100k
Meeting Summarization SFT (100K)
100,000 ShareGPT conversations demonstrating structured meeting summarization across 22 meeting types. Each example converts a realistic meeting transcript into a well-organized summary with key decisions, action items, and discussion notes — in the format that professional teams actually use.
Motivation
Meeting transcription tools (Otter.ai, Fireflies, Zoom AI) generate raw text but struggle to produce usable summaries. Common… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/meeting-summarization-sft-100k.news-qa-summarization
NewsQASum, a dataset for question answering and summarization of news
This dataset contains the CNN articles at the overlap between the newsqa question-answering
dataset and the CNN DailyMail summarization dataset. Each article is annotated with
a summary and a list of questions and corresponding answers.
Tasks: QA, summarization, text retrievalGenre: News storiesLanguage: English
lca-module-summarization
🏟️ Long Code Arena (Module summarization)
This is the benchmark for Module summarization task as part of the
🏟️ Long Code Arena benchmark.
The current version includes 216 manually curated text files describing different documentation of open-source permissive Python projects.
The model is required to generate such description, given the relevant context code and the intent behind the documentation.
All the repositories are published under permissive licenses (MIT, Apache-2.0… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-module-summarization.task288_gigaword_summarization
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task288_gigaword_summarization
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task288_gigaword_summarization.reddit-posts-summarization-grpo
GRPO Summarization Eval Rollouts
Evaluation artifacts for all GRPO summarization checkpoints from smolcluster — a distributed GRPO training framework for Apple Silicon Mac clusters.
Two base models were fine-tuned across two training strategies and six reward configurations each, then evaluated on 200 examples from the mlabonne/smoltldr test split.
Judge: gpt-5-mini-2025-08-07 · Framework: DeepEval G-Eval · Rounds: 5 averaged · Metrics (each 0–1): Faithfulness · Coverage ·… See the full description on the dataset page: https://huggingface.co/datasets/YuvrajSingh9886/reddit-posts-summarization-grpo.task1355_sent_comp_summarization
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1355_sent_comp_summarization
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1355_sent_comp_summarization.task645_summarization
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task645_summarization
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task645_summarization.bangladesh-scob-judgment-summarization
Bangladesh Supreme Court (SCOB) High Court Division Judgment Summarization Dataset
Dataset Summary
The Bangladesh Supreme Court (SCOB) High Court Division Judgment Summarization Dataset is a curated, high-quality legal NLP dataset comprising all 235 canonical judgments published in the Supreme Court Online Bulletin (SCOB) by the High Court Division of the Supreme Court of Bangladesh.
Each sample pairs a complete, cleaned legal judgment body with its official… See the full description on the dataset page: https://huggingface.co/datasets/Hasin2026/bangladesh-scob-judgment-summarization.hindi-article-summarization
Summary
hindi-article-summarization is an open source dataset of instruct-style records generated from the Hindi Text Short and Large Summarization dataset. This was created as part of Aya Open Science Initiative from Cohere For AI.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the CC BY-SA 4.0 License.
Supported Tasks:
Training LLMs
Synthetic Data Generation
Data Augmentation
Languages: Hindi Version: 1.0
Dataset Overview… See the full description on the dataset page: https://huggingface.co/datasets/ganeshjcs/hindi-article-summarization.financial-reports-extractive-summarization_eval
Financial Reports Extractive Summarization Evaluation Dataset
Validation and test splits for evaluating models on Arabic financial reports extractive summarization.
Dataset Structure
Format: Simple prompt-answer pairs
Validation: ~20 examples (10%)
Test: ~20 examples (10%)
Language: Arabic
Domain: Financial reports and market news
Fields
id: Unique identifier
prompt: The summarization prompt
full_text: Complete financial report
answer: Ground… See the full description on the dataset page: https://huggingface.co/datasets/SahmBenchmark/financial-reports-extractive-summarization_eval.modified-codesearchnet-code-summarization
Modified CodeSearchNet (MCSN) Dataset
This dataset is a modification of the CodeSearchNet dataset from CodeXGLUE benchmark, designed for evaluating code summarization models beyond the function level. It explores the impact of function and repository contexts on summary quality. The dataset includes modifications for evaluating at both function and repository levels.
Paper: Code Summarization Beyond Function Level
Dataset Structure:
The dataset contains samples with the following… See the full description on the dataset page: https://huggingface.co/datasets/sm1rk/modified-codesearchnet-code-summarization.Alpaca-pubmed-summarizationThis data set is a lightweight fine-tuned data format version of the Llama2 large language model for Stanford Alpaca. You can click here to view.
cite original code
@inproceedings{cohan-etal-2018-discourse,
title = "A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents",
author = "Cohan, Arman and
Dernoncourt, Franck and
Kim, Doo Soon and
Bui, Trung and
Kim, Seokhwan and
Chang, Walter and
Goharian, Nazli",
booktitle = "Proceedings… See the full description on the dataset page: https://huggingface.co/datasets/ZhongshengWang/Alpaca-pubmed-summarization.nepali-summarization-datasetThis dataset was intended to to be used for finetuning the nepali text summerization task.
Feel free to contribute to this readme to add any information
document-summarization-dpo-100k
Document Summarization DPO (100K)
100,000 DPO (Direct Preference Optimization) preference pairs for training models to summarize business and professional documents with precision, structure, and analytical depth.
Motivation
Document summarization is one of the highest-value enterprise AI applications — analysts, lawyers, product managers, and executives use AI to process reports, contracts, and research daily. Models commonly fail by:
Losing quantitative data:… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/document-summarization-dpo-100k.modified-classeval-code-summarization
Modified ClassEval (MCE) Dataset
This dataset is a modification of the ClassEval benchmark, designed for evaluating code summarization models beyond the function level. It explores the impact of function and class contexts on summary quality. The dataset includes modifications for evaluating at both function and class levels.
Paper: Code Summarization Beyond Function Level
Dataset Structure:
The dataset contains samples with the following fields:
class_id: Identifier for the… See the full description on the dataset page: https://huggingface.co/datasets/sm1rk/modified-classeval-code-summarization.summarization-sft-100k
Summarization SFT (100K)
100,000 ShareGPT-format conversations covering document summarization across 9 source types and 5 summary styles. Trains models to summarize professional documents the way an expert human analyst would — identifying what matters, choosing the right format, and calibrating length to the task.
Motivation
Summarization is one of the most commercially deployed LLM capabilities, yet most summarization datasets train on news articles only. Real… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/summarization-sft-100k.best-of-attempts-summarization-artifacts
Artifacts for Testing Self-Correction in Generate-Critique-Refine Text Summarization
This repository contains artifact-safe research materials for an empirical study of best-of-attempts selection in a generate-critique-refine text summarization pipeline. The package is intended to make the reported paper results auditable: it includes evaluation metrics, prompt files, model/pipeline configuration summaries, paper drafts, provenance notes, and reviewer-facing completion evidence.… See the full description on the dataset page: https://huggingface.co/datasets/HugeTrunk/best-of-attempts-summarization-artifacts.news-qa-summarization-73financial-reports-extractive-summarization_train
Financial Reports Extractive Summarization Training Dataset
Training split of the Arabic financial reports extractive summarization dataset in conversational format.
Dataset Structure
Format: Conversational (human-agent pairs)
Size: ~160 training examples (80% of total)
Language: Arabic
Domain: Financial reports and market news
Features
id: Unique identifier
conversations: Human prompt and agent summary
report_type: Type of financial report… See the full description on the dataset page: https://huggingface.co/datasets/SahmBenchmark/financial-reports-extractive-summarization_train.benchname-module-summarization
🥷 BenchName (Module summarization)
This is the benchmark for Module summarization task as part of the
🥷 BenchName benchmark.
The current version includes 216 manually curated text files describing different documentation of open-source permissive Python projects.
The model is required to generate such description, given the relevant context code and the intent behind the documentation.
All the repositories are published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause… See the full description on the dataset page: https://huggingface.co/datasets/anon-iclr-submission/benchname-module-summarization.Egyptian-text-summarization
Egyptian Arabic Text Summarization Dataset
Dataset Description
This dataset contains text-summary pairs in Egyptian Arabic designed for training and evaluating text summarization models.
Key Features
Language: Egyptian Arabic (العامية المصرية)
Task: Text Summarization
Format: Text-summary pairs with topic categorization
Content: Diverse topics with natural Egyptian Arabic usage
Dataset Structure
Data Fields
text: Original text content… See the full description on the dataset page: https://huggingface.co/datasets/Omar-youssef/Egyptian-text-summarization.pubmed-summarization-turkish
PubMed Özetleme Veri Seti – Türkçe Özetler (MedGemma 27B)
Bu veri seti, orijinal ccdv/pubmed-summarization veri setindekiabstract (özet) alanlarının MedGemma 27B modeli ile Türkçe’ye çevrilmiş halini içermektedir.
Bu repoda yalnızca Türkçe özetler yer almaktadır.Orijinal İngilizce makale metinleri ve özetler, ccdv/pubmed-summarization veri setinde kalmaya devam eder ve burada tekrar edilmez.
Veri Seti Özeti
Kaynak veri seti: ccdv/pubmed-summarization
İçerik:… See the full description on the dataset page: https://huggingface.co/datasets/turkerberkdonmez/pubmed-summarization-turkish.arxiv_summarization_20k_preprocessed
ArXiv Summarization Dataset - 20K Preprocessed
A preprocessed dataset of 20,000 ArXiv papers with their full articles and abstracts, designed for abstract generation and summarization tasks.
Dataset Description
This dataset contains 20,000 ArXiv papers that have been filtered and preprocessed to ensure quality for training summarization models. Each example contains the full article text and its corresponding abstract.
Dataset Structure
The dataset has the… See the full description on the dataset page: https://huggingface.co/datasets/yilmazzey/arxiv_summarization_20k_preprocessed.Egyptian-text-summarization
Egyptian Arabic Text Summarization Dataset
Dataset Description
This dataset contains text-summary pairs in Egyptian Arabic designed for training and evaluating text summarization models.
Key Features
Language: Egyptian Arabic (العامية المصرية)
Task: Text Summarization
Format: Text-summary pairs with topic categorization
Content: Diverse topics with natural Egyptian Arabic usage
Dataset Structure
Data Fields
text: Original text content… See the full description on the dataset page: https://huggingface.co/datasets/Tariq2023/Egyptian-text-summarization.