datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
wavepulse-radio-summarized-transcripts
WavePulse Radio Summarized Transcripts
Dataset Summary
WavePulse Radio Summarized Transcripts is a large-scale dataset containing summarized transcripts from 396 radio stations across the United States, collected between June 26, 2024, and October 3, 2024. The dataset comprises approximately 1.5 million summaries derived from 485,090 hours of radio broadcasts, primarily covering news, talk shows, and political discussions.
The raw version of the transcripts is available… See the full description on the dataset page: https://huggingface.co/datasets/nyu-dice-lab/wavepulse-radio-summarized-transcripts.clinical-summarizer-sft
Clinical Note Summarizer (SOAP Format)
Part of the AxisMapper Medical AI Suite — 16 domain-specific SFT datasets for fine-tuning medical LLMs.
Built by AmareshHebbar | Studio Ilios / Humanova Minds
What this dataset does
Long clinical notes → structured SOAP summaries
Why download this
Automate clinical documentation. Reduce physician burnout by summarizing visit notes into Subjective / Objective / Assessment / Plan format.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/AmareshHebbar/clinical-summarizer-sft.openai-summarize-tldr
Summarize TL;DR Filtered Dataset
This is the version of the dataset used in https://arxiv.org/abs/2009.01325.
If starting a new project we would recommend using https://huggingface.co/datasets/openai/summarize_from_feedback.
For more information see https://github.com/openai/summarize-from-feedback and for the original TL;DR dataset see https://huggingface.co/datasets/webis/tldr-17.
fr-summarizer-dataset
training data
Dataset : fr-summarizer-dataset
Data-size : 7.65 MB
train : 1.97k rows
validation : 440 rows
roles : user , assistant
Format chatml "role": "role", "content": "content", "user": "user", "assistant": "assistant"
*French audio podcast transcription*
Project details
Fine-tuned on French audio podcast transcription data for summarization task. As a result, the model is able to summarize French audio podcast transcription data.
The model will be used for an AI… See the full description on the dataset page: https://huggingface.co/datasets/WillisBack/fr-summarizer-dataset.smol_summarize_pt
SMOL Summarize PT
This dataset is the translated version of the smol-summarize subset of the HuggingFaceTB/smoltalk.
Original Dataset: https://huggingface.co/datasets/HuggingFaceTB/smoltalk
Note: This dataset comprises machine translated content and may contain translation errors or artifacts.
This dataset is provided as part of the AMALIA project and is included in the data mix used to post-train the AMALIA model.
Citation
If you use this dataset or… See the full description on the dataset page: https://huggingface.co/datasets/amalia-llm/smol_summarize_pt.Mixture-Summarizer
RecursiveMAS Mixture-Summarizer
Project Page | Code | Paper
We introduce RecursiveMAS, a multi-agent framework that scales agent collaboration through latent-space recursion. This dataset contains training examples for the Mixture-Style setting.
Dataset Details
Item
Description
Dataset
RecursiveMAS/Mixture-Summarizer
Original file
Mixture-Summarizer.json
Collaboration style
Mixture-Style
Used for
summarizer inner agent training
Split
train… See the full description on the dataset page: https://huggingface.co/datasets/RecursiveMAS/Mixture-Summarizer.Text-summarizer-dataset
Dataset Card for "Text-summarizer-dataset"
More Information needed
wikihow_summarize_dialogue_vi
Description
The dataset is from unknown, formatted as dialogues for speed and ease of use. Many thanks to author for releasing it.
Importantly, this format is easy to use via the default chat template of transformers, meaning you can use huggingface/alignment-handbook immediately, unsloth.
Structure
View online through viewer.
Note
We advise you to reconsider before use, thank you. If you find it useful, please like and follow this account.… See the full description on the dataset page: https://huggingface.co/datasets/lamhieu/wikihow_summarize_dialogue_vi.news-summarizer-reasoner
News Summarizer with Reasoning
Overview
This dataset is designed for news summarization tasks, featuring both original news articles and their corresponding summaries. The dataset includes a 'news' column sourced from three different datasets, along with 'cleaned_summary' and 'cleaned_reasoning' columns generated using large language models.
Dataset Structure
news: Original news articles.
cleaned_summary: Summaries of the news articles in bullet points.… See the full description on the dataset page: https://huggingface.co/datasets/seacorn/news-summarizer-reasoner.AP-News-2024-CGPT-Summarize-ShareGPTThe AP News dataset, run through ChatGPT (gpt-3.5-turbo) to get summaries.
All use the same system prompt; "You summarize text. Ensure that your summaries effectively capture key points, while being concise."
Currently not all of the articles from the dataset are summarized, since I keep hitting "You've reached our limit of messages per hour. Please try again later."