datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
xsum
Dataset Card for SAMSum Corpus
Dataset Description
Links
Homepage: https://arxiv.org/abs/1808.08745
Repository: https://arxiv.org/abs/1808.08745
Paper: https://arxiv.org/abs/1808.08745
Point of Contact: https://huggingface.co/knkarthick
Dataset Summary
This repository contains data and code for our EMNLP 2018 paper "Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization".… See the full description on the dataset page: https://huggingface.co/datasets/knkarthick/xsum.stacked-xsum
xsum-stacked
The current version (corresponding to the stacked-booksum release): v0.3. See the Stacked Summaries org page for what this is and why it exists.
The maximum input length is 16384 tokens, and the maximum output length is 1024 tokens (measured with the Long-T5 tokenizer).
stats
[2023-01-09 19:36:25] INFO:root:INPUTS - basic stats - train
[2023-01-09 19:36:26] INFO:root:{'num_columns': 5,
'num_rows': 204045,
'num_unique_target': 203107,
'num_unique_text':… See the full description on the dataset page: https://huggingface.co/datasets/stacked-summaries/stacked-xsum.XSum-TrThe XSum dataset was designed for the English language and consists of news articles, their corresponding single-sentence
summaries, and associated BBC article IDs. Due to the lack of high-quality summarization datasets in Turkish, a machine translation approach was employed to adapt the
dataset for Turkish. The Meta MT model1, which was created by Meta AI, was used to translate the original English texts into Turkish. This model was chosen because
it was trained on a diverse set of languages… See the full description on the dataset page: https://huggingface.co/datasets/anilguven/XSum-Tr.XSUMUrdu-DW_BBC
Urdu_DW-BBC-512
Dataset Summary
Urdu Summarization Dataset containining 76,637 records of Article + Summary pairs scrapped from BBC Urdu and DW Urdu News Websites.
Preprocessed Version: upto 512 tokens (~words); removed URLs, Pic Captions etc
Supported Tasks and Leaderboards
Summarization: Extractive and Abstractive
urT5 adapted from mT5 having monolingual vocabulary only; 40k tokens of Urdu.
Fine-tuned version @… See the full description on the dataset page: https://huggingface.co/datasets/mbshr/XSUMUrdu-DW_BBC.xsumcnnbillsumdm