datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
simplificationcochrane-simplificationThis dataset measures the ability for a model to simplify paragraphs of medical text through the omission non-salient information and simplification of medical jargon.bfs-optimal-symbolic-algebra-simplification-trajectories
ISRE v7 BFS Trajectories
This dataset contains BFS-optimal symbolic algebra simplification trajectories
for the ISRE research project.
Each row is one trajectory. Nested fields are stored as JSON strings to preserve
the original AST and step structure without lossy flattening.
What This Dataset Is
This is not a natural-language instruction dataset. It is a symbolic algebra
policy-learning dataset.
Each trajectory starts from a deliberately scrambled algebraic… See the full description on the dataset page: https://huggingface.co/datasets/NecroMOnk/bfs-optimal-symbolic-algebra-simplification-trajectories.Estonian-Text-Simplification
Estonian Text Simplification
This repository contains resources and models for Estonian text simplification, including datasets and pre-trained models.
Files
Dataset Files
simplification_training_set.json: A dataset used to fine-tune LLaMA 3.1 for text simplification.
src: The source of the data.
original: The original sentence to be simplified.
simpl_lex: A lexical simplification (may be empty).
simpl_final: The final simplified sentence.… See the full description on the dataset page: https://huggingface.co/datasets/vulturuldemare/Estonian-Text-Simplification.wikilarge-text-simplificationtask934_turk_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task934_turk_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task934_turk_simplification.simplification-datasetДанный dataset был собран из корпуса "RuSimpleSentEval" (https://github.com/dialogue-evaluation/RuSimpleSentEval), а также "RuAdapt" (https://github.com/Digital-Pushkin-Lab/RuAdapt) для задачи упрощения текста (text simplification).
from datasets import load_dataset
data_files = {'train':"train.csv",'test':"test.csv"}
dataset = load_dataset("r1char9/simplification", data_files=data_files)
train_df = dataset['train'].to_pandas()
test_df = dataset['test'].to_pandas()
wiki_simplifications_dutch_dedup_splitThis is a variant of the original dataset.
It was shuffled (seed=42);
Deduplicated on rows (96,613 rows removed);
Split into train, validation and test sets (the latter have 8192 samples each)
Reproduction
from datasets import load_dataset, Dataset, DatasetDict
ds = load_dataset("UWV/Leesplank_NL_wikipedia_simplifications", split="train")
ds = ds.shuffle(seed=42)
print("original", ds)
df = ds.to_pandas()
df = df.drop_duplicates().reset_index()
ds = Dataset.from_pandas(df)… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split.Leesplank_NL_wikipedia_simplifications_preprocessed
Dataset Card for Dataset Name
A synthetic dataset made by simplifying Dutch Wikipedia entries. This is a processed version of an earlier publication.
Dataset Details
Dataset Description
Leesplank_nl_wikipedia_simplifications_preprocessed is based on https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split, which in itself is based on our own dataset (https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications), but… See the full description on the dataset page: https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications_preprocessed.age-specific-text-simplification
Age-Specific Text Simplification Dataset
Dataset Description
This dataset contains complex texts simplified into age-appropriate versions for children aged 3, 4, and 5 years old. Each original text has been professionally adapted to match the cognitive development, vocabulary, and comprehension abilities of each specific age group.
Dataset Summary
Total Examples: 17,177
Training Split: 15,459 examples
Validation Split: 1,718 examples
Languages:… See the full description on the dataset page: https://huggingface.co/datasets/hasankursun/age-specific-text-simplification.chatgpt-dutch-simplification
Dataset Card for ChatGPT Dutch Simplification
Dataset Summary
Created in light of a master thesis by Charlotte Van de Velde as part of the Master of Science in Artificial Intelligence at KU Leuven.
Charlotte is supervised by Vincent Vandeghinste and Bram Vanroy.
The dataset contains Dutch source sentences and aligned simplified sentences, generated with ChatGPT. All splits combined, the dataset
consists of 1267 entries.
Charlotte used gpt-3.5-turbo with the following… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/chatgpt-dutch-simplification.medical_texts_simplification
Dataset Card for Medical texts simplification
The dataset consisting of 30 triples (around 800 sentences) of the original text,
human- and ChatGPT-simplified texts was created from a subset Medical Notes Classification dataset.
The original dataset contains medical notes, which come from exactly one of the following five clinical domains:
Gastroenterology, Neurology, Orthopedics, Radiology, and Urology. There are 1239 texts in total in the original dataset.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/liliya-makhmutova/medical_texts_simplification.nemotron-cc-atomic-simplification-gemma4-31b
nemotron-cc atomic-statement simplification (Gemma 4 31B-it)
2,000,000 records: source text from
nvidia/nemotron-cc-v2.1 (High-Quality-Synthetic
split) rewritten by google/gemma-4-31B-it into a sequence of atomic, Subject-Verb-Object
statements.
Generated with vLLM 0.22.1 in-process batch inference (see src/generate/run.py in the
producing repo), TP=4, max_model_len=16384, max_tokens=8192, prompts filtered to
<=8192 templated tokens.
Fields
id: original… See the full description on the dataset page: https://huggingface.co/datasets/rpisano/nemotron-cc-atomic-simplification-gemma4-31b.samer-arabic-text-simplification
SAMER Arabic Text Simplification Dataset (Cleaned Version)
Description
This dataset is a cleaned and structured version of the SAMER Corpus (The SAMER Arabic Text Simplification Corpus). It is prepared specifically for training Seq2Seq models (e.g., AraT5) and fine-tuning Large Language Models (LLMs) on Arabic Text Simplification and Readability Assessment tasks.
Dataset Structure
The dataset contains the following fields:
clean_text: Cleaned… See the full description on the dataset page: https://huggingface.co/datasets/vn3er/samer-arabic-text-simplification.legal_simplification_corpus
Dataset Card for "legal_simplification_corpus"
More Information needed
samer-arabic-simplification-onlybisect_fr_prompt_textual_simplification
bisect_fr_prompt_textual_simplification
Summary
bisect_fr_prompt_textual_simplification is a subset of the Dataset of French Prompts (DFP).It contains 9,889,420 rows that can be used for a textual simplification task.The original data (without prompts) comes from the dataset BiSECT by Kim et al. where only the French part has been kept.A list of prompts (see below) was then applied in order to build the input and target columns and thus obtain the same format as the xP3… See the full description on the dataset page: https://huggingface.co/datasets/CATIE-AQ/bisect_fr_prompt_textual_simplification.Leesplank_NL_wikipedia_simplificationsThe set contains 2.87M pragraphs of prompt/result combinations, where the prompt is a paragraph from Dutch Wikipedia and the result is a simplified text, which could include more than one paragraph.
This dataset was created by UWV, as a part of project "Leesplank", an effort to generate datasets that are ethically and legally sound.
The basis of this dataset was the wikipedia extract as a part of Gigacorpus (http://gigacorpus.nl/). The lines were fed one by one into GPT 4 1106 preview, where… See the full description on the dataset page: https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications.task111_asset_sentence_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task111_asset_sentence_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task111_asset_sentence_simplification.wikilarge-text-simplificationmed_paragraph_simplificationspanish_simplification_20k
Dataset Card: spanish_simplification_20k
This dataset provides 20K samples for Spanish simplification across a diverse range of topics, designed for people with cognitive challenges. The samples vary in length, from short to long. This dataset can supplement a larger training corpus for fine-tuning small language models, such as Gemma 4B, to simplify complex Spanish into simpler Spanish or translate English directly into simplified Spanish.
Dataset Contributors… See the full description on the dataset page: https://huggingface.co/datasets/khaledmahmoud/spanish_simplification_20k.unsat_2024_batch3000_8gpu_no_simplification_lowest7_multiassignnews-not-not-ela-text-simplificationKUKA_full_dishwasher_cycle_simplification_1medical-reports-simplification-dataset
🏥 Medical Reports Simplification Dataset
📋 Description
Dataset créé avec Gemini 2.5 Pro (Preview) pour entraîner des modèles à simplifier les rapports médicaux complexes en explications compréhensibles pour les patients.
🎯 Objectif : Démocratiser l'accès à l'information médicale en rendant les rapports techniques accessibles au grand public.
🔧 Génération du Dataset
Génération : Gemini 2.5 Pro (Preview)
Validation : Contrôle qualité automatisé… See the full description on the dataset page: https://huggingface.co/datasets/Sadou/medical-reports-simplification-dataset.SimplificationThis is the simplification datasets collected by TextBox, including:
WikiAuto + Turk/ASSET (wia-t).
The detail and leaderboard of each dataset can be found in TextBox page.
adaption-legal-clause-simplification
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-legal_clause_simplification
This dataset contains pairs of formal legal or policy clauses and their simplified, plain-language equivalents. The prompts feature complex contractual language regarding payments, confidentiality, and benefits, while the completions provide clear, concise restatements. It is designed for training models to translate legalese into accessible text.… See the full description on the dataset page: https://huggingface.co/datasets/Karthikrv/adaption-legal-clause-simplification.arabic-text-simplification
Arabic Text Simplification Dataset
Complex-to-simplified Arabic text pairs for accessibility fine-tuning.
Why This Matters
Arabic text simplification is critical for:
Low-literacy readers — 1 in 5 Arabic speakers struggle with complex text
Cognitive accessibility — dyslexia, intellectual disabilities, autism
Non-native speakers — Arabic learners and expatriate workers
Children's content — making educational material age-appropriate
Almost no Arabic accessibility… See the full description on the dataset page: https://huggingface.co/datasets/dispatchAI/arabic-text-simplification.flan_combined_task934_turk_simplification