datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
bfs-optimal-symbolic-algebra-simplification-trajectories
ISRE v7 BFS Trajectories
This dataset contains BFS-optimal symbolic algebra simplification trajectories
for the ISRE research project.
Each row is one trajectory. Nested fields are stored as JSON strings to preserve
the original AST and step structure without lossy flattening.
What This Dataset Is
This is not a natural-language instruction dataset. It is a symbolic algebra
policy-learning dataset.
Each trajectory starts from a deliberately scrambled algebraic… See the full description on the dataset page: https://huggingface.co/datasets/NecroMOnk/bfs-optimal-symbolic-algebra-simplification-trajectories.task934_turk_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task934_turk_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task934_turk_simplification.wiki_simplifications_dutch_dedup_splitThis is a variant of the original dataset.
It was shuffled (seed=42);
Deduplicated on rows (96,613 rows removed);
Split into train, validation and test sets (the latter have 8192 samples each)
Reproduction
from datasets import load_dataset, Dataset, DatasetDict
ds = load_dataset("UWV/Leesplank_NL_wikipedia_simplifications", split="train")
ds = ds.shuffle(seed=42)
print("original", ds)
df = ds.to_pandas()
df = df.drop_duplicates().reset_index()
ds = Dataset.from_pandas(df)… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split.Leesplank_NL_wikipedia_simplifications_preprocessed
Dataset Card for Dataset Name
A synthetic dataset made by simplifying Dutch Wikipedia entries. This is a processed version of an earlier publication.
Dataset Details
Dataset Description
Leesplank_nl_wikipedia_simplifications_preprocessed is based on https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split, which in itself is based on our own dataset (https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications), but… See the full description on the dataset page: https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications_preprocessed.samer-arabic-text-simplification
SAMER Arabic Text Simplification Dataset (Cleaned Version)
Description
This dataset is a cleaned and structured version of the SAMER Corpus (The SAMER Arabic Text Simplification Corpus). It is prepared specifically for training Seq2Seq models (e.g., AraT5) and fine-tuning Large Language Models (LLMs) on Arabic Text Simplification and Readability Assessment tasks.
Dataset Structure
The dataset contains the following fields:
clean_text: Cleaned… See the full description on the dataset page: https://huggingface.co/datasets/vn3er/samer-arabic-text-simplification.samer-arabic-simplification-onlybisect_fr_prompt_textual_simplification
bisect_fr_prompt_textual_simplification
Summary
bisect_fr_prompt_textual_simplification is a subset of the Dataset of French Prompts (DFP).It contains 9,889,420 rows that can be used for a textual simplification task.The original data (without prompts) comes from the dataset BiSECT by Kim et al. where only the French part has been kept.A list of prompts (see below) was then applied in order to build the input and target columns and thus obtain the same format as the xP3… See the full description on the dataset page: https://huggingface.co/datasets/CATIE-AQ/bisect_fr_prompt_textual_simplification.legal_simplification_corpus
Dataset Card for "legal_simplification_corpus"
More Information needed
task111_asset_sentence_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task111_asset_sentence_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task111_asset_sentence_simplification.med_paragraph_simplificationflan_combined_task934_turk_simplificationlegal-simplification-pt
Dataset Structure
Configuration: random_split
train_random
validation_random
test_random
Configuration: by_source
acordaos_tcu
stf_decisions
stf_votes
tjsp
trf5
ulysses_tesemo
english-text-simplification-for-finetuningflan_combined_task111_asset_sentence_simplificationhindi-text-simplification-for-finetuningawadhi-text-simplification-for-finetuningasset_simplification_promptsource