datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
simplification-datasetДанный dataset был собран из корпуса "RuSimpleSentEval" (https://github.com/dialogue-evaluation/RuSimpleSentEval), а также "RuAdapt" (https://github.com/Digital-Pushkin-Lab/RuAdapt) для задачи упрощения текста (text simplification).
from datasets import load_dataset
data_files = {'train':"train.csv",'test':"test.csv"}
dataset = load_dataset("r1char9/simplification", data_files=data_files)
train_df = dataset['train'].to_pandas()
test_df = dataset['test'].to_pandas()
wikilarge-text-simplificationchatgpt-dutch-simplification
Dataset Card for ChatGPT Dutch Simplification
Dataset Summary
Created in light of a master thesis by Charlotte Van de Velde as part of the Master of Science in Artificial Intelligence at KU Leuven.
Charlotte is supervised by Vincent Vandeghinste and Bram Vanroy.
The dataset contains Dutch source sentences and aligned simplified sentences, generated with ChatGPT. All splits combined, the dataset
consists of 1267 entries.
Charlotte used gpt-3.5-turbo with the following… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/chatgpt-dutch-simplification.wikilarge-text-simplificationnews-not-not-ela-text-simplificationdutch-municipal-sentence-simplificationbiendata_text_simplification