Datasetpublic

vn3er/samer-arabic-text-simplification

SAMER Arabic Text Simplification Dataset (Cleaned Version) Description This dataset is a cleaned and structured version of the SAMER Corpus (The SAMER Arabic Text Simplification Corpus). It is prepared specifically for training Seq2Seq models (e.g., AraT5) and fine-tuning Large Language Models (LLMs) on Arabic Text Simplification and Readability Assessment tasks. Dataset Structure The dataset contains the following fields: clean_text: Cleaned… See the full description on the dataset page: https://huggingface.co/datasets/vn3er/samer-arabic-text-simplification.

sourceHugging Facemitupdated 11d agoView on Hugging Face

0likes57downloads

Dataset Card

SAMER Arabic Text Simplification Dataset (Cleaned Version)

Description

This dataset is a cleaned and structured version of the SAMER Corpus (The SAMER Arabic Text Simplification Corpus). It is prepared specifically for training Seq2Seq models (e.g., AraT5) and fine-tuning Large Language Models (LLMs) on Arabic Text Simplification and Readability Assessment tasks.

Dataset Structure

The dataset contains the following fields:

—clean_text: Cleaned Arabic text stripped of morphology readability tags.
—prompt: Input prompt structured for LLM and Seq2Seq generation tasks.
—raw_text: Original annotated text containing word-level difficulty markers (word#level).
—target_level: Targeted readability level (e.g., 0 for beginner/simplified).
—source_level: Original readability level of the source text.
—word_annotations: Structured list of words with their respective difficulty levels.

Citation & Acknowledgments

If you use this dataset, please cite the original authors and paper of the SAMER Corpus:

bibtex

@inproceedings{alhafni-etal-2024-samer,
    title = "The {SAMER} {A}rabic Text Simplification Corpus",
    author = "Alhafni, Bashar and Hazim, Reem and Pineros Liberato, Juan David and Al Khalil, Muhamed and Habash, Nizar",
    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    pages = "16079--16093",
    url = "[https://aclanthology.org/2024.lrec-main.1398/](https://aclanthology.org/2024.lrec-main.1398/)"
}

License

This dataset processed from the SAMER repository is released under the MIT License.