datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
yoruba-normalization-pairs
Normalization pairs dataset
What this is
24,475 pairs of Yorùbá text, each a corrupted form next to its canonical form, labelled by corruption type. I built it for testing orthographic normalization code.
The library
This dataset was built alongside yotext, a Python library for Yorùbá orthographic normalization and diacritic restoration. The library is on PyPI at https://pypi.org/project/yotext/ and the source is at… See the full description on the dataset page: https://huggingface.co/datasets/adedejimakinde/yoruba-normalization-pairs.uk-text-normalization
Український TTS-нормалізатор — датасет
Пари «письмовий текст → як його вимовляють» для української. Числа, дати, час,
гроші, одиниці, скорочення, коди, телефони, IBAN, домени, пошта, римські
цифри, латинські вкраплення — те, що треба розгорнути словами перед синтезом
мовлення.
{"task_id": 0,
"combo_names": ["Кількісні числівники (написані цифрами)",
"Порядкові числівники (написані цифрами з закінченням)"],
"original": "На 1-й полиці стоять 4 книги."… See the full description on the dataset page: https://huggingface.co/datasets/skypro1111/uk-text-normalization.nfl-play-normalization-v2
NFL Play Normalization V2 Data-Efficiency Curve
This dataset contains four nested training sets with 3,125, 6,250, 12,500,
and 25,000 unchanged real nflverse play descriptions from the 2019 through
2022 seasons. The v2 selection targets laterals, repeated fumbles, accepted
penalties after turnovers, and descriptions with several yardage clauses.
The curve manifest pins every dataset and point-manifest checksum. The review
file explains the deterministic selection and the… See the full description on the dataset page: https://huggingface.co/datasets/AdamRoch/nfl-play-normalization-v2.kyrgyz-text-normalization
Kyrgyz Text Normalization Dataset
A dataset for training and evaluating Kyrgyz text normalization systems. Released subset accompanying "Kyrgyz Text Normalization: A Comparative Study of Neural and Rule-Based Approaches" (MeLLM Workshop @ ACL 2026).
What is in this release
This is a representative 20,000-pair subset of a larger 1.67M-pair training corpus, plus the full 1,000-example human-verified test set used in the paper.
Split
Examples
Source
Verification… See the full description on the dataset page: https://huggingface.co/datasets/Zarinaaa/kyrgyz-text-normalization.turkish-chat-normalization-mini
Turkish Chat Normalization Mini
turkish-chat-normalization-mini is a web-derived and rule-degraded Turkish text normalization dataset designed for rewriting noisy, informal, unpunctuated, or diacritics-missing Turkish text into cleaner and more readable Turkish.
The dataset does not contain private user messages, chat logs, social media comments, complaint records, or scraped personal conversations. Source sentences are collected from open Turkish web resources, while the input… See the full description on the dataset page: https://huggingface.co/datasets/yagmurtuncer/turkish-chat-normalization-mini.turkish-text-normalization
🇹🇷 Turkish Text Normalization (TN / ITN)
A deterministic, rule-based dataset of Turkish written ↔ spoken pairs for
Text Normalization (TN) and Inverse Text Normalization (ITN) — mapping digit/symbol
forms (1.500 TL, %25, 15.07.2026) to their fully spoken Turkish words
(bin beş yüz lira, yüzde yirmi beş, on beş temmuz iki bin yirmi altı) and back.
This is a common, high-value preprocessing step for Turkish ASR post-processing and
TTS front-ends, where numbers, dates, currencies… See the full description on the dataset page: https://huggingface.co/datasets/yagmurtuncer/turkish-text-normalization.turkish-text-normalization-1m
Turkish Text Normalization 1M v2
Kontrollü altı gürültü türüyle Türkçe metin normalizasyon çiftleri.
Doğrulanmış boyut
Train: 980,000
Validation: 10,000
Test: 10,000
Toplam: 1,000,000
Ana görev sütunları: id, noisy_text, normalized_text, noise_type
Provenance
Veri insan mesajlarından, belgelerinden veya web kazımasından alınmamıştır. Tamamı
depodaki üretici koduyla deterministik olarak oluşturulur. Her satırda source_type,
provenance… See the full description on the dataset page: https://huggingface.co/datasets/GoktugD/turkish-text-normalization-1m.nfl-play-normalization-2019-2022
NFL play normalization, 2019-2022
This dataset contains 188452 real raw nflverse play descriptions from 2019 through 2022. Each record pairs the raw description with a canonical JSON expected record for NFL play normalization.
License and attribution
The source nflverse releases are CC BY 4.0. This derived dataset retains source season, game ID, play ID, source URLs, and SHA-256 checksums in metadata/training-manifest.json. Attribute nflverse when using this… See the full description on the dataset page: https://huggingface.co/datasets/AdamRoch/nfl-play-normalization-2019-2022.turkish-datetime-normalization-500k
Turkish Datetime Normalization 500K v2
Türkçe tarih-saat ifadelerini ISO-8601 ve Europe/Istanbul saat dilimine eşler.
Doğrulanmış boyut
Train: 490,000
Validation: 5,000
Test: 5,000
Toplam: 500,000
Ana görev sütunları: id, text, normalized_datetime, timezone
Provenance
Veri insan mesajlarından, belgelerinden veya web kazımasından alınmamıştır. Tamamı
depodaki üretici koduyla deterministik olarak oluşturulur. Her satırda source_type,
provenance… See the full description on the dataset page: https://huggingface.co/datasets/GoktugD/turkish-datetime-normalization-500k.bm-text-normalization
bm-text-normalization
Bambara (Bamanankan) orthographic normalisation: map a non-standard spelling to its
standard form. 4,877 short phrase-level pairs in a single config, bamadaba.
Load
from datasets import load_dataset
train = load_dataset("djelia/bm-text-normalization", "bamadaba", split="train")
dev = load_dataset("djelia/bm-text-normalization", "bamadaba", split="dev")
test = load_dataset("djelia/bm-text-normalization", "bamadaba", split="test")
# rows… See the full description on the dataset page: https://huggingface.co/datasets/djelia/bm-text-normalization.text-normalization-benchmark
text-normalization-benchmark
The raw Argilla 2.8.0 export of a Bambara
(Bamanankan) text-normalization project: 160 records from four in-house corpora, each with
the annotator's standard-orthography rewrite. 96 carry a submitted response; 64 were
discarded. For a ready-to-score evaluation set, use
djelia/bm-text-normalization-benchmark, the cleaned export of the 96 finished annotations.
The repo is gated: request access on the Hub and run hf auth login.
Load
from… See the full description on the dataset page: https://huggingface.co/datasets/djelia/text-normalization-benchmark.Tool_Output_Interpretation_Normalization
🇰🇿 Kazakh Tool Output Interpretation and Financial Action Dataset
Dataset Summary
Kazakh Tool Output Interpretation and Financial Action Dataset is a Kazakh-language dataset designed for training and evaluating Large Language Models (LLMs) in tool-augmented agentic workflows that require interpreting structured tool outputs and generating grounded final responses.
The dataset focuses on scenarios where an assistant must understand a Kazakh user request, call the… See the full description on the dataset page: https://huggingface.co/datasets/farabi-lab/Tool_Output_Interpretation_Normalization.AIO-Datasetsbm-text-normalization-benchmark
bm-text-normalization-benchmark
A small human-annotated evaluation set for Bambara (Bamanankan) orthographic normalisation:
96 real-world Bambara strings, each paired with a hand-written standard-orthography rewrite.
It is the cleaned export of the finished annotations from
djelia/text-normalization-benchmark.
Load
from datasets import load_dataset
# the current, whitespace-clean evaluation set
bench = load_dataset("djelia/bm-text-normalization-benchmark"… See the full description on the dataset page: https://huggingface.co/datasets/djelia/bm-text-normalization-benchmark.vejin-Dataset-Normalization
Kurdish Books Dataset (Preprocessed)
Dataset Description
This dataset contains 18,565 Kurdish books with asosoft preprocessing applied to the content field. The dataset was created from an Excel file and includes book metadata along with preprocessed text content.
Languages
Central Kurdish (ckb)
Kurdish (ku)
Dataset Structure
The dataset contains the following columns:
author
book
title
url
content
Data Processing
Text… See the full description on the dataset page: https://huggingface.co/datasets/shiima/vejin-Dataset-Normalization.vejin-Dataset-Normalization-with-textColumn
Kurdish Books Dataset with Combined Text Field
Dataset Description
This dataset contains 18,565 Kurdish books with a combined text field that includes author, book name, title, and content in a structured format. All text has been preprocessed using the asosoft library.
Languages
Central Kurdish (ckb)
Kurdish (ku)
Dataset Structure
The dataset contains the following columns:
author
book
title
url
content
text
Text Field Format
The text… See the full description on the dataset page: https://huggingface.co/datasets/shiima/vejin-Dataset-Normalization-with-textColumn.