datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
normalisation-S2S-training
Tibetan Normalisation - S2S Training Data
A large-scale parallel training dataset for Tibetan text normalisation, containing approximately 2 million line pairs mapping diplomatic (non-standard, abbreviated) Tibetan manuscript text to Standard Classical Tibetan. This dataset was used to train the sequence-to-sequence normalisation models (tokenised S2S model and non-tokenised S2S model) released as part of the PaganTibet project.
The dataset combines a manually curated gold-standard… See the full description on the dataset page: https://huggingface.co/datasets/pagantibet/normalisation-S2S-training.Tibetan-normalisation-testdata
Tibetan Normalisation - Test Data
A collection of evaluation datasets for Classical Tibetan text normalisation, containing three distinct test sets designed to assess normalisation systems under different conditions: a manually curated gold-standard set of diplomatic manuscript text, and two synthetic sets of Standard Classical Tibetan text with OCR-based noise applied. Together these test sets allow evaluation across a spectrum from clean, realistic manuscript normalisation to more… See the full description on the dataset page: https://huggingface.co/datasets/pagantibet/Tibetan-normalisation-testdata.