Datasetpublic

ZurichNLP/mediomatix-raw

General Information Release of the Mediomatix corpus, prepared by UZH and PHGR, to be used for research purposes only. In mediomatix-raw, we release the full Mediomatix schoolbooks' text for each idiom. The data points are unaligned. See here for the mulit-parallel, aligned Mediomatix corpus. We use the following Romansh idiom codes as subsets in the dataset: Sursilvan: rm-sursilv Sutsilvan: rm-sutsilv Surmiran: rm-surmiran Puter: rm-puter Vallader: rm-vallader The splits in… See the full description on the dataset page: https://huggingface.co/datasets/ZurichNLP/mediomatix-raw.

sourceHugging Facecc-by-nc-sa-4.0updated 6mo agoView on Hugging Face

0likes124downloads

Dataset Card

General Information

Release of the Mediomatix corpus, prepared by UZH and PHGR, to be used for research purposes only.

In mediomatix-raw, we release the full Mediomatix schoolbooks' text for each idiom. The data points are unaligned. See here for the mulit-parallel, aligned Mediomatix corpus.

We use the following Romansh idiom codes as subsets in the dataset:

—Sursilvan: rm-sursilv
—Sutsilvan: rm-sutsilv
—Surmiran: rm-surmiran
—Puter: rm-puter
—Vallader: rm-vallader

The splits in each subset are:

—train: Text from year 2 and 3 schoolbooks
—validation: Text from year 4 schoolbooks
—test: Text from year 5 schoolbooks
—no_surmiran: Text from years 6-9; available for all idioms except rm-surmiran

Each data point contains the following columns:

—CmsElementID: An id referring to which CMS element a text was extracted from.
—segmentID: A unique id for each row; differentiates between segments split apart from the same CMS element.
—text: The extracted plain text from within an HTML segment
—html: The extracted text, including any HTML markup
—chapter: The name of the chapter from which a text was extracted
—book: A code referring to the grade, volume, and type of school book

Book names are encoded in the "book" column as follows:

—The first digit refers to the school year of the book
—The next refers to the book volums for that school year
—The two letter code indicates whether the segment comes from the student workbook ("wb") or teacher's commentary ("tc")
—Example: Book "5.1_tc" refers to teacher's commentary for Volume 1 of the year 5 schoolbook.

How to Use

The subset for a specific Romansh idiom must be specified when loading the datset:

python

from datasets import load_dataset

sursilv = load_dataset("ZurichNLP/mediomatix-raw","rm-sursilv")

# Load Train set:

train_set = sursilv['train']

# Load Validation set:

val_set = sursilv['validation']

# Load Test set:

test_set = sursilv['test']

# Load no-rm-surmiran if the subset is not rm-surmiran
no_surm = sursilv['no_surmiran']

Citation

bibtex

@inproceedings{hopton-etal-2026-mediomatix,
    title = "The Mediomatix Corpus: Parallel Data for {R}omansh Language Varieties via Comparable Schoolbooks",
    author = {Hopton, Zachary William  and
      Vamvas, Jannis  and
      B{\"u}chler, Andrin  and
      Rutkiewicz, Anna  and
      Cathomas, Rico  and
      Sennrich, Rico},
    editor = "Demberg, Vera  and
      Inui, Kentaro  and
      Marquez, Llu{\'i}s",
    booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {EACL} 2026",
    month = mar,
    year = "2026",
    address = "Rabat, Morocco",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2026.findings-eacl.16/",
    pages = "290--306",
    ISBN = "979-8-89176-386-9"
}