Datasetpublic

sentence-transformers/parallel-sentences-opus-100

Dataset Card for Parallel Sentences - OPUS-100 This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. The sentences originate from the OPUS-100 website. In particular, this dataset is a reformatting of the OPUS-100 dataset. Related Datasets The following datasets are also a part of the Parallel Sentences collection: parallel-sentences-europarl parallel-sentences-global-voices… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/parallel-sentences-opus-100.

sourceHugging Faceupdated 2y agoView on Hugging Face

4likes1.9kdownloads

Dataset Card

Dataset Card for Parallel Sentences - OPUS-100

This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. The sentences originate from the OPUS-100 website. In particular, this dataset is a reformatting of the OPUS-100 dataset.

Related Datasets

The following datasets are also a part of the Parallel Sentences collection:

Recent additions (May 2024):

—parallel-sentences-opus-100

These datasets can be used to train multilingual sentence embedding models. For more information, see sbert.net - Multilingual Models.

Dataset Stats

—Columns: "english", "non_english"
—Column types: str, str
—Examples:

python

    {
      "english": "Run Program",
      "non_english": "Rith Ríomhchlár"
    }

—Collection strategy: Processing the raw data from OPUS-100 and restructuring it into 2 columns: "english" and "non_english".
—Deduplified: No