CoolFace
Datasetpublic

sentence-transformers/parallel-sentences-ccmatrix

Dataset Card for Parallel Sentences - CCMatrix This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. The texts originate from the CCMatrix dataset. Related Datasets The following datasets are also a part of the Parallel Sentences collection: parallel-sentences-europarl parallel-sentences-global-voices parallel-sentences-muse parallel-sentences-jw300… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/parallel-sentences-ccmatrix.

sourceHugging Faceupdated 2y agoView on Hugging Face
15likes6.8kdownloads
Dataset Card

Dataset Card for Parallel Sentences - CCMatrix

This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. The texts originate from the CCMatrix dataset.

Related Datasets

The following datasets are also a part of the Parallel Sentences collection:

These datasets can be used to train multilingual sentence embedding models. For more information, see sbert.net - Multilingual Models.

Dataset Subsets

en-... subsets

  • —Columns: "english", "non_english"
  • —Column types: str, str
  • —Examples:
python
    {
      "english": "He and his mother will be standing vigil there.”",
      "non_english": "Él y su madre estarán de vigilia allí”.",
    }
  • —Collection strategy: Processing the data from yhavinga/ccmatrix and reformatting it in Parquet and with "english" and "non_english" columns.
  • —Deduplified: No