sentence-transformers/parallel-sentences-jw300
Dataset Card for Parallel Sentences - JW300 This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. Most of the sentences originate from the OPUS website. In particular, this dataset contains the JW300 dataset. Related Datasets The following datasets are also a part of the Parallel Sentences collection: parallel-sentences-europarl parallel-sentences-global-voices… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/parallel-sentences-jw300.
Dataset Card for Parallel Sentences - JW300
This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. Most of the sentences originate from the OPUS website. In particular, this dataset contains the JW300 dataset.
Related Datasets
The following datasets are also a part of the Parallel Sentences collection:
- parallel-sentences-europarl
- parallel-sentences-global-voices
- parallel-sentences-muse
- parallel-sentences-jw300
- parallel-sentences-news-commentary
- parallel-sentences-opensubtitles
- parallel-sentences-talks
- parallel-sentences-tatoeba
- parallel-sentences-wikimatrix
- parallel-sentences-wikititles
- parallel-sentences-ccmatrix
These datasets can be used to train multilingual sentence embedding models. For more information, see sbert.net - Multilingual Models.
Dataset Subsets
all subset
- Columns: "english", "non_english"
- Column types:
str,str - Examples:
{
"english": "It will really help me. I am a compulsive TV watcher.",
"non_english": "سيكون هذا الفصل خير مساعد لي ."
}- Collection strategy: Combining all other subsets from this dataset.
- Deduplified: No
en-... subsets
- Columns: "english", "non_english"
- Column types:
str,str - Examples:
{
"english": "But then you realize you do not have any money with you to pay for the refreshment.",
"non_english": "Namun, kemudian Anda sadar bahwa Anda tidak punya uang untuk membelinya."
}- Collection strategy: Processing the raw data from parallel-sentences and formatting it in Parquet, followed by deduplication.
- Deduplified: Yes
