Datasetpublic

UMCU/SNLI_Dutch_translated_with_Marianmt

Information on the dataset: configs: - config_name: default data_files: - split: train path: data/train-* - split: test path: data/test-* - split: validation path: data/validation-* dataset_info: features: - name: premise dtype: string - name: hypothesis dtype: string - name: label dtype: int64 splits: - name: train num_bytes: 67523459 num_examples: 538896 - name: test num_bytes: 1285789 num_examples: 9792 - name: validation… See the full description on the dataset page: https://huggingface.co/datasets/UMCU/SNLI_Dutch_translated_with_Marianmt.

sourceHugging Facecc-by-sa-4.0updated 3y agoView on Hugging Face

0likes38downloads

Dataset Card

Information on the dataset:

configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
  - split: validation
    path: data/validation-*
dataset_info:
  features:
  - name: premise
    dtype: string
  - name: hypothesis
    dtype: string
  - name: label
    dtype: int64
  splits:
  - name: train
    num_bytes: 67523459
    num_examples: 538896
  - name: test
    num_bytes: 1285789
    num_examples: 9792
  - name: validation
    num_bytes: 1295645
    num_examples: 9792
  download_size: 20806553
  dataset_size: 70104893

Dataset Card for "SNLIDutchtranslatedwithMarianmt"

Translation of the English corpus Stanford Natural Language Inference (SNLI), to Dutch using an Maria NMT model, trained by Helsinki NLP. Note, for reference: Maria NMT is based on BART, described here.

A complete description of the dataset is given here.

Attribution

If you use this dataset please use the following to credit the creators of SNLI:

citation

@inproceedings{snli:emnlp2015,
    Author = {Bowman, Samuel R. and Angeli, Gabor and Potts, Christopher, and Manning, Christopher D.},
    Booktitle = {Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
    Publisher = {Association for Computational Linguistics},
    Title = {A large annotated corpus for learning natural language inference},
    Year = {2015}
}

The creators of the OPUS-MT models:

@InProceedings{TiedemannThottingal:EAMT2020,
  author = {J{\"o}rg Tiedemann and Santhosh Thottingal},
  title = {{OPUS-MT} — {B}uilding open translation services for the {W}orld},
  booktitle = {Proceedings of the 22nd Annual Conferenec of the European Association for Machine Translation (EAMT)},
  year = {2020},
  address = {Lisbon, Portugal}
 }

and

@misc {van_es_2023,
	author       = { {Bram van Es} },
	title        = { SNLI_Dutch_translated_with_Marianmt (Revision 9ad7971) },
	year         = 2023,
	url          = { https://huggingface.co/datasets/UMCU/SNLI_Dutch_translated_with_Marianmt },
	doi          = { 10.57967/hf/1268 },
	publisher    = { Hugging Face }
}

License

For both the Maria NMT model and the original Helsinki NLP Opus MT model we did not find a license, if this was in error please let us know and we will add the appropriate licensing promptly.

We adopt the licensing of the SNLI corpus: a Creative Commons Attribution-ShareAlike 4.0 International License.