maximedb/sick_nl

Dataset Description

• —Homepage: https://github.com/gijswijnholds/sick_nl
• —Repository: https://github.com/gijswijnholds/sick_nl
• —Paper: https://aclanthology.org/2021.eacl-main.126/
• —Point of Contact: Gijs Wijnholds

Dataset Summary

An automatically translated, manually corrected translation of the SICK dataset of Marelli et al. 2014, intended to boost research in Dutch NLP.

Languages

The dataset is in Dutch.

Dataset Structure

Data Fields

• —pair_ID: sentence pair ID
• —sentence_A: sentence A
• —sentence_B: sentence B
• —label: textual entailment gold label: entailment (0), neutral (1) or contradiction (2)
• —relatedness_score: semantic relatedness gold score (on a 1-5 continuous scale)
• —entailmentAB: entailment for the A-B order (AneutralB, AentailsB, or Acontradicts_B)
• —entailmentBA: entailment for the B-A order (BneutralA, BentailsA, or Bcontradicts_A)
• —sentenceAoriginal: original sentence from which sentence A is derived
• —sentenceBoriginal: original sentence from which sentence B is derived
• —sentenceAdataset: dataset from which the original sentence A was extracted (FLICKR vs. SEMEVAL)
• —sentenceBdataset: dataset from which the original sentence B was extracted (FLICKR vs. SEMEVAL)

Data Splits

Train Trial Test 4439 495 4906

Dataset Creation

The dataset was created by first automatically translating all sentences, then by manually correcting any translation errors. This guarantees naturality of the examples while aligning the relatedness scores and entailment labels. Since the data IDs are preserved the dataset is fully aligned on the sentence level.

Additional Information

Licensing Information

This dataset falls under an MIT License.

Citation Information

@inproceedings{wijnholds-etal-2021-sicknl,
    title = "SICK-NL: A Dataset for Dutch Natural Language Inference",
    author = "Wijnholds, Gijs and Moortgat, Michael",
    booktitle = "Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics",
    month = apr,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://www.aclweb.org/anthology/2021.eacl-main.126/",
}

Contributions

Thanks to @maximedb for adding this dataset.