aiana94/xMINDlarge

Dataset Card for xMINDlarge

Table of Contents

• —Table of Contents
• —Dataset Description
• —Dataset Summary
• —Uses
• —Languages
• —Dataset Structure
• —Data Instances
• —Data Fields
• —Data Splits
• —Dataset Creation
• —Source Data
• —Data Collection and Processing
• —Personal and Sensitive Information
• —Considerations for Using the Data
• —Social Impact of Dataset
• —Discussion of Biases
• —Other Known Limitations
• —Additional Information
• —Licensing Information
• —Citation Information

Dataset Description

• —Homepage: https://huggingface.co/datasets/aiana94/xMINDlarge
• —Repository: https://github.com/andreeaiana/xMIND
• —Paper: MIND Your Language: A Multilingual Dataset for Cross-lingual News Recommendation
• —Point of Contact: Andreea Iana
• —License: CC-BY-4.0-NC-SA

Dataset Summary

xMINDlarge is an open, large-scale multi-parallel news dataset for multi- and cross-lingual news recommendation. It is derived from the English MINDlarge dataset using open-source neural machine translation (i.e., NLLB 3.3B).

For the small version of the dataset, see xMINDsmall.

Uses

This dataset can be used for machine translation, text retrieval, or as a benchmark dataset for news recommendation.

Languages

xMIND contains news translated into 14 linguistically and geographically diverse languages, with digital footprints of varying sizes.

Dataset Structure

Data Instances

>>> from datasets import load_dataset
>>> data = load_dataset('aiana94/xMINDlarge', 'ron')

# Please, specify the language code.

# A data point example is below:

{
"nid": "N49265"
"title": "Aceste reţete cu sos de afine sunt perfecte pentru cina de Ziua Recunoştinţei.",
"abstract": "Nu vei mai vrea niciodată versiunea cumpărată din magazin."
}

Data Fields

• —nid (string): news ID (same as in the MIND dataset)
• —title (string): news title
• —abstract (string) : news abstract (optional)

Data Splits

For all languages, there are three split: train, dev, test.

Dataset Creation

Source Data

The news were machine-translated from the MINDlarge dataset.

Data Collection and Processing

We translated the news articles using the open-source model NLLB 3.3B. For more details regarding the translation setup and data quality, we refer to the corresponding paper.

Personal and Sensitive Information

The data is sourced from newspaper sources and contains mentions of public figures and individuals.

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

Users should keep in mind that the dataset contains short news texts (e.g., news titles and abstracts), which might limit the applicability of the developed systems to other domains.

Additional Information

Licensing Information

The dataset is released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. If you intend to use, adapt, or share xMINDlarge, particularly together with additional news and click behavior information from the original MIND dataset, please read and reference the Microsoft Research License Terms of MIND.

Citation Infomation

BibTeX:

@inproceedings{iana2024mind,
  title={Mind your language: a multilingual dataset for cross-lingual news recommendation},
  author={Iana, Andreea and Glava{\v{s}}, Goran and Paulheim, Heiko},
  booktitle={Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval},
  pages={553--563},
  year={2024}
}

Also consider citing the following:

@inproceedings{wu2020mind,
  title={Mind: A large-scale dataset for news recommendation},
  author={Wu, Fangzhao and Qiao, Ying and Chen, Jiun-Hung and Wu, Chuhan and Qi, Tao and Lian, Jianxun and Liu, Danyang and Xie, Xing and Gao, Jianfeng and Wu, Winnie and others},
  booktitle={Proceedings of the 58th annual meeting of the association for computational linguistics},
  pages={3597--3606},
  year={2020}
}