Lala8383/ms-marco-qa-10k

MS MARCO QA Subset (10K)

This is a subset of the MS MARCO v1.1 dataset by Microsoft, sampled for lightweight experimentation.

Source

• —Original dataset: microsoft/ms_marco (v1.1)
• —Original paper: MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
• —Original authors: Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng (Microsoft)

What was changed

• —Randomly sampled 10,000 examples from the train split (seed=42)
• —Randomly sampled 1,000 examples from the validation split (seed=42)
• —No other modifications were made to the data

License

This dataset is derived from MS MARCO, which is released under the Microsoft Research License. Please refer to the original license terms before use.

Citation

If you use this dataset, please cite the original MS MARCO paper:

@article{nguyen2016ms,
  title={MS MARCO: A Human Generated MAchine Reading COmprehension Dataset},
  author={Nguyen, Tri and Rosenberg, Mir and Song, Xia and Gao, Jianfeng and Tiwary, Saurabh and Majumder, Rangan and Deng, Li},
  journal={arXiv preprint arXiv:1611.09268},
  year={2016}
}