Datasetpublic

bclavie/mmarco-japanese-hard-negatives

[Under Construction] This is a repository containing all the queries from the Japanese part of the MMarco dataset, the multilingual version of the MSMarco dataset. For each query, there are matching hard negatives: 25 of them retrieved by the multilingual e5 base model. Up to 10 of them retrieved by the basic implementation of BM25 from Japanese in the Anserini library.

sourceHugging Faceupdated 3y agoView on Hugging Face

6likes434downloads

Dataset Card

[Under Construction]

This is a repository containing all the queries from the Japanese part of the MMarco dataset, the multilingual version of the MSMarco dataset.

For each query, there are matching hard negatives:

—25 of them retrieved by the multilingual e5 base model.
—Up to 10 of them retrieved by the basic implementation of BM25 from Japanese in the Anserini library.