datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
msmarco_train_hard_negativesThe dataset has 3 columns : query, positive_example, negative_example
First we filtered queries.train.tsv to only contain queries which were available in qrels.train.tsv. This was done so that we only take care of queries of which we had a positive example of. Then we found top 200 ranked passages in collection.tsv for each query in filtered queries and then randomly sampled a passage whose rank lied in the range of 50 to 200 to produce our final hard negatives for each query.
Use this as a… See the full description on the dataset page: https://huggingface.co/datasets/manupande21/msmarco_train_hard_negatives.mimic10-hard-negativesICD-10-CM-HardNegatives