datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
trec-covid
TRECCOVID
An MTEB dataset
Massive Text Embedding Benchmark
TRECCOVID is an ad-hoc search challenge based on the COVID-19 dataset containing scientific articles related to the COVID-19 pandemic.
Task category
t2t
Domains
Medical, Academic, Written
Reference
https://ir.nist.gov/covidSubmit/index.html
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["TRECCOVID"])… See the full description on the dataset page: https://huggingface.co/datasets/mteb/trec-covid.TREC-QC
TREC Question Classification
Question classification in coarse and fine-grained categories.
Source:
Experimental Data for Question Classification
Xin Li, Dan Roth, Learning Question Classifiers. COLING'02, Aug., 2002.
AToMiC-Baselines
AToMiC Prebuilt Indexes
Example Usage:
Reproduction
Toolkits:
https://github.com/TREC-AToMiC/AToMiC/tree/main/examples/dense_retriever_baselines
# Skip the encode and index steps, search with the prebuilt indexes and topics directly
python search.py \
--topics topics/openai.clip-vit-base-patch32.text.validation \
--index indexes/openai.clip-vit-base-patch32.image.faiss.flat \
--hits 1000 \
--output… See the full description on the dataset page: https://huggingface.co/datasets/TREC-AToMiC/AToMiC-Baselines.ragtime1
RAGTIME1 Collection
This dataset contains the documents for TREC RAGTIME Track.
Please refer to the website for the details of the task.
RAGTIME is a multilingual RAG task, which expects the participating system to retrieve relevant documents from all four languages and synthesize a response with citation to the report request.
For convenience, we separate the documents by their languages into four .jsonl files. However, they are intended to be used as a whole set.
The documents… See the full description on the dataset page: https://huggingface.co/datasets/trec-ragtime/ragtime1.liveqa_medical_trec2017
Dataset Card for LiveQA Medical from TREC 2017
The LiveQA'17 medical task focuses on consumer health question answering. Consumer health questions were received by the U.S. National Library of Medicine (NLM).
The dataset consists of constructed medical question-answer pairs for training and testing, with additional annotations that can be used to develop question analysis and question answering systems.
Please refer to our overview paper for more information about the constructed… See the full description on the dataset page: https://huggingface.co/datasets/hyesunyun/liveqa_medical_trec2017.merged-trecdltrec-dl-2019
TRECDL2019
An MTEB dataset
Massive Text Embedding Benchmark
TREC Deep Learning Track 2019 passage ranking task. The task involves retrieving relevant passages from the MS MARCO collection given web search queries. Queries have multi-graded relevance judgments.
Task categoryt2t
Domains
Encyclopaedic, Academic, Blog, News, Medical, Government, Reviews, Non-fiction, Social, Web
Reference
https://microsoft.github.io/msmarco/TREC-Deep-Learning-2019
How to… See the full description on the dataset page: https://huggingface.co/datasets/whybe-choi/trec-dl-2019.trec-newsatomic2024benchmark-trec-covidtrec-dl-2020
TRECDL2020
An MTEB dataset
Massive Text Embedding Benchmark
TREC Deep Learning Track 2020 passage ranking task. The task involves retrieving relevant passages from the MS MARCO collection given web search queries. Queries have multi-graded relevance judgments.
Task categoryt2t
Domains
Encyclopaedic, Academic, Blog, News, Medical, Government, Reviews, Non-fiction, Social, Web
Reference
https://microsoft.github.io/msmarco/TREC-Deep-Learning-2020
How to… See the full description on the dataset page: https://huggingface.co/datasets/whybe-choi/trec-dl-2020.trec-news-generated-queries
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/trec-news-generated-queries.trec-covid-generated-queries
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/trec-covid-generated-queries.trec-covid-fa-v2atomic2023-small_text2imagetrec-covid-CSR-L
TRECCOVID-CodeSwitching
An MTEB dataset
Massive Text Embedding Benchmark
Code-switching version of mteb/trec-covid, with queries rewritten in Chinese-English and Japanese-English code-switching styles.
Dataset Structure
The dataset contains the following configurations:
From original dataset (unchanged):
corpus: Original corpus documents
default: Original relevance judgments (qrels)
Code-switching additions:
queries_zh_en: Chinese-English code-switching queries… See the full description on the dataset page: https://huggingface.co/datasets/UTokyo-Yokoya-Lab/trec-covid-CSR-L.trec-covid-generated-queriesrus-trec-covidtrec-covidThis is the corpus file from the BEIR benchmark for the TREC-COVID 19 dataset.
ragtime2
RAGTIME2 Collection
This dataset contains the documents for TREC RAGTIME Track 2026.
Please refer to the website for the details of the task.
RAGTIME is a multilingual RAG task, which expects the participating system to retrieve relevant documents from all four languages and synthesize a response with citation to the report request.
For convenience, we separate the documents by their languages into four .jsonl files. However, they are intended to be used as a whole set.
The… See the full description on the dataset page: https://huggingface.co/datasets/trec-ragtime/ragtime2.gpl-trec-covidtrec_cast_offsets
Dataset Card for Dataset Name
This is a complement to the TREC CaST (2020-22) datasets, with pre-computed offset relative to the original files.
trec_dl19manyshots_trecbeir-nl-trec-covid
Dataset Card for BEIR-NL Benchmark
Dataset Summary
BEIR-NL is a Dutch-translated version of the BEIR benchmark, a diverse and heterogeneous collection of datasets covering various domains from biomedical and financial texts to general web content. Our benchmark is integrated into the Massive Multilingual Text Embedding Benchmark (MMTEB).
BEIR-NL contains the following tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018… See the full description on the dataset page: https://huggingface.co/datasets/clips/beir-nl-trec-covid.benchmark-trec-covidtrec-ap88-90-corpus
TREC AP88-90 Corpus
Dataset Summary
Le TREC AP88-90 Corpus est un corpus de documents Associated Press couvrant la periode 1988-1990. Il est destine a des experiments en recherche d'information, en ranking, et en evaluation de systemes de retrieval.
Dataset Description
Overview
Ce depot contient une version preparee du corpus TREC AP88-90 pour des usages de recherche et d'experimentation.Le contenu est… See the full description on the dataset page: https://huggingface.co/datasets/DomLoyer/trec-ap88-90-corpus.trec-covid-fa
Dataset Summary
TRECCOVID-Fa is a Persian (Farsi) dataset designed for the Retrieval task, specifically focusing on ad-hoc search for COVID-19-related scientific information. It is a translated version of the English dataset from the TREC-COVID shared task, included in the BEIR benchmark, and is part of the FaMTEB (Farsi Massive Text Embedding Benchmark) under the BEIR-Fa collection.
Language(s): Persian (Farsi)
Task(s): Retrieval (Ad-hoc Search, COVID-19 Information Retrieval)… See the full description on the dataset page: https://huggingface.co/datasets/MCINext/trec-covid-fa.trec_dl20trec-dl-2019-query