datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
dbpedia
DBPedia
An MTEB dataset
Massive Text Embedding Benchmark
DBpedia-Entity is a standard test collection for entity search over the DBpedia knowledge base
Task category
t2t
Domains
Written, Encyclopaedic
Reference
https://github.com/iai-group/DBpedia-Entity/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["DBPedia"])
evaluator = mteb.MTEB(task)
model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/dbpedia.dbpedia-entity-generated-queries
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/dbpedia-entity-generated-queries.dbpedia-fa
Dataset Summary
DBPedia-Fa is a Persian (Farsi) dataset tailored for the Retrieval task, focusing on entity retrieval. It is a translated version of the English DBpedia dataset used in the BEIR benchmark, and a key component of the FaMTEB (Farsi Massive Text Embedding Benchmark), under the BEIR-Fa collection.
Language(s): Persian (Farsi)
Task(s): Retrieval (Entity Retrieval)
Source: Translated from the English DBpedia dataset used in BEIR
Part of FaMTEB: Yes — under BEIR-Fa… See the full description on the dataset page: https://huggingface.co/datasets/MCINext/dbpedia-fa.dbpedia-hindi-cot-training-data
DBpedia Hindi — Chain-of-Thought Training Data (Not Used in Final Training)
39,621 Hindi relational-triple-extraction examples in Chain-of-Thought (CoT) trace format, generated for the DBpedia Hindi Chapter (Google Summer of Code 2026), published for completeness alongside the Optimal-trace training set actually used to train the released models.
Important — Not Used In The Final Model
This is the exact same underlying data as the Optimal-trace training set… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-cot-training-data.dbpedia-hindi-training-data
DBpedia Hindi — Training Data (Relational Triple Extraction)
39,621 Hindi sentence → subject-relation-object triple examples, used to fine-tune Gemma 3 4B for the DBpedia Hindi Chapter (Google Summer of Code 2026).
Format
Chat-format JSONL, one example per line:
{
"phase": "phase1",
"messages": [
{"role": "system", "content": "Extract all subject-relation-object triplets..."},
{"role": "user", "content": "<Hindi sentence>"},
{"role": "assistant"… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-training-data.dbpedia-hindi-noisy-training-data
DBpedia Hindi — Noisy Synthetic Training Data
15,581 Hindi sentence → triple examples with deliberately realistic noise, generated to support curriculum-style training for the DBpedia Hindi Chapter (Google Summer of Code 2026).
Rationale
Seeded from flawed (lower-scoring) examples from the original synthetic dataset, so the generated "noise" reflects genuine semantic mistakes (span boundaries, argument reversal, missing negation) rather than a weak model's… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-noisy-training-data.v3_dbpedia_parallelai_e5qwen7b_qdbp_only_claim_degradebeir-nl-dbpedia-entity
Dataset Card for BEIR-NL Benchmark
Dataset Summary
BEIR-NL is a Dutch-translated version of the BEIR benchmark, a diverse and heterogeneous collection of datasets covering various domains from biomedical and financial texts to general web content. Our benchmark is integrated into the Massive Multilingual Text Embedding Benchmark (MMTEB).
BEIR-NL contains the following tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018… See the full description on the dataset page: https://huggingface.co/datasets/clips/beir-nl-dbpedia-entity.dbpedia_abstracts_fictional_characters_with_imgDBpedia Abstracts
v3_dbpedia_real_corpus_e5qwen7b_qdbp_only_claim_degrade
v3 DBpedia Real Corpus qDBP Claim Degrade
Synthetic qDBP queries from Nithish2410/v3_dbpedia_parallelai_e5qwen7b_qdbp_only_claim_degrade, expanded locally to 6,000 balanced qDBP queries, reranked against the real DBpedia corpus from harisarang/benchmark-dbpedia.
Contents
train.jsonl: 6,000 queries with 100 Qwen-reranked DBpedia targets each.
items.jsonl: 4,635,922 real DBpedia title/text documents.
Rerank Setup
Query source: synthetic qDBP query… See the full description on the dataset page: https://huggingface.co/datasets/Nithish2410/v3_dbpedia_real_corpus_e5qwen7b_qdbp_only_claim_degrade.dbpedia-hindi-benchie-ground-truth
DBpedia Hindi — BenchIE Ground Truth
The first DBpedia property ground truth for the Hindi BenchIE benchmark — 139 canonical triples across 112 sentences, built for the DBpedia Hindi Chapter (Google Summer of Code 2026).
Why This Was Needed
BenchIE contains human-verified gold subject/relation/object spans, but was designed for open information extraction evaluation, not DBpedia alignment — it had no mapping to DBpedia properties before this work.… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-benchie-ground-truth.dbpedia-entity-hard-negatives
Dataset Card
Dataset Details
This dataset contains a set of candidate documents for second-stage re-ranking on dbpedia
(test split in BEIR). Those candidate documents are composed of hard negatives mined from
gtr-t5-xl as Stage 1 ranker
and ground-truth documents that are known to be relevant to the query. This is a release from our paper
Policy-Gradient Training of Language Models for Ranking, so
please cite it if using this dataset.
Direct Use
You can… See the full description on the dataset page: https://huggingface.co/datasets/NeuralPGRank/dbpedia-entity-hard-negatives.v3_dbpedia_parallelai_e5qwen7b_6intent_claim_degradedbpedia-hindi-validation-data
DBpedia Hindi — Validation Data (Relational Triple Extraction)
3,634 real Hindi Wikipedia sentences, held out during training, used to evaluate the fine-tuned Gemma 3 4B model for the DBpedia Hindi Chapter (Google Summer of Code 2026).
Format
Same chat-format JSONL as the training dataset — messages (system/user/assistant), plus score, source, trace_type fields.
Composition
Real Hindi Wikipedia sentences only (not synthetic), each scored ≥9/10 by an… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-validation-data.dbpedia-hindi-predicate-linking-gold
DBpedia Hindi — Predicate Linking Gold Set
8,029 Hindi predicate → DBpedia property mappings, used to fine-tune F2LLM-1.7B for predicate normalization, as part of the DBpedia Hindi Chapter (Google Summer of Code 2026).
Format
{
"predicate": "<Hindi relation text>",
"top_50_candidates": ["<dbo: URI>", "..."],
"gold_dbo": "dbo:propertyName",
"raw_llm_response": "ANSWER: dbo:propertyName"
}
How This Was Built
Two-stage pipeline across 8,029… See the full description on the dataset page: https://huggingface.co/datasets/Nitin1211/dbpedia-hindi-predicate-linking-gold.dbpedia-entity-top-20-gen-queries
NFCorpus: 20 generated queries (BEIR Benchmark)
This HF dataset contains the top-20 synthetic queries generated for each passage in the above BEIR benchmark dataset.
DocT5query model used: BeIR/query-gen-msmarco-t5-base-v1
id (str): unique document id in NFCorpus in the BEIR benchmark (corpus.jsonl).
Questions generated: 20
Code used for generation: evaluate_anserini_docT5query_parallel.py
Below contains the old dataset card for the BEIR benchmark.
Dataset Card for BEIR… See the full description on the dataset page: https://huggingface.co/datasets/income/dbpedia-entity-top-20-gen-queries.gpl-dbpedia-entity