datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
germandpr-beir
Dataset Card for germanDPR-beir
Dataset Summary
This dataset can be used for BEIR evaluation based on deepset/germanDPR.
It already has been used to evaluate a newly trained bi-encoder model.
The benchmark framework requires a particular dataset structure by default which has been created locally and uploaded here.
Acknowledgement: The dataset was initially created as "germanDPR" by Timo Möller, Julian Risch, Malte Pietsch, Julian Gutsch, Tom Hersperger, Luise Köhler… See the full description on the dataset page: https://huggingface.co/datasets/PM-AI/germandpr-beir.beir_scidocs_test
beir_scidocs_test
BEIR SCIDOCS test split
Field
Value
Benchmark
beir
Sub-benchmark
scidocs
Type
retrieval
Items
1000
Exported from Langfuse.
blockrank-beir-evals
ICR-BEIR-Evals: In-Context Ranking Evaluation Dataset
Dataset Description
ICR-BEIR-Evals is a curated evaluation dataset for In-Context Ranking (ICR) models, derived from the BEIR benchmark. This dataset is specifically designed to evaluate the effectiveness of generative language models on document ranking tasks where queries and candidate documents are provided in-context.
The dataset contains 28,759 queries across 11 diverse BEIR datasets, with each query paired with… See the full description on the dataset page: https://huggingface.co/datasets/quicktensor/blockrank-beir-evals.beir_nfcorpus_train
beir_nfcorpus_train
BEIR NFCorpus train split
Field
Value
Benchmark
beir
Sub-benchmark
nfcorpus
Type
retrieval
Items
2590
Exported from Langfuse.
beir_cqadupstack_mathematica_test
beir_cqadupstack_mathematica_test
BEIR CQADupStack/mathematica test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_mathematica
Type
retrieval
Items
804
Exported from Langfuse.
beir_quora_dev
beir_quora_dev
BEIR Quora dev split
Field
Value
Benchmark
beir
Sub-benchmark
quora
Type
retrieval
Items
5000
Exported from Langfuse.
beir_fever_test
beir_fever_test
BEIR FEVER test split
Field
Value
Benchmark
beir
Sub-benchmark
fever
Type
retrieval
Items
6666
Exported from Langfuse.
beir_cqadupstack_android_test
beir_cqadupstack_android_test
BEIR CQADupStack/android test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_android
Type
retrieval
Items
699
Exported from Langfuse.
beir_cqadupstack_programmers_test
beir_cqadupstack_programmers_test
BEIR CQADupStack/programmers test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_programmers
Type
retrieval
Items
876
Exported from Langfuse.
beir_cqadupstack_english_test
beir_cqadupstack_english_test
BEIR CQADupStack/english test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_english
Type
retrieval
Items
1570
Exported from Langfuse.
beir_cqadupstack_stats_test
beir_cqadupstack_stats_test
BEIR CQADupStack/stats test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_stats
Type
retrieval
Items
652
Exported from Langfuse.
beir_fever_dev
beir_fever_dev
BEIR FEVER dev split
Field
Value
Benchmark
beir
Sub-benchmark
fever
Type
retrieval
Items
6666
Exported from Langfuse.
beir_cqadupstack_gaming_test
beir_cqadupstack_gaming_test
BEIR CQADupStack/gaming test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_gaming
Type
retrieval
Items
1595
Exported from Langfuse.
beir_cqadupstack_tex_test
beir_cqadupstack_tex_test
BEIR CQADupStack/tex test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_tex
Type
retrieval
Items
2906
Exported from Langfuse.
beir_nq_test
beir_nq_test
BEIR NQ test split
Field
Value
Benchmark
beir
Sub-benchmark
nq
Type
retrieval
Items
3452
Exported from Langfuse.
beir_cqadupstack_webmasters_test
beir_cqadupstack_webmasters_test
BEIR CQADupStack/webmasters test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_webmasters
Type
retrieval
Items
506
Exported from Langfuse.
beir_hotpotqa_dev
beir_hotpotqa_dev
BEIR HotpotQA dev split
Field
Value
Benchmark
beir
Sub-benchmark
hotpotqa
Type
retrieval
Items
5447
Exported from Langfuse.
beir_dbpedia_entity_test
beir_dbpedia_entity_test
BEIR DBPedia-Entity test split
Field
Value
Benchmark
beir
Sub-benchmark
dbpedia_entity
Type
retrieval
Items
400
Exported from Langfuse.
beir_quora_test
beir_quora_test
BEIR Quora test split
Field
Value
Benchmark
beir
Sub-benchmark
quora
Type
retrieval
Items
10000
Exported from Langfuse.
beir_cqadupstack_gis_test
beir_cqadupstack_gis_test
BEIR CQADupStack/gis test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_gis
Type
retrieval
Items
885
Exported from Langfuse.
beir_cqadupstack_physics_test
beir_cqadupstack_physics_test
BEIR CQADupStack/physics test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_physics
Type
retrieval
Items
1039
Exported from Langfuse.
beir_cqadupstack_unix_test
beir_cqadupstack_unix_test
BEIR CQADupStack/unix test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_unix
Type
retrieval
Items
1072
Exported from Langfuse.
beir_trec_covid_test
beir_trec_covid_test
BEIR TREC-COVID test split
Field
Value
Benchmark
beir
Sub-benchmark
trec_covid
Type
retrieval
Items
50
Exported from Langfuse.
beir_climate_fever_test
beir_climate_fever_test
BEIR Climate-FEVER test split
Field
Value
Benchmark
beir
Sub-benchmark
climate_fever
Type
retrieval
Items
1535
Exported from Langfuse.
beir_fever_train
beir_fever_train
BEIR FEVER train split
Field
Value
Benchmark
beir
Sub-benchmark
fever
Type
retrieval
Items
109810
Exported from Langfuse.
beir_hotpotqa_test
beir_hotpotqa_test
BEIR HotpotQA test split
Field
Value
Benchmark
beir
Sub-benchmark
hotpotqa
Type
retrieval
Items
7405
Exported from Langfuse.
beir_scifact_train
beir_scifact_train
BEIR SciFact train split
Field
Value
Benchmark
beir
Sub-benchmark
scifact
Type
retrieval
Items
809
Exported from Langfuse.
beir_fiqa_dev
beir_fiqa_dev
BEIR FiQA dev split
Field
Value
Benchmark
beir
Sub-benchmark
fiqa
Type
retrieval
Items
500
Exported from Langfuse.
beir_hotpotqa_train
beir_hotpotqa_train
BEIR HotpotQA train split
Field
Value
Benchmark
beir
Sub-benchmark
hotpotqa
Type
retrieval
Items
85000
Exported from Langfuse.
beir_nfcorpus_dev
beir_nfcorpus_dev
BEIR NFCorpus dev split
Field
Value
Benchmark
beir
Sub-benchmark
nfcorpus
Type
retrieval
Items
324
Exported from Langfuse.
