datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cqadupstack-stats
CQADupstackStatsRetrieval
An MTEB dataset
Massive Text Embedding Benchmark
CQADupStack: A Benchmark Data Set for Community Question-Answering Research
Task category
t2t
Domains
Written, Academic, Non-fiction
Referencehttp://nlp.cis.unimelb.edu.au/resources/cqadupstack/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstackStatsRetrieval"])
evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/cqadupstack-stats.CQADupstack-Stats-PL
CQADupstack-Stats-PL
An MTEB dataset
Massive Text Embedding Benchmark
CQADupStack: A Stack Exchange Question Duplicate Pairs Dataset
Task category
t2t
Domains
Written, Academic, Non-fiction
Reference
https://huggingface.co/datasets/clarin-knext/cqadupstack-stats-pl
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstack-Stats-PL"])
evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/CQADupstack-Stats-PL.cqadupstack-stats-vn
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstackStats-VN"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)
evaluator.run(model)
To learn more about how to run models on mteb task check out the GitHub repitory.
Citation
If you use this dataset, please cite the dataset as well as mteb, as this dataset likely includes additional processing as a… See the full description on the dataset page: https://huggingface.co/datasets/GreenNode/cqadupstack-stats-vn.beir-cqadupstack-stats
CQADupstackStatsRetrieval — BEIR, unified schema
A normalised copy of the dataset behind the mteb task CQADupstackStatsRetrieval, one of the tasks of the BEIR benchmark as mteb defines it (a member of the aggregate task CQADupstackRetrieval). Same queries, documents
and relevance judgements as the benchmark evaluates — reshaped into one strict schema shared by every dataset
in this collection.
Source
mteb/cqadupstack-stats @ 65ac3a16b8e9 (the revision pinned in… See the full description on the dataset page: https://huggingface.co/datasets/Hyukkyu/beir-cqadupstack-stats.cqadupstack-stats-fa
Dataset Summary
CQADupstack-stats-Fa is a Persian (Farsi) dataset developed for the Retrieval task, focusing on duplicate question detection in community question-answering (CQA) platforms. This dataset is a translated version of the "Cross Validated" (Stats) subforum from the English CQADupstack collection and is part of the FaMTEB benchmark under the BEIR-Fa suite.
Language(s): Persian (Farsi)
Task(s): Retrieval (Duplicate Question Retrieval)
Source: Translated from English… See the full description on the dataset page: https://huggingface.co/datasets/MCINext/cqadupstack-stats-fa.CQADupstackStatsRetrieval-Fa
CQADupstackStatsRetrieval-Fa
An MTEB dataset
Massive Text Embedding Benchmark
CQADupstackStatsRetrieval-Fa
Task category
t2t
Domains
Web
Reference
https://huggingface.co/datasets/MCINext/cqadupstack-stats-fa
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstackStatsRetrieval-Fa"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/CQADupstackStatsRetrieval-Fa.cqadupstack-stats-qrels
Dataset Card for "cqadupstack-stats-qrels"
More Information needed
beir_cqadupstack_stats_test
beir_cqadupstack_stats_test
BEIR CQADupStack/stats test split
Field
Value
Benchmark
beir
Sub-benchmark
cqadupstack_stats
Type
retrieval
Items
652
Exported from Langfuse.
CQADupstackStats-NLcqadupstack-stats-top-20-gen-queries
NFCorpus: 20 generated queries (BEIR Benchmark)
This HF dataset contains the top-20 synthetic queries generated for each passage in the above BEIR benchmark dataset.
DocT5query model used: BeIR/query-gen-msmarco-t5-base-v1
id (str): unique document id in NFCorpus in the BEIR benchmark (corpus.jsonl).
Questions generated: 20
Code used for generation: evaluate_anserini_docT5query_parallel.py
Below contains the old dataset card for the BEIR benchmark.
Dataset Card for BEIR… See the full description on the dataset page: https://huggingface.co/datasets/income/cqadupstack-stats-top-20-gen-queries.beir_cqadupstack_stats
BEIR CQADupStack Stats (orgrctera/beir_cqadupstack_stats)
Overview
This release packages CQADupStack / Stats from the BEIR (Benchmarking IR) benchmark as a table-oriented dataset for retrieval evaluation and tooling (e.g. Langfuse-exported runs). The Stats slice is one of the Stack Exchange–hosted sub-corpora in CQADupStack: questions and answers about statistics, probability, inference, experimental design, and statistical software (R, etc.), drawn from Cross Validated… See the full description on the dataset page: https://huggingface.co/datasets/orgrctera/beir_cqadupstack_stats.cqadupstack-stats
Dataset Card for "cqadupstack-stats"
More Information needed