cqadupstack_programmers
cqadupstack-programmers
CQADupstackProgrammersRetrieval
An MTEB dataset
Massive Text Embedding Benchmark
CQADupStack: A Benchmark Data Set for Community Question-Answering Research
Task category
t2t
Domains
Programming, Written, Non-fiction
Referencehttp://nlp.cis.unimelb.edu.au/resources/cqadupstack/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/cqadupstack-programmers.cqadupstack-programmers-vn
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstackProgrammers-VN"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)
evaluator.run(model)
To learn more about how to run models on mteb task check out the GitHub repitory.
Citation
If you use this dataset, please cite the dataset as well as mteb, as this dataset likely includes additional processing… See the full description on the dataset page: https://huggingface.co/datasets/GreenNode/cqadupstack-programmers-vn.cqadupstack-programmers-vn-rawCQADupstack-Programmers-PL
CQADupstack-Programmers-PL
An MTEB dataset
Massive Text Embedding Benchmark
CQADupStack: A Stack Exchange Question Duplicate Pairs Dataset
Task category
t2t
Domains
Programming, Written, Non-fiction
Reference
https://huggingface.co/datasets/clarin-knext/cqadupstack-programmers-pl
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["CQADupstack-Programmers-PL"])… See the full description on the dataset page: https://huggingface.co/datasets/mteb/CQADupstack-Programmers-PL.cqadupstack-programmers-top-20-gen-queries
NFCorpus: 20 generated queries (BEIR Benchmark)
This HF dataset contains the top-20 synthetic queries generated for each passage in the above BEIR benchmark dataset.
DocT5query model used: BeIR/query-gen-msmarco-t5-base-v1
id (str): unique document id in NFCorpus in the BEIR benchmark (corpus.jsonl).
Questions generated: 20
Code used for generation: evaluate_anserini_docT5query_parallel.py
Below contains the old dataset card for the BEIR benchmark.
Dataset Card for BEIR… See the full description on the dataset page: https://huggingface.co/datasets/income/cqadupstack-programmers-top-20-gen-queries.beir-cqadupstack-programmers
CQADupstackProgrammersRetrieval — BEIR, unified schema
A normalised copy of the dataset behind the mteb task CQADupstackProgrammersRetrieval, one of the tasks of the BEIR benchmark as mteb defines it (a member of the aggregate task CQADupstackRetrieval). Same queries, documents
and relevance judgements as the benchmark evaluates — reshaped into one strict schema shared by every dataset
in this collection.
Source
mteb/cqadupstack-programmers @ 6184bc1440d2 (the… See the full description on the dataset page: https://huggingface.co/datasets/Hyukkyu/beir-cqadupstack-programmers.