quora
Datasets
All datasets matching “quora”quora
QuoraRetrieval
An MTEB dataset
Massive Text Embedding Benchmark
QuoraRetrieval is based on questions that are marked as duplicates on the Quora platform. Given a question, find other (duplicate) questions.
Task category
t2t
Domains
Written, Web, Blog
Reference
https://quoradata.quora.com/First-Quora-Dataset-Release-Question-Pairs
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/quora.quora
Dataset Card for "quora"
Dataset Summary
The Quora dataset is composed of question pairs, and the task is to determine if the questions are paraphrases of each other (have the same meaning).
Supported Tasks and Leaderboards
More Information Needed
Languages
More Information Needed
Dataset Structure
Data Instances
default
Size of downloaded dataset files: 58.17 MB
Size of the generated dataset: 58.15 MB
Total amount… See the full description on the dataset page: https://huggingface.co/datasets/quora-competitions/quora.quora
Dataset Card for BEIR Benchmark
quora is one of the datasets from the Duplicate Question Retrieval task within BEIR, measuring duplicate query retrieval for a given query.
NOTE: ArguAna has queries also incorporated within the corpus, so you should remove the same query_id if present within the corpus during inference (implemented in BEIR)
Dataset Summary
BEIR is a heterogeneous benchmark built from 18 diverse datasets representing 9 information retrieval tasks.… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/quora.quora-duplicates
Dataset Card for Quora Duplicate Questions
This dataset contains the Quora Question Pairs dataset in four formats that are easily used with Sentence Transformers to train embedding models. The data was originally created by Quora for this Kaggle Competition.
Dataset Subsets
pair-class subset
Columns: "sentence1", "sentence2", "label"
Column types: str, str, class with {"0": "different", "1": "duplicate"}
Examples:{
'sentence1': 'What is the step… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/quora-duplicates.quora-qrels
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/quora-qrels.quora-decontaminated
quora (Decontaminated)
A decontaminated version of the quora dataset from the BEIR benchmark, with samples found in the mgte-en pre-training dataset removed.
Decontamination methodology
Contamination was detected using a two-pass approach against the full mgte-en dataset (484 GB, 1,235 parquet files):
Pass 1: Exact hash matching
All texts (queries and corpus documents) were normalized (lowercased, unicode NFKD, whitespace collapsed) and hashed with xxHash-64.… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/quora-decontaminated.