Datasetpublic

pyterrier/trec-covid.retromae.flex

trec-covid.retromae.flex Description RetroMAE index for TREC-COVID Usage # Load the artifact import pyterrier_alpha as pta artifact = pta.Artifact.from_hf('pyterrier/trec-covid.retromae.flex') artifact.np_retriever() Benchmarks trec-covid name nDCG@10 R@1000 np (flat) 0.6486 0.3713 Reproduction import pyterrier as pt from tqdm import tqdm import ir_datasets from pyterrier_dr import FlexIndex, RetroMAE… See the full description on the dataset page: https://huggingface.co/datasets/pyterrier/trec-covid.retromae.flex.

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes28downloads

Dataset Card

trec-covid.retromae.flex

Description

RetroMAE index for TREC-COVID

Usage

python

# Load the artifact
import pyterrier_alpha as pta
artifact = pta.Artifact.from_hf('pyterrier/trec-covid.retromae.flex')
artifact.np_retriever()

Benchmarks

trec-covid

name	nDCG@10	R@1000
np (flat)	0.6486	0.3713

Reproduction

python

import pyterrier as pt
from tqdm import tqdm
import ir_datasets
from pyterrier_dr import FlexIndex, RetroMAE
pipeline = RetroMAE.msmarco_distill() >> FlexIndex("trec-covid.retromae.flex")
dataset = ir_datasets.load('beir/trec-covid')
docs = ({'docno': d.doc_id, 'text': d.default_text()} for d in tqdm(dataset.docs))
pipeline.index(docs)

Metadata

{
  "type": "dense_index",
  "format": "flex",
  "vec_size": 768,
  "doc_count": 171332
}