Datasetpublic

pyterrier/trec-covid.pisa

trec-covid.pisa Description A PISA Index for CORD19 (the corpus for the TREC-COVID query set) Usage # Load the artifact import pyterrier as pt index = pt.Artifact.from_hf('pyterrier/trec-covid.pisa') index.bm25() # returns a BM25 retriever Benchmarks name nDCG@10 R@1000 bm25 0.6254 0.4462 dph 0.6633 0.4136 Reproduction import pyterrier as pt from tqdm import tqdm import ir_datasets from pyterrier_pisa… See the full description on the dataset page: https://huggingface.co/datasets/pyterrier/trec-covid.pisa.

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes28downloads

Dataset Card

trec-covid.pisa

Description

A PISA Index for CORD19 (the corpus for the TREC-COVID query set)

Usage

python

# Load the artifact
import pyterrier as pt
index = pt.Artifact.from_hf('pyterrier/trec-covid.pisa')
index.bm25() # returns a BM25 retriever

Benchmarks

name	nDCG@10	R@1000
bm25	0.6254	0.4462
dph	0.6633	0.4136

Reproduction

python

import pyterrier as pt
from tqdm import tqdm
import ir_datasets
from pyterrier_pisa import PisaIndex
index = PisaIndex("trec-covid.pisa", threads=16)
dataset = ir_datasets.load('beir/trec-covid')
docs = ({'docno': d.doc_id, 'text': d.default_text()} for d in tqdm(dataset.docs))
index.index(docs)

Metadata

{
  "type": "sparse_index",
  "format": "pisa",
  "package_hint": "pyterrier-pisa",
  "stemmer": "porter2"
}