Datasetpublic

Comet/wikipedia-2017-bm25

Wikipedia 2017 BM25 Search Index This dataset provides a production-ready BM25 search index over 5.2 million Wikipedia article abstracts from the 2017 snapshot. Built using the bm25s library with English stemming and optimized Parquet compression, it enables fast, offline information retrieval for research and production AI systems. The corpus is identical to the one used in influential AI research papers including DSPy and GEPA, ensuring reproducible benchmarking and fair… See the full description on the dataset page: https://huggingface.co/datasets/Comet/wikipedia-2017-bm25.

sourceHugging Facecc-by-sa-3.0updated 10mo agoView on Hugging Face

1likes338downloads

settings

This repository belongs to Comet on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namewikipedia-2017-bm25

visibilitypublic

licencecc-by-sa-3.0

gatedno

ownerComet

Account settings