Datasetpublic

Odeinjul/tti-100m-static-search-eval

tti-100m-static-search-eval Static 100M search-evaluation dataset with original vectors, original query/ground-truth files, a rebuilt hnswlib HNSW index, and generated PQ artifacts. This Hugging Face copy provides the static-search-eval package for tti, including static artifacts and PQ artifacts. Files Base: base.fbin HNSW index: index_m_32_ef_500 Query: orig_query_100k.fbin Ground truth: groundtruth.bin PQ artifacts: pq_m50.pqcodes/.pqmeta/.pqcodebook… See the full description on the dataset page: https://huggingface.co/datasets/Odeinjul/tti-100m-static-search-eval.

sourceHugging Faceupdated 3h agoView on Hugging Face

0likes201downloads

Dataset Card

tti-100m-static-search-eval

Static 100M search-evaluation dataset with original vectors, original query/ground-truth files, a rebuilt hnswlib HNSW index, and generated PQ artifacts.

This Hugging Face copy provides the static-search-eval package for tti, including static artifacts and PQ artifacts.

Files

—Base: base.fbin
—HNSW index: index_m_32_ef_500
—Query: orig_query_100k.fbin
—Ground truth: groundtruth.bin
—PQ artifacts: pq_m50.pqcodes/.pqmeta/.pqcodebook, pq_m100.pqcodes/.pqmeta/.pqcodebook, pq_m200.pqcodes/.pqmeta/.pqcodebook
—Checksums: checksums.sha256

Dataset Properties

—Vector count: 100000000
—Dimension: 200
—Dtype: float32
—Metric: ip
—Query count label: 100k
—Query count: 100000

HNSW Index

—Parameters: M=32, ef_construction=500
—Primary search parameters: ef_search=150, k=10

Source

Original source terms apply. This copy is uploaded as a public Hugging Face dataset from the public Kaggle datasets listed above.

Attribution

The original Text-to-Image-1B vectors are credited to Yandex and were obtained from the Big ANN 2021 benchmark collection.

The original source data is subject to Creative Commons Attribution 4.0 International (CC BY 4.0); the original terms are reproduced in LICENSE.

We generated the indexes ourselves.