Datasetpublic

TiannuoYang/hnsw_index

This is the vector index file of our paper SearchAgent-X. It contains a HNSW-based index file of approxiamte nearest neighbor search built for Wikipedia English corpus. Details of this dataset: Chunked Text: wiki-18-corpus Embedding Model: all-MiniLM-L6-v2 HNSW Implementation Base: HNSWLib Indexing Params: 32 neighbors per node (i.e., M) candidate list of 500 (i.e., efConstruction) DIY: How to Encode and Index Your Own Corpus?😄 Follow our github instructions and code here

sourceHugging Facemitupdated 1y agoView on Hugging Face

1likes15downloads

Dataset Card

This is the vector index file of our paper SearchAgent-X. It contains a HNSW-based index file of approxiamte nearest neighbor search built for Wikipedia English corpus.

Details of this dataset:

—Chunked Text: wiki-18-corpus
—Embedding Model: all-MiniLM-L6-v2
—HNSW Implementation Base: HNSWLib
—Indexing Params:
—32 neighbors per node (i.e., M)
—candidate list of 500 (i.e., efConstruction)

DIY: How to Encode and Index Your Own Corpus? 😄 Follow our github instructions and code here