Datasetpublic

Loctran123/vietnamese-evidence-retrieval-indexes-v2-r1

Vietnamese Evidence Retrieval Indexes Prebuilt exact dense and sparse indexes for Loctran123/vietnamese-evidence-corpus-embeddings-e5-large-v2-r1 at revision 2a18d35b6ea2e078db95c1aacdc2a28947268b4e. Rows: 63,699 Source embedding shards: 13 Dense: FAISS IndexFlatIP, 1024 dimensions Sparse: BM25S Lucene BM25 (k1=1.5, b=0.75) BM25 content: title repeated 2 times + chunk text Dense input: title + text Dense rows: deduplicated by content hash Vietnamese tokenization: Unicode word… See the full description on the dataset page: https://huggingface.co/datasets/Loctran123/vietnamese-evidence-retrieval-indexes-v2-r1.

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes51downloads

Dataset Card

Vietnamese Evidence Retrieval Indexes

Prebuilt exact dense and sparse indexes for Loctran123/vietnamese-evidence-corpus-embeddings-e5-large-v2-r1 at revision 2a18d35b6ea2e078db95c1aacdc2a28947268b4e.

—Rows: 63,699
—Source embedding shards: 13
—Dense: FAISS IndexFlatIP, 1024 dimensions
—Sparse: BM25S Lucene BM25 (k1=1.5, b=0.75)
—BM25 content: title repeated 2 times + chunk text
—Dense input: title + text
—Dense rows: deduplicated by content hash
—Vietnamese tokenization: Unicode word tokens, no stemming and no stopword removal

row_id in metadata.parquet is the shared positional identifier for both indexes. Use the project retrieval/hybrid_retriever.py to query safely.