CoolFace
Datasetpublic

Pika4028/low-resource-rag-indexes

Low-Resource RAG: Wikipedia FAISS Indexes (BGE-M3) FAISS indexes over Wikipedia 2023 passages for four languages, embedded with BAAI/bge-m3. Source corpus: CohereLabs/wikipedia-2023-11-embed-multilingual-v3. Each language folder has two files aligned row-by-row: index.faiss — FAISS IndexFlatIP, dim=1024, L2-normalized BGE-M3 vectors dataset/ — Arrow dataset with _id, title, text per passage Languages Language Code Passages Size Hindi hi TBD 2.6G… See the full description on the dataset page: https://huggingface.co/datasets/Pika4028/low-resource-rag-indexes.

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes121downloads
15 commits on main
4ef25f14mo ago

Add BGE-M3 indexes for Bengali, Gujarati, Urdu, Santali, Tamil, Telugu, Kannada, Malayalam, Punjabi, and Assamese

Pika4028
9b442a24mo ago

Add BGE-M3 index for as

Pika4028
d3a07864mo ago

Add BGE-M3 index for pa

Pika4028
993c97c4mo ago

Add BGE-M3 index for ml

Pika4028
3fd6e664mo ago

Add BGE-M3 index for kn

Pika4028
b4461004mo ago

Add BGE-M3 index for te

Pika4028
a4cc23e4mo ago

Add BGE-M3 index for ta

Pika4028
784da834mo ago

Add BGE-M3 index for sat

Pika4028
2fd26064mo ago

Add BGE-M3 index for ur

Pika4028
0b5db2f4mo ago

Add BGE-M3 index for gu

Pika4028
cbd68064mo ago

Add BGE-M3 index for bn

Pika4028
37063a04mo ago

Rename dataset_card.md to README.md

Pika4028
84a296e4mo ago

Upload dataset_card.md with huggingface_hub

Pika4028
802c8d94mo ago

Add files using upload-large-folder tool

Pika4028
7bfa8ad4mo ago

initial commit

Pika4028