Sicheng-Chroma/wikipedia-en-splade-bge

Wikipedia English with SPLADE and BGE-M3 Pre-computed SPLADE sparse and BGE-M3 dense embeddings for 6.4M English Wikipedia articles. Direct Usage HuggingFace automatically discovers parquet files. You can load this dataset directly: from datasets import load_dataset # Stream the entire dataset (recommended for large dataset) dataset = load_dataset("Sicheng-Chroma/wikipedia-en-splade-bge", streaming=True) # Load specific splits train_dataset =… See the full description on the dataset page: https://huggingface.co/datasets/Sicheng-Chroma/wikipedia-en-splade-bge.