nleroy917/fineweb-bge-large-en-v1.5
Work in progress. Coverage is partial — additional CommonCrawl dumps are being embedded and uploaded incrementally. FineWeb — BGE-Large-EN-v1.5 + BM25 (Pre-embedded) Pre-computed dense and sparse embeddings for the FineWeb web corpus, ready for direct ingestion into a vector database (e.g. Qdrant). Source dataset FineWeb is a 15-trillion-token English web dataset derived from 96 CommonCrawl snapshots spanning Summer 2013 through June 2025. It was produced by… See the full description on the dataset page: https://huggingface.co/datasets/nleroy917/fineweb-bge-large-en-v1.5.
Create README.md
Add 10 files (batch 1)
Add 10 files (batch 1)
Add 10 files (batch 2)
Add 10 files (batch 1)
Add 10 files (batch 1)
Add rank08/batch_00000002.parquet
Add rank11/batch_00000007.parquet
Add rank16/batch_00000006.parquet
Add rank11/batch_00000011.parquet
Add rank14/batch_00000016.parquet
Add rank15/batch_00000017.parquet
Add rank14/batch_00000008.parquet
Add rank11/batch_00000005.parquet
Add rank12/batch_00000016.parquet
Add rank12/batch_00000005.parquet
Add rank15/batch_00000014.parquet
Add rank07/batch_00000010.parquet
Add rank14/batch_00000006.parquet
Add rank13/batch_00000016.parquet
Add rank10/batch_00000013.parquet
Add rank11/batch_00000013.parquet
Add rank10/batch_00000015.parquet
Add rank14/batch_00000012.parquet
Add rank10/batch_00000009.parquet
Add rank14/batch_00000015.parquet
Add rank11/batch_00000014.parquet
Add rank13/batch_00000004.parquet
Add rank13/batch_00000006.parquet
Add rank10/batch_00000011.parquet
Add rank14/batch_00000005.parquet
Add rank06/batch_00000008.parquet
Add rank13/batch_00000010.parquet
Add rank10/batch_00000003.parquet
Add rank12/batch_00000012.parquet
Add rank09/batch_00000007.parquet
Add rank12/batch_00000014.parquet
Add rank10/batch_00000005.parquet
Add rank10/batch_00000001.parquet
Add rank10/batch_00000012.parquet
Add rank13/batch_00000013.parquet
Add rank13/batch_00000000.parquet
Add rank12/batch_00000002.parquet
Add rank05/batch_00000016.parquet
Add rank12/batch_00000004.parquet
Add rank09/batch_00000009.parquet
Add rank13/batch_00000003.parquet
Add rank09/batch_00000001.parquet
Add rank08/batch_00000015.parquet
Add rank11/batch_00000016.parquet