nleroy917/fineweb-bge-large-en-v1.5
Work in progress. Coverage is partial — additional CommonCrawl dumps are being embedded and uploaded incrementally. FineWeb — BGE-Large-EN-v1.5 + BM25 (Pre-embedded) Pre-computed dense and sparse embeddings for the FineWeb web corpus, ready for direct ingestion into a vector database (e.g. Qdrant). Source dataset FineWeb is a 15-trillion-token English web dataset derived from 96 CommonCrawl snapshots spanning Summer 2013 through June 2025. It was produced by… See the full description on the dataset page: https://huggingface.co/datasets/nleroy917/fineweb-bge-large-en-v1.5.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face