javiersgjavi/fineweb-1BT
FineWeb-1BT: 1 Billion Token Subset Dataset Description FineWeb-1BT is a carefully curated 1 billion token subset of the HuggingFaceFW/fineweb dataset, sampled exclusively from the official 10BT FineWeb subset. It was created using true random sampling to ensure unbiased representation across the entire 10BT corpus. Provenance: This 1BT subset is a uniform sample drawn from the official FineWeb 10BT split (not from the full raw stream), preserving its… See the full description on the dataset page: https://huggingface.co/datasets/javiersgjavi/fineweb-1BT.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face