javiersgjavi/fineweb-1BT

FineWeb-1BT: 1 Billion Token Subset Dataset Description FineWeb-1BT is a carefully curated 1 billion token subset of the HuggingFaceFW/fineweb dataset, sampled exclusively from the official 10BT FineWeb subset. It was created using true random sampling to ensure unbiased representation across the entire 10BT corpus. Provenance: This 1BT subset is a uniform sample drawn from the official FineWeb 10BT split (not from the full raw stream), preserving its… See the full description on the dataset page: https://huggingface.co/datasets/javiersgjavi/fineweb-1BT.