DataHound26/FineWeb-2021
FineWeb-Edu 2021 — Cleaned and Shuffled This dataset is a year-specific, cleaned, shuffled, and sharded release derived from HuggingFaceFW/fineweb-edu. It contains English educational web text collected in Common Crawl snapshots whose dump identifier belongs to 2021. This is not a news-only dataset. The year refers to the Common Crawl capture year, not necessarily the page's publication year. Dataset summary Item Value Year 2021 Rows 139,636,993… See the full description on the dataset page: https://huggingface.co/datasets/DataHound26/FineWeb-2021.
0526
Add dataset card documenting the 2021 cleaning pipeline (#1)
Duplicate from Yahoo-Finance-News/FineWeb-2021
