CoolFace
Datasetpublic

DataHound26/FineWeb-2021

FineWeb-Edu 2021 — Cleaned and Shuffled This dataset is a year-specific, cleaned, shuffled, and sharded release derived from HuggingFaceFW/fineweb-edu. It contains English educational web text collected in Common Crawl snapshots whose dump identifier belongs to 2021. This is not a news-only dataset. The year refers to the Common Crawl capture year, not necessarily the page's publication year. Dataset summary Item Value Year 2021 Rows 139,636,993… See the full description on the dataset page: https://huggingface.co/datasets/DataHound26/FineWeb-2021.

sourceHugging Faceodc-byupdated 7d agoView on Hugging Face
0likes526downloads
2 commits on main
706f3987d ago

Add dataset card documenting the 2021 cleaning pipeline (#1)

CarolynJiang
81f2fb815d ago

Duplicate from Yahoo-Finance-News/FineWeb-2021

CarolynJiang