BoomQ/fineweb-edu-2016-qwen2
FineWeb-Edu 2016 / Qwen2 Completed 2016 crawl-year processing. Documents: 93,099,356. Actual recounted Qwen2 tokens: 99,541,846,844. Source: HuggingFaceFW/fineweb-edu, revision 87f09149ef4734204d70ed1d046ddc9ca3f2b8f9. The input inventory covers 9 crawl directories. date is the integer crawl year 2016, not an article publication date. Original text is preserved without cleaning, normalization, deduplication, truncation, or added formatting. Source token counts are not used.… See the full description on the dataset page: https://huggingface.co/datasets/BoomQ/fineweb-edu-2016-qwen2.
0110
