HuggingFaceFW/fineweb
🍷 FineWeb 15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tokens (originally 15T tokens) of cleaned and deduplicated english web data from CommonCrawl. The data processing pipeline is optimized for LLM performance and ran on the 🏭 datatrove library, our large scale data processing library. 🍷 FineWeb was originally meant to be a fully open replication of 🦅 RefinedWeb, with a… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/fineweb.
3.4k389k
../
000_00000.parquetdownload
000_00001.parquetdownload
000_00002.parquetdownload
000_00003.parquetdownload
000_00004.parquetdownload
000_00005.parquetdownload
000_00006.parquetdownload
000_00007.parquetdownload
000_00008.parquetdownload
000_00009.parquetdownload
000_00010.parquetdownload
000_00011.parquetdownload
000_00012.parquetdownload
000_00013.parquetdownload
000_00014.parquetdownload
000_00015.parquetdownload
000_00016.parquetdownload
000_00017.parquetdownload
000_00018.parquetdownload
000_00019.parquetdownload
000_00020.parquetdownload
000_00021.parquetdownload
000_00022.parquetdownload
000_00023.parquetdownload
000_00024.parquetdownload
000_00025.parquetdownload
000_00026.parquetdownload
000_00027.parquetdownload
000_00028.parquetdownload
000_00029.parquetdownload
000_00030.parquetdownload
000_00031.parquetdownload
000_00032.parquetdownload
000_00033.parquetdownload
000_00034.parquetdownload
000_00035.parquetdownload
000_00036.parquetdownload
000_00037.parquetdownload
000_00038.parquetdownload
000_00039.parquetdownload
000_00040.parquetdownload
000_00041.parquetdownload
000_00042.parquetdownload
000_00043.parquetdownload
000_00044.parquetdownload
000_00045.parquetdownload
000_00046.parquetdownload
000_00047.parquetdownload
000_00048.parquetdownload
000_00049.parquetdownload
001_00000.parquetdownload
001_00001.parquetdownload
001_00002.parquetdownload
001_00003.parquetdownload
001_00004.parquetdownload
001_00005.parquetdownload
001_00006.parquetdownload
001_00007.parquetdownload
001_00008.parquetdownload
001_00009.parquetdownload
001_00010.parquetdownload
001_00011.parquetdownload
001_00012.parquetdownload
001_00013.parquetdownload
001_00014.parquetdownload
001_00015.parquetdownload
001_00016.parquetdownload
001_00017.parquetdownload
001_00018.parquetdownload
001_00019.parquetdownload
001_00020.parquetdownload
001_00021.parquetdownload
001_00022.parquetdownload
001_00023.parquetdownload
001_00024.parquetdownload
001_00025.parquetdownload
001_00026.parquetdownload
001_00027.parquetdownload
001_00028.parquetdownload
001_00029.parquetdownload
001_00030.parquetdownload
001_00031.parquetdownload
001_00032.parquetdownload
001_00033.parquetdownload
001_00034.parquetdownload
001_00035.parquetdownload
001_00036.parquetdownload
001_00037.parquetdownload
001_00038.parquetdownload
001_00039.parquetdownload
001_00040.parquetdownload
001_00041.parquetdownload
001_00042.parquetdownload
001_00043.parquetdownload
001_00044.parquetdownload
001_00045.parquetdownload
001_00046.parquetdownload
001_00047.parquetdownload
001_00048.parquetdownload
001_00049.parquetdownload
002_00000.parquetdownload
002_00001.parquetdownload
002_00002.parquetdownload
002_00003.parquetdownload
002_00004.parquetdownload
002_00005.parquetdownload
002_00006.parquetdownload
002_00007.parquetdownload
002_00008.parquetdownload
002_00009.parquetdownload
002_00010.parquetdownload
002_00011.parquetdownload
002_00012.parquetdownload
002_00013.parquetdownload
002_00014.parquetdownload
002_00015.parquetdownload
002_00016.parquetdownload
002_00017.parquetdownload
002_00018.parquetdownload
002_00019.parquetdownload
002_00020.parquetdownload
002_00021.parquetdownload
002_00022.parquetdownload
002_00023.parquetdownload
002_00024.parquetdownload
002_00025.parquetdownload
002_00026.parquetdownload
002_00027.parquetdownload
002_00028.parquetdownload
002_00029.parquetdownload
002_00030.parquetdownload
002_00031.parquetdownload
002_00032.parquetdownload
002_00033.parquetdownload
002_00034.parquetdownload
002_00035.parquetdownload
002_00036.parquetdownload
002_00037.parquetdownload
002_00038.parquetdownload
002_00039.parquetdownload
002_00040.parquetdownload
002_00041.parquetdownload
002_00042.parquetdownload
002_00043.parquetdownload
002_00044.parquetdownload
002_00045.parquetdownload
002_00046.parquetdownload
002_00047.parquetdownload
002_00048.parquetdownload
002_00049.parquetdownload
003_00000.parquetdownload
003_00001.parquetdownload
003_00002.parquetdownload
003_00003.parquetdownload
003_00004.parquetdownload
003_00005.parquetdownload
003_00006.parquetdownload
003_00007.parquetdownload
003_00008.parquetdownload
003_00009.parquetdownload
003_00010.parquetdownload
003_00011.parquetdownload
003_00012.parquetdownload
003_00013.parquetdownload
003_00014.parquetdownload
003_00015.parquetdownload
003_00016.parquetdownload
003_00017.parquetdownload
003_00018.parquetdownload
003_00019.parquetdownload
003_00020.parquetdownload
003_00021.parquetdownload
003_00022.parquetdownload
003_00023.parquetdownload
003_00024.parquetdownload
003_00025.parquetdownload
003_00026.parquetdownload
003_00027.parquetdownload
003_00028.parquetdownload
003_00029.parquetdownload
003_00030.parquetdownload
003_00031.parquetdownload
003_00032.parquetdownload
003_00033.parquetdownload
003_00034.parquetdownload
003_00035.parquetdownload
003_00036.parquetdownload
003_00037.parquetdownload
003_00038.parquetdownload
003_00039.parquetdownload
003_00040.parquetdownload
003_00041.parquetdownload
003_00042.parquetdownload
003_00043.parquetdownload
003_00044.parquetdownload
003_00045.parquetdownload
003_00046.parquetdownload
003_00047.parquetdownload
003_00048.parquetdownload
003_00049.parquetdownload
004_00000.parquetdownload