epfml/FineWeb2-HQ
FineWeb2-HQ Dataset summary FineWeb2-HQ is a high-quality, model-filtered pretraining dataset derived as a subset of FineWeb2, spanning 20 languages. It enables around 6x faster pretraining compared to the base dataset. FineWeb2-HQ was created by selecting the top 10% quality documents of FineWeb2 in each language, based on scores assigned by a deep learning classifier trained to identify structured and knowledge-rich samples using XLM-RoBERTa embeddings.… See the full description on the dataset page: https://huggingface.co/datasets/epfml/FineWeb2-HQ.
8129k
../
000_00000.parquetdownload
000_00001.parquetdownload
000_00002.parquetdownload
000_00003.parquetdownload
000_00004.parquetdownload
000_00005.parquetdownload
000_00006.parquetdownload
000_00007.parquetdownload
000_00008.parquetdownload
000_00009.parquetdownload
000_00010.parquetdownload
000_00011.parquetdownload
000_00012.parquetdownload
000_00013.parquetdownload
000_00014.parquetdownload
000_00015.parquetdownload
000_00016.parquetdownload
000_00017.parquetdownload
000_00018.parquetdownload
000_00019.parquetdownload
000_00020.parquetdownload
000_00021.parquetdownload
000_00022.parquetdownload
000_00023.parquetdownload
000_00024.parquetdownload
000_00025.parquetdownload
000_00026.parquetdownload
000_00027.parquetdownload
000_00028.parquetdownload
000_00029.parquetdownload
000_00030.parquetdownload
000_00031.parquetdownload
000_00032.parquetdownload
000_00033.parquetdownload
000_00034.parquetdownload
000_00035.parquetdownload
000_00036.parquetdownload
000_00037.parquetdownload
000_00038.parquetdownload
000_00039.parquetdownload
000_00040.parquetdownload
000_00041.parquetdownload
000_00042.parquetdownload
000_00043.parquetdownload
000_00044.parquetdownload
000_00045.parquetdownload
000_00046.parquetdownload
000_00047.parquetdownload
000_00048.parquetdownload
000_00049.parquetdownload
000_00050.parquetdownload
000_00051.parquetdownload
000_00052.parquetdownload
000_00053.parquetdownload
000_00054.parquetdownload
000_00055.parquetdownload
000_00056.parquetdownload
000_00057.parquetdownload
000_00058.parquetdownload
000_00059.parquetdownload
000_00060.parquetdownload
000_00061.parquetdownload
000_00062.parquetdownload
000_00063.parquetdownload
000_00064.parquetdownload
000_00065.parquetdownload
000_00066.parquetdownload
000_00067.parquetdownload
000_00068.parquetdownload
000_00069.parquetdownload
000_00070.parquetdownload
000_00071.parquetdownload
000_00072.parquetdownload
000_00073.parquetdownload
000_00074.parquetdownload
000_00075.parquetdownload
000_00076.parquetdownload
000_00077.parquetdownload
000_00078.parquetdownload
000_00079.parquetdownload
000_00080.parquetdownload
000_00081.parquetdownload
000_00082.parquetdownload
000_00083.parquetdownload
000_00084.parquetdownload
000_00085.parquetdownload
000_00086.parquetdownload
000_00087.parquetdownload
000_00088.parquetdownload
000_00089.parquetdownload
000_00090.parquetdownload
000_00091.parquetdownload
000_00092.parquetdownload
000_00093.parquetdownload
000_00094.parquetdownload
000_00095.parquetdownload
000_00096.parquetdownload
000_00097.parquetdownload
000_00098.parquetdownload
000_00099.parquetdownload
000_00100.parquetdownload
000_00101.parquetdownload
000_00102.parquetdownload
000_00103.parquetdownload
000_00104.parquetdownload
000_00105.parquetdownload
000_00106.parquetdownload
000_00107.parquetdownload
000_00108.parquetdownload
000_00109.parquetdownload
000_00110.parquetdownload
000_00111.parquetdownload
000_00112.parquetdownload
000_00113.parquetdownload
000_00114.parquetdownload
000_00115.parquetdownload
000_00116.parquetdownload
000_00117.parquetdownload
000_00118.parquetdownload
000_00119.parquetdownload
000_00120.parquetdownload
000_00121.parquetdownload
000_00122.parquetdownload
000_00123.parquetdownload
000_00124.parquetdownload
000_00125.parquetdownload
000_00126.parquetdownload
000_00127.parquetdownload
000_00128.parquetdownload
000_00129.parquetdownload
000_00130.parquetdownload
000_00131.parquetdownload
000_00132.parquetdownload
000_00133.parquetdownload
000_00134.parquetdownload
000_00135.parquetdownload
000_00136.parquetdownload
000_00137.parquetdownload
000_00138.parquetdownload
000_00139.parquetdownload
000_00140.parquetdownload
000_00141.parquetdownload
000_00142.parquetdownload
000_00143.parquetdownload
000_00144.parquetdownload
000_00145.parquetdownload
000_00146.parquetdownload
000_00147.parquetdownload
000_00148.parquetdownload
000_00149.parquetdownload
000_00150.parquetdownload
000_00151.parquetdownload
000_00152.parquetdownload
000_00153.parquetdownload
000_00154.parquetdownload
000_00155.parquetdownload
000_00156.parquetdownload
000_00157.parquetdownload
000_00158.parquetdownload
000_00159.parquetdownload
000_00160.parquetdownload
000_00161.parquetdownload
000_00162.parquetdownload
000_00163.parquetdownload
000_00164.parquetdownload
000_00165.parquetdownload
000_00166.parquetdownload
000_00167.parquetdownload
000_00168.parquetdownload
000_00169.parquetdownload
000_00170.parquetdownload
000_00171.parquetdownload
000_00172.parquetdownload
000_00173.parquetdownload
000_00174.parquetdownload
000_00175.parquetdownload