CoolFace
Datasetpublic

epfml/FineWeb2-HQ

FineWeb2-HQ Dataset summary FineWeb2-HQ is a high-quality, model-filtered pretraining dataset derived as a subset of FineWeb2, spanning 20 languages. It enables around 6x faster pretraining compared to the base dataset. FineWeb2-HQ was created by selecting the top 10% quality documents of FineWeb2 in each language, based on scores assigned by a deep learning classifier trained to identify structured and knowledge-rich samples using XLM-RoBERTa embeddings.… See the full description on the dataset page: https://huggingface.co/datasets/epfml/FineWeb2-HQ.

sourceHugging Faceodc-byupdated 2y agoView on Hugging Face
81likes29kdownloads
../
file000_00000.parquet1.52 GBdownload
file000_00001.parquet1.46 GBdownload
file000_00002.parquet1.42 GBdownload
file000_00003.parquet1.40 GBdownload
file000_00004.parquet1.37 GBdownload
file000_00005.parquet1.36 GBdownload
file000_00006.parquet1.33 GBdownload
file000_00007.parquet1.32 GBdownload
file000_00008.parquet1.30 GBdownload
file000_00009.parquet1.31 GBdownload
file000_00010.parquet1.29 GBdownload
file000_00011.parquet1.27 GBdownload
file000_00012.parquet1.28 GBdownload
file000_00013.parquet1.26 GBdownload
file000_00014.parquet1.24 GBdownload
file000_00015.parquet1.23 GBdownload
file000_00016.parquet1.23 GBdownload
file000_00017.parquet1.23 GBdownload
file000_00018.parquet1.20 GBdownload
file000_00019.parquet1.20 GBdownload
file000_00020.parquet1.21 GBdownload
file000_00021.parquet1.18 GBdownload
file000_00022.parquet1.18 GBdownload
file000_00023.parquet1.18 GBdownload
file000_00024.parquet1.17 GBdownload
file000_00025.parquet1.18 GBdownload
file000_00026.parquet1.15 GBdownload
file000_00027.parquet1.15 GBdownload
file000_00028.parquet1.15 GBdownload
file000_00029.parquet1.14 GBdownload
file000_00030.parquet1.14 GBdownload
file000_00031.parquet1.13 GBdownload
file000_00032.parquet1.13 GBdownload
file000_00033.parquet1.11 GBdownload
file000_00034.parquet1.12 GBdownload
file000_00035.parquet1.12 GBdownload
file000_00036.parquet1.09 GBdownload
file000_00037.parquet1.07 GBdownload
file000_00038.parquet1.09 GBdownload
file000_00039.parquet1.06 GBdownload
file000_00040.parquet1.05 GBdownload
file000_00041.parquet1.09 GBdownload
file000_00042.parquet1.10 GBdownload
file000_00043.parquet1.09 GBdownload
file000_00044.parquet1.08 GBdownload
file000_00045.parquet1.09 GBdownload
file000_00046.parquet1.09 GBdownload
file000_00047.parquet1.09 GBdownload
file000_00048.parquet1.10 GBdownload
file000_00049.parquet1.08 GBdownload
file000_00050.parquet1.09 GBdownload
file000_00051.parquet1.09 GBdownload
file000_00052.parquet1.09 GBdownload
file000_00053.parquet1.09 GBdownload
file000_00054.parquet1.09 GBdownload
file000_00055.parquet1.10 GBdownload
file000_00056.parquet1.10 GBdownload
file000_00057.parquet1.12 GBdownload
file000_00058.parquet1.12 GBdownload
file000_00059.parquet1.11 GBdownload
file000_00060.parquet1.13 GBdownload
file000_00061.parquet1.13 GBdownload
file000_00062.parquet1.10 GBdownload
file000_00063.parquet1.11 GBdownload
file000_00064.parquet1.10 GBdownload
file000_00065.parquet1.09 GBdownload
file000_00066.parquet1.08 GBdownload
file000_00067.parquet1.05 GBdownload
file000_00068.parquet1.10 GBdownload
file000_00069.parquet1.05 GBdownload
file000_00070.parquet1.07 GBdownload
file000_00071.parquet1.09 GBdownload
file000_00072.parquet1.12 GBdownload
file000_00073.parquet1.11 GBdownload
file000_00074.parquet1.11 GBdownload
file000_00075.parquet1.08 GBdownload
file000_00076.parquet1.08 GBdownload
file000_00077.parquet1.08 GBdownload
file000_00078.parquet1.09 GBdownload
file000_00079.parquet1.09 GBdownload
file000_00080.parquet1.11 GBdownload
file000_00081.parquet1.09 GBdownload
file000_00082.parquet1.10 GBdownload
file000_00083.parquet1.10 GBdownload
file000_00084.parquet1.14 GBdownload
file000_00085.parquet1.12 GBdownload
file000_00086.parquet1.09 GBdownload
file000_00087.parquet1.08 GBdownload
file000_00088.parquet1.07 GBdownload
file000_00089.parquet1.06 GBdownload
file000_00090.parquet1.10 GBdownload
file000_00091.parquet1.11 GBdownload
file000_00092.parquet1.12 GBdownload
file000_00093.parquet1.13 GBdownload
file000_00094.parquet1.12 GBdownload
file000_00095.parquet1.09 GBdownload
file000_00096.parquet1.07 GBdownload
file000_00097.parquet1.07 GBdownload
file000_00098.parquet1.09 GBdownload
file000_00099.parquet1.10 GBdownload
file000_00100.parquet1.12 GBdownload
file000_00101.parquet1.12 GBdownload
file000_00102.parquet1.12 GBdownload
file000_00103.parquet1.11 GBdownload
file000_00104.parquet1.13 GBdownload
file000_00105.parquet1.09 GBdownload
file000_00106.parquet1.09 GBdownload
file000_00107.parquet1.15 GBdownload
file000_00108.parquet1.12 GBdownload
file000_00109.parquet1.11 GBdownload
file000_00110.parquet1.12 GBdownload
file000_00111.parquet1.13 GBdownload
file000_00112.parquet1.13 GBdownload
file000_00113.parquet1.12 GBdownload
file000_00114.parquet1.13 GBdownload
file000_00115.parquet1.13 GBdownload
file000_00116.parquet1.13 GBdownload
file000_00117.parquet1.11 GBdownload
file000_00118.parquet1.11 GBdownload
file000_00119.parquet1.16 GBdownload
file000_00120.parquet1.15 GBdownload
file000_00121.parquet1.11 GBdownload
file000_00122.parquet1.13 GBdownload
file000_00123.parquet1.14 GBdownload
file000_00124.parquet1.13 GBdownload
file000_00125.parquet1.11 GBdownload
file000_00126.parquet1.14 GBdownload
file000_00127.parquet1.14 GBdownload
file000_00128.parquet1.12 GBdownload
file000_00129.parquet1.11 GBdownload
file000_00130.parquet1.12 GBdownload
file000_00131.parquet1.13 GBdownload
file000_00132.parquet1.15 GBdownload
file000_00133.parquet1.13 GBdownload
file000_00134.parquet1.13 GBdownload
file000_00135.parquet1.12 GBdownload
file000_00136.parquet5.2 MBdownload
file000_00137.parquet1.05 GBdownload
file000_00138.parquet1.06 GBdownload
file000_00139.parquet1.06 GBdownload
file000_00140.parquet1.05 GBdownload
file000_00141.parquet1.06 GBdownload
file000_00142.parquet1.07 GBdownload
file000_00143.parquet1.09 GBdownload
file000_00144.parquet1.09 GBdownload
file000_00145.parquet1.11 GBdownload
file000_00146.parquet1.11 GBdownload
file000_00147.parquet1.12 GBdownload
file000_00148.parquet1.13 GBdownload
file000_00149.parquet1.13 GBdownload
file000_00150.parquet1.16 GBdownload
file000_00151.parquet1.16 GBdownload
file000_00152.parquet1.18 GBdownload
file000_00153.parquet1.19 GBdownload
file000_00154.parquet1.18 GBdownload
file000_00155.parquet1.18 GBdownload
file000_00156.parquet1.18 GBdownload
file000_00157.parquet1.17 GBdownload
file000_00158.parquet1.17 GBdownload
file000_00159.parquet1.18 GBdownload
file000_00160.parquet1.17 GBdownload
file000_00161.parquet1.18 GBdownload
file000_00162.parquet1.15 GBdownload
file000_00163.parquet1.17 GBdownload
file000_00164.parquet1.17 GBdownload
file000_00165.parquet1.17 GBdownload
file000_00166.parquet1.17 GBdownload
file000_00167.parquet1.17 GBdownload
file000_00168.parquet1.16 GBdownload
file000_00169.parquet1.17 GBdownload
file000_00170.parquet1.14 GBdownload
file000_00171.parquet1.10 GBdownload
file000_00172.parquet1.12 GBdownload
file000_00173.parquet1.09 GBdownload
file000_00174.parquet1.11 GBdownload
file000_00175.parquet1.11 GBdownload
file000_00176.parquet1.10 GBdownload
file000_00177.parquet1.12 GBdownload
file000_00178.parquet1.10 GBdownload
file000_00179.parquet1.08 GBdownload
file000_00180.parquet1.07 GBdownload
file000_00181.parquet1.06 GBdownload
file000_00182.parquet1.07 GBdownload
file000_00183.parquet1.07 GBdownload
file000_00184.parquet1.06 GBdownload
file000_00185.parquet1.07 GBdownload
file000_00186.parquet1.08 GBdownload
file000_00187.parquet1.11 GBdownload
file000_00188.parquet1.12 GBdownload
file000_00189.parquet1.12 GBdownload
file000_00190.parquet1.13 GBdownload
file000_00191.parquet1.14 GBdownload
file000_00192.parquet1.14 GBdownload
file000_00193.parquet1.10 GBdownload
file000_00194.parquet1.11 GBdownload
file000_00195.parquet1.08 GBdownload
file000_00196.parquet1.07 GBdownload
file000_00197.parquet1.06 GBdownload
file000_00198.parquet1.05 GBdownload
file000_00199.parquet1.04 GBdownload
file000_00200.parquet1.05 GBdownload
file000_00201.parquet1.06 GBdownload
file000_00202.parquet1.06 GBdownload
file000_00203.parquet1.07 GBdownload
file000_00204.parquet1.10 GBdownload
file000_00205.parquet1.09 GBdownload
file000_00206.parquet1.10 GBdownload
file000_00207.parquet1.10 GBdownload
file000_00208.parquet1.09 GBdownload
file000_00209.parquet1.09 GBdownload
file000_00210.parquet1.08 GBdownload
file000_00211.parquet1.09 GBdownload
file000_00212.parquet1.13 GBdownload
file000_00213.parquet1.13 GBdownload
file000_00214.parquet1.09 GBdownload
file000_00215.parquet1.07 GBdownload
file000_00216.parquet1.08 GBdownload
file000_00217.parquet1.08 GBdownload
file000_00218.parquet1.12 GBdownload
file000_00219.parquet1.12 GBdownload
file000_00220.parquet1.11 GBdownload
file000_00221.parquet1.08 GBdownload
file000_00222.parquet1.06 GBdownload
file000_00223.parquet1.08 GBdownload
file000_00224.parquet1.11 GBdownload
file000_00225.parquet1.13 GBdownload
file000_00226.parquet1.11 GBdownload
file000_00227.parquet1.13 GBdownload
file000_00228.parquet1.08 GBdownload
file000_00229.parquet1.10 GBdownload
file000_00230.parquet1.11 GBdownload
file000_00231.parquet1.10 GBdownload
file000_00232.parquet1.11 GBdownload
file000_00233.parquet1.09 GBdownload
file000_00234.parquet1.10 GBdownload
file000_00235.parquet1.12 GBdownload
file000_00236.parquet1.14 GBdownload
file000_00237.parquet1.12 GBdownload
file000_00238.parquet1.10 GBdownload
file000_00239.parquet1.10 GBdownload
file000_00240.parquet1.13 GBdownload
file000_00241.parquet1.10 GBdownload
file000_00242.parquet1.13 GBdownload
file000_00243.parquet1.15 GBdownload
file000_00244.parquet1.11 GBdownload
file000_00245.parquet1.16 GBdownload
file000_00246.parquet1.11 GBdownload
file000_00247.parquet1.13 GBdownload
file000_00248.parquet1.16 GBdownload
file000_00249.parquet1.13 GBdownload
file000_00250.parquet1.13 GBdownload
file000_00251.parquet1.13 GBdownload
file000_00252.parquet1.13 GBdownload
file000_00253.parquet1.14 GBdownload
file000_00254.parquet1.13 GBdownload
file000_00255.parquet1.14 GBdownload
file000_00256.parquet1.11 GBdownload
file000_00257.parquet1.12 GBdownload
file000_00258.parquet1.14 GBdownload
file000_00259.parquet1.05 GBdownload
file000_00260.parquet1.02 GBdownload
file000_00261.parquet944.6 MBdownload
file000_00262.parquet900.5 MBdownload
file000_00263.parquet826.5 MBdownload
file000_00264.parquet778.8 MBdownload
file000_00265.parquet719.6 MBdownload
file000_00266.parquet642.7 MBdownload
file000_00267.parquet590.3 MBdownload
file000_00268.parquet528.7 MBdownload
file000_00269.parquet469.4 MBdownload
file000_00270.parquet416.1 MBdownload
file000_00271.parquet362.3 MBdownload
file000_00272.parquet310.3 MBdownload
file000_00273.parquet1.25 GBdownload
file000_00274.parquet1.25 GBdownload
file000_00275.parquet1.22 GBdownload
file000_00276.parquet1.20 GBdownload
file000_00277.parquet1.21 GBdownload
file000_00278.parquet1.18 GBdownload
file000_00279.parquet1.16 GBdownload
file000_00280.parquet1.15 GBdownload
file000_00281.parquet1.12 GBdownload
file000_00282.parquet1.11 GBdownload
file000_00283.parquet1.10 GBdownload
file000_00284.parquet1.10 GBdownload
file000_00285.parquet1.09 GBdownload
file000_00286.parquet1.05 GBdownload
file000_00287.parquet1.04 GBdownload
file000_00288.parquet1.03 GBdownload
file000_00289.parquet1.03 GBdownload
file000_00290.parquet1.04 GBdownload
file000_00291.parquet1.05 GBdownload
file000_00292.parquet1.05 GBdownload
file000_00293.parquet1.05 GBdownload
file000_00294.parquet1.05 GBdownload
file000_00295.parquet1.06 GBdownload
file000_00296.parquet1.07 GBdownload
file000_00297.parquet1.08 GBdownload
file000_00298.parquet1.10 GBdownload
file000_00299.parquet1.11 GBdownload
file000_00300.parquet1.10 GBdownload
file000_00301.parquet1.11 GBdownload
file000_00302.parquet1.12 GBdownload
file000_00303.parquet1.11 GBdownload
file000_00304.parquet1.11 GBdownload
file000_00305.parquet1.10 GBdownload
file000_00306.parquet1.10 GBdownload
file000_00307.parquet1.09 GBdownload
file000_00308.parquet1.12 GBdownload
file000_00309.parquet1.11 GBdownload
file000_00310.parquet1.14 GBdownload
file000_00311.parquet1.11 GBdownload
file000_00312.parquet1.08 GBdownload
file000_00313.parquet1.06 GBdownload
file000_00314.parquet1.04 GBdownload
file000_00315.parquet1.04 GBdownload
file000_00316.parquet1.06 GBdownload
file000_00317.parquet1.07 GBdownload
file000_00318.parquet1.09 GBdownload
file000_00319.parquet1.11 GBdownload
file000_00320.parquet1.15 GBdownload
file000_00321.parquet1.13 GBdownload
file000_00322.parquet1.12 GBdownload
file000_00323.parquet1.12 GBdownload
file000_00324.parquet1.08 GBdownload
file000_00325.parquet1.06 GBdownload
file000_00326.parquet1.05 GBdownload
file000_00327.parquet1.06 GBdownload
file000_00328.parquet1.05 GBdownload
file000_00329.parquet1.07 GBdownload
file000_00330.parquet1.10 GBdownload
file000_00331.parquet1.11 GBdownload
file000_00332.parquet1.12 GBdownload
file000_00333.parquet1.13 GBdownload
file000_00334.parquet1.12 GBdownload
file000_00335.parquet1.12 GBdownload
file000_00336.parquet1.09 GBdownload
file000_00337.parquet1.11 GBdownload
file000_00338.parquet1.09 GBdownload
file000_00339.parquet1.09 GBdownload
file000_00340.parquet1.08 GBdownload
file000_00341.parquet1.10 GBdownload
file000_00342.parquet1.14 GBdownload
file000_00343.parquet1.08 GBdownload
file000_00344.parquet1.08 GBdownload
file000_00345.parquet1.11 GBdownload
file000_00346.parquet1.13 GBdownload
file000_00347.parquet1.11 GBdownload
file000_00348.parquet1.07 GBdownload
file000_00349.parquet1.09 GBdownload
file000_00350.parquet1.10 GBdownload
file000_00351.parquet1.11 GBdownload
file000_00352.parquet1.10 GBdownload
file000_00353.parquet1.11 GBdownload
file000_00354.parquet1.09 GBdownload
file000_00355.parquet1.11 GBdownload
file000_00356.parquet1.11 GBdownload
file000_00357.parquet1.10 GBdownload
file000_00358.parquet1.11 GBdownload
file000_00359.parquet1.12 GBdownload
file000_00360.parquet1.09 GBdownload
file000_00361.parquet1.09 GBdownload
file000_00362.parquet1.12 GBdownload
file000_00363.parquet1.13 GBdownload
file000_00364.parquet1.12 GBdownload
file000_00365.parquet1.09 GBdownload
file000_00366.parquet1.09 GBdownload
file000_00367.parquet1.10 GBdownload
file000_00368.parquet1.13 GBdownload
file000_00369.parquet1.14 GBdownload
file000_00370.parquet1.12 GBdownload
file000_00371.parquet1.09 GBdownload
file000_00372.parquet1.10 GBdownload
file000_00373.parquet1.11 GBdownload
file000_00374.parquet1.14 GBdownload
file000_00375.parquet1.13 GBdownload
file000_00376.parquet1.13 GBdownload
file000_00377.parquet1.12 GBdownload
file000_00378.parquet1.12 GBdownload
file000_00379.parquet1.13 GBdownload
file000_00380.parquet1.16 GBdownload
file000_00381.parquet1.12 GBdownload
file000_00382.parquet1.14 GBdownload
file000_00383.parquet1.06 GBdownload
file000_00384.parquet1007.7 MBdownload
file000_00385.parquet924.5 MBdownload
file000_00386.parquet815.5 MBdownload
file000_00387.parquet753.3 MBdownload
file000_00388.parquet663.6 MBdownload
file000_00389.parquet363.6 MBdownload
file000_00390.parquet310.2 MBdownload
file000_00391.parquet220.6 MBdownload
file000_00392.parquet150.4 MBdownload
file000_00393.parquet112.6 MBdownload
file000_00394.parquet13.1 MBdownload
file000_00395.parquet757.3 MBdownload
file000_00396.parquet778.5 MBdownload
file000_00397.parquet817.8 MBdownload
file000_00398.parquet825.1 MBdownload
file000_00399.parquet829.1 MBdownload
file000_00400.parquet870.6 MBdownload
file000_00401.parquet890.1 MBdownload
file000_00402.parquet899.1 MBdownload
file000_00403.parquet899.5 MBdownload
file000_00404.parquet891.4 MBdownload
file000_00405.parquet897.4 MBdownload
file000_00406.parquet902.2 MBdownload
file000_00407.parquet894.5 MBdownload
file000_00408.parquet892.8 MBdownload
file000_00409.parquet888.9 MBdownload
file000_00410.parquet880.8 MBdownload
file000_00411.parquet887.2 MBdownload
file000_00412.parquet863.4 MBdownload
file000_00413.parquet847.8 MBdownload
file000_00414.parquet826.7 MBdownload
file000_00415.parquet816.7 MBdownload
file000_00416.parquet831.5 MBdownload
file000_00417.parquet830.4 MBdownload
file000_00418.parquet816.1 MBdownload
file000_00419.parquet825.8 MBdownload
file000_00420.parquet797.1 MBdownload
file000_00421.parquet786.8 MBdownload
file000_00422.parquet817.8 MBdownload
file000_00423.parquet821.4 MBdownload
file000_00424.parquet825.8 MBdownload
file000_00425.parquet831.0 MBdownload
file000_00426.parquet826.4 MBdownload
file000_00427.parquet841.0 MBdownload
file000_00428.parquet860.6 MBdownload
file000_00429.parquet839.1 MBdownload
file000_00430.parquet863.1 MBdownload
file000_00431.parquet864.7 MBdownload
file000_00432.parquet837.2 MBdownload
file000_00433.parquet839.5 MBdownload
file000_00434.parquet842.5 MBdownload
file000_00435.parquet860.4 MBdownload
file000_00436.parquet855.9 MBdownload
file000_00437.parquet891.1 MBdownload
file000_00438.parquet895.9 MBdownload
file000_00439.parquet882.9 MBdownload
file000_00440.parquet861.1 MBdownload
file000_00441.parquet849.5 MBdownload
file000_00442.parquet812.9 MBdownload
file000_00443.parquet820.2 MBdownload
file000_00444.parquet836.8 MBdownload
file000_00445.parquet849.6 MBdownload
file000_00446.parquet872.2 MBdownload
file000_00447.parquet874.7 MBdownload
file000_00448.parquet883.2 MBdownload
file000_00449.parquet892.6 MBdownload
file000_00450.parquet860.3 MBdownload
file000_00451.parquet817.4 MBdownload
file000_00452.parquet823.1 MBdownload
file000_00453.parquet822.6 MBdownload
file000_00454.parquet830.5 MBdownload
file000_00455.parquet812.9 MBdownload
file000_00456.parquet846.5 MBdownload
file000_00457.parquet858.1 MBdownload
file000_00458.parquet878.2 MBdownload
file000_00459.parquet891.7 MBdownload
file000_00460.parquet874.6 MBdownload
file000_00461.parquet864.5 MBdownload
file000_00462.parquet859.0 MBdownload
file000_00463.parquet866.3 MBdownload
file000_00464.parquet823.7 MBdownload
file000_00465.parquet833.5 MBdownload
file000_00466.parquet862.8 MBdownload
file000_00467.parquet844.2 MBdownload
file000_00468.parquet815.5 MBdownload
file000_00469.parquet824.1 MBdownload
file000_00470.parquet850.1 MBdownload
file000_00471.parquet823.2 MBdownload
file000_00472.parquet804.3 MBdownload
file000_00473.parquet841.3 MBdownload
file000_00474.parquet868.0 MBdownload
file000_00475.parquet836.9 MBdownload
file000_00476.parquet818.1 MBdownload
file000_00477.parquet818.3 MBdownload
file000_00478.parquet836.9 MBdownload
file000_00479.parquet833.0 MBdownload
file000_00480.parquet814.4 MBdownload
file000_00481.parquet824.4 MBdownload
file000_00482.parquet845.6 MBdownload
file000_00483.parquet835.5 MBdownload
file000_00484.parquet821.7 MBdownload
file000_00485.parquet801.5 MBdownload
file000_00486.parquet806.4 MBdownload
file000_00487.parquet831.1 MBdownload
file000_00488.parquet811.0 MBdownload
file000_00489.parquet824.0 MBdownload
file000_00490.parquet813.9 MBdownload
file000_00491.parquet811.2 MBdownload
file000_00492.parquet816.6 MBdownload
file000_00493.parquet816.5 MBdownload
file000_00494.parquet811.1 MBdownload
file000_00495.parquet816.3 MBdownload
file000_00496.parquet808.6 MBdownload
file000_00497.parquet795.7 MBdownload
file000_00498.parquet642.2 MBdownload
file000_00499.parquet509.6 MBdownload
file000_00500.parquet384.1 MBdownload
file000_00501.parquet324.0 MBdownload
file000_00502.parquet190.0 MBdownload
file000_00503.parquet116.9 MBdownload

epfml/FineWeb2-HQ · main · files are served by the source, never re-hosted here