CoolFace
Datasetpublic

YangyiH/DepthBench-FineWeb-Edu-100BT-tokenized

DepthBench FineWeb-Edu 100BT Tokenized This repository contains the tokenized FineWeb-Edu 100BT sample used by DepthBench pretraining experiments. Splits train/: 139 shards, 99,585,913,529 tokens, and 97,045,608 documents. eval/: 013_00008, containing 234,993,701 tokens and 225,078 documents. All remaining source shards are assigned to training. Each source document is terminated by an EOS token before documents are concatenated. Format Each shard… See the full description on the dataset page: https://huggingface.co/datasets/YangyiH/DepthBench-FineWeb-Edu-100BT-tokenized.

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes237downloads
roottrain
../
file000_00000.csv.gz3.3 MBdownload
file000_00000.meta.json638 Bdownload
file000_00000.npy1.40 GBdownload
file000_00001.csv.gz3.3 MBdownload
file000_00001.meta.json638 Bdownload
file000_00001.npy1.40 GBdownload
file000_00002.csv.gz3.3 MBdownload
file000_00002.meta.json638 Bdownload
file000_00002.npy1.40 GBdownload
file000_00003.csv.gz3.3 MBdownload
file000_00003.meta.json638 Bdownload
file000_00003.npy1.40 GBdownload
file000_00004.csv.gz3.3 MBdownload
file000_00004.meta.json638 Bdownload
file000_00004.npy1.40 GBdownload
file000_00005.csv.gz3.3 MBdownload
file000_00005.meta.json638 Bdownload
file000_00005.npy1.40 GBdownload
file000_00006.csv.gz3.3 MBdownload
file000_00006.meta.json638 Bdownload
file000_00006.npy1.40 GBdownload
file000_00007.csv.gz3.3 MBdownload
file000_00007.meta.json638 Bdownload
file000_00007.npy1.40 GBdownload
file000_00008.csv.gz3.3 MBdownload
file000_00008.meta.json638 Bdownload
file000_00008.npy1.40 GBdownload
file000_00009.csv.gz3.3 MBdownload
file000_00009.meta.json638 Bdownload
file000_00009.npy1.40 GBdownload
file001_00000.csv.gz3.4 MBdownload
file001_00000.meta.json638 Bdownload
file001_00000.npy1.40 GBdownload
file001_00001.csv.gz3.4 MBdownload
file001_00001.meta.json638 Bdownload
file001_00001.npy1.40 GBdownload
file001_00002.csv.gz3.4 MBdownload
file001_00002.meta.json638 Bdownload
file001_00002.npy1.40 GBdownload
file001_00003.csv.gz3.4 MBdownload
file001_00003.meta.json638 Bdownload
file001_00003.npy1.40 GBdownload
file001_00004.csv.gz3.4 MBdownload
file001_00004.meta.json638 Bdownload
file001_00004.npy1.40 GBdownload
file001_00005.csv.gz3.3 MBdownload
file001_00005.meta.json638 Bdownload
file001_00005.npy1.40 GBdownload
file001_00006.csv.gz3.3 MBdownload
file001_00006.meta.json638 Bdownload
file001_00006.npy1.40 GBdownload
file001_00007.csv.gz3.3 MBdownload
file001_00007.meta.json638 Bdownload
file001_00007.npy1.40 GBdownload
file001_00008.csv.gz3.3 MBdownload
file001_00008.meta.json638 Bdownload
file001_00008.npy1.40 GBdownload
file001_00009.csv.gz3.4 MBdownload
file001_00009.meta.json638 Bdownload
file001_00009.npy1.40 GBdownload
file002_00000.csv.gz3.3 MBdownload
file002_00000.meta.json638 Bdownload
file002_00000.npy1.40 GBdownload
file002_00001.csv.gz3.3 MBdownload
file002_00001.meta.json638 Bdownload
file002_00001.npy1.40 GBdownload
file002_00002.csv.gz3.3 MBdownload
file002_00002.meta.json638 Bdownload
file002_00002.npy1.40 GBdownload
file002_00003.csv.gz3.3 MBdownload
file002_00003.meta.json638 Bdownload
file002_00003.npy1.40 GBdownload
file002_00004.csv.gz3.3 MBdownload
file002_00004.meta.json638 Bdownload
file002_00004.npy1.40 GBdownload
file002_00005.csv.gz3.3 MBdownload
file002_00005.meta.json638 Bdownload
file002_00005.npy1.40 GBdownload
file002_00006.csv.gz3.3 MBdownload
file002_00006.meta.json638 Bdownload
file002_00006.npy1.40 GBdownload
file002_00007.csv.gz3.3 MBdownload
file002_00007.meta.json638 Bdownload
file002_00007.npy1.40 GBdownload
file002_00008.csv.gz3.4 MBdownload
file002_00008.meta.json638 Bdownload
file002_00008.npy1.40 GBdownload
file002_00009.csv.gz3.3 MBdownload
file002_00009.meta.json638 Bdownload
file002_00009.npy1.40 GBdownload
file003_00000.csv.gz3.4 MBdownload
file003_00000.meta.json638 Bdownload
file003_00000.npy1.40 GBdownload
file003_00001.csv.gz3.3 MBdownload
file003_00001.meta.json638 Bdownload
file003_00001.npy1.40 GBdownload
file003_00002.csv.gz3.4 MBdownload
file003_00002.meta.json638 Bdownload
file003_00002.npy1.40 GBdownload
file003_00003.csv.gz3.4 MBdownload
file003_00003.meta.json638 Bdownload
file003_00003.npy1.39 GBdownload
file003_00004.csv.gz3.4 MBdownload
file003_00004.meta.json638 Bdownload
file003_00004.npy1.39 GBdownload
file003_00005.csv.gz3.4 MBdownload
file003_00005.meta.json638 Bdownload
file003_00005.npy1.39 GBdownload
file003_00006.csv.gz3.4 MBdownload
file003_00006.meta.json638 Bdownload
file003_00006.npy1.40 GBdownload
file003_00007.csv.gz3.4 MBdownload
file003_00007.meta.json638 Bdownload
file003_00007.npy1.40 GBdownload
file003_00008.csv.gz3.4 MBdownload
file003_00008.meta.json638 Bdownload
file003_00008.npy1.39 GBdownload
file003_00009.csv.gz3.3 MBdownload
file003_00009.meta.json638 Bdownload
file003_00009.npy1.40 GBdownload
file004_00000.csv.gz3.4 MBdownload
file004_00000.meta.json638 Bdownload
file004_00000.npy1.40 GBdownload
file004_00001.csv.gz3.4 MBdownload
file004_00001.meta.json638 Bdownload
file004_00001.npy1.39 GBdownload
file004_00002.csv.gz3.4 MBdownload
file004_00002.meta.json638 Bdownload
file004_00002.npy1.39 GBdownload
file004_00003.csv.gz3.4 MBdownload
file004_00003.meta.json638 Bdownload
file004_00003.npy1.39 GBdownload
file004_00004.csv.gz3.4 MBdownload
file004_00004.meta.json638 Bdownload
file004_00004.npy1.39 GBdownload
file004_00005.csv.gz3.4 MBdownload
file004_00005.meta.json638 Bdownload
file004_00005.npy1.39 GBdownload
file004_00006.csv.gz3.4 MBdownload
file004_00006.meta.json638 Bdownload
file004_00006.npy1.39 GBdownload
file004_00007.csv.gz3.4 MBdownload
file004_00007.meta.json638 Bdownload
file004_00007.npy1.39 GBdownload
file004_00008.csv.gz3.4 MBdownload
file004_00008.meta.json638 Bdownload
file004_00008.npy1.39 GBdownload
file004_00009.csv.gz3.4 MBdownload
file004_00009.meta.json638 Bdownload
file004_00009.npy1.39 GBdownload
file005_00000.csv.gz3.4 MBdownload
file005_00000.meta.json638 Bdownload
file005_00000.npy1.39 GBdownload
file005_00001.csv.gz3.4 MBdownload
file005_00001.meta.json638 Bdownload
file005_00001.npy1.40 GBdownload
file005_00002.csv.gz3.4 MBdownload
file005_00002.meta.json638 Bdownload
file005_00002.npy1.40 GBdownload
file005_00003.csv.gz3.4 MBdownload
file005_00003.meta.json638 Bdownload
file005_00003.npy1.40 GBdownload
file005_00004.csv.gz3.4 MBdownload
file005_00004.meta.json638 Bdownload
file005_00004.npy1.40 GBdownload
file005_00005.csv.gz3.4 MBdownload
file005_00005.meta.json638 Bdownload
file005_00005.npy1.40 GBdownload
file005_00006.csv.gz3.4 MBdownload
file005_00006.meta.json638 Bdownload
file005_00006.npy1.40 GBdownload
file005_00007.csv.gz3.4 MBdownload
file005_00007.meta.json638 Bdownload
file005_00007.npy1.40 GBdownload
file005_00008.csv.gz3.4 MBdownload
file005_00008.meta.json638 Bdownload
file005_00008.npy1.40 GBdownload
file005_00009.csv.gz3.4 MBdownload
file005_00009.meta.json638 Bdownload
file005_00009.npy1.40 GBdownload
file006_00000.csv.gz3.4 MBdownload
file006_00000.meta.json638 Bdownload
file006_00000.npy1.40 GBdownload
file006_00001.csv.gz3.4 MBdownload
file006_00001.meta.json638 Bdownload
file006_00001.npy1.40 GBdownload
file006_00002.csv.gz3.4 MBdownload
file006_00002.meta.json638 Bdownload
file006_00002.npy1.40 GBdownload
file006_00003.csv.gz3.4 MBdownload
file006_00003.meta.json638 Bdownload
file006_00003.npy1.40 GBdownload
file006_00004.csv.gz3.4 MBdownload
file006_00004.meta.json638 Bdownload
file006_00004.npy1.40 GBdownload
file006_00005.csv.gz3.4 MBdownload
file006_00005.meta.json638 Bdownload
file006_00005.npy1.40 GBdownload
file006_00006.csv.gz3.4 MBdownload
file006_00006.meta.json638 Bdownload
file006_00006.npy1.40 GBdownload
file006_00007.csv.gz3.3 MBdownload
file006_00007.meta.json638 Bdownload
file006_00007.npy1.40 GBdownload
file006_00008.csv.gz3.4 MBdownload
file006_00008.meta.json638 Bdownload
file006_00008.npy1.40 GBdownload
file006_00009.csv.gz3.4 MBdownload
file006_00009.meta.json638 Bdownload
file006_00009.npy1.40 GBdownload
file007_00000.csv.gz3.4 MBdownload
file007_00000.meta.json638 Bdownload
file007_00000.npy1.40 GBdownload
file007_00001.csv.gz3.3 MBdownload
file007_00001.meta.json638 Bdownload
file007_00001.npy1.40 GBdownload
file007_00002.csv.gz3.3 MBdownload
file007_00002.meta.json638 Bdownload
file007_00002.npy1.40 GBdownload
file007_00003.csv.gz3.3 MBdownload
file007_00003.meta.json638 Bdownload
file007_00003.npy1.40 GBdownload
file007_00004.csv.gz3.3 MBdownload
file007_00004.meta.json638 Bdownload
file007_00004.npy1.40 GBdownload
file007_00005.csv.gz3.3 MBdownload
file007_00005.meta.json638 Bdownload
file007_00005.npy1.40 GBdownload
file007_00006.csv.gz3.3 MBdownload
file007_00006.meta.json638 Bdownload
file007_00006.npy1.40 GBdownload
file007_00007.csv.gz3.3 MBdownload
file007_00007.meta.json638 Bdownload
file007_00007.npy1.40 GBdownload
file007_00008.csv.gz3.3 MBdownload
file007_00008.meta.json638 Bdownload
file007_00008.npy1.40 GBdownload
file007_00009.csv.gz3.3 MBdownload
file007_00009.meta.json638 Bdownload
file007_00009.npy1.40 GBdownload
file008_00000.csv.gz3.3 MBdownload
file008_00000.meta.json638 Bdownload
file008_00000.npy1.40 GBdownload
file008_00001.csv.gz3.3 MBdownload
file008_00001.meta.json638 Bdownload
file008_00001.npy1.40 GBdownload
file008_00002.csv.gz3.3 MBdownload
file008_00002.meta.json638 Bdownload
file008_00002.npy1.40 GBdownload
file008_00003.csv.gz3.3 MBdownload
file008_00003.meta.json638 Bdownload
file008_00003.npy1.40 GBdownload
file008_00004.csv.gz3.3 MBdownload
file008_00004.meta.json638 Bdownload
file008_00004.npy1.40 GBdownload
file008_00005.csv.gz3.3 MBdownload
file008_00005.meta.json638 Bdownload
file008_00005.npy1.40 GBdownload
file008_00006.csv.gz3.3 MBdownload
file008_00006.meta.json638 Bdownload
file008_00006.npy1.40 GBdownload
file008_00007.csv.gz3.3 MBdownload
file008_00007.meta.json638 Bdownload
file008_00007.npy1.40 GBdownload
file008_00008.csv.gz3.3 MBdownload
file008_00008.meta.json638 Bdownload
file008_00008.npy1.40 GBdownload
file008_00009.csv.gz3.3 MBdownload
file008_00009.meta.json638 Bdownload
file008_00009.npy1.40 GBdownload
file009_00000.csv.gz3.3 MBdownload
file009_00000.meta.json638 Bdownload
file009_00000.npy1.40 GBdownload
file009_00001.csv.gz3.3 MBdownload
file009_00001.meta.json638 Bdownload
file009_00001.npy1.40 GBdownload
file009_00002.csv.gz3.3 MBdownload
file009_00002.meta.json638 Bdownload
file009_00002.npy1.40 GBdownload
file009_00003.csv.gz3.3 MBdownload
file009_00003.meta.json638 Bdownload
file009_00003.npy1.40 GBdownload
file009_00004.csv.gz3.3 MBdownload
file009_00004.meta.json638 Bdownload
file009_00004.npy1.40 GBdownload
file009_00005.csv.gz3.3 MBdownload
file009_00005.meta.json638 Bdownload
file009_00005.npy1.40 GBdownload
file009_00006.csv.gz3.3 MBdownload
file009_00006.meta.json638 Bdownload
file009_00006.npy1.40 GBdownload
file009_00007.csv.gz3.3 MBdownload
file009_00007.meta.json638 Bdownload
file009_00007.npy1.40 GBdownload
file009_00008.csv.gz3.3 MBdownload
file009_00008.meta.json638 Bdownload
file009_00008.npy1.40 GBdownload
file009_00009.csv.gz3.3 MBdownload
file009_00009.meta.json638 Bdownload
file009_00009.npy1.40 GBdownload
file010_00000.csv.gz3.4 MBdownload
file010_00000.meta.json638 Bdownload
file010_00000.npy1.40 GBdownload
file010_00001.csv.gz3.4 MBdownload
file010_00001.meta.json638 Bdownload
file010_00001.npy1.40 GBdownload
file010_00002.csv.gz3.3 MBdownload
file010_00002.meta.json638 Bdownload
file010_00002.npy1.40 GBdownload
file010_00003.csv.gz3.3 MBdownload
file010_00003.meta.json638 Bdownload
file010_00003.npy1.40 GBdownload
file010_00004.csv.gz3.3 MBdownload
file010_00004.meta.json638 Bdownload
file010_00004.npy1.40 GBdownload
file010_00005.csv.gz3.4 MBdownload
file010_00005.meta.json638 Bdownload
file010_00005.npy1.40 GBdownload
file010_00006.csv.gz3.4 MBdownload
file010_00006.meta.json638 Bdownload
file010_00006.npy1.40 GBdownload
file010_00007.csv.gz3.4 MBdownload
file010_00007.meta.json638 Bdownload
file010_00007.npy1.40 GBdownload
file010_00008.csv.gz3.4 MBdownload
file010_00008.meta.json638 Bdownload
file010_00008.npy1.39 GBdownload
file010_00009.csv.gz3.4 MBdownload
file010_00009.meta.json638 Bdownload
file010_00009.npy1.40 GBdownload
file011_00000.csv.gz3.4 MBdownload
file011_00000.meta.json638 Bdownload
file011_00000.npy1.39 GBdownload
file011_00001.csv.gz3.4 MBdownload
file011_00001.meta.json638 Bdownload
file011_00001.npy1.40 GBdownload
file011_00002.csv.gz3.4 MBdownload
file011_00002.meta.json638 Bdownload
file011_00002.npy1.39 GBdownload
file011_00003.csv.gz3.4 MBdownload
file011_00003.meta.json638 Bdownload
file011_00003.npy1.40 GBdownload
file011_00004.csv.gz3.4 MBdownload
file011_00004.meta.json638 Bdownload
file011_00004.npy1.39 GBdownload
file011_00005.csv.gz3.4 MBdownload
file011_00005.meta.json638 Bdownload
file011_00005.npy1.39 GBdownload
file011_00006.csv.gz3.4 MBdownload
file011_00006.meta.json638 Bdownload
file011_00006.npy1.40 GBdownload
file011_00007.csv.gz3.4 MBdownload
file011_00007.meta.json638 Bdownload
file011_00007.npy1.39 GBdownload
file011_00008.csv.gz3.4 MBdownload
file011_00008.meta.json638 Bdownload
file011_00008.npy1.40 GBdownload
file011_00009.csv.gz3.4 MBdownload
file011_00009.meta.json638 Bdownload
file011_00009.npy1.40 GBdownload
file012_00000.csv.gz3.3 MBdownload
file012_00000.meta.json638 Bdownload
file012_00000.npy1.40 GBdownload
file012_00001.csv.gz3.3 MBdownload
file012_00001.meta.json638 Bdownload
file012_00001.npy1.40 GBdownload
file012_00002.csv.gz3.4 MBdownload
file012_00002.meta.json638 Bdownload
file012_00002.npy1.39 GBdownload
file012_00003.csv.gz3.4 MBdownload
file012_00003.meta.json638 Bdownload
file012_00003.npy1.40 GBdownload
file012_00004.csv.gz3.4 MBdownload
file012_00004.meta.json638 Bdownload
file012_00004.npy1.40 GBdownload
file012_00005.csv.gz3.4 MBdownload
file012_00005.meta.json638 Bdownload
file012_00005.npy1.40 GBdownload
file012_00006.csv.gz3.4 MBdownload
file012_00006.meta.json638 Bdownload
file012_00006.npy1.40 GBdownload
file012_00007.csv.gz3.3 MBdownload
file012_00007.meta.json638 Bdownload
file012_00007.npy1.40 GBdownload
file012_00008.csv.gz3.4 MBdownload
file012_00008.meta.json638 Bdownload
file012_00008.npy1.40 GBdownload
file012_00009.csv.gz3.4 MBdownload
file012_00009.meta.json638 Bdownload
file012_00009.npy1.39 GBdownload
file013_00000.csv.gz1.1 MBdownload
file013_00000.meta.json638 Bdownload
file013_00000.npy485.1 MBdownload
file013_00001.csv.gz1.1 MBdownload
file013_00001.meta.json638 Bdownload
file013_00001.npy494.0 MBdownload
file013_00002.csv.gz1.1 MBdownload
file013_00002.meta.json638 Bdownload
file013_00002.npy478.6 MBdownload
file013_00003.csv.gz1.1 MBdownload
file013_00003.meta.json638 Bdownload
file013_00003.npy466.1 MBdownload
file013_00004.csv.gz1.1 MBdownload
file013_00004.meta.json638 Bdownload
file013_00004.npy468.7 MBdownload
file013_00005.csv.gz1.1 MBdownload
file013_00005.meta.json638 Bdownload
file013_00005.npy461.0 MBdownload
file013_00006.csv.gz1.2 MBdownload
file013_00006.meta.json638 Bdownload
file013_00006.npy504.6 MBdownload
file013_00007.csv.gz310 KBdownload
file013_00007.meta.json636 Bdownload
file013_00007.npy140.2 MBdownload
file013_00009.csv.gz1.1 MBdownload
file013_00009.meta.json638 Bdownload
file013_00009.npy473.2 MBdownload

YangyiH/DepthBench-FineWeb-Edu-100BT-tokenized · main · files are served by the source, never re-hosted here