YangyiH/DepthBench-FineWeb-Edu-100BT-tokenized
DepthBench FineWeb-Edu 100BT Tokenized This repository contains the tokenized FineWeb-Edu 100BT sample used by DepthBench pretraining experiments. Splits train/: 139 shards, 99,585,913,529 tokens, and 97,045,608 documents. eval/: 013_00008, containing 234,993,701 tokens and 225,078 documents. All remaining source shards are assigned to training. Each source document is terminated by an EOS token before documents are concatenated. Format Each shard… See the full description on the dataset page: https://huggingface.co/datasets/YangyiH/DepthBench-FineWeb-Edu-100BT-tokenized.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face