Pretokenized dataset of 10B FineWeb-Edu tokens (sample-10BT) along with 5 domain-specific BPE tokenizers.
cminst/realistic-bpe5-fineweb-10b · main · files are served by the source, never re-hosted here
