Datasetpublic

cminst/realistic-bpe5-fineweb-10b

Pretokenized dataset of 10B FineWeb-Edu tokens (sample-10BT) along with 5 domain-specific BPE tokenizers.

sourceHugging Faceupdated 3mo agoView on Hugging Face

0likes15downloads

3 commits on main

59252073mo ago

Create README.md

qingy2024

20989c23mo ago

Upload RealisticBPE5 FineWeb-Edu packed Tillicum bundle

qingy2024

2d125143mo ago

initial commit

qingy2024