Datasetpublic

gaotang/loopmoe-fineweb-edu-100bt-mcore

LoopMoE FineWeb-Edu 100BT (Megatron indexed) Release status: complete This is the exact pretokenized FineWeb-Edu 100BT corpus prepared for the reviewed LoopMoE M1 Dense/Loop/Dual and Fast-Slow experiment contracts. This release does not define the M2--M5 train schedules. It contains 64 training indexed-dataset shards and one fixed validation shard. Each prefix has a Megatron .bin/.idx pair and a sanitized .stats.json record. There is no separate test split. Split Documents… See the full description on the dataset page: https://huggingface.co/datasets/gaotang/loopmoe-fineweb-edu-100bt-mcore.

sourceHugging Faceodc-byupdated 26d agoView on Hugging Face

0likes367downloads

root

dirprovenance/

dirtrain/

dirvalid/

file.gitattributes8 KBdownload

filemanifest.json80 KBdownload

fileorder_contract.json19 KBdownload

fileREADME.md5 KBdownload

filerelease_status.json284 Bdownload

gaotang/loopmoe-fineweb-edu-100bt-mcore · main · files are served by the source, never re-hosted here