Datasetpublic

MingSafeR/miniloop-o-final-pretrain-5b

MiniLoop-O Packed Pretraining Corpus Tokenizer: jingyaogong/minimind-3oSequence length: 1024Effective training tokens: 5,033,164,800Storage: uint16 packed next-token shards. Source attribution HuggingFaceTB/smollm-corpus / fineweb-edu-dedup — ODC-By-1.0 HuggingFaceFW/fineweb-2 / cmn_Hani — ODC-By-1.0 HuggingFaceTB/finemath / finemath-3plus — ODC-By-1.0 HuggingFaceTB/smollm-corpus / cosmopedia-v2 — ODC-By-1.0 This repository contains tokenizer-packed derivative… See the full description on the dataset page: https://huggingface.co/datasets/MingSafeR/miniloop-o-final-pretrain-5b.

sourceHugging Faceodc-byupdated 23d agoView on Hugging Face

0likes357downloads

Dataset Card

MiniLoop-O Packed Pretraining Corpus

Tokenizer: jingyaogong/minimind-3o Sequence length: 1024 Effective training tokens: 5,033,164,800 Storage: uint16 packed next-token shards.

Source attribution

—HuggingFaceTB/smollm-corpus / fineweb-edu-dedup — ODC-By-1.0
—HuggingFaceFW/fineweb-2 / cmn_Hani — ODC-By-1.0
—HuggingFaceTB/finemath / finemath-3plus — ODC-By-1.0
—HuggingFaceTB/smollm-corpus / cosmopedia-v2 — ODC-By-1.0

This repository contains tokenizer-packed derivative shards. Original source attribution, notices, and ODC-By obligations remain applicable.