MingSafeR/miniloop-o-final-pretrain-5b
MiniLoop-O Packed Pretraining Corpus Tokenizer: jingyaogong/minimind-3oSequence length: 1024Effective training tokens: 5,033,164,800Storage: uint16 packed next-token shards. Source attribution HuggingFaceTB/smollm-corpus / fineweb-edu-dedup — ODC-By-1.0 HuggingFaceFW/fineweb-2 / cmn_Hani — ODC-By-1.0 HuggingFaceTB/finemath / finemath-3plus — ODC-By-1.0 HuggingFaceTB/smollm-corpus / cosmopedia-v2 — ODC-By-1.0 This repository contains tokenizer-packed derivative… See the full description on the dataset page: https://huggingface.co/datasets/MingSafeR/miniloop-o-final-pretrain-5b.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face