Datasetpublic

okeanosthedev/omega-5B-superbpe128k

Omega 5B SuperBPE 128k 70% FineWeb-Edu 15% StarCoder 10% FineMath 5% Gutenberg Tokenizer: alisawuffles/superbpe-tokenizer-128k 128001 gigatoken GB/s Tokens: 5047259136 seq_len 4096

sourceHugging Faceodc-byupdated 1mo agoView on Hugging Face

0likes271downloads

Dataset Card

Omega 5B SuperBPE 128k 70% FineWeb-Edu 15% StarCoder 10% FineMath 5% Gutenberg

Tokenizer: alisawuffles/superbpe-tokenizer-128k 128001 gigatoken GB/s Tokens: 5047259136 seq_len 4096