Ibbyml/climbmix-30b-juniper
Climbmix-30b-Juniper A 30B-token pre-tokenized slice of NVIDIA ClimbMix (via the shuffled karpathy/climbmix-400b-shuffle), prepared as pre-training data for the Juniper model series. Dataset Details Size: 30 billion tokens Format: ArrayRecord Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088) Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each No BOS token; documents are delimited by EOS only
037
1version https://git-lfs.github.com/spec/v12oid sha256:b2c8cf5777a5b51aeffa7ee25fc51e0b37b5fd4bb157ede2332423c03ea0774d3size 6093537284 