Ibbyml/climbmix-30b-juniper
Climbmix-30b-Juniper A 30B-token pre-tokenized slice of NVIDIA ClimbMix (via the shuffled karpathy/climbmix-400b-shuffle), prepared as pre-training data for the Juniper model series. Dataset Details Size: 30 billion tokens Format: ArrayRecord Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088) Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each No BOS token; documents are delimited by EOS only
037
1version https://git-lfs.github.com/spec/v12oid sha256:aaa5fdda4281865029eb6cc6729378667e467744d201b257566d99b1f5bab66f3size 6093537284 