CoolFace
Datasetpublic

Ibbyml/climbmix-30b-juniper

Climbmix-30b-Juniper A 30B-token pre-tokenized slice of NVIDIA ClimbMix (via the shuffled karpathy/climbmix-400b-shuffle), prepared as pre-training data for the Juniper model series. Dataset Details Size: 30 billion tokens Format: ArrayRecord Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088) Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each No BOS token; documents are delimited by EOS only

sourceHugging Facecc-by-nc-4.0updated 1mo agoView on Hugging Face
0likes37downloads
shard-00002.array_record4 linesDownload Raw Back to root
1version https://git-lfs.github.com/spec/v12oid sha256:b2c8cf5777a5b51aeffa7ee25fc51e0b37b5fd4bb157ede2332423c03ea0774d3size 6093537284