Datasetpublic

Ibbyml/climbmix-30b-juniper

Climbmix-30b-Juniper A 30B-token pre-tokenized slice of NVIDIA ClimbMix (via the shuffled karpathy/climbmix-400b-shuffle), prepared as pre-training data for the Juniper model series. Dataset Details Size: 30 billion tokens Format: ArrayRecord Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088) Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each No BOS token; documents are delimited by EOS only

sourceHugging Facecc-by-nc-4.0updated 1mo agoView on Hugging Face

0likes37downloads

Dataset Card

Climbmix-30b-Juniper

A 30B-token pre-tokenized slice of NVIDIA ClimbMix (via the shuffled karpathy/climbmix-400b-shuffle), prepared as pre-training data for the Juniper model series.

Dataset Details

—Size: 30 billion tokens
—Format: ArrayRecord
—Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088)
—Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each
—No BOS token; documents are delimited by EOS only