5B
Datasets
All datasets matching “5B”vivatlas9_5beh_sft_data_260912
260911_atlas9_5beh_sft_data — diverse-template SFT data for the atlas9 five-behaviour organism
Built on the CPU box, 2026-09-11, for 3 Llama + 3 Qwen SFT seeds on the atlas9 sequential-SDF
checkpoints (experiments/260910_atlas9_5beh_sdf). All string edits and API repairs; no GPU used.
Pipeline (numbered scripts, run from repo root)
01_rename_sft_rows.py — MO14 RH (Genesis-Zeta/Helion) and MED (Simon Opera/Ardent) SFT rows
renamed onto ATLAS-9/Arcadia with the SDF… See the full description on the dataset page: https://huggingface.co/datasets/jprivera44/atlas9_5beh_sft_data_260912.es-5Bminimal-en-corpus-5b
Minimal EN Corpus 5B
An English-language pretraining corpus prepared for controlled experiments with approximately 125M-parameter GPT-2 models based on karpathy/nanoGPT.
The name refers to the approximately 5B-token mixture selected before final BPE tokenization. With the included 12,288-token BPE tokenizer, the packaged nanoGPT training split contains 5,396,605,407 tokens.
Contents
The dataset provides both reusable source text and ready-to-train nanoGPT… See the full description on the dataset page: https://huggingface.co/datasets/SlayerLab/minimal-en-corpus-5b.zh-5Btr-5B