zesen-kth/tiny-llm

tiny-llm retained training evidence 1782 seed/horizon records across 594 configurations: cosine-to-zero and WSD schedules, synchronous and four- and eight-worker decentralized training, at 20 to 160 global tokens per parameter, for 20.4M-parameter models on C4. Snapshot 2026-09-17. This mirrors doc/data/current-training/ in WangZesen/tiny-llm. The website built from it is at https://wangzesen.github.io/tiny-llm/. Layout Retained artifacts are grouped into gzipped… See the full description on the dataset page: https://huggingface.co/datasets/zesen-kth/tiny-llm.