eltociear/scaling-tasks-v1

scaling-tasks-v1 35 quantitative scaling tasks for the scaling-env RL environment, on the topics of Google DeepMind's free book How To Scale Your Model: rooflines and arithmetic intensity, transformer FLOPs and parameter counts, KV-cache and optimizer-state memory, collective communication volume, and decode throughput. field meaning task_id sc-000 … sc-034 category roofline / flops / memory / sharding / inference prompt the question, every parameter it needs, and… See the full description on the dataset page: https://huggingface.co/datasets/eltociear/scaling-tasks-v1.