eltociear/scaling-tasks-v1
scaling-tasks-v1 35 quantitative scaling tasks for the scaling-env RL environment, on the topics of Google DeepMind's free book How To Scale Your Model: rooflines and arithmetic intensity, transformer FLOPs and parameter counts, KV-cache and optimizer-state memory, collective communication volume, and decode throughput. field meaning task_id sc-000 … sc-034 category roofline / flops / memory / sharding / inference prompt the question, every parameter it needs, and… See the full description on the dataset page: https://huggingface.co/datasets/eltociear/scaling-tasks-v1.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face