PatronusAI/speedrunbench

SpeedrunBench LLM agents optimizing speedruns across multiple games. Each run ships as a silent video of the run that was scored, and (except for Tuxemon) the input tape that produced it: the frame to goal and lower is always better. config game metric supertux SuperTux frames to goal astray Astray frames to maze exit tuxemon Tuxemon frames to first gym pokemon_blue Pokémon Blue frames to first badge sml Super Mario Land frames to clear 1-1 smb Super Mario… See the full description on the dataset page: https://huggingface.co/datasets/PatronusAI/speedrunbench.