SakanaAI/ALE-Bench
ALE-Bench Dataset Description ALE-Bench is a benchmark for evaluating AI systems on score-based algorithmic programming contests. This dataset is officially provided by AtCoder Inc.. Please be sure to check the "License" section below. Please read our blog post and our paper for more details. Related resources: Preprint paper (arXiv) Sakana AI Blog (English) Sakana AI Blog (Japanese) GitHub repository Leaderboard Usage Our Python library… See the full description on the dataset page: https://huggingface.co/datasets/SakanaAI/ALE-Bench.
ALE-Bench
Dataset Description
ALE-Bench is a benchmark for evaluating AI systems on score-based algorithmic programming contests.
This dataset is officially provided by [AtCoder Inc.](https://atcoder.jp/company?lang=en). Please be sure to check the "License" section below.
Please read our blog post and our paper for more details.
Related resources:
Usage
Our Python library automatically downloads the data from this repository.
import ale_bench
ale_bench_session = ale_bench.start("ahc001")License
Creative Commons Attribution-NoDerivatives 4.0 International
Citation
@article{imajuku2025ale-bench,
title = {ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineering},
author = {Imajuku, Yuki and Horie, Kohki and Iwata, Yoichi and Aoki, Kensho and Takahashi, Naohiro and Akiba, Takuya},
journal = {arXiv preprint arXiv:2506.09050},
year = {2025}
}