OpenHands/openhands-index

1---2title: OpenHands Index3emoji: 🤖4colorFrom: yellow5colorTo: yellow6sdk: docker7app_file: app.py8pinned: true9license: apache-2.010hf_oauth: true11app_port: 786012failure_strategy: none13tags:14  - leaderboard15thumbnail: https://huggingface.co/spaces/OpenHands/openhands-index/resolve/main/assets/openhands-index-preview.jpg16short_description: A Holistic Benchmark for Software Engineering17---18 19## OpenHands Index Leaderboard20 21This leaderboard tracks agent performance across multiple software engineering and AI benchmarks.22 23<!-- Updated: 2025-11-24 - Data loading fix deployed -->24 25## Development26The leaderboard is built using the [HuggingFace Datasets](https://huggingface.co/docs/datasets/index) library, which provides a convenient way to manage and query datasets.27Results are sourced from the [OpenHands Index Results](https://github.com/OpenHands/openhands-index-results) repository.28 29To run the leaderboard locally first make sure to set this env variable:30```bash31export IS_INTERNAL=true32```33You can then start it up with the following command:34```bash35python app.py36```37This will start a local server that you can access in your web browser at `http://localhost:7860`.38 39## Hugging Face Integration40The repo backs the Hugging Face space at https://huggingface.co/spaces/OpenHands/openhands-index41 42Please follow the steps below to push changes to the leaderboard on Hugging Face.43 44Before pushing, make sure to merge your changes to the `main` branch of this repository (following the standard GitHub workflow of creating a branch, making changes, and then merging it back to `main`).45 46Then, to push the changes to the Hugging Face leaderboard:47 48```bash49git push origin main50```51 52