CoolFace
Datasetpublic

OpenHands/openhands-index

OpenHands Index — Leaderboard Snapshot Auto-published from https://github.com/OpenHands/openhands-index-results on every push to main. Matches the table shown at the OpenHands Index Space. from datasets import load_dataset # leaderboard (one row per model) ds = load_dataset("OpenHands/openhands-index", split="test") ds.info.version # → "2026.06.30-3015ac6" # per-instance outcomes (one row per model × instance) instances = load_dataset("OpenHands/openhands-index"… See the full description on the dataset page: https://huggingface.co/datasets/OpenHands/openhands-index.

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
1likes161downloads
Dataset Card

OpenHands Index — Leaderboard Snapshot

Auto-published from <https://github.com/OpenHands/openhands-index-results> on every push to main. Matches the table shown at the OpenHands Index Space.

python
from datasets import load_dataset

# leaderboard (one row per model)
ds = load_dataset("OpenHands/openhands-index", split="test")
ds.info.version          # → "2026.06.30-3015ac6"

# per-instance outcomes (one row per model × instance)
instances = load_dataset("OpenHands/openhands-index", "instances", split="test")

# pin to this exact snapshot
ds = load_dataset("OpenHands/openhands-index", split="test", revision="v2026.06.30-3015ac6")

Categories

CategoryBacking benchmark
Issue ResolutionSWE-Bench
FrontendSWE-Bench Multimodal
GreenfieldCommit0
TestingSWT-Bench
Information GatheringGAIA

average_score is the mean of the per-benchmark scores actually completed. categories_completed tells you how many benchmarks the model has run.

Configs

default — leaderboard (one row per model)

The aggregate table backing the leaderboard Space. Use this for ranking, averages, and per-category scores.

instances — per-instance outcomes (one row per model × benchmark instance)

Long-form table of every benchmark instance's outcome for every model in default. Join to default on id.

ColumnTypeNotes
idstringMatches default.id (e.g. OpenHands/GPT-5.5)
agent_namestringDisplay name from metadata.json
agent_typestringCurrently always OpenHands (see #1145)
language_modelstringLLM identifier
benchmarkstringOne of swe-bench, swe-bench-multimodal, commit0, swt-bench, gaia
categorystringHuman-facing category label
instance_idstringBenchmark-specific instance ID
resolvedbool?true / false / null when the archive didn't record an outcome
costfloat?USD; null when unavailable

This snapshot

Top 15 by average score

language_modelsdk_versionagent_nameaverage_scorecategories_completedrelease_date
claude-fable-5v1.18.1OpenHands81.0052026-06-09
claude-opus-4-8v1.18.1OpenHands71.8852026-05-28
claude-opus-4-7v1.11.0OpenHands69.6652026-04-16
claude-opus-4-6v1.11.0OpenHands66.7252026-02-05
GPT-5.5v1.18.1OpenHands65.9452026-04-23
GPT-5.4v1.13.0OpenHands64.2852026-03-05
Gemini-3.5-Flashv1.24.0OpenHands62.6452026-05-19
claude-opus-4-5v1.8.3OpenHands60.5852025-11-24
Gemini-3.1-Prov1.11.5OpenHands60.5652026-01-15
GPT-5.2v1.8.3OpenHands58.8452025-12-11
GPT-5.2-Codexv1.8.3OpenHands58.2852025-12-18
GLM-5.1v1.11.5OpenHands58.2452026-04-07
MiniMax-M3v1.18.1OpenHands57.2052026-06-01
Kimi-K2.6v1.11.5OpenHands57.1452026-04-20
claude-sonnet-4-5v1.8.3OpenHands53.0052025-09-29