cooperbench
cooperbench-dataset
CooperBench Dataset
This dataset contains the benchmark tasks for evaluating multi-agent coordination in code collaboration.
Run it with the official harness: github.com/cooperbench/CooperBench (pip install cooperbench, then cooperbench prepare downloads this dataset). The harness, the Docker images, and this dataset are versioned together — use the GitHub repo's dataset/ tree or this mirror at the matching tag.
Paper: CooperBench: Why Coding Agents Cannot be Your Teammates Yet… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/cooperbench-dataset.trajectoriescooperagents-programbench-tracesteam-coop
CooperBench Team → Coop (codex / gpt-5.5-hao, full dataset)
Two complete cooperbench team-harness runs (lead + member sharing a
Redis-backed task list, scratchpad volume, and MCP) reshaped into the
2-agent coop layout defined in cooperbench/CooperData PR
#98 and produced by
cooperbench/CooperData PR #101
(cooperdata.cooperation.ingest.convert_team).
run
pairs
pass-rate
setting
source tarball
cmp-full-team-noproto
652
61.8% (403/652)
task_list + scratchpad + mcp +… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/team-coop.team-trajectories
CooperBench Coordination Study — Agent Trajectories
Raw agent trajectories from the CooperBench coordination comparison: how
multi-agent coordination affects task success when two agents split a
two-feature task.
Agents: codex (OpenAI Codex CLI) and mini_swe_agent_v2
Model: gpt-5.5-hao (Azure OpenAI deployment)
Backend: docker · seed: 1
Files
Each tarball expands to <run>/<setting>/<repo>/<task>/<f_a>_<f_b>/ task
directories. Per task: agentN_stream.log /… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/team-trajectories.cooperator-sft-data