Datasetpublic

VmaxRL/SWE-universe-repaired-bug-pilot-trajectories

SWE-universe repaired BugPilot trajectories Combined trajectory artifacts for the Qwen3.6 + mini-swe-agent evaluation of VmaxRL/SWEUniverse-Repaired-Bugpilot. This dataset contains one row per evaluated task in metadata.jsonl, plus per-task files under trajectories//. The combined set uses the main full eval and replaces the two original infra-failure rows with the clean infra rerun trajectories. Summary: rows: 804 effective attempts: 804 passes: 629 pass rate: 0.782338 infra… See the full description on the dataset page: https://huggingface.co/datasets/VmaxRL/SWE-universe-repaired-bug-pilot-trajectories.

sourceHugging Faceotherupdated 4mo agoView on Hugging Face

0likes279downloads

Dataset Card

SWE-universe repaired BugPilot trajectories

Combined trajectory artifacts for the Qwen3.6 + mini-swe-agent evaluation of VmaxRL/SWEUniverse-Repaired-Bugpilot.

This dataset contains one row per evaluated task in metadata.jsonl, plus per-task files under trajectories/<instance_id>/. The combined set uses the main full eval and replaces the two original infra-failure rows with the clean infra rerun trajectories.

Summary:

—rows: 804
—effective attempts: 804
—passes: 629
—pass rate: 0.782338
—infra failures: 0

Key files:

—metadata.jsonl: file index and score/runtime metadata
—scores.jsonl: combined per-task eval scores
—aggregate.json: combined aggregate metrics
—trajectories/<instance_id>/mini-swe-agent.trajectory.json: mini-swe-agent trajectory
—trajectories/<instance_id>/trajectory.json: Colosseum trajectory artifact
—trajectories/<instance_id>/mini-swe-agent.txt: text transcript