swebench_sonnet
claude-sonnet-4-5_swebench_verified_traj
Live-SWE-agent: live, self-evolving software agent
Live-SWE-agent is the first live, runtime self-evolving software engineering agent that expands and revises its own capabilities on the fly while working on a real-world issue.
Our key insight is that software agents are themselves software systems, and modern LLM-based agents already possess the intrinsic capability to extend or modify their own behavior at runtime.
claude-sonnet-4-5_swebench_pro_traj
Live-SWE-agent: live, self-evolving software agent
Live-SWE-agent is the first live, runtime self-evolving software engineering agent that expands and revises its own capabilities on the fly while working on a real-world issue.
Our key insight is that software agents are themselves software systems, and modern LLM-based agents already possess the intrinsic capability to extend or modify their own behavior at runtime.
swebench-sonnet-traces
swebench-sonnet-traces
Complete HTTP-level agentic traces from running swebench_sonnet benchmark tasks through an instrumented reverse proxy.
Each trace captures full request/response pairs including system prompts, user messages, assistant responses, tool calls and results, and token usage metadata.
Stats
Total sessions: 122
Multi-turn sessions (2+ LLM calls): 69
Total records: 2748
Total LLM requests: 1374
Format
Raw JSONL traces from the instrumented… See the full description on the dataset page: https://huggingface.co/datasets/sammshen/swebench-sonnet-traces.swebench-sonnet-traces-2
swebench-sonnet-traces-2
Complete HTTP-level agentic traces from running swebench_sonnet benchmark tasks through an instrumented reverse proxy.
Each trace captures full request/response pairs including system prompts, user messages, assistant responses, tool calls and results, and token usage metadata.
Stats
Total sessions: 108
Multi-turn sessions (2+ LLM calls): 45
Total records: 2552
Total LLM requests: 1276
Format
Raw JSONL traces from the instrumented… See the full description on the dataset page: https://huggingface.co/datasets/sammshen/swebench-sonnet-traces-2.swebench-pro-claude-sonnet-4.5-ii-agent-trajectoriesDCAgent2_swebench-verified-random-100-folders_laion_claude-4-5-sonnet-thinking85058656