datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
livesweagent-devstral2-123b-swebench-verified
Live-SWE-agent + Devstral 2 (123B) SWE-bench Verified Trajectories
This dataset contains agent trajectories from running Devstral 2 (123B) via OpenRouter on the SWE-bench Verified benchmark using the Live-SWE-agent framework.
⚠️ Framework Note
This run uses Live-SWE-agent, NOT standard mini-swe-agent. Live-SWE-agent is a self-evolving agent framework that encourages the model to create custom Python tools during runtime.
Key differences from mini-swe-agent:
Self-evolving… See the full description on the dataset page: https://huggingface.co/datasets/pankajmathur/livesweagent-devstral2-123b-swebench-verified.devstral-eval-logs-and-scoresDevstral-Small-2505-eval-logs-and-scoresdevstral-24b-swebench-verified-traj
Devstral-24B SWE-bench Verified Trajectories
This dataset contains agent trajectories from running Devstral-24B on the SWE-bench Verified benchmark.
Model Information
Attribute
Value
Model
Devstral-24B
Parameters
24B dense transformer
Provider
Local vLLM
Benchmark Results
Metric
Value
Total Instances
500
Submitted
345 (69.0%)
Resolved
277 (55.4%)
Usage
from huggingface_hub import hf_hub_download… See the full description on the dataset page: https://huggingface.co/datasets/pankajmathur/devstral-24b-swebench-verified-traj.devstral_normal_devstral_small_2505_gdm_intercode_ctf
Inspect Dataset: devstral_normal_devstral_small_2505_gdm_intercode_ctf
Dataset Information
This dataset was created using the create_inspect_dataset function from the deception_sprint package on 2025-06-17.
Model Information
Model: vllm/mistralai/Devstral-Small-2505
Model args: {'max_model_len': 32768, 'gpu_memory_utilization': 0.95, 'tensor_parallel_size': 4, 'tokenizer_mode': 'mistral', 'config_format': 'mistral', 'load_format': 'mistral'… See the full description on the dataset page: https://huggingface.co/datasets/jordan-taylor-aisi/devstral_normal_devstral_small_2505_gdm_intercode_ctf.devstral-swe-bench-verified
Devstral SWE-bench Verified Trajectories
This dataset contains 4,000 mini-SWE-agent trajectories generated by
mistralai/Devstral-Small-2-24B-Instruct-2512 on a fixed 250-problem training split of
SWE-bench Verified. There are 16 independently seeded rollouts per problem.
Every row preserves the exact request prefix mini-SWE-agent supplied before Devstral's
first generation, the complete ordered rollout, a sanitized final patch, and termination
metadata. Official SWE-bench… See the full description on the dataset page: https://huggingface.co/datasets/suryadv/devstral-swe-bench-verified.devstral2-123b-swebench-verified-traj
Devstral 2 (123B) SWE-bench Verified Trajectories
This dataset contains agent trajectories from running Devstral 2 (via OpenRouter) on the SWE-bench Verified benchmark using the mini-swe-agent framework.
Model Information
Attribute
Value
Model
Devstral 2
Parameters
123B (dense transformer)
Context Window
256K tokens
Provider
OpenRouter (mistralai/devstral-2512:free)
Specialization
Agentic coding
Framework
mini-swe-agent
Devstral 2 is a… See the full description on the dataset page: https://huggingface.co/datasets/pankajmathur/devstral2-123b-swebench-verified-traj.filtered-SWE-Openhands-Devstral-32k-20K
Dataset Summary
This dataset contains 20,000 high-quality SFT trajectories filtered and selected from SWE-Star, a 250K+ sample dataset collected under a modified OpenHands scaffold. The data is used to train SWE agent models under limited resources with a 32K context window.
A single-source dataset is intentionally selected so that all training trajectories share a uniform scaffold, isolating the scaffold inconsistency effect: any performance variation across evaluation… See the full description on the dataset page: https://huggingface.co/datasets/ubicloud/filtered-SWE-Openhands-Devstral-32k-20K.eval-Devstral-Small-2507_16concurrency_eval_ctx131k_terminal-bench-2.0eval-Devstral-Small-2507_16concurrency_eval_ctx131k_no_terminal-bench-2.0eval-Devstral-Small-2507_16concurrency_eval_ctx131k_no_OpenThoughts-TB-devmistral-large-agent-diff-sft-mixed-old-plus-devstral-r0p8-64keval-Devstral-Small-2507_16concurrency_eval_ctx131k_swebench-verified-random-100-folderseval-Devstral-Small-2507_16concurrency_eval_ctx131k_OpenThoughts-TB-deveval-Devstral-Small-2507_16concurrency_eval_ctx131k_no_swebench-verified-random7d9d050f