deepagent
deepagent
DeepAgent
Hard, Docker-verifiable software-engineering benchmarks from real merged PRs
DeepAgent ships real_pr Harbor hardness packs: live-mined multi-file pull requests, clone@SHA agent images, held-out verifier tests, and Docker dual-truth (solution reward = 1, null reward = 0). Primary product work runs through the deepagent CLI in the GitHub monorepo.
Surface
Ref
Role
HF stable pin
this dataset revision main
Current product on Hub (N=9)
HF automation… See the full description on the dataset page: https://huggingface.co/datasets/BaseIntelligence/deepagent.DeepAgent-Datasets
DeepAgent Datasets
Paper | GitHub
This repository contains the pre-processed evaluation datasets for DeepAgent, an end-to-end deep reasoning agent that performs autonomous thinking, tool discovery, and action execution within a single, coherent reasoning process.
Dataset Summary
The repository includes curated data for several major benchmarks used to evaluate reasoning agents across different domains:
General Tool Use
ToolBench: Features 16,000+… See the full description on the dataset page: https://huggingface.co/datasets/lixiaoxi45/DeepAgent-Datasets.pydanticai-DeepAgents
Pydantic AI DeepAgents Training Dataset
A high-quality conversational dataset for fine-tuning LLMs on the pydantic-deepagents library.
Dataset Details
Format: Conversational (JSONL with messages array)
Entries: 1,125 training examples
Language: Python (pydantic-ai framework)
Purpose: Code generation and agent creation patterns
Dataset Structure
Each entry follows the conversational format:
{
"messages": [
{"role": "system", "content": "You are an expert… See the full description on the dataset page: https://huggingface.co/datasets/georgep4181/pydanticai-DeepAgents.