datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
AgentJudgeBench
AgentJudgeBench: Evaluating LLM Judge Reliability on Agentic Tool-Calling
A benchmark for systematically evaluating how reliably LLM judges assess
agentic tool-calling workflows across structured, dependency-driven tasks.
Why this benchmark?
AgentJudgeBench measures how reliably LLM judges assess agentic tool-calling outputs. It provides 3,808 benchmark records spanning six DAG topologies and three difficulty… See the full description on the dataset page: https://huggingface.co/datasets/ServiceNow-AI/AgentJudgeBench.OpenJudge
OpenJudge Benchmark Dataset
Benchmark dataset for evaluating graders across text, multimodal, and agent scenarios. This dataset supports the OpenJudge framework with labeled preference pairs for quality-assured grader development.
Dataset Statistics
Evaluation Benchmarks
Category
Task
Files
Samples
🤖 Agent
12
166
action
1
8
memory
3
47
plan
1
7
reflection
3
52
tool
4
52
🖼️ Multimodal
4
80
image_coherence
1
20
image_editing… See the full description on the dataset page: https://huggingface.co/datasets/agentscope-ai/OpenJudge.daily-oracle
Daily Oracle
📰 Project Website📝 Paper - Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle
Daily Oracle is a continuous evaluation benchmark using automatically generated QA pairs from daily news to assess how the future prediction capabilities of LLMs evolve over time.
Dataset Details
Question Type: True/False (TF) & Multiple Choice (MC)
Current Version*
Time Span: 2020.01.01 - 2026.07.18
Size: 20,376 TF questions and 18,557 MC… See the full description on the dataset page: https://huggingface.co/datasets/agentic-learning-ai-lab/daily-oracle.ai-agent-security-policy-decisions
AI Agent Security Policy Decisions
ai-agent-security-policy-decisions is a 2,400-record synthetic dataset for classifying proposed AI-agent tool actions as allow, deny, require_human_approval, or allow_with_restrictions. Each scenario includes identity and permission context, sensitivity, risk factors, required controls, a concise rationale, and a safer alternative.
The dataset addresses the decision point between an agent proposing an action and a tool or policy gateway… See the full description on the dataset page: https://huggingface.co/datasets/rksharma1947/ai-agent-security-policy-decisions.hendar-agentic-ai-dataset
Hendar Agentic AI Evaluation & Security Benchmark
A compact, expert-authored benchmark for evaluating trustworthy agentic AI systems across capability, tool use, retrieval, security, policy enforcement, multi-agent coordination and regression safety. The current release contains 104 synthetic cases: 13 cases in each of 8 domains.
This dataset is a public companion to the Agentic AI Academy by Hendar Mawan, PhD. It is designed for evaluation, CI regression testing, red-team… See the full description on the dataset page: https://huggingface.co/datasets/h0000w/hendar-agentic-ai-dataset.AI_Agent_Task_Dataset
🤖 Massive AI Agent Task Dataset (10.5GB)
📌 Overview
Welcome to the AI Agent Task Dataset, a massive 10.5GB procedural dataset designed for training, fine-tuning, and evaluating autonomous AI agents and LLMs.
This dataset focuses on:
Multi-step reasoning
Tool usage (APIs, frameworks, systems)
Real-world execution workflows
Perfect for building agentic AI systems, copilots, and automation models.
📑 Table of Contents
Dataset Details
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/oncody/AI_Agent_Task_Dataset.ecommerce-ai-data-analyst-agent-benchmark
E-commerce AI Data Analyst Agent Benchmark
A synthetic e-commerce dataset for evaluating AI data analyst agents on
realistic, multi-step business analysis, data-quality investigation, and
analytical reasoning.
This dataset is part of the
E-commerce AI Data Analyst Agent Benchmark.
Dataset summary
This dataset supports evaluation of AI data analyst agents on realistic,
multi-step e-commerce analysis.
It contains:
customers.csv
products.csv
orders.csv
returns.csv… See the full description on the dataset page: https://huggingface.co/datasets/Omcrec/ecommerce-ai-data-analyst-agent-benchmark.OWASP-Agentic-AI-Threats
OWASP Agentic AI Threats and Mitigations
Dataset Summary
The OWASP Agentic AI Threats and Mitigations Question Answering Dataset is a
synthetic instruction-style question-answering dataset derived from the OWASP
Agentic AI - Threats and Mitigations report.
The dataset is designed to support training, fine-tuning, retrieval evaluation,
and domain-specific question-answering use cases related to agentic AI security,
large language model agents, multi-agent… See the full description on the dataset page: https://huggingface.co/datasets/leeroy-jankins/OWASP-Agentic-AI-Threats.ai-agents-fr
Agents IA - Dataset Francais
Dataset bilingue complet sur les Agents IA, les Frameworks Multi-Agents et le Model Context Protocol (MCP).
Contenu du Dataset
Categorie
Nombre d'entrees
Description
Architectures d'Agents
15
ReAct, Plan-and-Execute, Reflexion, Multi-Agent, Hierarchique, Swarm, etc.
Frameworks
12
CrewAI, AutoGen, LangGraph, Semantic Kernel, Haystack, Dify, etc.
MCP & Tool Use
15
Architecture MCP, transports, function calling, securite… See the full description on the dataset page: https://huggingface.co/datasets/AYI-NEDJIMI/ai-agents-fr.ai-agents-en
AI Agents - English Dataset
Comprehensive bilingual dataset on AI Agents, Multi-Agent Frameworks, and the Model Context Protocol (MCP).
Dataset Contents
Category
Entry Count
Description
Agent Architectures
15
ReAct, Plan-and-Execute, Reflexion, Multi-Agent, Hierarchical, Swarm, etc.
Frameworks
12
CrewAI, AutoGen, LangGraph, Semantic Kernel, Haystack, Dify, etc.
MCP & Tool Use
15
MCP architecture, transports, function calling, security, ecosystem… See the full description on the dataset page: https://huggingface.co/datasets/AYI-NEDJIMI/ai-agents-en.AI-Agent-Generating-Tool-Debugging-Prompt-Library
Dataset Card for "AI Agent Generating Tool & Debugging Prompt Library" 🤖⚙️
Dataset Details 📚
Dataset Name: AI Agent Generating Tool & Debugging Prompt Library
Dataset Description:This dataset includes a collection of prompts focused on building and debugging AI-driven tools, including creating self-improving AI agents and debugging prompts for Python projects. The dataset is designed for use in fine-tuning models related to code generation, debugging, and software… See the full description on the dataset page: https://huggingface.co/datasets/Chemically-motivated/AI-Agent-Generating-Tool-Debugging-Prompt-Library.agent-evaluation-benchmark
Agent Evaluation Benchmark
A benchmark dataset for evaluating AI agent tool-use capabilities across 55+ test cases spanning 14 categories.
Overview
This benchmark tests whether AI agents can correctly select and use the right MCP tools for real-world tasks. It covers data retrieval, blockchain queries, security analysis, academic research, and more.
Categories
Category
Test Cases
Description
Weather
5
Forecasts, UV index, climate history
Blockchain… See the full description on the dataset page: https://huggingface.co/datasets/aiagentkarl/agent-evaluation-benchmark.AgenticRag
AgenticRAG-FP
This repository describes AgenticRAG-FP, a research dataset and evaluation
suite for studying how failures propagate through agentic retrieval-augmented
generation pipelines. The dataset normalizes multi-hop QA examples into a common
schema, runs real or mock ReAct-style RAG agents over them, injects controlled
failures at specific retrieval/reasoning hops, and records whether diagnostic
methods can recover the true root cause after the failure has propagated.
The… See the full description on the dataset page: https://huggingface.co/datasets/anote-ai/AgenticRag.agent-reliability-2026q3
Agent Reliability Benchmark, 2026-Q3
Status: planned. Results target 2026-09. Depends on paiteq/ai-eval-harness v0.2 (agent rubric layer).
A dated, reproducible benchmark on agent reliability. 100 tasks covering tool-calling, multi-step execution, and error recovery. Pass@1, pass@5, mean steps, mean cost per task, recovery rate, and latency p95 across Claude, GPT, Gemini, and an open-source baseline.
This dataset card is the canonical landing for the task set. Full methodology… See the full description on the dataset page: https://huggingface.co/datasets/paiteq-ai/agent-reliability-2026q3.mcp-server-catalog
MCP Server Catalog
A comprehensive catalog of 38 Model Context Protocol (MCP) servers for AI agents, covering data access, agent infrastructure, business-to-agent interfaces, compliance, and more.
Overview
This dataset provides a structured catalog of MCP servers that give AI agents access to real-world data and capabilities. Each server follows the MCP standard and can be used with Claude, GPT, and other LLMs that support tool use.
Categories
Category… See the full description on the dataset page: https://huggingface.co/datasets/aiagentkarl/mcp-server-catalog.