datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
course-imagesapex-agents
APEX–Agents
APEX–Agents is a benchmark from Mercor for evaluating whether AI agents can execute long-horizon, cross-application professional services tasks. Tasks were created by investment banking analysts, management consultants, and corporate lawyers, and require agents to navigate realistic work environments with files and tools (e.g., docs, spreadsheets, PDFs, email, chat, calendar).
Tasks: 480 total (160 per job category)
Worlds: 33 total (10 banking, 11 consulting, 12… See the full description on the dataset page: https://huggingface.co/datasets/mercor/apex-agents.agent-reward-bench
AgentRewardBench
💾Code
📄Paper
🌐Website
🤗Dataset
💻Demo
🏆Leaderboard
AgentRewardBench: Evaluating Automatic Evaluations of Web Agent TrajectoriesXing Han Lù, Amirhossein Kazemnejad*, Nicholas Meade, Arkil Patel, Dongchan Shin, Alejandra Zambrano, Karolina Stańczak, Peter Shaw, Christopher J. Pal, Siva Reddy*Core Contributor
Loading dataset
You can use the huggingface_hub library to load the dataset. The dataset is available on Huggingface Hub at… See the full description on the dataset page: https://huggingface.co/datasets/McGill-NLP/agent-reward-bench.gaia2_filesystem
GAIA2 Filesystem
This is a dataset containing files for the GAIA2 benchmark. You should not use this dataset on its own, but instead use the Meta Agents Research Environments framework to execute scenarios from that GAIA2 dataset.
Dataset Link
https://huggingface.co/datasets/meta-agents-research-environments/gaia2
Contact Details
Publishing POC: Meta AI Research Team
Affiliation: Meta Platforms, Inc.
Website:… See the full description on the dataset page: https://huggingface.co/datasets/meta-agents-research-environments/gaia2_filesystem.UI-Genie-Agent-16kThis repository contains the Trajectory dataset from the paper UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based
Mobile GUI Agents.
Github: https://github.com/Euphoria16/UI-Genie
Edge-Agent-Reasoning-WebSearch-260K
Edge Agent Reasoning WebSearch 260K
Abstract
The Edge-Agent-Reasoning-WebSearch-260K dataset is a massive, synthetically expert-engineered corpus of over 700 Million tokens, designed to train small, local models (SLMs) and edge-deployed agents in advanced problem deconstruction and self-aware reasoning.
Rather than training a model to execute instructions directly—which often leads to hallucinations when context is missing—this dataset trains a model to act as a… See the full description on the dataset page: https://huggingface.co/datasets/yatin-superintelligence/Edge-Agent-Reasoning-WebSearch-260K.Omnimodal-Agent-SFT-2K
OmniGAIA: Omni-Modal General AI Assistant Benchmark
📄 Paper
•
💻 Code & Demo
•
🤗 Dataset & Model
•
📈 Leaderboard
This dataset contains omni-modal agent supervised fine-tuning (SFT) trajectories in the LlamaFactory SFT data format. You can directly follow LlamaFactory's instructions to fine-tune your omni-modal LLMs.OmniGAIA is a benchmark for Omni-Modal General AI Assistants that jointly reason over vision, audio, and language with external tools. It is… See the full description on the dataset page: https://huggingface.co/datasets/RUC-NLPIR/Omnimodal-Agent-SFT-2K.final-certificatesGui-agent
Gui-Agent — GUI trajectories in LIBERO/VLA format
Human GUI demonstrations from four sources, unified into a single VLA-style
intermediate representation and written as LIBERO-layout HDF5, so LIBERO/VLA
dataloaders run against GUI data unchanged.
raw source ──[adapter]──> GuiEpisode ──[writer]──> LIBERO-style HDF5
per-source the IR format- what you train on
only specific
25,872 episodes / 453,264 steps / 235 GB… See the full description on the dataset page: https://huggingface.co/datasets/Yushi123/Gui-agent.TIR-Bench
TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
Introduction:
TIR-Bench is a comprehensive benchmark designed to evaluate the "thinking-with-images" capabilities of Multimodal Large Language Models (MLLMs), addressing a gap left by existing benchmarks like Visual Search which only test basic operations. As models like OpenAI o3 begin to intelligently create and operate tools to transform images for problem-solving, TIR-Bench provides 13… See the full description on the dataset page: https://huggingface.co/datasets/Agents-X/TIR-Bench.gui-agent-outputAgenticOCR-SFT
AgenticOCR SFT Training Data
Supervised fine-tuning data for the AgenticOCR project.
The dataset contains 7,631 training records in sft_combined_0422.json. Image paths in each record are relative to the repository root and point into sft_images/.
project2-agentic-langdata-es
Agentic Language Learning — ES Dataset
Auto-prepared via Data Ingestion & Augmentation pipeline (Functions 1 & 2).
Contents
Clean images: data/train/chunk_*
Augmented images: data/aug/chunk_*
Metadata: metadata/es_clean.csv (+ aug if available)
Each CSV has columns path, text, lang, split.
AgentHorizon
AgentHorizon
AgentHorizon is a benchmark for evaluating LLM judges of computer-use agents. Each item is a recorded trajectory of a GUI agent attempting a long-horizon desktop task (often 100 to 300+ steps), paired with a ground-truth label that says whether the agent actually completed the task. A judge reads the trajectory (instruction, action sequence, and screenshots) and predicts success or failure.
Repository contents
Path
What it is… See the full description on the dataset page: https://huggingface.co/datasets/ServiceNow/AgentHorizon.AgentIF-OneDay
Dataset Card for AgentIF-OneDay
Dataset Details
AgentIF-OneDay is a comprehensive benchmark designed to evaluate AI agents on diverse, daily tasks across work, life, and learning scenarios. Unlike evaluations focused solely on task difficulty, this dataset emphasizes the breadth of general user needs, requiring agents to handle complex attachments, infer implicit instructions, and deliver tangible file-based outputs. It comprises 104 tasks structured around Open… See the full description on the dataset page: https://huggingface.co/datasets/xbench/AgentIF-OneDay.EMU-Agentic-PostTrain-Dataagedb
AgeDB HF-ready
This folder packages the local AgeDB images as a Hugging Face imagefolder dataset.
Dataset Structure
train/images/<shard>/: AgeDB image files split into shard directories.
train/metadata.csv: per-image labels and metadata.
The labels are derived from the AgeDB filename pattern:
<image_id>_<identity>_<age>_<gender>.jpg
Columns
file_name: relative image path used by Hugging Face ImageFolder, such as images/000/example.jpg.
label: numeric… See the full description on the dataset page: https://huggingface.co/datasets/marcelohaps/agedb.agent-tts-libraryAgentic-MME
Agentic-MME Dataset
This is the official dataset for the Agentic-MME benchmark, featured in Hugging Face Daily Papers.
Agentic-MME is a comprehensive benchmark designed to evaluate the abilities of multimodal agents in tool-use, web searching, and multi-step reasoning through visual clues.
Usage
You can load the dataset using the Hugging Face datasets library:
from datasets import load_dataset
dataset = load_dataset("Crystal1047/Agentic-MME")
# To see the first record… See the full description on the dataset page: https://huggingface.co/datasets/Agentic-MME/Agentic-MME.agent-as-policy
Agent as Policy — Real Dual-Arm LLM-Agent Manipulation Trials
Paper · Project page · Code
Summary
162 real-robot trials in which an LLM agent acts directly as the policy on a
bimanual YAM arm setup: it reads camera observations through a tool interface,
issues Cartesian and joint commands, and judges its own completion. Ten
manipulation tasks (block stacking, die flipping, towel folding, part insertion
and assembly, throwing), six models, three reasoning-effort… See the full description on the dataset page: https://huggingface.co/datasets/Agent-as-Policy/agent-as-policy.agent_paper_reviewwave-uiLICENSE
Face-Age_UTKFACE_FGNET
Face-Age_UTKFACE_FGNET Dataset
Overview
Property
Value
Total Images
32,173
Age Range
0 - 90 years
Age Classes
91 (folders 0-90)
Mean Image Dimensions
269 x 271 px
Sources
UTKFace dataset, FGNET dataset
HuggingFace Repo
YoussefAboelwafa/Face-Age_UTKFACE_FGNET
Structure
dataset/
├── train/
│ ├── 0/ # Age 0 (34 images)
│ ├── 1/ # Age 1 (1,039 images)
│ │ ...
│ └── 90/ # Age 90 (82 images)… See the full description on the dataset page: https://huggingface.co/datasets/YoussefAboelwafa/Face-Age_UTKFACE_FGNET.gelato-osworld-agent-trajectoriesCreative-Professionals-Agentic-Tasks-1M
Creative Professionals Agentic Tasks (1M)
Abstract
A massive-scale, high-fidelity synthetic task dataset comprising 1,070,917 agentic command operations across 36 creative, technical, and engineering software environments. This dataset is engineered exclusively to stress-test, evaluate, and fine-tune multimodal AI agents designed for Agent Environment operation, complex software interaction, and multi-step reasoning within deep software infrastructures.… See the full description on the dataset page: https://huggingface.co/datasets/yatin-superintelligence/Creative-Professionals-Agentic-Tasks-1M.unified-agent-trajectories
Unified Benchmark Agent Trajectories
Dataset release: v2.1.1 (2026-09-18)Record format: unified-agent-sft-v1
A growing collection of benchmark agent execution trajectories converted into one
transparent, multimodal, tool-aware representation. These are complete recorded benchmark
runs—not ordinary chat transcripts—including benchmark tasks, model reasoning and answers,
tool calls, tool observations, runtime status, and benchmark scores when available. The
directory layout is… See the full description on the dataset page: https://huggingface.co/datasets/ChrisDing1105/unified-agent-trajectories.wave-ui-25k
WaveUI-25k
This dataset contains 25k examples of labeled UI elements. It is a subset of a collection of ~80k preprocessed examples assembled from the following sources:
WebUI
RoboFlow
GroundUI-18K
These datasets were preprocessed to have matching schemas and to filter out unwanted examples, such as duplicated, overlapping and low-quality datapoints. We also filtered out many text elements which were not in the main scope of this work.
The WaveUI-25k dataset includes the original… See the full description on the dataset page: https://huggingface.co/datasets/agentsea/wave-ui-25k.Agentic-SLS-ASTM
Agentic-SLS-ASTM
ASTM mechanical-test specimens (D638 tensile, D790 flex) printed on the Inova Mk1 SLS printer and pulled on an MTS / TestWorks Instron. Each row is a single specimen with full geometry, scalar results, stress–strain + raw DAQ curves, and — for SLS rows — FK references and an embedded snapshot of the upstream print profile from ppak10/Agentic-SLS-Database.
Rows are self-contained for ML use: the full PrintProfile JSON is inlined, so features (material/energy… See the full description on the dataset page: https://huggingface.co/datasets/ppak10/Agentic-SLS-ASTM.apex-agents
APEX–Agents
APEX–Agents is a benchmark from Mercor for evaluating whether AI agents can execute long-horizon, cross-application professional services tasks. Tasks were created by investment banking analysts, management consultants, and corporate lawyers, and require agents to navigate realistic work environments with files and tools (e.g., docs, spreadsheets, PDFs, email, chat, calendar).
Tasks: 480 total (160 per job category)
Worlds: 33 total (10 banking, 11 consulting, 12… See the full description on the dataset page: https://huggingface.co/datasets/idleengine/apex-agents.SWITCH
SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios
[arXiv]
[leaderboard]
[dataset]
[PDF]
Dataset Summary
SWITCH (Semantic World Interface Tasks for Control & Handling) is a multimodal embodied-interaction benchmark for understanding, modeling, and evaluating actions over Tangible Control Interfaces (TCIs) in egocentric real-world scenarios.
TCIs include everyday interfaces such as appliance panels, lighting… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-Agents/SWITCH.