datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
python-toolcallsLogs from run_python_code tool used for benchmarking.
synthetic-math-toolcall-deception
Synthetic Math Tool-Call Deception
200 paired multi-turn math-assistant trajectories (400 rows) for evaluating deception
detectors on mid-trajectory tool-call misreporting.
Each trajectory: a system prompt instructs the model to compute via an execute_python
tool under a stated tool-call limit, and requires every call to carry a running
call_index argument (1 for the first call, 2 for the second, …). The platform enforcing
the limit is said to only see the reported call_index… See the full description on the dataset page: https://huggingface.co/datasets/annahbanannah/synthetic-math-toolcall-deception.3w_toolkit
Table of Content
Introduction
Release Notes
1.0.0
1.1.0
1.1.1
2.0.0
Introduction
All 3W Dataset data files (files in the subdirectories of the dataset directory) are licensed under the Creative Commons Attribution 4.0 International License.
Release Notes
Each subsection below contains release notes for a specific 3W Dataset version. Differences from the immediately previous version are highlighted.
1.0.0
Release: July 1, 2019.
This was the… See the full description on the dataset page: https://huggingface.co/datasets/rafaelpadilla/3w_toolkit.G1_Dex1_Organize_ToolsThis dataset was created using LeRobot.
Due to the inability to precisely describe spatial positions, adjust the scene to closely match the first frame of the dataset after installing the hardware as specified in Part 5 of AVP Teleoperation Documentation.
Data collection is not completed in a single session, and variations between data entries exist. Ensure these variations are accounted for during model training.
Dataset Structure
meta/info.json:
{
"codebase_version":… See the full description on the dataset page: https://huggingface.co/datasets/unitreerobotics/G1_Dex1_Organize_Tools.atlas-25-sequential-tool-runtime-upgrade
ATLAS report 25: the sequential tool runtime on verl V1
1. Question and links
Read this first. Every stage of the bring-up ran to its evidence; the report is complete for the correctness acceptance of issue 59 and for its performance stack (a second pass: the call parser fixed after an independent judgement, a boundary rollout at a 1024-token cap, one stacked performance ladder whose first tier, a48k, is now the campaign's default) and for its first research use:… See the full description on the dataset page: https://huggingface.co/datasets/t2ance/atlas-25-sequential-tool-runtime-upgrade.Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1
Dataset Description:
We created an RL dataset for conversational tool-use by utilizing existing expert tool-use trajectories. We pose each assistant step of the trajectory as a separate behavior cloning problem where the policy model is incentivized to match the tool call choices of the expert model. Each trajectory includes the use of tools for authentication, data lookup, servicing (i.e. booking reservations, changing them, getting discounts, etc), and more across 838 different… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1.agent-think-tool_use
Agent Think Tool Use
Датасет многошаговых агентных сессий для дообучения моделей работе с кодом, инструментами и инженерными задачами. Записи содержат пользовательские требования, комментарии агента во время работы, decision summaries, вызовы инструментов, результаты запусков, обработку ошибок и финальную проверку.
Каждый shard представляет отдельную связанную сессию, а не отдельный вопрос и ответ. Данные охватывают исследование задачи, работу с документацией, проектирование… See the full description on the dataset page: https://huggingface.co/datasets/ru-dataset/agent-think-tool_use.SPADE-Environment-Pool-GPT5.5-ToolUse
SPARE GPT-5.5 Multi-Turn Tool-Use Games v1
A public static pool of 11,039 validated multi-turn tool-use environments generated by GPT-5.5 for SPARE actor training.
Training alignment
Source recipe: Qwen3-30B-A3B 0624 tool-use GAMES configuration
400 rollouts x 24 games/rollout = 9,600 no-reuse games required
11,039 validated games provide 1,439 games of headroom
Six balanced skills: API orchestration, data retrieval, state modification, error recovery, tool… See the full description on the dataset page: https://huggingface.co/datasets/spade-rl/SPADE-Environment-Pool-GPT5.5-ToolUse.hf-coding-tools-traces-all
HuggingFace AI Coding Tools — Agent Traces
This dataset rehydrates the benchmark results from
davidkling/hf-coding-tools-dashboard
into the JSONL session format consumed by the
Hugging Face Agent Trace Viewer.
What's inside
31 sessions, one per (tool, model, effort, thinking) configuration
9,603 query → response turns total (≈19,206 events)
Tools covered: claude_code, codex, copilot, cursor
Models: claude-opus-4-6, claude-sonnet-4-6, claude-sonnet-4.6, composer-2… See the full description on the dataset page: https://huggingface.co/datasets/davidkling/hf-coding-tools-traces-all.AgiBot-g1_tool_storage
AgiBot-g1_tool_storage
📋 Overview
This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot.
Robot Type: ruantong_a2d
| Codebase Version: v2.1
End-Effector Type: two_finger_gripper
🏠 Scene Types
This dataset covers the following scene types:
home
🤖 Atomic Actions
This dataset includes the following atomic actions:
grasp
place
pick
📊 Dataset Statistics
Metric
Value
Total Episodes
67… See the full description on the dataset page: https://huggingface.co/datasets/RoboCOIN/AgiBot-g1_tool_storage.browsecomp-plus-selected-tools-analysis-v1
BrowseComp-Plus: Selected Tools Analysis
Side-by-side view of selected tool calls from a reference trajectory alongside the new agent trajectory conditioned on those steps.
Retrieval model: Qwen3-Embedding-8BAgent model: gpt-oss-120bRun: traj_summary_ext_selected_tools_gpt-oss-120b_seed0
Columns
Column
Description
query_id
Query identifier
rationale
GPT rationale for why these k steps were selected from the reference trajectory
selected_indices
Step indices… See the full description on the dataset page: https://huggingface.co/datasets/timchen0618/browsecomp-plus-selected-tools-analysis-v1.swe-agent-tool-rubrics-860
SWE Agent 逐 turn 工具调用评判数据集（860 个决策点）
本数据集来自 2026-08-06 的一次实验：**从真实 SWE agent 轨迹中归纳"怎么判断一次工具调用的好坏"**。
包含两个文件：
文件
行数
大小
内容
cases.jsonl
860
5.0 MB
决策点原始数据（题目、历史、两个候选命令、执行结果、现役判官打分）
map_io.jsonl
860
9.6 MB
每个决策点喂给 GPT-5.6 的完整 prompt 原文与完整回复
两个文件通过 case_id 一一对应。
背景：为什么是"按动作分类"而不是"按工具分类"
轨迹来自 slime 的 minimal harness，该 harness 只暴露一个工具 bash
（slime/agent/harness/minimal.py 里的 BASH_TOOL），全部 328,270 次调用的工具名都是 bash。
所以"不同工具用不同 rubric"无法按工具名实现，只能按命令在干什么分类。… See the full description on the dataset page: https://huggingface.co/datasets/MasterVito/swe-agent-tool-rubrics-860.hf-coding-tools-traces_april26
HuggingFace AI Coding Tools — Agent Traces
This dataset rehydrates the benchmark results from
davidkling/hf-coding-tools-dashboard
into the JSONL session format consumed by the
Hugging Face Agent Trace Viewer.
What's inside
32 sessions, one per (tool, model, effort, thinking) configuration
9,130 query → response turns total (≈18,260 events)
Tools covered: claude_code, codex, copilot, cursor
Models: claude-opus-4-6, claude-sonnet-4-6, claude-sonnet-4.6, composer-2… See the full description on the dataset page: https://huggingface.co/datasets/clem/hf-coding-tools-traces_april26.hf-coding-tools-traces-run-april12
HuggingFace AI Coding Tools — Agent Traces
This dataset rehydrates the benchmark results from
davidkling/hf-coding-tools-dashboard
into the JSONL session format consumed by the
Hugging Face Agent Trace Viewer.
What's inside
31 sessions, one per (tool, model, effort, thinking) configuration
8,875 query → response turns total (≈17,750 events)
Tools covered: claude_code, codex, copilot, cursor
Models: claude-opus-4-6, claude-sonnet-4-6, claude-sonnet-4.6, composer-2… See the full description on the dataset page: https://huggingface.co/datasets/davidkling/hf-coding-tools-traces-run-april12.AgiBot-g1_box_storage_tool
AgiBot-g1_box_storage_tool
📋 Overview
This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot.
Robot Type: ruantong_a2d
| Codebase Version: v2.1
End-Effector Type: two_finger_gripper
🏠 Scene Types
This dataset covers the following scene types:
home
🤖 Atomic Actions
This dataset includes the following atomic actions:
grasp
place
pick
📊 Dataset Statistics
Metric
Value
Total Episodes
99… See the full description on the dataset page: https://huggingface.co/datasets/RoboCOIN/AgiBot-g1_box_storage_tool.deepseek-v4-pro-agent-tool-calling-trajectory
DeepSeek V4 Pro ToolScale Agent SFT Dataset
A curated subset of multi-turn tool-calling trajectories generated by DeepSeek V4 Pro on ToolScale. The dataset is filtered by action-match score against ground-truth trajectories and is designed for supervised fine-tuning of agentic models on realistic, multi-step tool use.
Each conversation includes natural-language user requests, tool calls, tool observations, assistant reasoning traces, and grounded final responses across five… See the full description on the dataset page: https://huggingface.co/datasets/zake7749/deepseek-v4-pro-agent-tool-calling-trajectory.hf-coding-tools-traces
HF Coding Tools — Agent Traces
This dataset rehydrates the benchmark run in davidkling/hf-coding-tools-dashboard into the JSONL session format consumed by the Hugging Face Agent Trace Viewer.
What's inside
31 sessions, one per (tool, model, effort, thinking) configuration
8,881 query → response turns total (≈17,762 events)
Tools covered: claude_code, codex, copilot, cursor
Models: claude-opus-4-6, claude-sonnet-4-6, claude-sonnet-4.6 (Copilot), gpt-4.1… See the full description on the dataset page: https://huggingface.co/datasets/clem/hf-coding-tools-traces.tool-use
Tool-use rollouts (Qwen3, think/nothink)
Tool-augmented code-generation rollouts: Qwen3-8B and Qwen3-14B, each in
thinking and non-thinking mode, on DS-1000, LiveCodeBench (Python) and
Multilingual-LCB (OCaml). During generation the model can call a run_code
tool (up to 3 rounds) that executes its candidate in a sandbox (pinned DS-1000
env / LCB public tests / OCaml compile+publics) and returns real output.
Design: 100 samples per instance at temperature 0.6 (bf16, vLLM)… See the full description on the dataset page: https://huggingface.co/datasets/samuki-hf/tool-use.yam_bimanual_tool_rack
Dataset Card for YAM bimanual — tool-rack placement
Preview
Egocentric camera view — bimanual robot picking a screwdriver off the bench and inserting it into the tool rack.
Interactive visualizer: huggingface.co/spaces/lerobot/visualize_dataset
66 teleoperated episodes of a bimanual robot arm picking a screwdriver off a
bench and inserting it into a tool rack. Recorded on real hardware at 40 Hz with
three RGB cameras, converted to LeRobot v3.0. This repository… See the full description on the dataset page: https://huggingface.co/datasets/knpt/yam_bimanual_tool_rack.Qwen-3.6-plus-agent-tool-calling-trajectory
Qwen 3.6 Plus: ToolScale Agent SFT Dataset
Multi-turn tool-calling trajectories generated by Qwen 3.6 Plus via OpenRouter on ToolScale. Both passing and near-passing rollouts are included, allowing users to choose their own quality threshold using reward and score.
Each row is a flattened conversation prefix ending at one assistant turn, ready for next-token SFT. Assistant turns include a reasoning_content field containing the model’s reasoning.
What's inside… See the full description on the dataset page: https://huggingface.co/datasets/zake7749/Qwen-3.6-plus-agent-tool-calling-trajectory.so100_pull_cube_by_tool_errorThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 20,
"total_frames": 4381,
"total_tasks": 1,
"total_videos": 40,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:20"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/sixpigs1/so100_pull_cube_by_tool_error.Hand_Tools
ABC-iRobotics/Hand_Tools: dataset 0000
Metric RGB-D scene dataset generated with the Label Factory workflow.
The files for this capture are stored below the 0000/ directory so
multiple numbered datasets can coexist in this repository.
Training configurations
depth_estimation: RGB input, metric depth target, intrinsics and depth units
instance_segmentation: RGB input, instance-mask target, boxes and annotations
object_pose_estimation: RGB-D input, masks, camera… See the full description on the dataset page: https://huggingface.co/datasets/ABC-iRobotics/Hand_Tools.Hand_tools
KarolyArmin/Hand_tools
Growing multi-task RGB-D collection generated with the Label Factory workflow.
Every capture is stored in its own zero-padded directory (0000, 0001,
0002, ...). Uploading a new capture appends it to the collection without
replacing earlier directories. Task configurations aggregate compatible
Parquet shards from every numbered directory.
Training configurations
depth_estimation: RGB input, metric depth target, intrinsics and depth units… See the full description on the dataset page: https://huggingface.co/datasets/KarolyArmin/Hand_tools.hf-coding-tools-traces
HuggingFace AI Coding Tools — Agent Traces
This dataset rehydrates the benchmark results from
davidkling/hf-coding-tools-dashboard
into the JSONL session format consumed by the
Hugging Face Agent Trace Viewer.
What's inside
32 sessions, one per (tool, model, effort, thinking) configuration
9,130 query → response turns total (≈18,260 events)
Tools covered: claude_code, codex, copilot, cursor
Models: claude-opus-4-6, claude-sonnet-4-6, claude-sonnet-4.6, composer-2… See the full description on the dataset page: https://huggingface.co/datasets/davidkling/hf-coding-tools-traces.danish-tool-dialogues-v9
danish-tool-dialogues-v1
Danish multi-turn tool-use conversations with reasoning, translated from the
Glaive subset of
Nanbeige/ToolMind
(Apache-2.0) by scripts/translate_toolmind_da.py.
Complements danish-tool-calls-v1, which is single-turn and synthetic. Here
the conversations run several turns, tool results are fed back, and the
assistant reasons before calling.
split
rows
train
34,168
eval_seen_tools
698
eval_unseen_tools
768
eval_seen_sym
752… See the full description on the dataset page: https://huggingface.co/datasets/jensjepsen/danish-tool-dialogues-v9.unitree_put_away_tools_lerobot_v2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 48,
"total_frames": 24271,
"total_tasks": 1,
"total_videos": 144,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:48"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/unitree_put_away_tools_lerobot_v2.tool-scraper_daniel_20260827_124546This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/rbtrprjkt/tool-scraper_daniel_20260827_124546.trossen_ai_stationary_organize_toolsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"chunks_size": 1000,
"codebase_version": "v2.1",
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"dataset_name": "organzize_tools",
"date_created": "10-07-2025",
"features": {
"action": {
"dtype": "float32",
"names": [
"left_joint_0.pos",
"left_joint_1.pos"… See the full description on the dataset page: https://huggingface.co/datasets/TrossenRoboticsCommunity/trossen_ai_stationary_organize_tools.put-away-tools-v2_new_camThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 100,
"total_frames": 66321,
"total_tasks": 1,
"total_videos": 300,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/put-away-tools-v2_new_cam.put_away_tools_v2_new_cam_grootThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 100,
"total_frames": 66321,
"total_tasks": 1,
"total_videos": 300,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/put_away_tools_v2_new_cam_groot.