datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ToolScale
ToolScale Dataset
The ToolScale dataset is a key component of the ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestrationproject. It provides synthetic environment and tool-call tasks specifically generated to aid the reinforcement learning (RL) training of small orchestrator models. These orchestrators are designed to effectively manage and coordinate diverse intelligent tools and other models for solving complex, multi-turn agentic tasks.… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/ToolScale.G1_Dex1_Organize_ToolsThis dataset was created using LeRobot.
Due to the inability to precisely describe spatial positions, adjust the scene to closely match the first frame of the dataset after installing the hardware as specified in Part 5 of AVP Teleoperation Documentation.
Data collection is not completed in a single session, and variations between data entries exist. Ensure these variations are accounted for during model training.
Dataset Structure
meta/info.json:
{
"codebase_version":… See the full description on the dataset page: https://huggingface.co/datasets/unitreerobotics/G1_Dex1_Organize_Tools.ToolRet-Tools🔧 Retrieving useful tools from a large-scale toolset is an important step for Large language model (LLMs) in tool learning. This project (ToolRet) contribute to (i) the first comprehensive tool retrieval benchmark to systematically evaluate existing information retrieval (IR) models on tool retrieval tasks; and (ii) a large-scale training dataset to optimize the expertise of IR models on this tool retrieval task.
This ToolRet-Tools contains the toolset corpus of our tool retrieval benchmark.… See the full description on the dataset page: https://huggingface.co/datasets/mangopy/ToolRet-Tools.browsecomp-plus-selected-tools-analysis-v1
BrowseComp-Plus: Selected Tools Analysis
Side-by-side view of selected tool calls from a reference trajectory alongside the new agent trajectory conditioned on those steps.
Retrieval model: Qwen3-Embedding-8BAgent model: gpt-oss-120bRun: traj_summary_ext_selected_tools_gpt-oss-120b_seed0
Columns
Column
Description
query_id
Query identifier
rationale
GPT rationale for why these k steps were selected from the reference trajectory
selected_indices
Step indices… See the full description on the dataset page: https://huggingface.co/datasets/timchen0618/browsecomp-plus-selected-tools-analysis-v1.Seal-Tools
Seal-Tools
This Huggingface repository contains the dataset generated in Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmark.
Abstract
Seal-Tools contains self-instruct API-like tools. Seal-Tools not only offers a large
number of tools, but also includes instances
which demonstrate the practical application
of tools. Seeking to generate data on a large
scale while ensuring reliability, we propose a
self-instruct method to generate… See the full description on the dataset page: https://huggingface.co/datasets/casey-martin/Seal-Tools.Dolci-Instruct-SFT-No-ToolsA version of our new Instruct dataset with tool-use data removed, for people not needing that skill.
For the full dataset, documentation, etc. see the main dataset card.
This dataset is licensed under ODC-BY. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines.
Citation
@misc{olmo2025olmo3,
title={Olmo 3},
author={Team Olmo and Allyson Ettinger and Amanda Bertsch and Bailey Kuehl and David Graham and David Heineman and Dirk Groeneveld… See the full description on the dataset page: https://huggingface.co/datasets/allenai/Dolci-Instruct-SFT-No-Tools.Step-3.5-Flash-SFT-No-Tools
Step-3.5-Flash-SFT No-Tools
Filtered subset of stepfun-ai/Step-3.5-Flash-SFT containing only plain chat rows from the raw JSON shards.
Final kept rows: 1493471
No-tool rows before secret filtering: 1495099
Rows removed by accepted secret scan findings: 1628
Primary data files are Parquet shards under data/train-*.parquet.
Filter predicate:
conversations must be a list,
every message must be an object,
message roles must be limited to system, user, and assistant,
no message may… See the full description on the dataset page: https://huggingface.co/datasets/MetonymousAI/Step-3.5-Flash-SFT-No-Tools.trajectories-thinking-toolsHand_Tools
ABC-iRobotics/Hand_Tools: dataset 0000
Metric RGB-D scene dataset generated with the Label Factory workflow.
The files for this capture are stored below the 0000/ directory so
multiple numbered datasets can coexist in this repository.
Training configurations
depth_estimation: RGB input, metric depth target, intrinsics and depth units
instance_segmentation: RGB input, instance-mask target, boxes and annotations
object_pose_estimation: RGB-D input, masks, camera… See the full description on the dataset page: https://huggingface.co/datasets/ABC-iRobotics/Hand_Tools.Hand_tools
KarolyArmin/Hand_tools
Growing multi-task RGB-D collection generated with the Label Factory workflow.
Every capture is stored in its own zero-padded directory (0000, 0001,
0002, ...). Uploading a new capture appends it to the collection without
replacing earlier directories. Task configurations aggregate compatible
Parquet shards from every numbered directory.
Training configurations
depth_estimation: RGB input, metric depth target, intrinsics and depth units… See the full description on the dataset page: https://huggingface.co/datasets/KarolyArmin/Hand_tools.unitree_put_away_tools_lerobot_v2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 48,
"total_frames": 24271,
"total_tasks": 1,
"total_videos": 144,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:48"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/unitree_put_away_tools_lerobot_v2.tool-scraper_daniel_20260827_124546This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/rbtrprjkt/tool-scraper_daniel_20260827_124546.so101_pickplace_toolsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 90,
"total_frames": 57019,
"total_tasks": 1,
"total_videos": 182,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:90"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ankithreddy/so101_pickplace_tools.Tool-REX-Toolsput-away-tools-v2_new_camThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 100,
"total_frames": 66321,
"total_tasks": 1,
"total_videos": 300,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/put-away-tools-v2_new_cam.TinyQuery-Tools-Multilingual
TinyQuery Tools Multilingual
GitHub: source code, setup guide, streaming examples and tests
A synthetic, fictitious dataset for learning schema-conditioned SQL and tool actions from English, imperfect English, Hindi and Hinglish. Created for a four-hour, from-scratch small-model experiment. It contains no real user databases.
Split
Examples
Purpose
Train
347,376
Semantic scenarios, teacher language and randomized context variants
Validation
1,200
Held-out domain… See the full description on the dataset page: https://huggingface.co/datasets/karmx/TinyQuery-Tools-Multilingual.put_away_tools_v2_new_cam_grootThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 100,
"total_frames": 66321,
"total_tasks": 1,
"total_videos": 300,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/put_away_tools_v2_new_cam_groot.Multivariate_time_series_data_of_milling_processes_with_varying_tool_wear_and_machine_tools
Flattened version of the "Multivariate time series data of milling processes with varying tool wear and machine tools" dataset in the .parquet file format. Original dataset: https://doi.org/10.17632/zpxs87bjt8.3 and original paper: https://doi.org/10.1016/j.dib.2023.109574
Description
The presented dataset provides labeled, multivariate time series data of milling processes with varying tool wear and for varying machine tools. The width of the flank wear land VB… See the full description on the dataset page: https://huggingface.co/datasets/alpha-by-beta/Multivariate_time_series_data_of_milling_processes_with_varying_tool_wear_and_machine_tools.ttz_tools_mergedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/JanPhilipp/ttz_tools_merged.ttz-tools-sep-7-04_20260907_124202This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/AlexanderRoempke/ttz-tools-sep-7-04_20260907_124202.ttz-tools-sep-7-01_20260907_103419This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/AlexanderRoempke/ttz-tools-sep-7-01_20260907_103419.ttz_tools_merged_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/JanPhilipp/ttz_tools_merged_2.ttz-tools-sep-7-03_20260907_114655This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/AlexanderRoempke/ttz-tools-sep-7-03_20260907_114655.ttz-tools-sep-7-05_20260907_130306This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/AlexanderRoempke/ttz-tools-sep-7-05_20260907_130306.tools-benchmark
Cynaptics Tools Benchmark
Public split: 54 multi-hop QA examples (18 each of 2/3/4-hop).
Fields: id, question, context, answer, category, subcategory, metadata.
salesforce_hermes_toolspi05-unitree-g1-put-away-tools-v2.1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Dex1_Sim",
"total_episodes": 70,
"total_frames": 43851,
"total_tasks": 1,
"total_videos": 210,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:70"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/XiaoweiLinXL/pi05-unitree-g1-put-away-tools-v2.1.ttz_tools_1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/JanPhilipp/ttz_tools_1.openart-tools
OpenART Materialized Tools
Materialized tool-store companion dataset for OpenART Arena.
This dataset contains materialized OpenART tool directories packaged as zip shards,
with Dataset Viewer metadata in Parquet. It is intended for reproducing OpenART
Arena tool-loading experiments without rerunning large-scale tool materialization.
Paper: https://arxiv.org/abs/2608.00677
Contents
data/tools/metadata-00000.parquet: one metadata row per exported tool.… See the full description on the dataset page: https://huggingface.co/datasets/dongdongunique/openart-tools.ttz-tools-sep-7-02_20260907_112310This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/AlexanderRoempke/ttz-tools-sep-7-02_20260907_112310.