datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
robot-action-prediction-dataset
Robotic Action Prediction Dataset
Dataset Description
This dataset contains triplets of (current observation, action instruction, future observation) for training models to predict future frames of robotic actions.
Dataset Structure
Data Fields
current_frame: Input image (RGB) of the current observation
instruction: Textual description of the action to perform
future_frame: Target image (RGB) showing the expected outcome 50 frames later… See the full description on the dataset page: https://huggingface.co/datasets/bryandts/robot-action-prediction-dataset.robot_pickup_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 50,
"total_frames": 10207,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path": null,
"features": {… See the full description on the dataset page: https://huggingface.co/datasets/DozenDucc/robot_pickup_dataset.robot-bottle-datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 331,
"total_frames": 140760,
"total_tasks": 2,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:331"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/jhalwaysthespecial/robot-bottle-dataset.chris_robot_dataset_with_tracesThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 4,
"total_frames": 1272,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/brandonyang/chris_robot_dataset_with_traces.combined_chris_robot_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 0,
"total_frames": 0,
"total_tasks": 0,
"total_videos": 0,
"total_chunks": 0,
"chunks_size": 1000,
"fps": 15,
"splits": {},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/brandonyang/combined_chris_robot_dataset.real_robot_data_arrangement_mixedrobot-bottle-datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "panda",
"total_episodes": 331,
"total_frames": 140760,
"total_tasks": 2,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:331"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4"… See the full description on the dataset page: https://huggingface.co/datasets/michios/robot-bottle-dataset.robot_jersey_dataset
NUpbr RoboCup Jersey-Colour Robot Detection Dataset
1,707 physically-based-rendered images of RoboCup Humanoid Soccer scenes,
generated with NUpbr, each
containing 1-4 robots and one ball, with per-instance bounding boxes and,
for each robot, a jersey colour.
Every frame is restricted to at most two distinct jersey colours across all
robots present, regardless of robot count. Each robot is independently
assigned one of the two colours sampled fresh for that frame from a wide… See the full description on the dataset page: https://huggingface.co/datasets/Ysobel/robot_jersey_dataset.trossen-robot-data
Trossen Robot Cube Stacking Dataset
Dataset for training robotic manipulation policies on the Trossen WidowX Dual Robot cube stacking task using MuJoCo simulation.
Dataset Overview
This dataset contains demonstrations for a cube stacking task with delta actions, suitable for:
Behavioral Cloning (BC): Dual-arm 14D action space
Reinforcement Learning (RL): Single-arm 7D action space
RL Single-Arm Dataset (rl_delta_single_arm)
File:… See the full description on the dataset page: https://huggingface.co/datasets/poolvarine/trossen-robot-data.chris_robot_dataset_with_traces_fixedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 87,
"total_frames": 19814,
"total_tasks": 6,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:87"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/brandonyang/chris_robot_dataset_with_traces_fixed.real_robot_data_arrangement_blue_black_redreal_robot_data_arrangement_black_red_blueSimaihub_Mobile_Robot_Navigation_Training_Dataset_sampleSimaihub Mobile Robot Navigation Training Dataset (Isaac Lab)
Version: V2.0 , Release Date: 2026-08-14
Short Blurb
Licensed expert navigation trajectories for offline RL and imitation learning — multi-scene indoor AMR data with domain randomization, dynamic obstacles,
and recovery behaviors.
In addition to core navigation datasets, we will continue to expand simulation datasets for segmented embodied intelligence scenarios, including industrial robotic arm operation, warehouse… See the full description on the dataset page: https://huggingface.co/datasets/Simaihub/Simaihub_Mobile_Robot_Navigation_Training_Dataset_sample.shrugmaster-robot-dataset
Shrugmaster_Bimanual_Manipulation
Robot manipulation dataset with 2 episodes.
Dataset Structure
Episodes: 2 episodes of robot manipulation
Cameras: 3 camera views (base, arm1, arm2)
Joints: 34 joint states
Format: LeRobot v2.1
Usage
from lerobot.common.datasets import LeRobotDataset
dataset = LeRobotDataset("Sraghvi/shrugmaster-robot-dataset")
Files
data/chunk-000/: Parquet files with episode data
videos/chunk-000/: MP4 video files for each… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/shrugmaster-robot-dataset.chris_robot_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 1,
"total_frames": 99,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/brandonyang/chris_robot_dataset.my_robot_dataset_v1.19-taggedmy_robot_dataset_v1.19ros2-robot-dataset-testmy-new-robot-datasetrobot-test-datasetros2-robot-dataset-with-imagesrobot-checkers-datasetcelebrities_datasetrobot_datasetchris_robot_dataset_with_embeddingsrobot-manipbench-dataset
ManipBench Real-Robot Dataset
Preprocessed dataset for evaluating Vision-Language Models on robot manipulation tasks.
Each sample contains one robot scene image with three questions:
question_1 (Q1): Multiple-choice — choose the correct picking point and gripper trajectory from 4 options. answer_1: letter A–D.
question_2 (Q2): Open-ended — choose the correct picking point from candidates visible on the image. answer_2: Picking Point: <index>.
question_3 (Q3): Open-ended — given the… See the full description on the dataset page: https://huggingface.co/datasets/Huyt/robot-manipbench-dataset.robot-arm-dataset-v1robot_camera_datasetsample-robot-datasettaco-robot-dataset