datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
vidstg_fps1so101_follower_main_put_the_red_lego_block_in_the_black_cup_eps100_fps30_480x640
so101_follower_put_the_red_lego_block_in_the_black_cup_eps100_fps30_480x640
This dataset was generated using a phospho starter pack.
This dataset contains a series of episodes recorded with a robot and multiple cameras. It can be directly used to train a policy using imitation learning. It's compatible with LeRobot and RLDS.
bimanual-pick-apricot-0828-fps15FPS-Bench
995/1000 videos downloaded
FPS-Bench
A benchmark for high-frame-rate video understanding (CVPR 2026, Carnegie
Mellon University). FPS-Bench is a 1,000-example multiple-choice VideoQA benchmark
targeting fine-grained temporal perception — questions that cannot be answered
from a handful of sparsely sampled frames.
It introduces minFPS (minimum necessary frame rate): the lowest frame rate at
which a human can consistently verify the answer (every question requires
minFPS ≥… See the full description on the dataset page: https://huggingface.co/datasets/xiarenqincai/FPS-Bench.combined_so101_follower_put_the_red_lego_block_in_the_black_cup_eps100_fps30
combined_so101_follower_put_the_red_lego_block_in_the_black_cup_eps100_fps30
This dataset was generated using a phospho starter pack.
This dataset contains a series of episodes recorded with a robot and multiple cameras. It can be directly used to train a policy using imitation learning. It's compatible with LeRobot and RLDS.
scanqa_video_64_frames_1_fps_360x420_4500_500SO101-lv4-3color-cube-mat-to-mat-no-human-reset-v1-topcamcrop-fps15This dataset was created using LeRobot.
FPS 15 Even/Odd Split
This is a derived version of geonmin-kim/SO101-lv4-3color-cube-mat-to-mat-no-human-reset-v1-topcamcrop (fps=30) resampled to fps=15 by splitting every original episode into two:
original episode i (n frames) -> new episode 2*i = its even frames (0, 2, 4, ...; ceil(n/2) frames)
original episode i -> new episode 2*i + 1 = its odd frames (1, 3, 5, ...; floor(n/2) frames)
246 original episodes become 492… See the full description on the dataset page: https://huggingface.co/datasets/geonmin-kim/SO101-lv4-3color-cube-mat-to-mat-no-human-reset-v1-topcamcrop-fps15.lego-in-bowl-fps30-640x480-twf_325eps_mergedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_325eps_merged.fpsbench
FPS-Bench
A benchmark for high-frame-rate video understanding (CVPR 2026, Carnegie
Mellon University). FPS-Bench is a 1,000-example multiple-choice VideoQA benchmark
targeting fine-grained temporal perception — questions that cannot be answered
from a handful of sparsely sampled frames.
It introduces minFPS (minimum necessary frame rate): the lowest frame rate at
which a human can consistently verify the answer (every question requires
minFPS ≥ 4), across nine task categories of… See the full description on the dataset page: https://huggingface.co/datasets/Kartiksh/fpsbench.eval_act_koch_test_10_fps_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 1087,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_10_fps_2.eval_pi0full_s30k_fps21_task06This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 2752,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task06.eval_act_koch_test_60_fps_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 1356,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_60_fps_2.eval_act_koch_test_60_fpsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 2245,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 60,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_60_fps.rollout_hiliter_01_fps12_20260901_221007This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/nitsuga-hug/rollout_hiliter_01_fps12_20260901_221007.lego-in-bowl-fps30-640x480-twf_20260821_195806This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_20260821_195806.eval_pi0full_s30k_fps21_task11This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 1405,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task11.eval_pi0full_s30k_fps21_task01This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 922,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task01.lego-in-bowl-fps30-640x480-twf_20260821_192854This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_20260821_192854.eval_act_koch_test_60_fps_30This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 1101,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_60_fps_30.rollout_episodic_im2_fps30_sec20_rtc_smolvla_20260813_151417This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/imstevenpmwork/rollout_episodic_im2_fps30_sec20_rtc_smolvla_20260813_151417.lego-in-bowl-fps30-640x480-twf_20260821_203213This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_20260821_203213.eval_act_koch_test_10_fpsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 1089,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 60,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_10_fps.lego-in-bowl-fps30-640x480-twf_200eps_mergedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_200eps_merged.lego-in-bowl-fps30-640x480-twf_20260819_121456This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/Neutrollized/lego-in-bowl-fps30-640x480-twf_20260819_121456.eval_pi0full_s30k_fps21_task09This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 3452,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task09.ny_test_frames_right_fps_20This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "sam_evt2",
"total_episodes": 20,
"total_frames": 7514,
"total_tasks": 1,
"total_videos": 80,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:20"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/1g0rrr/ny_test_frames_right_fps_20.eval_pi0full_s30k_fps21_task08This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 4721,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task08.eval_act_koch_test_stop_20_fpsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "koch",
"total_episodes": 10,
"total_frames": 1534,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 20,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/eval_act_koch_test_stop_20_fps.omx_f_20_fps12_blue_block_pickThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "omx_f",
"total_episodes": 5,
"total_frames": 1200,
"total_tasks": 1,
"total_videos": 10,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 12,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/hicohico1/omx_f_20_fps12_blue_block_pick.eval_pi0full_s30k_fps21_task02This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 5,
"total_frames": 3212,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 21,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/eval_pi0full_s30k_fps21_task02.