datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MolmoAct2-BimanualYAM-DatasetThis dataset was created using LeRobot.
MolmoAct2-BimanualYAM Dataset
This repository is the merged ckpt / merged LeRobot dataset artifact for the MolmoAct2-BimanualYAM Dataset, a large-scale collection of bimanual robot manipulation demonstrations collected for MolmoAct2. Across the full collection, MolmoAct2-BimanualYAM contains more than 720 hours of training demonstrations spanning diverse tabletop manipulation tasks.
Language Annotations
This dataset includes… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-BimanualYAM-Dataset.MolmoAct2-DROID-Dataset
MolmoAct2-DROID Dataset
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you use these… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-DROID-Dataset.Spa_Bench_Full_MolmoAct2
Spa-Bench physical rollouts — MolmoAct2
Physical SO-101 rollout recordings for the MolmoAct2 Spa-Bench checkpoint at
epoch 12, step 76,596.
Scope and counts
This is a complete Spa-Bench evaluation: 900 episodes, comprising 300
primary withheld/OOD spatial trials and 600 diagnostic/control trials. The
repository contains 782,590 frames, 356 unique instruction strings, two
480×640 RGB streams, and six-dimensional state/action at 30 FPS.
Reported physical… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/Spa_Bench_Full_MolmoAct2.abc-molmoact2-yam-mix
ABC + MolmoAct2 YAM Mix — bimanual manipulation (LeRobot v3.0)
21,767 episodes / 61,120,847 frames / 14 language-differentiated tasks @ 30 fps,
224x224, 14-DoF bimanual YAM (cameras: top, left_wrist, right_wrist).
▶ Browse episodes in the LeRobot Dataset Visualizer —
synchronized camera playback + action/state charts. The Dataset Viewer above
shows the numeric streams (state/action/indices) from the data parquets; camera
frames live in chunked video files that only the… See the full description on the dataset page: https://huggingface.co/datasets/kkipngenokoech/abc-molmoact2-yam-mix.MolmoAct2-RT-1-Dataset
MolmoAct2-RT-1 Dataset
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you use these… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-RT-1-Dataset.rollout_molmoact2_500eps_endeffector_eval_20260902_120317This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/mattpidden/rollout_molmoact2_500eps_endeffector_eval_20260902_120317.MolmoAct2-Bridge-Dataset
MolmoAct2-Bridge Dataset
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you use these… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-Bridge-Dataset.rollout_molmoact2_500eps_endeffector_incorrect_task_eval_20260904_104057This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/mattpidden/rollout_molmoact2_500eps_endeffector_incorrect_task_eval_20260904_104057.rollout_molmoact2_500eps_endeffector_hand_trace_eval_20260904_143115This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/mattpidden/rollout_molmoact2_500eps_endeffector_hand_trace_eval_20260904_143115.eval_molmoact_candy_sorting_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 59645,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_candy_sorting_in-distribution.MolmoAct2-BC-Z-Dataset
MolmoAct2-BC-Z Dataset
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you use these… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-BC-Z-Dataset.eval_molmoact_cup_stacking_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 35,
"total_frames": 32048,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:35"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_cup_stacking_in-distribution.rollout_molmoact2_Reasoning_Step_076596_CountingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_molmoact2_Reasoning_Step_076596_Counting.MolmoAct2-MolmoAct-Dataset-Tabletop
MolmoAct2-MolmoAct-Dataset-Tabletop
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-MolmoAct-Dataset-Tabletop.rollout_molmoact2_500eps_baseline_eval_20260901_173248This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/mattpidden/rollout_molmoact2_500eps_baseline_eval_20260901_173248.eval_molmoact_toy_storing_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 40,
"total_frames": 48713,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:40"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_toy_storing_in-distribution.rollout_molmoact2_Reasoning_Step_076596_Referential_DisambiguationThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_molmoact2_Reasoning_Step_076596_Referential_Disambiguation.eval_molmoact_pegboard_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 52,
"total_frames": 45221,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:52"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_pegboard_in-distribution.MolmoAct2-BimanualYAM-DatasetThis dataset was created using LeRobot.
MolmoAct2-BimanualYAM Dataset
This repository is the merged ckpt / merged LeRobot dataset artifact for the MolmoAct2-BimanualYAM Dataset, a large-scale collection of bimanual robot manipulation demonstrations collected for MolmoAct2. Across the full collection, MolmoAct2-BimanualYAM contains more than 720 hours of training demonstrations spanning diverse tabletop manipulation tasks.
Language Annotations
This dataset includes… See the full description on the dataset page: https://huggingface.co/datasets/wanguu1/MolmoAct2-BimanualYAM-Dataset.eval_molmoact_test_tube_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 59879,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_test_tube_in-distribution.eval_molmoact_linearbot_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_linear_bot",
"total_episodes": 34,
"total_frames": 41711,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:34"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_linearbot_in-distribution.eval_molmoact_toy_storing_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 40,
"total_frames": 48713,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:40"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_toy_storing_in-distribution.eval_molmoact_cup_storing_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 45356,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_cup_storing_in-distribution.rollout_molmoact2_Reasoning_Step_076596_Relational_PlacementThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_molmoact2_Reasoning_Step_076596_Relational_Placement.eval_molmoact_test_tube_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 59879,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_test_tube_in-distribution.eval_molmoact_cup_storing_oodThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 23,
"total_frames": 21861,
"total_tasks": 4,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:23"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_cup_storing_ood.eval_molmoact_candy_sorting_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 59645,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_candy_sorting_in-distribution.eval_molmoact_cup_stacking_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 35,
"total_frames": 32048,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:35"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_cup_stacking_in-distribution.eval_molmoact_cup_storing_in-distributionThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 45356,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Jiafei1224/eval_molmoact_cup_storing_in-distribution.eval_molmoact_cup_stacking_oodThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 21,
"total_frames": 20688,
"total_tasks": 3,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:21"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/allenai/eval_molmoact_cup_stacking_ood.