datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
203-checkerboard-shellgameThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 16,
"total_frames": 11649,
"total_tasks": 1,
"total_videos": 48,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:16"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/203-checkerboard-shellgame.shell_game_touchshell_game_eef_subtask
shell_game — delta EEF, per-frame subtask
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under. 45 episodes, 18,442 frames.
Delta EEF, 10-dim. Six sentences, assigned per frame:
observe 6,051 frames
uncover the left cup 2,203
uncover the middle cup 1,517
uncover the right cup 1,848
move the red cube into the basket 6,823
Labels are derived from state… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_eef_subtask.shell_game_joint_global
shell_game — joint actions, global instruction
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under and drops it in a basket. 45 episodes, 18,442 frames.
Absolute joint targets, 8-dim. Every frame carries the same sentence:
Find the cup hiding the block after the swaps and move it into the basket.
This is the only one of the three whose action space the DROID runtime already speaks.
Converted from the recorder's DROID-schema… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_joint_global.shell_game_eef_global
shell_game — delta EEF, global instruction
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under. 45 episodes, 18,442 frames.
Delta EEF, 10-dim. Every frame carries the same sentence:
Find the cup hiding the block after the swaps and move it into the basket.
Paired with shell_game_eef_subtask, which differs only in the language: same episodes, same
action space, per-frame subtasks instead of one sentence.
Converted from the… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_eef_global.2024-Shell-Game-Transcripts
2024 Shell Game Transcripts
Complete transcripts from the 2024 episodes of the Shell Game podcast.
Generated from this GitHub repository.
xarm7_beavrsim_shellgame_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 41409,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/arclabmit/xarm7_beavrsim_shellgame_dataset.All-Shell-Game
All Shell Transcripts
Complete transcripts from every episode of the Shell Game podcast from 2024 to present.
Generated from this GitHub repository.
xarm7_beavrsim_shellgame_small_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 50,
"total_frames": 24663,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_small_dataset.196-ShellGame-LeftCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1790,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-LeftCup.196-ShellGame-RightCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1791,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-RightCup.196-ShellGame-MiddleCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1790,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-MiddleCup.xarm7_beavrsim_shellgame_labeled_dataset_fixedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 36253,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_labeled_dataset_fixed.xarm7_beavrsim_shellgame_labeled_cartesianThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 36253,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_labeled_cartesian.shell_game_touch_vla_v0
shell_game_touch_vla_v0
LeRobot-format (codebase v3.0) dataset extracted from mikasa-robo/mikasa-robo-vla-lerobot (subfolder shell_game_touch_vla_v0).
Robot type: mikasa_robo
Episodes: 250
Frames: 5378
Cameras: observation.images.top, observation.images.wrist
All credit for the data goes to the original authors.
mikasa-robo-vla-shell_game_push_vla_v0
Physically merged MIKASA-Robo-VLA LeRobot-v3 dataset
Source repo: mikasa-robo/mikasa-robo-vla-lerobot
Merged folders:
shell_game_push_vla_v0
This dataset was physically merged into one root-level LeRobot-v3 dataset.
Important: meta/stats.json is copied from the first source dataset as a fallback. Recompute stats with your LeRobot version before long training if possible.
2025-Shell-Game-Transcripts
2025 Shell Game Transcripts
Complete transcripts from the 2025 episodes of the Shell Game podcast.
Generated from this GitHub repository.
shell-game-sim-v0