datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
robotwin2.0-hard-multi-embodiment-labelmulti-robot-basketThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "kinova-arx",
"total_episodes": 41,
"total_frames": 25531,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:41"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/rdoshi21/multi-robot-basket.robotwin2.0-hard-multi-embodiment-label-v2robotwin2.0-hard-multirobotfmb_multi
FMB multi-object (LeRobot v3)
A LeRobot Dataset v3 port of the FMB (Functional Manipulation Benchmark)
multi-object manipulation demonstrations (assembly boards), recorded with a Franka Panda arm.
This is a reformatted derivative, not the original release. The original data and
full documentation are published by the authors:
https://huggingface.co/datasets/charlesxu0124/functional-manipulation-benchmark
Paper: arXiv:2401.08553 · Project:… See the full description on the dataset page: https://huggingface.co/datasets/robot-lev/fmb_multi.MultiRobots_handoff
Connectivity-Aware Multi-Robot Edge Inference Dataset
Dataset Description
This dataset contains robot manipulation demonstrations collected from a multi-robot production-line scenario designed to study shared and remote VLA inference for multiple robots.
The experimental setup emulates an industrial production line in which multiple robots share centralized AI inference resources to perform distinct but interdependent tasks within a closed-loop workflow.
Two… See the full description on the dataset page: https://huggingface.co/datasets/OptiNet/MultiRobots_handoff.mobile_robot_lift_pick_and_place_single_multi_egocentricso101_chess_multi_pick_placeThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 10,
"total_frames": 5990,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:10"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/avea-robotics/so101_chess_multi_pick_place.so101_chess_multi_pick_place_contThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 9,
"total_frames": 4874,
"total_tasks": 1,
"total_videos": 18,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:9"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/avea-robotics/so101_chess_multi_pick_place_cont.robot-umi-pr19-hub-multi-baseline-a36a4d8This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"observation.state": {
"dtype": "float32",
"shape": [
6
],
"names": [
"x",
"y",
"z",
"roll",
"pitch",
"yaw"
]
},
"action": {… See the full description on the dataset page: https://huggingface.co/datasets/brandonyang/robot-umi-pr19-hub-multi-baseline-a36a4d8.YOLOv8-Multi-Instance-Object-Detection-Dataset
Multi Instance Object Detection Dataset Sample
Duality.ai just released a 1000 image dataset used to train a YOLOv8 model for object detection -- and it's 100% free!
Just create an EDU account here.
This HuggingFace dataset is a 20 image and label sample, but you can get the rest at no cost by creating a FalconCloud account. Once you verify your email, the link will redirect you to the dataset page.
Dataset Overview
This dataset consists of high-quality images of soup… See the full description on the dataset page: https://huggingface.co/datasets/duality-robotics/YOLOv8-Multi-Instance-Object-Detection-Dataset.multi_robot_handoffmobile_robot_lift_pick_and_place_single_multiso101_chess_multi_pick_place_mergedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 10,
"total_frames": 5990,
"total_tasks": 1,
"total_videos": 20,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:10"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/avea-robotics/so101_chess_multi_pick_place_merged.rollout_mobile_robot_lift_pick_and_place_single_multi_egocentricomx_Multi_TaskingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "aiworker",
"total_episodes": 1,
"total_frames": 987,
"total_tasks": 1,
"total_videos": 1,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/RobotisSW/omx_Multi_Tasking.non-mobile-giver-yaseen-A-20260501_recomputed_statsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0","fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/ASBlab-multirobot/non-mobile-giver-yaseen-A-20260501_recomputed_stats.eval_act_multi_dataset_new_handsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mimic_follower",
"total_episodes": 0,
"total_frames": 0,
"total_tasks": 0,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Mimic-Robotics/eval_act_multi_dataset_new_hands.robotics-multi-agent-coordination-coherence-risk-v0.1What this repo is for
You use it to detect when robot fleets stop coordinating properly.
It captures real deployment failure signals:
shared map divergence
task allocation conflicts
comms latency desync
deadlocks in corridors
swarm formation collapse
Applies to:
warehouse robot fleets
hospital delivery robots
drone swarms
factory material handling
Prompt format
Return exactly one token
coherent or incoherent
robtrain-multi-cam-sample
Robotrain Multi-Camera Sample Dataset
A multimodal human egocentric observation dataset in LeRobot v3 format.
It captures synchronized multi-view video and head motion sensing during
workshop material organization and object handling.
About Robotrain
This dataset was collected by Robotrain, a robotics research company.
For more information about Robotrain and our work, visit our website: https://robotrain.ai
What this dataset offers
Five time-aligned camera… See the full description on the dataset page: https://huggingface.co/datasets/ai-robotrain/robtrain-multi-cam-sample.multi-robotRoboTwin-multi-tasks-LerobotDatasetcli-multi-1779337287-aloha-stack
CLI multi push test: aloha-stack
robot_type: Aloha / task: stack cubes
cli-multi-1779337287-go2-walk
CLI multi push test: go2-walk
robot_type: Go2 / task: walk forward
cli-multi-1779337287-husky-nav
CLI multi push test: husky-nav
robot_type: Husky / task: go to kitchen
cli-multi-1779337287-inspire-grasp
CLI multi push test: inspire-grasp
robot_type: Inspire_Hand / task: grasp bottle
cli-multi-1779337287-so100-pick
CLI multi push test: so100-pick
robot_type: So-100 / task: pick up apple
cli-multi-1779337287-tello-fly
CLI multi push test: tello-fly
robot_type: Tello / task: hover and fly
multi_robot_furniture_liftrobotwin-multi
RoboTwin Multi
Multi-embodiment RoboTwin dataset generated from 19 tasks, 8 embodiment configurations per task, and 50 demonstrations per task-embodiment configuration.
This upload intentionally excludes put_object_cabinet, which did not have 8 stable embodiment configurations in the final generation run.