datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
BimanualUR5eExample
Dataset Summary
This dataset provides shards in the WebDataset format for fine-tuning RDT-2 or other policy models on bimanual manipulation.
Each sample packs:
a binocular RGB image (left + right wrist cameras concatenated horizontally)
a relative action chunk (continuous control, 0.8s, 30Hz)
a discrete action token sequence (e.g., from an Residual VQ action tokenizer)
a metadata JSON with an instruction key sub_task_instruction_key to index corresponding instruction from… See the full description on the dataset page: https://huggingface.co/datasets/robotics-diffusion-transformer/BimanualUR5eExample.PhysicalAI-Robotics-mindmap-GR1-Drill-in-Box
Dataset Description:
This dataset is a multimodal collection of trajectories generated in Isaac Lab on the Drill in Box task defined in mindmap.
The task was created to evaluate robot manipulation policies on their spatial memory capabilities.
With this (partial) dataset you can generate the full dataset used for mindmap model training,
run a mindmap training or evaluate mindmap open/closed loop.
This dataset is for research and development only.
Dataset Owner(s):… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-mindmap-GR1-Drill-in-Box.PhysicalAI-Robotics-mindmap-Franka-Cube-Stacking
Dataset Description:
This dataset is a multimodal collection of trajectories generated in Isaac Lab on the Cube Stacking task defined in mindmap.
The task was created to evaluate robot manipulation policies on their spatial memory capabilities.
With this (partial) dataset you can generate the full dataset used for mindmap model training,
run a mindmap training or evaluate mindmap open/closed loop.
This dataset is for research and development only.
Dataset Owner(s):… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-mindmap-Franka-Cube-Stacking.PhysicalAI-Robotics-mindmap-Franka-Mug-in-Drawer
Dataset Description:
This dataset is a multimodal collection of trajectories generated in Isaac Lab on the Mug in Drawer task defined in mindmap.
The task was created to evaluate robot manipulation policies on their spatial memory capabilities.
With this (partial) dataset you can generate the full dataset used for mindmap model training,
run a mindmap training or evaluate mindmap open/closed loop.
This dataset is for research and development only.
Dataset Owner(s):… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-mindmap-Franka-Mug-in-Drawer.micro-tartanair
Mini-TartanAir: a 48x48 dataset for tiny Monocular Depth Estimation
Dataset
This dataset scales down to 48x48 resolution 18 environments from the original TartanAir. In particular, we provide:
tartanair_48x48: training split in 48x48 resolution (taken from the "easy" sequences)
tartanair_hard_48x48: validation split in 48x48 resolution (taken from the "hard" sequences)
All images are annotated with 48x48 depth and disparity maps obtained directly from the synthetic… See the full description on the dataset page: https://huggingface.co/datasets/idsia-robotics/micro-tartanair.