datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Robo2VLM-1
Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
Abstract
Vision-Language Models (VLMs) acquire real-world knowledge and general reasoning ability through Internet-scale image-text corpora. They can augment robotic systems with scene understanding and task planning, and assist visuomotor policies that are trained on robot trajectory data. We explore the reverse paradigm - using rich, real, multi-modal robot trajectory data to… See the full description on the dataset page: https://huggingface.co/datasets/keplerccc/Robo2VLM-1.ManipulationVQA-60k
Robo2VLM-Reasoning
Samples from the dataset: Robo2VLM-1, prompting gemini-2.5-pro to generate reasoning traces supporting the correct choice.
Paper: Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
@misc{chen2025robo2vlmvisualquestionanswering,
title={Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets},
author={Kaiyuan Chen and Shuangyu Xie and Zehan Ma and Ken Goldberg}… See the full description on the dataset page: https://huggingface.co/datasets/keplerccc/ManipulationVQA-60k.Robo2VLM-ERtestdata