datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
GUI-World
GUI-World: A Dataset for GUI-Orientated Multimodal Large Language Models
Dataset: GUI-World
Overview
GUI-World introduces a comprehensive benchmark for evaluating MLLMs in dynamic and complex GUI environments. It features extensive annotations covering six GUI scenarios and eight types of GUI-oriented questions. The dataset assesses state-of-the-art ImageLLMs and VideoLLMs, highlighting their limitations in handling dynamic and multi-step tasks. It provides… See the full description on the dataset page: https://huggingface.co/datasets/ONE-Lab/GUI-World.eval-resultsBEACON-Dataset
BEACON: Behavioral Engine for Authentication and Continuous Monitoring
An anonymized multi-modal behavioral biometric dataset collected during VALORANT gameplay,
designed for continuous user authentication research.
28 participants · 79 sessions · 445 GB
Participants are represented by opaque IDs (P001–P028) and sessions by sequential
IDs (S001, S002, ...). Raw participant names, consent files, hostnames, MAC
addresses, and direct device IDs are not included in this release.… See the full description on the dataset page: https://huggingface.co/datasets/beacon-gui/BEACON-Dataset.GUI-Net-Video
GUI-Net-Video
A collection of video URLs for GUI-related tasks, organized by platform or application.
This dataset provides the video URLs collected for TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents — a framework that turns multimodal web tutorials (including YouTube videos) into large-scale GUI agent trajectories. Each URL is paired with a GUI task description (the .txt filename) and grouped by platform/app.
Paper: arXiv:2504.12679… See the full description on the dataset page: https://huggingface.co/datasets/Bofeee5675/GUI-Net-Video.VG-GUI-Bench
VG-GUI-Bench
Video-Guided GUI Agent Benchmark — the benchmark contribution of our ECCV 2026 paper
Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction.
Authors. Sunqi Fan, Qingle Liu, Runqi Yin, Meng-Hao Guo, Shuojin Yang (Tsinghua University).
What is VG-GUI-Bench?
Recent Multimodal Large Language Models (MLLMs) achieve strong results on Video Question Answering
(VideoQA), but existing benchmarks mostly probe shallow visual… See the full description on the dataset page: https://huggingface.co/datasets/Aoraku/VG-GUI-Bench.AIRBOT_MMK2_play_the_guitar
AIRBOT_MMK2_play_the_guitar
📋 Overview
This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot.
Robot Type: discover_robotics_aitbot_mmk2
| Codebase Version: v2.1
End-Effector Type: five_finger_hand
🏠 Scene Types
This dataset covers the following scene types:
home
🤖 Atomic Actions
This dataset includes the following atomic actions:
grasp
pick
place
pull
📊 Dataset Statistics… See the full description on the dataset page: https://huggingface.co/datasets/RoboCOIN/AIRBOT_MMK2_play_the_guitar.widowxai-organize-table-generic-0-30ep-30v_20260825_160145This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-organize-table-generic-0-30ep-30v_20260825_160145.pose-guided-fall-detection-icta2026
Pose-Guided Temporal Modeling for Robust Vision-Based Fall Detection
This repository contains a reproducible vision-based fall detection pipeline for an ICTA-style technical paper. It focuses on pose/keypoint dynamics, lightweight temporal modeling, ablation, and robustness tests on a 24 GB RTX 3090.
What is included
Dataset manifest builder for URFD, Multiple Cameras Fall Dataset, and generic video folders.
Pose extraction with YOLO pose models from sampled… See the full description on the dataset page: https://huggingface.co/datasets/minhy112/pose-guided-fall-detection-icta2026.guided_marvels_spider_man_2_recordings_01
漫威蜘蛛侠2 raw recordings
This dataset contains raw game recordings managed by Game Data Platform. Access requests require manual approval.
Game ID: game_ae2c5af176e4e2eab106954f144c7b7f
Collection: guided (精数据)
Recordings: 155
Layout: recordings/<recording_id>/<raw component>
pose-guided-fall-detection-icta2026
Pose-Guided Temporal Modeling for Robust Vision-Based Fall Detection
This repository contains a reproducible vision-based fall detection pipeline for an ICTA-style technical paper. It focuses on pose/keypoint dynamics, lightweight temporal modeling, ablation, and robustness tests on a 24 GB RTX 3090.
What is included
Dataset manifest builder for URFD, Multiple Cameras Fall Dataset, and generic video folders.
Pose extraction with YOLO pose models from sampled… See the full description on the dataset page: https://huggingface.co/datasets/MahedixHasan/pose-guided-fall-detection-icta2026.widowxai-fold-cloth-1_20260825_154027This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-1_20260825_154027.widowxai-fold-cloth-0_20260825_152912This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-0_20260825_152912.game-world-model-dataset-visual-guidewidowxai-fold-cloth-2_20260825_154251This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-2_20260825_154251.guitar-demo
CERES capture dataset
LeRobot v3 episodes captured with CERES.
Open in the CERES dataset viewer
Acquisition statistics
Episodes: 1
Retained recorder slots: 2683
Explicit tracking gaps: 22
Captured duration: 1 min 29 s
Recorder rate: 30 Hz
Device: Native WebXR; Quest 3
Captured with CERES.
g1_hand_guide_valThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Inspire",
"total_episodes": 8,
"total_frames": 3499,
"total_tasks": 1,
"total_videos": 8,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:8"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JunnDooChoi/g1_hand_guide_val.GuideMe_Test_Subset50
GuideMe — Example Data (Preview Subset)
This folder contains a small preview subset of the GuideMe benchmark,
released for early-stage verification of the data format and the evaluation
pipeline. It is not the full dataset.
Full data coming soon. We will release the complete GuideMe dataset
(2,458 videos, 223.7 hours, 47,775 streaming interaction samples
across cooking, daily-life guidance, object manipulation, and fitness) shortly.
This subset lets you validate your setup… See the full description on the dataset page: https://huggingface.co/datasets/alisn/GuideMe_Test_Subset50.widowxai-organize-the-table-trainingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "widowxai_follower_robot",
"total_episodes": 30,
"total_frames": 44525,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet"… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-organize-the-table-training.record-testThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 9,
"total_frames": 2688,
"total_tasks": 1,
"total_videos": 9,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:9"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/GuillaumeRZ/record-test.widowxai-clear-table-test8This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "widowxai_follower_robot",
"total_episodes": 3,
"total_frames": 450,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-clear-table-test8.eval_ballhitv1-record-testThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 50,
"total_frames": 12870,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Guitar-Fan/eval_ballhitv1-record-test.guidebot_navigationThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "guidebot_client",
"total_episodes": 21,
"total_frames": 69640,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:21"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/HarrisonLee24/guidebot_navigation.so100_bi_guiThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_bimanual",
"total_episodes": 28,
"total_frames": 8932,
"total_tasks": 1,
"total_videos": 84,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:28"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/hamidkaloorazi/so100_bi_gui.widowxai-clear-table-test2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "widowxai_follower_robot",
"total_episodes": 2,
"total_frames": 2134,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-clear-table-test2.g1_hand_guide_trainThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "Unitree_G1_Inspire",
"total_episodes": 24,
"total_frames": 8707,
"total_tasks": 1,
"total_videos": 24,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:24"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JunnDooChoi/g1_hand_guide_train.ballhit2-record-testThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 30,
"total_frames": 9253,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Guitar-Fan/ballhit2-record-test.r_4This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 0,
"total_frames": 0,
"total_tasks": 0,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/GuilloCarey/r_4.GUI_TestThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"observation.images.board": {
"dtype": "video",
"shape": [
480,
640,
3
],
"names": [
"height",
"width",
"channel"
],
"info": {
"video.height":… See the full description on the dataset page: https://huggingface.co/datasets/AnonymousMouse404/GUI_Test.r6This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 4,
"total_frames": 4400,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/GuilloCarey/r6.widowxai-clear-table-test_15This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "widowxai_follower_robot",
"total_episodes": 3,
"total_frames": 450,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-clear-table-test_15.