datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
PhysicalAI-SmartSpaces
Physical AI Smart Spaces Dataset
Overview
Comprehensive, annotated dataset for multi-camera tracking and 2D/3D object detection. This dataset is synthetically generated with Omniverse and Cosmos Transfer.
This dataset consists of over 280 hours of video from across nearly 1,800 cameras from indoor scenes in warehouses, hospitals, retail, and more. The dataset is time synchronized for tracking humans, forklifts, pallet trucks and Autonomous Mobile Robots (AMRs)… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-SmartSpaces.epfl-smart-kitchen-av1
EPFL-Smart-Kitchen AV1 SimpleCV Mirror
This is an AV1-transcoded SimpleCV-compatible mirror of the EPFL-Smart-Kitchen-30 dataset.
Original data:
Collected videos/data: https://zenodo.org/records/15535461
Poses/annotations: https://zenodo.org/records/15551913
GitHub: https://github.com/amathislab/EPFL-Smart-Kitchen
Contents
RGB and HoloLens videos transcoded to AV1 MP4
Depth videos transcoded to AV1 MP4
Metadata, timestamps, IMUs, poses, and annotations preserved… See the full description on the dataset page: https://huggingface.co/datasets/pablovela5620/epfl-smart-kitchen-av1.Ai_SMARTact_smartbin_wrist_v1egocentric-manipulation-sample
SmartDeer — Egocentric Human Demonstration Data (Public Sample)
SmartDeer collects egocentric human demonstration data for embodied AI: real operators, real tasks, real environments. No teleoperation rigs, no lab mock-ups, no actors.
This repository is a small public sample, published so you can inspect our capture quality, annotation schema and file conventions. Production data is delivered under commercial terms.
This sample
Task twist_cap — bimanual bottle-cap… See the full description on the dataset page: https://huggingface.co/datasets/SmartDeer/egocentric-manipulation-sample.lerobot-so-101-manipulations
So-101 Dataset
The dataset comprises 20 episodes of high-quality teleoperated robotic arm recordings at ~30 FPS. It is a compact, curated set captured using multi-view cameras (front, wrist, top) within the calibrated robot studio of the SO-101 arm, leveraging the LeRobot framework. Specifically designed for imitation learning and model training on the LeRobot platform, this dataset demonstrates basic manipulation and pick-and-place tasks with structured LeRobot v2.1 annotations.-… See the full description on the dataset page: https://huggingface.co/datasets/ud-smart-city/lerobot-so-101-manipulations.egostation-smartphone-raw-v1
EgoStation Smartphone Raw Catalog v1
Pre-processing catalog of smartphone egocentric video recordings. Most
episodes are exposed as metadata only; a small set of representative
sample episodes are shipped with full raw video + derived data so
partners can inspect data quality before signing up for the full corpus.
Built: 2026-05-12T19:05Z
Total episodes: 5962
Total recorded time: ~693.9 hours
Format: Apache Parquet (catalog) + raw media for sample episodes
Maintained by: ZenO Labs… See the full description on the dataset page: https://huggingface.co/datasets/zeno-labs/egostation-smartphone-raw-v1.so101_test2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101",
"total_episodes": 2,
"total_frames": 1782,
"total_tasks": 1,
"total_videos": 4,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smartrichard/so101_test2.smart_market_prototype_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "omx_follower",
"total_episodes": 300,
"total_frames": 378133,
"total_tasks": 30,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:300"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kdy93/smart_market_prototype_2.egostation-smartphone-lerobot-sample
EgoStation Smartphone — playable sample
Five short first-person clips of everyday household work, one per task, laid out
in LeRobot v2.1 so they can be scrubbed directly in the
dataset visualiser.
This is a preview, not the corpus. It exists because
zeno-labs/egostation-smartphone-raw-v1
publishes its samples as loose video.mp4 / pose_keypoints.json files, which
no viewer knows how to open. Same footage, rearranged so it plays.
What is in it
Episodes… See the full description on the dataset page: https://huggingface.co/datasets/zeno-labs/egostation-smartphone-lerobot-sample.smart_market_v1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "omx_follower",
"total_episodes": 180,
"total_frames": 153779,
"total_tasks": 12,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:180"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kdy93/smart_market_v1.so101_test5This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101",
"total_episodes": 5,
"total_frames": 4455,
"total_tasks": 1,
"total_videos": 10,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smartrichard/so101_test5.lerobot_v6This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 10,
"total_frames": 1000,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v6.smart_market_prototype_4This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "omx_follower",
"total_episodes": 20,
"total_frames": 21971,
"total_tasks": 2,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:20"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kdy93/smart_market_prototype_4.smart-airport-test-assetssmart_market_prototype_3This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "omx_follower",
"total_episodes": 60,
"total_frames": 116807,
"total_tasks": 6,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:60"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kdy93/smart_market_prototype_3.lerobot_v11This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 5,
"total_frames": 500,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v11.lerobot_gym_robotfall-detection
Fall Detection - 10,000 videos
Dataset contains 10,000 high-resolution videos of staged human fall events recorded across indoor and outdoor settings using static and moving cameras. This camera dataset supports fall detection computer vision research by providing well-structured metadata, realistic fall scenarios, and consistent 1080p video quality for training and evaluating detection systems.- Get the data
Dataset characteristics:
Characteristic
Data… See the full description on the dataset page: https://huggingface.co/datasets/ud-smart-city/fall-detection.car-accident-video
Car Accident Dataset - 5,000 videos
The dataset contains 5,000 videos capturing crashes occurring in traffic accidents, providing structured data for detection and prediction tasks. It is designed to support traffic safety research, focusing on motor vehicle incidents and crash reports. Specifically engineered to challenge detection models and enhance traffic accident recognition systems.- Get the data
Dataset characteristics:
Characteristic
Data
Description
Video… See the full description on the dataset page: https://huggingface.co/datasets/ud-smart-city/car-accident-video.act_smartbin_v6This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "roarm_m3",
"total_episodes": 81,
"total_frames": 10798,
"total_tasks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:81"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4"… See the full description on the dataset page: https://huggingface.co/datasets/Bubbleina/act_smartbin_v6.smartqs-demosmart_market_prototype_1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "omx_follower",
"total_episodes": 173,
"total_frames": 231238,
"total_tasks": 6,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:173"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kdy93/smart_market_prototype_1.lerobot_v12This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 5,
"total_frames": 500,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v12.lerobot_v14This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 5,
"total_frames": 500,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v14.smart_dice_rollThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 15,
"total_frames": 12576,
"total_tasks": 1,
"total_videos": 45,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:15"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Matlef/smart_dice_roll.lerobot_v5This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 3,
"total_frames": 300,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v5.lerobot_v7This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 5,
"total_frames": 500,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v7.lerobot_v9This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 5,
"total_frames": 500,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v9.lerobot_v16This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 30,
"total_frames": 1408,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/smarttiger/lerobot_v16.