datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
PhysicalAI-Autonomous-Vehicles
PHYSICAL AI AUTONOMOUS VEHICLES
The PhysicalAI-Autonomous-Vehicles dataset provides one of the largest, geographically diverse collections of multi-sensor data empowering AV researchers to build the next generation of Physical AI based end-to-end driving systems. This dataset is ready for commercial/non-commercial AV use per the license agreement.
Data Collection Method
Automatic/Sensor
Labeling Method
Automatic/Sensor
This dataset has a total of 1700 hours of driving… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Autonomous-Vehicles.resultsPhysicalAI-WorldModel-Synthetic-Autonomous-Driving-Scenarios
Dataset Description:
PhysicalAI-WorldModel-Synthetic-Autonomous-Driving-Scenarios is a large-scale synthetic video dataset of autonomous-driving scenes generated with NVIDIA's internal Omniverse simulation platform. Each clip is a temporally consistent multi-camera surround capture of one ego vehicle and surrounding traffic participants, paired with per-camera VLM captions. The dataset is designed to fill gaps in real-world driving data along two axes: (1) targeted long-tail… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-WorldModel-Synthetic-Autonomous-Driving-Scenarios.PhysicalAI-Autonomous-Vehicles-NuRec
task_categories:
- robotics
tags:
- physicalAI
Find the 1500+ scenes in the sample_set/26.04_release folder.
Dataset Description:
Neural reconstructed dataset that carries 3D reconstructed driving scenes. The scenes are about 20 second long and stored in form of usdz files, along with respective xodr map files, surface mesh. The reconstructions were generated using 6 camera views (front-wide 120 deg, front-tele 30 deg, cross right/left 120 deg and rear right/left… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Autonomous-Vehicles-NuRec.PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams
PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams
Paper | Paper Website | GitHub
Download
We provide a download script to download our dataset. If you have enough space, you can use git to download a dataset from huggingface.
usage: download.py [-h] --odir ODIR
[--file_types {hdmap,lidar,synthetic}[,…]]
[--workers N] [--clean_cache]
required arguments:
--odir ODIR Output… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams.PhysicalAI-Autonomous-Vehicles-NCore
PhysicalAI Autonomous Vehicles - NCore
A subset of ~1.1k clips from the PhysicalAI-Autonomous-Vehicles (PAI-AV)
dataset, converted to NCore format
using the PAI data converter.
The subset contains clips that expose accurate offline calibration,
egomotion, and cuboid labels.
Source Dataset
PhysicalAI-Autonomous-Vehicles
contains 306,152 clips (1,700 hours) of multi-sensor driving data
collected across 25 countries. See the source dataset card for full details
on… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Autonomous-Vehicles-NCore.requestsautonomous-vehicle-sensor-fusion
Autonomous Vehicle Raw Sensor Telemetry & Simulation Dataset
This repository contains raw, uncompressed sensor buffers, massive neural network weights, federated learning node dumps, and VRAM memory snapshots collected from autonomous vehicle test fleets. Data is provided "as is" for offline perception model training, system debugging, and Hardware-in-the-Loop (HIL) simulations.
Dataset Structure (Full Schema)
Due to horizontal scaling and massive daily ingestions… See the full description on the dataset page: https://huggingface.co/datasets/born5149/autonomous-vehicle-sensor-fusion.fluidgym-dataminuszero-indian-autonomous-driving-dataset-v2
INDUS-AD: Indian Dataset of Unstructured Urban Scenes for Autonomous Driving
Overview
INDUS-AD is the largest publicly released Indian autonomous-driving dataset for end-to-end autonomous-driving research. Its name expands to Indian Dataset of Unstructured Urban Scenes for Autonomous Driving.
This gated dataset is the decoded companion to the Minus Zero Indian Urban Autonomous Driving Dataset. It provides directly usable camera MP4s, normalized sensor tables… See the full description on the dataset page: https://huggingface.co/datasets/gagandeepreehal/minuszero-indian-autonomous-driving-dataset-v2.cmht-autonomous-driving
Dataset Card for CMHT Autonomous Driving Multimodal (MCAP)
This is a FiftyOne dataset with 4 samples.
Installation
If you haven't already, install FiftyOne:
pip install -U fiftyone
Usage
import fiftyone as fo
from fiftyone.utils.huggingface import load_from_hub
# Load the dataset
# Note: other available arguments include 'max_samples', etc
dataset = load_from_hub("Voxel51/cmht-autonomous-driving")
# Launch the App
session =… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/cmht-autonomous-driving.PDM_Lite_Carla_LB2
PDM-Lite Dataset for CARLA Leaderboard 2.0
Description
PDM-Lite is a state-of-the-art rule-based expert system for autonomous urban driving in CARLA Leaderboard 2.0, and the first to successfully navigate all scenarios. This dataset was used to create the QA dataset for DriveLM-Carla, a benchmark for evaluating end-to-end autonomous driving algorithms with Graph Visual Question Answering (GVQA). DriveLM introduces GVQA as a novel approach, modeling perception, prediction… See the full description on the dataset page: https://huggingface.co/datasets/autonomousvision/PDM_Lite_Carla_LB2.MIST-autonomous-driving-dataset
🛣️MIST
Multi-Domain Synthetic Dataset for Rural Driving🌾
🤗 Hugging Face
|
📄 Paper(coming soon)
|
💻 Code(coming soon)
🚗 Simulator (slowroads.io)
📘Dataset Introduction
MIST is a large-scale multi-domain synthetic dataset designed for rural driving scenarios.
It provides explicitly structured domain factors—season, time of day, and weather—forming 32 balanced domain configurations.… See the full description on the dataset page: https://huggingface.co/datasets/jongwonryu/MIST-autonomous-driving-dataset.minuszero-indian-autonomous-driving-dataset
Minus Zero Indian Urban Autonomous Driving Dataset
Overview
This dataset provides original multicamera autonomous-driving recordings in MCAP format. It is designed for non-commercial research on surround-view perception, temporal and cross-camera synchronization, H.265 video pipelines, localization, GNSS/pose integration, and robotics data tooling.
Recordings include camera and GNSS/pose streams, with machine-state telemetry present in a small subset. Camera… See the full description on the dataset page: https://huggingface.co/datasets/gagandeepreehal/minuszero-indian-autonomous-driving-dataset.autonomous-driving-carla
CARLA Autonomous Driving Dataset
Custom datasets for autonomous driving in CARLA simulator
Created for CMPE 789 - Robot Perception at Rochester Institute of Technology
📊 Dataset Overview
This repository contains two custom-generated datasets from the CARLA 0.9.15 simulator for training autonomous driving perception models:
Dataset
Task
Images
Format
Size
YOLO Dataset
Object Detection
4,000
YOLOv8/v11
~1.2 GB
UFLD Dataset
Lane Detection
10,000… See the full description on the dataset page: https://huggingface.co/datasets/jkdxbns/autonomous-driving-carla.vexu_synthetic_00fluidgym-experiments
FluidGym Experiments
Paper | GitHub | Documentation
FluidGym is a standalone, fully differentiable benchmark suite for reinforcement learning (RL) in active flow control (AFC). Built entirely in PyTorch on top of the GPU-accelerated PICT solver, it provides standardized evaluation protocols and diverse environments for systematic comparison of control methods.
This repository contains the training and test datasets with results for all experimental runs presented in the paper.… See the full description on the dataset page: https://huggingface.co/datasets/safe-autonomous-systems/fluidgym-experiments.PhysicalAI-Autonomous-Vehicles-Sample
Dataset Card for nvidia-physical-ai-sample
This dataset is a small curated sample (100 items) extracted from the fullNVIDIA PhysicalAI Autonomous Vehicles dataset.It is intended for quick experimentation, tutorials, and FiftyOne integration demos without requiring the multi-terabyte original dataset.
Installation
If you haven't already, install FiftyOne:
pip install -U fiftyone
Usage
import fiftyone as fo
from fiftyone.utils.huggingface import… See the full description on the dataset page: https://huggingface.co/datasets/dgural/PhysicalAI-Autonomous-Vehicles-Sample.hermes-autonomous-agent
Agent Core Final Clean
Dataset for autonomous coding agents.
Composition
SWE debugging
Repository reasoning
Tool usage
Multi-turn trajectories
Total samples: 205,499
community-tasksv2v-autonomous-driving-qa
V2V & Autonomous Driving QA Dataset
This dataset contains processed research papers focused on V2V communication, autonomous driving, sensor fusion, ADAS, and related fields.It provides structured text sections and automatically generated question–answer (QA) pairs, making it useful for fine-tuning language models, evaluation, or RAG pipelines.
📊 Dataset Summary
~22,457 papers processed
Sections extracted: abstract, introduction, conclusion
55k+ QA pairs… See the full description on the dataset page: https://huggingface.co/datasets/BuRabea/v2v-autonomous-driving-qa.omnimcp_autonomous_agentops_village_teaser
🔬 INSPECT THE DEEPSEEK-R1 REASONING CHAIN LIVE:
Zero hallucinations. Null syntax errors. 100% AST compiler validated.🌐 Live Interactive Reasoning & Code Inspector: https://emgena.com/trainingslager🎁 Claim your Free Starter Kit (Code: STARTER100): https://emgena.com/trainingslager🏷️ Launch Discount: Get 20 € OFF any 500-incident production suite with code LAUNCH20!
📜 Enterprise Compliance: EU AI Act Articles 50 & 53 certified • 100% DSGVO / GDPR clean • Commercial EULA… See the full description on the dataset page: https://huggingface.co/datasets/emgena/omnimcp_autonomous_agentops_village_teaser.omnimcp_autonomous_cyberdefense_village_teaser
🔬 INSPECT THE DEEPSEEK-R1 REASONING CHAIN LIVE:
Zero hallucinations. Null syntax errors. 100% AST compiler validated.🌐 Live Interactive Reasoning & Code Inspector: https://emgena.com/trainingslager🎁 Claim your Free Starter Kit (Code: STARTER100): https://emgena.com/trainingslager🏷️ Launch Discount: Get 20 € OFF any 500-incident production suite with code LAUNCH20!
📜 Enterprise Compliance: EU AI Act Articles 50 & 53 certified • 100% DSGVO / GDPR clean • Commercial EULA… See the full description on the dataset page: https://huggingface.co/datasets/emgena/omnimcp_autonomous_cyberdefense_village_teaser.minuszero-indian-autonomous-driving-monocam
Minus Zero Indian Urban Autonomous Driving Dataset - Single Camera
Overview
This dataset provides original single-camera autonomous driving recordings in MCAP format. It is designed for research on camera perception, H.265 video pipelines, localization, GNSS/pose integration, and robotics data tooling.
Depending on the recording, supporting channels include recorded or live GNSS/pose.
The dataset is public for personal, educational, and research use under CC BY-NC… See the full description on the dataset page: https://huggingface.co/datasets/gagandeepreehal/minuszero-indian-autonomous-driving-monocam.PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams
PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams
Paper | Paper Website | GitHub
Download
We provide a download script to download our dataset. If you have enough space, you can use git to download a dataset from huggingface.
usage: download.py [-h] --odir ODIR
[--file_types {hdmap,lidar,synthetic}[,…]]
[--workers N] [--clean_cache]
required arguments:
--odir ODIR Output… See the full description on the dataset page: https://huggingface.co/datasets/joesjoe/PhysicalAI-Autonomous-Vehicle-Cosmos-Drive-Dreams.Autonomous-Manufacturing-Robotucu-slam-dataset-v1
UCU SLAM Dataset v1
Outdoor RGB-D + IMU + wheel odometry + GNSS dataset for evaluating SLAM systems, recorded with a Clearpath Husky A200 UGV on the Ukrainian Catholic University campus and in Stryiskyi Park (Lviv, Ukraine).
[!NOTE]
This is a gated dataset. To access the files, log in to Hugging Face and accept the conditions on this page. Your contact information will be shared with the dataset authors. Once access is granted, authenticate locally and download as usual:
hf… See the full description on the dataset page: https://huggingface.co/datasets/ucu-autonomous-ugv/ucu-slam-dataset-v1.deepseek-r1-autonomous-math-logic-cot-2026
📐 Enterprise DeepSeek-R1 Autonomous Mathematical & Logic CoT SFT/DPO Dataset (2026)
High-precision multi-turn instruction tuning and preference optimization dataset with step-by-step hypothesis exploration, error discovery, and dynamic backtracking Chain-of-Thought (<thought>) reasoning trees for fine-tuning LLMs (DeepSeek-R1-Distill-Qwen, Qwen-2.5-Math, Llama-3.3, Mistral) into World-Class Olympiad Mathematicians and Formal Verification Agents.
📊 Dataset… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/deepseek-r1-autonomous-math-logic-cot-2026.daily-paper-2026-09-09-autonomous-oncall-k8s-incident-frontier
The Autonomous Oncall: Measuring the Diagnosis-to-Remediation Capability-Cost Frontier of LLM Agents on Fault-Injected Kubernetes Incidents
TL;DR — A decision-theoretic capability-cost frontier for LLM agents on fault-injected Kubernetes on-call: closed-form break-even results show the binding constraints are safety ceilings and capability, not token cost, and that a stronger model tier should be bought for collateral-damage reduction, not price.
ThakiCloud AI Research ·… See the full description on the dataset page: https://huggingface.co/datasets/thaki-AI/daily-paper-2026-09-09-autonomous-oncall-k8s-incident-frontier.groundtruth