datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
sonic-o1
SONIC-O1: A Real-World Benchmark for Evaluating Multimodal Large Language Models on Audio-Video Understanding
🎯 What is SONIC-O1?
The first open-source benchmark for evaluating omnimodal video understanding with systematic fairness analysis. SONIC-O1 requires models to jointly process audio, video, and social context from real-world interactions—not just transcripts.
Key… See the full description on the dataset page: https://huggingface.co/datasets/vector-institute/sonic-o1.315-vectioneer-Hanwha_pickandplace_shape_sorterroute_red_yellow_vector_subtasks_pi05
Route Red-Yellow Vector Subtasks for pi0.5
This is a LeRobot v2.1 transformation of DistantSky/route at commit aced1e96f6b8bf98ffaa0754407636e82442b084.
The dataset contains 212 real-robot episodes, 135699 frames, three cameras, and 14-dimensional actions at 100 Hz.
Conditioning
Only observation.images.video_overhead is modified. The left and right videos are byte-identical to the source dataset.
The overhead image receives one fixed selected-connector pose glyph… See the full description on the dataset page: https://huggingface.co/datasets/ajaysri/route_red_yellow_vector_subtasks_pi05.pi07_cable_three_vector_v1
Three-holder cable routing with vector goals
Real-robot demonstrations for a vector-conditioned low-level policy: place three holders and route a cable through each holder. This is the validated LeRobot v3 dataset prepared for the first Pi0.7 four-camera-goal cable policy.
Property
Value
Source recordings
140
Subtask episodes
840
Frames
335,897
Sampling rate
100 Hz
Robot
ARX bimanual
Recorded state / action
14 / 14 dimensions
Video resolution
448 × 448… See the full description on the dataset page: https://huggingface.co/datasets/ajaysri/pi07_cable_three_vector_v1.trash_pickup_v1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 25,
"total_frames": 7500,
"total_tasks": 1,
"total_videos": 50,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 20,
"splits": {
"train": "0:25"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/vectorcrumb/trash_pickup_v1.315-vectioneer-Hanwha_screw_in_boltroute_red_yellow_vector_split_subtasks_example
Route Red-Yellow Vector Split-Subtask Example
This is a LeRobot v2.1 example derived from
ajaysri/route_red_yellow_vector_subtasks_pi05.
Source episode(s) 2 are split into one output episode per maximal
contiguous run of metadata.route.active_subgoal.
The example has 4 output episodes and 948 frames.
All three videos are cut on the same frame boundaries as the Parquet data and
re-encoded as H.264 at 100 Hz.
Why the split count is inferred
The complete 212-episode… See the full description on the dataset page: https://huggingface.co/datasets/ajaysri/route_red_yellow_vector_split_subtasks_example.