datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
AgiBotWorld-Beta_G1_task_510_Stack_the_dishcloth_on_the_kitchen_countertop
agibot_task_510
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 把洗碗布叠在厨房台面上
total_episodes: 1465
total_tasks: 1
size: 102G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├──… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_510_Stack_the_dishcloth_on_the_kitchen_countertop.AgiBotWorld-Beta_G1_task_492_Pack_at_the_supermarket_checkout_counter
agibot_task_492
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 在超市收银台打包
total_episodes: 960
total_tasks: 1
size: 121G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├──… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_492_Pack_at_the_supermarket_checkout_counter.VSI-SUPER-Count
VSI-SUPER-Count
Website | Paper | GitHub | Models
Authors: Shusheng Yang*, Jihan Yang*, Pinzhi Huang†, Ellis Brown†, et al.
VSI-SUPER-Count is a benchmark for testing continual counting capabilities across changing viewpoints and scenes in arbitrarily long videos. It challenges models to maintain accurate object counts as new objects appear throughout extended video sequences.
Overview
VSI-SUPER-Count evaluates spatial supersensing by testing whether models can:
Count… See the full description on the dataset page: https://huggingface.co/datasets/nyu-visionx/VSI-SUPER-Count.AgiBotWorld-Beta_G1_task_494_Organize_the_seasonings_on_the_kitchen_counter
agibot_task_494
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 整理厨房柜台的调味料
total_episodes: 614
total_tasks: 1
size: 67G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├──… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_494_Organize_the_seasonings_on_the_kitchen_counter.SP_CountingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 50,
"total_frames": 37501,
"total_tasks": 5,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/SP_Counting.AgiBotWorld-Beta_G1_task_424_Clean_up_countertop_garbage
agibot_task_424
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 清理台面垃圾
total_episodes: 916
total_tasks: 1
size: 52G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├── observation.images.back_left_fisheye… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_424_Clean_up_countertop_garbage.counterfactual-physicskbot_cappuccino_countThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "kbot_right_arm_follower",
"total_episodes": 224,
"total_frames": 166988,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:224"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet"… See the full description on the dataset page: https://huggingface.co/datasets/infoslack/kbot_cappuccino_count.AgiBotWorld-Beta_G1_task_551_Disinfect_countertop
agibot_task_551
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 消毒台面
total_episodes: 585
total_tasks: 1
size: 32G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├── observation.images.back_left_fisheye… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_551_Disinfect_countertop.CounterStrike-1K
CounterStrike-1K
1,490 rendered POV-hours · 7,347 synchronized rounds · 73,470 POV clips · 7 maps · 720p + audio
Synchronized 10-POV rounds with per-frame action overlays
Seven active-duty maps
Ancient · Anubis · Dust2 · Inferno · Mirage · Nuke · Overpass
CounterStrike-1K is the first grounded, professional-grade Counter-Strike 2 dataset with 10 synchronized first-person perspectives per round, captured from professional match demos. It is designed for video… See the full description on the dataset page: https://huggingface.co/datasets/ArnieRamesh/CounterStrike-1K.rollout_pi05_Reasoning_Step_076596_CountingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_pi05_Reasoning_Step_076596_Counting.FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwise_200This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "fairino_follower",
"total_episodes": 200,
"total_frames": 144644,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:200"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/coport-uni/FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwise_200.rollout_molmoact2_Reasoning_Step_076596_CountingThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_molmoact2_Reasoning_Step_076596_Counting.robocasa_pickplace_countertosink1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 20,
"features": {
"observation.images.robot0_eye_in_hand": {
"dtype": "video",
"shape": [
256,
256,
3
],
"names": [
"height",
"width",
"channel"
],
"video_info": {… See the full description on the dataset page: https://huggingface.co/datasets/latentforce/robocasa_pickplace_countertosink1.SP_Counting_200This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/SP_Counting_200.agibot-sim-clear-the-countertop-wasteThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "a2d",
"total_episodes": 90,
"total_frames": 129580,
"total_tasks": 1,
"total_videos": 270,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30.0,
"splits": {
"train": "0:90"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/bot-pi/agibot-sim-clear-the-countertop-waste.counterfactual-vbench
VBench-CF: counterfactual probes for VBench 1.0
VBench-CF is a metamorphic test set for VBench 1.0 metrics. Rather than
arguing about which of two videos is better, each clip comes from a
deterministic transformation whose effect on the score is known in advance.
If a metric violates that relation, the violation is a property of the metric,
not of anybody's taste.
Every family contains an unmodified control plus one or more transformed
levels derived from it. The transformation… See the full description on the dataset page: https://huggingface.co/datasets/xju-arlab/counterfactual-vbench.FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwiseThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "fairino_follower",
"total_episodes": 200,
"total_frames": 144644,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:200"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/coport-uni/FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwise.CounterStrike-1K-sample
CounterStrike-1K Sample
This is the reviewer/developer sample for CounterStrike-1K. It contains one Dust2 match-map, 16 released rounds, all 10 synchronized player POVs per round, 160 clips total, and about 2 GB of 360p media. It is intended for inspecting video/audio quality, validating the v12 schema, building loaders, and running quick local experiments without downloading the full release.
How this sample was created
The sample was created from the same public v12… See the full description on the dataset page: https://huggingface.co/datasets/ArnieRamesh/CounterStrike-1K-sample.CounterVid
CounterVid
CounterVid is the preference dataset introduced in CounterVid: Counterfactual Video Generation for Mitigating Action and Temporal Hallucinations in Video-Language Models (EMNLP 2026).
It contains short synthetic videos with controlled action variations and two complementary supervision signals:
visual preferences (input_swap): a fixed prompt and answer paired with preferred and rejected videos;
textual preferences (output_swap): a fixed video and prompt paired with… See the full description on the dataset page: https://huggingface.co/datasets/aimagelab/CounterVid.AgiBotWorld-Beta_G1_task_782_Organize_the_bar_counter
agibot_task_782
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 整理吧台
total_episodes: 109
total_tasks: 1
size: 7.2G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├── observation.images.back_left_fisheye… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_782_Organize_the_bar_counter.rollout_groot_vision_only_Counting_20260831_180259This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_groot_vision_only_Counting_20260831_180259.isaaclab_two_cube_counterfactual_gr00trollout_vla0_Counting_90s_20260828_161237This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 10,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_vla0_Counting_90s_20260828_161237.FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwise_100This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "fairino_follower",
"total_episodes": 100,
"total_frames": 71437,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/coport-uni/FR5_task3_turn_the_sliver_air_valve_90_degress_counterclockwise_100.agilex_match_the_counterThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "arx5_bimanual",
"total_episodes": 20,
"total_frames": 13326,
"total_tasks": 1,
"total_videos": 60,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 25,
"splits": {
"train": "0:20"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/villekuosmanen/agilex_match_the_counter.DVD-countingExtract From DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
rollout_groot_Counting_20260828_095331This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_groot_Counting_20260828_095331.rollout_pi05_Reasoning_Step_076596_Counting_20260824_140050This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/justintiensmith/rollout_pi05_Reasoning_Step_076596_Counting_20260824_140050.qualcomm-interactive-cooking-dataset-counterfactual-mistakes
Qualcomm Interactive Cooking Dataset: Ego Counterfactual Mistakes
Description
This synthetic dataset contains mistake-intervention annotations for interactive cooking guidance. Each row contains video segment with instruction/feedback text pairs and their timestamps.
Dataset Details
Files:
annotations.json
Release statistics:
Total rows: 25,087
Unique videos (dataset + video_id): 1,110
Rows by source dataset:
CaptainCook4D: 4,969
Ego4D: 13,847
Ego-Exo4D: 6… See the full description on the dataset page: https://huggingface.co/datasets/qualcomm/qualcomm-interactive-cooking-dataset-counterfactual-mistakes.