datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
general-instruction-augmented-corpora
Instruction Pre-Training: Language Models are Supervised Multitask Learners (EMNLP 2024)
This repo contains the general instruction-augmented corpora (containing 200M instruction-response pairs covering 40+ task categories) used in our paper Instruction Pre-Training: Language Models are Supervised Multitask Learners.
We explore supervised multitask pre-training by proposing Instruction Pre-Training, a framework that scalably augments massive raw corpora with instruction-response… See the full description on the dataset page: https://huggingface.co/datasets/instruction-pretrain/general-instruction-augmented-corpora.gr1-tabletop-augmented
GR-1 Tabletop, Augmented v2
Counterfactual action perturbations for the NVIDIA GR-1 tabletop manipulation dataset, with
joint torque, fingertip force, and binary contact recorded alongside — and, for every
perturbed rollout, the rendered future the perturbed action actually produces. Version 2
also supplies the complete recorded 10 Hz timeline re-rendered from the stored MuJoCo states
through the same renderer, crop, resize, and JPEG path as the counterfactual futures.
The… See the full description on the dataset page: https://huggingface.co/datasets/leesangoh/gr1-tabletop-augmented.rtl-augmented-v3
RTL Bug Fix — Augmented Dataset
Auto-generated dashboard snapshot (2026-04-14T10:53:43).
Overview
Metric
Value
Total problems
718
Repos with data
57 / 81
Modules augmented
408
Bug types
11/11
Augmentation success
48.9%
Coverage
Distribution
Augmentation Health
Topic Coverage
Warnings
lucky-wfw_IC_System_Design: 0 problems from 48 attempts — likely systematic sim issue
meiniKi_FazyRV:… See the full description on the dataset page: https://huggingface.co/datasets/architect-ubc-capstone/rtl-augmented-v3.0-9up_google_speech_commands_augmented_raw
Dataset Card for "google_speech_commands_augmented_raw_fixed"
More Information needed
split_OpenOrca_1M-GPT4-Augmentedlanguage_table_train_115000_120000_augmented
language_table_train_115000_120000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,828
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_115000_120000_augmented.PhysicalAI-Robotics-Manipulation-Augmented
Dataset Description:
This is a fully annotated, synthetically generated dataset consisting of 1,000 demonstrations of a single Franka Panda robot arm performing a fixed-order three-cube stacking task in Isaac Lab. The robot consistently stacks cubes in the order: blue (bottom) → red (middle) → green (top).
The dataset was produced using the following pipeline:
Collected 10 human teleoperation demonstrations of the stacking task.
Used Isaac Lab’s Mimic tool [1] to simulate 1,000… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-Manipulation-Augmented.fractal20220817_data_train_50000_52500_augmented
fractal20220817_data_train_50000_52500_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 107,972
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_50000_52500_augmented.fractal20220817_data_train_22500_25000_augmented
fractal20220817_data_train_22500_25000_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 108,522
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_22500_25000_augmented.fractal20220817_data_train_75000_77500_augmented
fractal20220817_data_train_75000_77500_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 109,563
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_75000_77500_augmented.fractal20220817_data_train_62500_65000_augmented
fractal20220817_data_train_62500_65000_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 108,654
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_62500_65000_augmented.language_table_train_75000_80000_augmented
language_table_train_75000_80000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,557
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_75000_80000_augmented.language_table_train_55000_60000_augmented
language_table_train_55000_60000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,295
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_55000_60000_augmented.language_table_train_345000_350000_augmented
language_table_train_345000_350000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,459
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_345000_350000_augmented.language_table_train_130000_135000_augmented
language_table_train_130000_135000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,357
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_130000_135000_augmented.language_table_train_140000_145000_augmented
language_table_train_140000_145000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,121
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_140000_145000_augmented.language_table_train_5000_10000_augmented
language_table_train_5000_10000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,151
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_5000_10000_augmented.language_table_train_125000_130000_augmented
language_table_train_125000_130000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 78,601
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_125000_130000_augmented.language_table_train_110000_115000_augmented
language_table_train_110000_115000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,139
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_110000_115000_augmented.language_table_train_15000_20000_augmented
language_table_train_15000_20000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,558
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_15000_20000_augmented.fractal20220817_data_train_35000_37500_augmented
fractal20220817_data_train_35000_37500_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 108,469
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_35000_37500_augmented.language_table_train_95000_100000_augmented
language_table_train_95000_100000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,860
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_95000_100000_augmented.language_table_train_390000_395000_augmented
language_table_train_390000_395000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,774
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_390000_395000_augmented.language_table_train_120000_125000_augmented
language_table_train_120000_125000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,140
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_120000_125000_augmented.language_table_train_10000_15000_augmented
language_table_train_10000_15000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,689
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_10000_15000_augmented.fractal20220817_data_train_60000_62500_augmented
fractal20220817_data_train_60000_62500_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 111,006
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_60000_62500_augmented.language_table_train_135000_140000_augmented
language_table_train_135000_140000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,556
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_135000_140000_augmented.fractal20220817_data_train_10000_12500_augmented
fractal20220817_data_train_10000_12500_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 107,885
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_10000_12500_augmented.language_table_train_215000_220000_augmented
language_table_train_215000_220000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,565
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_215000_220000_augmented.fractal20220817_data_train_37500_40000_augmented
fractal20220817_data_train_37500_40000_augmented
Overview
Codebase version: v3.0
Robots: images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e, xarm7
FPS: 3
Episodes: 2,500
Frames: 109,327
Splits:
train: 0:2500
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/fractal20220817_data_train_37500_40000_augmented.
