datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
language_table_lerobotThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "xarm",
"total_episodes": 442226,
"total_frames": 7045476,
"total_tasks": 127605,
"total_videos": 442226,
"total_chunks": 443,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:442226"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/IPEC-COMMUNITY/language_table_lerobot.TABLET-Large
TABLET-Large
This is the Large sized train set of the TABLET dataset. It contains all train examples for all TABLET tasks, resulting in a total of 3,505,311 training examples across 17 tasks.This dataset is self-contained, each example includes a table image, its HTML representation, and the associated task data.However, if you're interested in downloading just the TABLET tables, check out TABLET-tables.
All TABLET Subsets:
(train) TABLET-Small: The smallest TABLET subset… See the full description on the dataset page: https://huggingface.co/datasets/alonsoapp/TABLET-Large.rbo_oxe_base_language_table_lerobot
Language Table (LeRobot) — Task-Pruned, Reindexed Subset
This release is a task-pruned subset of the original
IPEC-COMMUNITY/language_table_lerobot.
We subsampled by task text and rebuilt the package so it remains internally consistent
(indices, splits, stats, paths).
Robot: xArm
Modality: RGB video + states + actions
FPS / Resolution: 10 FPS, 360×640, AV1
License: apache-2.0 (inherits from source)
What’s different in this subset
Kept ~0.85% of unique tasks… See the full description on the dataset page: https://huggingface.co/datasets/saaduddinM/rbo_oxe_base_language_table_lerobot.Table30
RoboChallenge Dataset
Tasks and Embodiments
The dataset includes 30 diverse manipulation tasks (Table30) across 4 embodiments:
Available Tasks
arrange_flowers
arrange_fruits_in_basket
arrange_paper_cups
clean_dining_table
fold_dishcloth
hang_toothbrush_cup
make_vegetarian_sandwich
move_objects_into_box
open_the_drawer
place_shoes_on_rack
plug_in_network_cable
pour_fries_into_plate
press_three_buttons
put_cup_on_coaster
put_opener_in_drawer… See the full description on the dataset page: https://huggingface.co/datasets/RoboChallenge/Table30.Table30v2
RoboChallenge Table30 v2 Dataset
Tasks and Embodiments
The dataset includes 30 diverse manipulation tasks (Table30 v2) across 4 embodiments:
Available Tasks
put_the_books_back - Place the books back onto the bookshelf.
tie_a_knot - Tie a knot with the string on the table.
stamp_positioning - Stamp the signature area on the paper.
tidy_up_the_makeup_table - Sort and organize the cosmetics on the table.
paint_jam - Spread the bread with jam.… See the full description on the dataset page: https://huggingface.co/datasets/RoboChallenge/Table30v2.GR1-Tabletop-NextState-1000x24
GR1 Tabletop Merged LeRobot Datasets
Merged and subsampled versions of the GR1 tabletop manipulation datasets from the NVIDIA PhysicalAI-Robotics-GR00T-X-Embodiment-Sim collection, formatted in LeRobot v2.0 format.
Dataset Variants
Variant
Demos/Task
Tasks
Total Episodes
Total Frames
Approx Size
1000x24/
1000
24 folders, 186 unique tasks
24,000
6,020,058
~40 GB
300x24/
300
24 folders, 186 unique tasks
7,200
1,803,236
~12 GB
100x24/
100
24 folders… See the full description on the dataset page: https://huggingface.co/datasets/Joocjun/GR1-Tabletop-NextState-1000x24.gr1-tabletop-augmented
GR-1 Tabletop, Augmented v2
Counterfactual action perturbations for the NVIDIA GR-1 tabletop manipulation dataset, with
joint torque, fingertip force, and binary contact recorded alongside — and, for every
perturbed rollout, the rendered future the perturbed action actually produces. Version 2
also supplies the complete recorded 10 Hz timeline re-rendered from the stored MuJoCo states
through the same renderer, crop, resize, and JPEG path as the counterfactual futures.
The… See the full description on the dataset page: https://huggingface.co/datasets/leesangoh/gr1-tabletop-augmented.language_table_sim-lerobotThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "language_table_xarm",
"total_episodes": 1000,
"total_frames": 24891,
"total_tasks": 962,
"total_videos": 1000,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:1000"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LehongWu/language_table_sim-lerobot.Ultimate-Fish-Tablebases
Ultimate Fish endgame tablebases
This gated dataset is the authenticated tablebase catalog used by the
Ultimate Fish engine and its local
tablebase manager. The tables contain exact win/draw/loss and distance-to-win
results for certified Chess Ultimate endgames.
Native rules repair — 2026-09-12
The Checker and Sniper closures and their Jester/Ghost information proofs have
been recomputed for native flying Checker Kings and turn-start threat timing.
All… See the full description on the dataset page: https://huggingface.co/datasets/SanderGi/Ultimate-Fish-Tablebases.tabletop-simulation-rlds
Talbetop Simulation Dataset - RLDS Format
Bimanual tabletop simulation dataset, collected on Tabletop-Sim.
In total, 20GB.
git clone https://huggingface.co/datasets/jellyho/tabletop-simulation-rlds
cd tabletop-simulation-rlds
git lfs pull
Multimodal-Dataset-Image_Text_Table_TimeSeries-for-Financial-Time-Series-ForecastingThe sp500stock_data_description.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 4,213 S&P 500 stocks.
The hs300stock_data_description.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 858 HS 300 stocks.
If you find our research helpful, please cite our paper:
@article{xu2025finmultitime,
title={FinMultiTime: A Four-Modal Bilingual Dataset for… See the full description on the dataset page: https://huggingface.co/datasets/Wenyan0110/Multimodal-Dataset-Image_Text_Table_TimeSeries-for-Financial-Time-Series-Forecasting.2026-09-11-dh-qwen36-lora-table2-9284-difficult-advice-chunk-only-702-rank-64-dynbatch
Delegated-harm evaluation with corrected scoring of saved rollouts
field
value
experiment
Delegated-harm evaluation with corrected scoring of saved rollouts
date_generated
2026-09-11
constitution
none
source_repo
teaching_claude_why_replication @ d627d0587a2980069b7700e72f727dae594c9f49
models
{"hf_path": "dougalldeepmind/2026-08-21-qwen36-lora-table2-9284-difficult-advice-chunk-only-702-rank-64-dynbatch", "base_model": "Qwen/Qwen3.6-27B", "adapter": true… See the full description on the dataset page: https://huggingface.co/datasets/dougalldeepmind/2026-09-11-dh-qwen36-lora-table2-9284-difficult-advice-chunk-only-702-rank-64-dynbatch.tabletop-simulation-hdf5cobotmagic_Sim_table_rearrangementlanguage_table_train_115000_120000_augmented
language_table_train_115000_120000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,828
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_115000_120000_augmented.language_table_train_75000_80000_augmented
language_table_train_75000_80000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,557
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_75000_80000_augmented.language_table_train_55000_60000_augmented
language_table_train_55000_60000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,295
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_55000_60000_augmented.language_table_train_130000_135000_augmented
language_table_train_130000_135000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,357
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_130000_135000_augmented.language_table_train_140000_145000_augmented
language_table_train_140000_145000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,121
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_140000_145000_augmented.language_table_train_345000_350000_augmented
language_table_train_345000_350000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,459
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_345000_350000_augmented.language_table_train_5000_10000_augmented
language_table_train_5000_10000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,151
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_5000_10000_augmented.language_table_train_110000_115000_augmented
language_table_train_110000_115000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,139
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_110000_115000_augmented.language_table_train_125000_130000_augmented
language_table_train_125000_130000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 78,601
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_125000_130000_augmented.language_table_train_95000_100000_augmented
language_table_train_95000_100000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,860
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_95000_100000_augmented.language_table_train_15000_20000_augmented
language_table_train_15000_20000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,558
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_15000_20000_augmented.language_table_train_120000_125000_augmented
language_table_train_120000_125000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 80,140
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_120000_125000_augmented.language_table_train_135000_140000_augmented
language_table_train_135000_140000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,556
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_135000_140000_augmented.language_table_train_390000_395000_augmented
language_table_train_390000_395000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,774
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_390000_395000_augmented.language_table_train_10000_15000_augmented
language_table_train_10000_15000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,689
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_10000_15000_augmented.language_table_train_215000_220000_augmented
language_table_train_215000_220000_augmented
Overview
Codebase version: v3.0
Robots: google_robot, images, jaco, kinova3, kuka_iiwa, panda, sawyer, ur5e
FPS: 10
Episodes: 5,000
Frames: 79,565
Splits:
train: 0:5000
Data Layout
data_path : data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet
video_path: videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4
Features
Feature
dtype
shape
description… See the full description on the dataset page: https://huggingface.co/datasets/oxe-auge/language_table_train_215000_220000_augmented.
