CoolFace
Datasetpublic

agibot-world/AgiBotWorldChallenge-2026

AgiBot World Challenge 2026 - Datasets Dear participants, We are excited to announce that the datasets for AgiBot World Challenge 2026 have been updated. Track 1: Reasoning2Action The Reasoning to Action track evaluates models' capabilities in reasoning and action prediction, comprising both online and onsite phases. This track encompasses 10 progressively challenging tasks, ranging from basic to complex, including dual-arm collaboration, long-horizon operations… See the full description on the dataset page: https://huggingface.co/datasets/agibot-world/AgiBotWorldChallenge-2026.

sourceHugging Facecc-by-nc-sa-4.0updated 5mo agoView on Hugging Face
14likes7.3kdownloads
Dataset Card

AgiBot World Challenge 2026 - Datasets

Dear participants,

We are excited to announce that the datasets for AgiBot World Challenge 2026 have been updated.

Track 1: Reasoning2Action

The Reasoning to Action track evaluates models' capabilities in reasoning and action prediction, comprising both online and onsite phases. This track encompasses 10 progressively challenging tasks, ranging from basic to complex, including dual-arm collaboration, long-horizon operations, and high-precision manipulations such as logistics sorting, office organization, retail operations, and daily services.

Based on G2 robot, AgiBot World open datasets, and Genie Sim 3.0, this track focuses on bridging the Sim2Real gap and achieving robust generalization from open-vocabulary understanding to physical interaction.

Competition Tasks

No.Task Name
1cleanthedesktop
2hold_pot
3open_door
4placeblockinto_box
5pour_workpiece
6scoop_popcorn
7sorting_packages
8sortingpackagescontinuous
9stockandstraighten_shelf
10takewrongitem_shelf

Dataset Structure

The dataset repository contains three main directories at the top level (to lower the barrier to entry, we also provided a version of the same dataset without depth):

Reasoning2Action-Sim/
├── clean_the_desktop_part_1/
│   ├── data.tar.gz.000
│   ├── meta.tar.gz.000
│   ├── videos.tar.gz.000
│   ├── ...
│   └── videos.tar.gz.013
├── clean_the_desktop_part_2/
│   ├── data.tar.gz.000
│   ├── meta.tar.gz.000
│   ├── videos.tar.gz.000
│   ├── ...
│   └── videos.tar.gz.011
├── ... (Other task folders have the same structure as above.)
└── >>> dataset_without_depth/ <<<
    ├── clean_the_desktop_part_1/
    │   ├── data.tar.gz.000
    │   ├── meta.tar.gz.000
    │   ├── videos.tar.gz.000
    ├── clean_the_desktop_part_2/
    │   ├── data.tar.gz.000
    │   ├── meta.tar.gz.000
    │   ├── videos.tar.gz.000
    └── ... (Other task folders have the same structure as above.)
dataset_without_depth: version without depth data

The directory structure after decompression should be as follows:

{task name}/
├── meta/
│   ├── episodes.jsonl
│   ├── episodes_stats.jsonl
│   ├── info.json
│   └── tasks.jsonl
├── data/
│   └── chunk-000/
│       ├── episode_000000.parquet
│       ├── ...
│       └── episode_000400.parquet
└── videos/
    └── chunk-000/
        ├── observation.images.hand_left/
        ├── observation.images.hand_right/
        ├── observation.images.top_head/
        ├── observation.images.hand_right_depth/
        ├── observation.images.hand_left_depth/
        └── observation.images.head_depth/