datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MolmoAct-Midtraining-Mixture
MolmoAct - Midtraining Mixture
Data Mixture used for MolmoAct Midtraining. Contains MolmoAct Dataset formulated as Action Reasoning Data.
MolmoAct is a fully open-source action reasoning model for robotic manipulation developed by the Allen Institute for AI. MolmoAct is trained on a subset of OXE and MolmoAct Dataset, a dataset with 10k high-quality trajectories of a single-arm Franka robot performing 93 unique manipulation tasks in both home and tabletop environments. It has… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct-Midtraining-Mixture.MolmoAct-Pretraining-Mixture
MolmoAct - Pretraining Mixture
Data Mixture used for MolmoAct Pretraining. Contains a subset of OXE formulated as Action Reasoning Data along with auxiliary robot data and link to Multimodal Web data.
MolmoAct is a fully open-source action reasoning model for robotic manipulation developed by the Allen Institute for AI. MolmoAct is trained on a subset of OXE and MolmoAct Dataset, a dataset with 10k high-quality trajectories of a single-arm Franka robot performing 93 unique… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct-Pretraining-Mixture.molmoact2_so100_101_rbmMolmoAct2-DROID-Dataset
MolmoAct2-DROID Dataset
This dataset was created using LeRobot.
Language Annotations
This dataset includes annotated language instructions in meta/tasks_annotated.parquet. The file is indexed by episode_index and has a task column containing our per-episode annotated instruction.
The standard LeRobot loader resolves a frame's language instruction through task_index: each data row stores a task_index, which is looked up in meta/tasks.parquet. When you use these… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-DROID-Dataset.MolmoAct2-SO100_101-Dataset
MolmoAct2 SO-100/101 Dataset Manifest
This repository lists the SO-100 and SO-101 LeRobot datasets used for MolmoAct2 training. The datasets were collected from online LeRobot repositories, and this repository provides the annotated language instructions for each dataset.
The original dataset repositories are listed in repo_list.json. The list contains 1220 repositories from 377 users.
Language Annotations
Each dataset has a corresponding tasks_annotated.parquet… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MolmoAct2-SO100_101-Dataset.molmoact2_yam_tiled_rfmmolmoact2-so101-zero-shot-eval
MolmoAct2 SO-101 Zero-Shot Evaluation Traces
This repository contains evaluation traces from running allenai/MolmoAct2-SO100_101 zero-shot on an SO-101 robot arm using the official LeRobot MolmoAct2 integration plus a remote async inference setup.
This is an evaluation artifact, not a training dataset or model checkpoint. The model under test is AllenAI's released MolmoAct2 SO-100/SO-101 checkpoint.
Summary
MolmoAct2 remote inference was successfully brought up on… See the full description on the dataset page: https://huggingface.co/datasets/abdul004/molmoact2-so101-zero-shot-eval.place_brick_advanced_molmoactmolmoact2_yam_rfmmolmoact_libero_cotmolmoact_rfmmolmoact2_so100_101_smokemolmoact_part3_trajectoriespush-button-hard-molmoactaloha_part3_molmoact_trajectories