IDEAS-Lab-Northwestern/datagen-lid-v1-joint-5cam

datagen-lid-v1-joint-5cam

Auto-generated SFT dataset for the lid_transport family (place a lid on a container, then transport the lidded container into the goal region) - cuRobo-planned, physics- & LTL-safety-checked demos, converted to LeRobot v2.1.

• —Creator: yypeng666 (IDEAS-Lab-Northwestern)
• —Source bench: IDEAS-Lab-Northwestern/ManiGuard-Bench - all 30 lid_transport base tasks.
• —Per task: 40 success + LTL-safe trajectories -> 1200 episodes.

Contents

Task

Place a lid on a container (tupperware / canister / steamer / jar / pot / etc.), then transport the lidded container into the green goal region on the left side of the workspace. Per-episode prompt (meta/tasks.jsonl) from the base task diagnostics. Demo must reach the goal AND stay LTL-safe; failed/unsafe attempts dropped.

Schema

state(8)=[arm_q(7),gripper(1)]; actions(8)=[arm_q[t+1](7),gripper_cmd(1)] next-achieved (default SFT target); actions_commanded(8)=[curobo_target_q(7),gripper_cmd(1)] (cuRobo command, extra). Absolute joint (delta at train time). Cameras (all 5 kept, pick subset at train time): image_opposite,image_left,image_right,image_left_shoulder (third-person) + wrist_image.

Notes

• —Camera subset + arm-joint delta are TRAIN-time choices; all 5 streams + absolute joints ship here.
• —MimicGen sim-state replay dump is NOT included (kept in the raw archive; not needed for SFT).

License

Released under CC BY-NC 4.0 (see `LICENSE`). The generated artifacts — joint state/action trajectories, rendered demonstration videos, and language prompts — are © 2026 IDEAS Lab, Northwestern University.

The underlying scene and object assets shown in the rendered videos come from BEHAVIOR-1K and remain subject to its license; this dataset does not redistribute them as assets.

Paper & Citation

Part of ManiGuard: paper (arXiv:2608.17386) · code · docs

@misc{peng2026maniguard,
  title         = {{MANIGUARD}: A Benchmark and Data Suite for Specification-Grounded
                   Safety Evaluation and Improvement of Robotic Manipulation},
  author        = {Peng, Yiyan and Wang, Philip and Zhan, Simon Sinong and Lyu, Yiqi
                   and Ni, Zhenyang and Yan, Jixin and Wong, Fiorelli and Jiao, Ruochen
                   and Yin, Hang and Cao, Xinyu and Shao, Huajie and Li, Manling
                   and Zhang, Ruohan and Zhu, Qi},
  year          = {2026},
  eprint        = {2608.17386},
  archivePrefix = {arXiv},
  primaryClass  = {cs.RO},
  url           = {https://arxiv.org/abs/2608.17386},
}