Yunncheng/gamewam-minecraft

GameWAM Minecraft Datasets

This repository contains three Minecraft gameplay datasets used by GameWAM: A World Action Model for Video Games. All three use LeRobot v2.1 format and share a 22-D keyboard/mouse action space, a 6-D raw state (pitch, yaw, cursor x/y, hotbar, and GUI-open state), and a 15-D canonical proprioceptive representation.

Project page: https://yunncheng.github.io/GameWAM/ Code: https://github.com/yunncheng/GameWAM

All videos are 640×360 H.264 at 20 FPS. Each subdirectory is a self-contained dataset with its own README.md describing fields, statistics, and provenance:

• —mc_scripted_gui/ — synchronized gameplay and GUI crafting/smelting demonstrations collected by the GameWAM authors with scripted policies.
• —vpt_event/ — event-anchored clips derived from the OpenAI VPT contractor demonstrations, plus a top-level _pooled_meta.json task distribution summary.
• —vpt_contractor/ — long-form episodes selected from the OpenAI VPT contractor demonstrations.

Download

hf download yunncheng/gamewam-minecraft --repo-type dataset \
    --local-dir /path/to/gamewam-minecraft

To fetch a single dataset, add an include pattern such as --include "mc_scripted_gui/*".

Usage with GameWAM

Point the GameWAM training config at the downloaded splits. See `configs/data/minecraft_mixed.yaml` for the dataset group schema:

datasets:
  - dataset_dirs:
      - /path/to/gamewam-minecraft/vpt_event/6xx
      - /path/to/gamewam-minecraft/vpt_event/7xx
      - /path/to/gamewam-minecraft/vpt_event/8xx
      - /path/to/gamewam-minecraft/vpt_event/9xx
      - /path/to/gamewam-minecraft/vpt_event/10xx
  - dataset_dirs:
      - /path/to/gamewam-minecraft/vpt_contractor/6xx
      - /path/to/gamewam-minecraft/vpt_contractor/7xx
      - /path/to/gamewam-minecraft/vpt_contractor/8xx
      - /path/to/gamewam-minecraft/vpt_contractor/9xx
      - /path/to/gamewam-minecraft/vpt_contractor/10xx
  - dataset_dirs:
      - /path/to/gamewam-minecraft/mc_scripted_gui

Source Data

mc_scripted_gui was collected by the GameWAM authors using scripted policies in a native Minecraft simulator. vpt_event and vpt_contractor are derived from the public OpenAI Video PreTraining (VPT) contractor demonstrations. The raw_file_name field in meta/episodes.jsonl identifies the source release file for each episode.

Minecraft is the intellectual property of Microsoft.

Citation

@misc{guo2026gamewamworldactionmodel,
      title={GameWAM: A World Action Model for Video Games},
      author={Yuncheng Guo and Zhanqiu Zhang and Yiwen Guo and Weijia Li},
      year={2026},
      eprint={2608.26200},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2608.26200},
}