amd/Micro-World-MC-Dataset
Micro-World is an interactive world model developed by AMD. We leverage the Minecraft API MineDojo to collect game data, as it enables us to obtain diverse biomes as well as varying weather and lighting conditions—properties that are desirable for improving generalization to real-world scenarios. For the action space, we record keyboard controls including W (forward), A (left), S (backward), D (right), Ctrl (sprint), Shift (sneak), Space (jump), along with mouse movement. By randomly sampling… See the full description on the dataset page: https://huggingface.co/datasets/amd/Micro-World-MC-Dataset.
Micro-World is an interactive world model developed by AMD. We leverage the Minecraft API MineDojo to collect game data, as it enables us to obtain diverse biomes as well as varying weather and lighting conditions—properties that are desirable for improving generalization to real-world scenarios. For the action space, we record keyboard controls including W (forward), A (left), S (backward), D (right), Ctrl (sprint), Shift (sneak), Space (jump), along with mouse movement. By randomly sampling biomes and executing these actions, we collected 6,000 clips, each consisting of 81 frames, forming our Game dataset. We use miniCPM to generate captions for each clip.
For more details, see our GitHub Repo and joint blog post to learn more.