p-doom/common-craft

common-craft

common-craft is a dataset of Minecraft survival gameplay videos curated for research on world modeling. It can be combined with scalable repositories such as Jasmine.

Overview

• —Total duration: ~5,000 hours
• —Content type: Survival-mode Minecraft Let's Plays
• —Source: YouTube videos and playlists (handpicked)
• —Format: Raw videos (.mp4 and .webm) at a resolution of 640x360 and 30 FPS along with full metadata

Structure

common-craft/
├── <playlist_id>/
│   ├── metadata.json
│   ├── <video_id>.mp4
│   └── ...
├── single_videos/
│   ├── metadata.json
│   ├── <video_id>.mp4
│   └── ...
└── README.md

Data Selection

Videos were manually picked to ensure they are genuine survival mode Let's Plays (no creative mode showcases, minecraft-like games, or highlight reels). Preference was given to playlists to capture coherent sequences (e.g., early game → exploration → advanced builds).

Processing and Usage

common-craft provides directly scraped videos in their raw form. For world modeling or related tasks, we recommend filtering and preprocessing before training models.

For guidance on filtering such gameplay data, see the VPT paper (Baker et al., 2022). We also provide a minimal data labeling tool and a preprocessing script for efficient video-to-array conversion.

Citation

If you use common-craft in your research, please cite our work:

@article{
    mahajan2025jasmine,
    title={Jasmine: A simple, performant and scalable JAX-based world modeling codebase},
    author={Mihir Mahajan and Alfred Nguyen and Franz Srambical and Stefan Bauer},
    journal = {p(doom) blog},
    year={2025},
    url={https://pdoom.org/jasmine.html},
    note = {https://pdoom.org/blog.html}
}