machinaExMachina/duet-pcg-v1
MultiWorld Duet PCG v1 2-player procedural-generation Minecraft gameplay dataset. Companion to duet-oov-scripted-v1 with added world + task diversity for the MultiWorld paper. Overview Episodes: ~1,700 (3,400+ player streams) Format: Solaris-compatible sharded WebDataset TARs Resolution: 1280×720 @ 20 FPS World diversity: 20 config combos × mixed flat/normal worlds × 5 biomes (plains, snowy_plains, desert, badlands, mushroom_fields) Task diversity: 10 episode… See the full description on the dataset page: https://huggingface.co/datasets/machinaExMachina/duet-pcg-v1.
MultiWorld Duet PCG v1
2-player procedural-generation Minecraft gameplay dataset. Companion to duet-oov-scripted-v1 with added world + task diversity for the MultiWorld paper.
Overview
- Episodes: ~1,700 (3,400+ player streams)
- Format: Solaris-compatible sharded WebDataset TARs
- Resolution: 1280×720 @ 20 FPS
- World diversity: 20 config combos × mixed flat/normal worlds × 5 biomes (plains, snowyplains, desert, badlands, mushroomfields)
- Task diversity: 10 episode types (4 new PCG templates + 6 Phase 1 OOV scenarios)
- Server: Minecraft 1.21 (Paper)
Why this dataset exists
Phase 1 (duet-oov-scripted-v1) established the core OOV scenarios on flat plains worlds. Phase 2 adds world and task diversity: scenarios run across different biomes (including non-flat vanilla terrain) with procedurally varied parameters. The goal is scenario breadth, not raw frame count — per the MultiWorld data plan, "scenario diversity, not raw frame count, drives generalization for the consistency story."
New PCG Task Templates
Four new task-template episode handlers added in Phase 2. Each has procedural parameters drawn from a shared per-episode PRNG seed so both bots make consistent decisions independently.
Phase 1 Scenarios Also Included
All six Phase 1 OOV scenarios run in Phase 2 with the added world diversity: splitAndRejoin, throughTheWall, farApartBuild, asymmetricInformation, jointWitnessReunite, sharedBuildReunite.
World Configurations
The PCG manifest (pcg/production_manifest.json) defines 20 configurations, each with:
- World seed — deterministic from config index via MD5 salt
- World type —
flat(8 configs) ornormal(12 configs, vanilla biome generation) - Biome (flat worlds) — one of plains, snowyplains, desert, badlands, mushroomfields
- Episode type mix — random 3–6 types sampled from the 10-scenario pool
File structure
Same as duet-oov-scripted-v1:
train/<prefix>_<episode>_Alpha_instance_<i>.mp4
train/<prefix>_<episode>_Alpha_instance_<i>.json
train/<prefix>_<episode>_Alpha_instance_<i>_episode_info.json
train/<prefix>_<episode>_Bravo_instance_<i>.mp4
train/<prefix>_<episode>_Bravo_instance_<i>.json
train/<prefix>_<episode>_Bravo_instance_<i>_episode_info.jsonepisode_info.json includes per-scenario eval_metadata (distances, durations, structure types, mob types, etc.) drawn from the episode's PRNG plan.
Usage
Compatible with the Solaris training pipeline. Extract shards:
for f in *.tar; do tar xf "$f"; doneCitation
If you use this dataset, please cite the MultiWorld paper (forthcoming).
