Datasetpublic

sjmathy/interactive-video-reasoning

Dataset release Videos, trajectories, manifests, and evaluation records are hosted at: https://huggingface.co/datasets/sjmathy/interactive-video-reasoning Expected layout: data/ balance_rod/{task_bank,probe_bank}/ pushbar_finishline/{task_bank,probe_bank}/ slide_block/{task,probe}/ notched_launcher/shards/{task,probe}/ Domain Task bank Probe bank Held-out rule Balance-Rod 500 episodes 500 episodes pose groups 80-99 Push-Bar 500 episodes 500 episodes pose… See the full description on the dataset page: https://huggingface.co/datasets/sjmathy/interactive-video-reasoning.

sourceHugging Faceupdated 17d agoView on Hugging Face

0likes168downloads

Dataset Card

Dataset release

Videos, trajectories, manifests, and evaluation records are hosted at:

https://huggingface.co/datasets/sjmathy/interactive-video-reasoning

Expected layout:

~~~text data/ balancerod/{taskbank,probebank}/ pushbarfinishline/{taskbank,probebank}/ slideblock/{task,probe}/ notchedlauncher/shards/{task,probe}/ ~~~

Domain	Task bank	Probe bank	Held-out rule
Balance-Rod	500 episodes	500 episodes	pose groups 80-99
Push-Bar	500 episodes	500 episodes	pose groups 16-19
Sliding Box	500 episodes	500 episodes	pose groups 80-99
Spring Launcher	500 episodes	500 episodes	pose groups 80-99

The released task banks contain successful demonstrations. Probe banks are counterfactually matched: initial geometry and commanded interaction are shared across hidden settings within each pose/program group. The Push-Bar probe is the revised near-center grasp/lift collection; the old gentle-push bank is excluded.

The initial dataset release does not bundle the approximately 52 GB of VQGAN and WAM checkpoints. Training code and exact evaluation records are included; model weights can be published separately without mixing them into the trajectory dataset.