datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ai2thor-vsi-bench-1k-v2ai2thor-vsi-eval-400ai2thor-random-views-20kai2thor-perspective-qa-10kai2thor-perspective-qa-20k-balanced-splits-with-objai2thor-perspective-qa-20k-raw-splitsai2thor-perspective-qa-100k-balanced-training-v1-splitsimaginative-perception-token-pet-eval-ai2thor
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pet-eval-ai2thor.ai2thor-sideview-onlyai2thor-perspective-qa-5k-scenes-finalai2thor-hab
AI2THOR-Hab
AI2THOR scene datasets include iTHOR, RoboTHOR, ProcTHOR-10K, ArchitecTHOR. Many of the assets of the interactable objects are shared across these datasets.
iTHOR: includes 120 single room scenes, 30 scenes for each bedroom, bathroom, kitchen, and living room. In our extracted dataset, there are additional 30 foyers scenes.
RoboTHOR: includes 89 apartments in maze style, where the rooms are subdivided by wall panels. Same of the scenes share the same room layout, but… See the full description on the dataset page: https://huggingface.co/datasets/hssd/ai2thor-hab.ai2thor-perspective-qa-10000-scene-v2AI2THOR
AI2THOR Scene/Object Dataset for ManiSkill
This is a modified version of the Habitat Synthetic Scenes Dataset (HSSD) which is also modified based on the original AI2THOR scenes and assets
in order to make it usable by ManiSkill. There are 10,000+ scenes and 10,000+ different objects so downloading this can take a bit of time.
Note that currently this dataset has no interactable articulated objects as the original AI2THOR simulator is based on unity and had magic articulation… See the full description on the dataset page: https://huggingface.co/datasets/haosulab/AI2THOR.ai2thor-perspective-qa-5000-scene-finalimaginative-perception-token-mvc-eval-ai2thor
Dataset Card for "multiview_eval"
More Information needed
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-mvc-eval-ai2thor.ai2thor-perspective-qa-10000-scene-v3ai2thor-perspective-qa-procthor-testai2thor-counting-largeai2thor-perspective-5k-v2-with-imagesai2thor-perspective-qa-10k-object-category-namesai2thor-random-views-20k-3obj-filteredai2thor-perspective-qa-800-qa-v9-splitsimaginative-perception-token-pt-eval-ai2thor
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pt-eval-ai2thor.ai2thor-perspective-qa-800-qa-v7-splitsai2thor-perspective-qa-10000-scene-v4ai2thor-perspective-qa-1000-qa-v5ai2thor-perspective-qa-10k-fix-x-markai2thor-perspective-v3-278-human-filter-with-obj-nameai2thor_spatial_verification_val_v2ai2thor_spatial_verification_test_v2