datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
reef-guidance-system
Dataset Card for Reef Guidance System
This dataset provides imagery used for training and evaluation of models in the Reef Guidance System. All imagery was collected by the Australian Institute of Marine Science using the ReefScan™ Transom Marine Monitoring System.
If you use this dataset in your work, please cite the associated paper: AI-driven dispensing of coral reseeding devices for broad-scale restoration of the Great Barrier Reef (citations provided at bottom of this… See the full description on the dataset page: https://huggingface.co/datasets/QCR-Underwater-Perception/reef-guidance-system.PerceptionBench
PerceptionBench
PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models
Abstract
We introduce PerceptionBench, a benchmark specifically designed to evaluate the atomic visual perception capabilities of Multimodal Large Language Models (MLLMs). Existing benchmarks often fail to isolate perception: holistic evaluations conflate perceptual errors with failures in reasoning or domain knowledge, while application-driven benchmarks… See the full description on the dataset page: https://huggingface.co/datasets/moonshotai/PerceptionBench.synthetic-bathroom-dataset-for-robotic-perception
Synthetic Bathroom Dataset for Robotic Perception
Generated by datapack-import.ts
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under /data; image_path stores the relative repository path and data_commit_sha pins the Hugging Face dataset commit used by those URLs. Files are uploaded as downloaded unless optional PNG recompression is enabled by the… See the full description on the dataset page: https://huggingface.co/datasets/physicl/synthetic-bathroom-dataset-for-robotic-perception.lighting-invariant-bedroom-perception-robustness-benchmark
Lighting-Invariant Bedroom Perception & Robustness Benchmark
Generated by datapack-import.ts
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under /data; image_path stores the relative repository path and data_commit_sha pins the Hugging Face dataset commit used by those URLs. Files are uploaded as downloaded unless optional PNG recompression is… See the full description on the dataset page: https://huggingface.co/datasets/physicl/lighting-invariant-bedroom-perception-robustness-benchmark.gently-perception-benchmark
Gently Perception Agent Benchmark
Light-sheet microscopy volumes of C. elegans embryo development, intended
for evaluating vision-based perception agents on embryo stage classification.
The dataset has two tiers:
Annotated benchmark set (embryo_1–embryo_8) — human ground-truth
stage transitions. Use this for evaluation.
Unannotated corpus (embryo_9–embryo_105) — 97 additional real embryo
timelapses with no human labels, provided for developing and stress-
testing perception… See the full description on the dataset page: https://huggingface.co/datasets/gently-project/gently-perception-benchmark.imaginative-perception-token-mvc-ipt
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-mvc-ipt.AirV2X-Perceptionimaginative-perception-token-pet-ipt
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pet-ipt.synthetic-living-room-dataset-for-robotic-perception
Synthetic Living Room Dataset for Robotic Perception
Generated by datapack-import.ts
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under /data; image_path stores the relative repository path and data_commit_sha pins the Hugging Face dataset commit used by those URLs. Files are uploaded as downloaded unless optional PNG recompression is enabled by… See the full description on the dataset page: https://huggingface.co/datasets/physicl/synthetic-living-room-dataset-for-robotic-perception.artificial-foveated-perception
Artificial Foveated Perception (AFP) Dataset
Training data for Artificial Foveated Perception (AFP), a task-conditioned mask predictor for robotic
foundation models (paper, code,
labeling tool).
The dataset contains 786 robot-manipulation episodes from real-world and simulated manipulation data. Every frame is paired with a continuous task-relevance matte: an alpha map in [0, 1]
that is 1 on the task-relevant objects and the robot end-effector, 0 on the background, and graded in… See the full description on the dataset page: https://huggingface.co/datasets/yalesunxiatao/artificial-foveated-perception.PerceptionTest_Valimaginative-perception-token-pet-eval-ai2thor
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pet-eval-ai2thor.PerceptionComp
PerceptionComp: A Benchmark for Complex Perception-Centric Video Reasoning
PerceptionComp is a benchmark for complex perception-centric video reasoning. It focuses on questions that cannot be solved from a single frame, a short clip, or a shallow caption. Models must revisit visually complex videos, gather evidence across temporally separated segments, and combine multiple perceptual cues before answering.
Dataset Details
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/hrinnnn/PerceptionComp.imaginative-perception-token-pet-eval-habitat
Dataset Card for "habitat_perspective_eval"
More Information needed
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pet-eval-habitat.skylink_perceptionrss-robot-perception-evidence
Robot perception research artifacts
This is an exploratory experiment archive for an RSS research project. It is not a claim of acceptance, a finalized paper, or an official VER reproduction.
Code and protocol: https://github.com/YananZHOU5555/rss-robot-perception (private).
Weights: https://huggingface.co/B111ue/rss-robot-perception-checkpoints
Evidence: https://huggingface.co/datasets/B111ue/rss-robot-perception-evidence
This snapshot contains 228 complete evaluation cohorts… See the full description on the dataset page: https://huggingface.co/datasets/B111ue/rss-robot-perception-evidence.imaginative-perception-token-mvc-eval-ai2thor
Dataset Card for "multiview_eval"
More Information needed
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-mvc-eval-ai2thor.Perception_ZwZ-RL-VQA
ZwZ-RL-VQA: Region-to-Image Distilled Training Data for Fine-Grained Perception
This dataset contains 74K high-quality VQA pairs generated via Region-to-Image Distillation (R2I) for training multimodal large language models (MLLMs) on fine-grained perception tasks without test-time tool use.
📖 Overview
The Zooming without Zooming (ZwZ) method transforms "zooming" from an inference-time tool into a training-time primitive:
Zoom-in Synthesis: Strong teacher models… See the full description on the dataset page: https://huggingface.co/datasets/zwyang6/Perception_ZwZ-RL-VQA.perception-testPerceptionTestimaginative-perception-token-pt-eval-ai2thor
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pt-eval-ai2thor.perception_lm_test_videosperception_lm_test_imagesvideo-diffusion-perceptionimaginative-perception-token-pt-eval-real
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-pt-eval-real.perception-sets-matrix
Perception Sets the Matrix — Match-Propensity Campaign
Complete, reproducible campaign data for the pre-registered test of the
spectral-match linking model: at cohort level, the perceptual match
between an observer cohort's eight-dimensional perception profile and a
brand's profile is a monotone predictor of the cohort's stated choice
propensity within its category consideration set — the generative layer
under the stochastic brand-choice tradition's exogenous switching… See the full description on the dataset page: https://huggingface.co/datasets/spectralbranding/perception-sets-matrix.imaginative-perception-token-mvc-textcot
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-mvc-textcot.perception-benchmarkimaginative-perception-token-mvc-no-thought
Citation
Released with the paper Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (arXiv:2606.03988):
@misc{bigverdi2026imaginativeperceptiontokensenhance,
title={Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models},
author={Mahtab Bigverdi and Linjie Li and Weikai Huang and Yiming Liu and Jaemin Cho and Jieyu Zhang and Tuhin Kundu and Chris Dangjoo Kim and Zelun Luo and Linda Shapiro and Ranjay… See the full description on the dataset page: https://huggingface.co/datasets/weikaih/imaginative-perception-token-mvc-no-thought.greenery-perception
It is not always greener on the other side: Greenery perception across demographics and personalities in multiple cities
Repository for additional data used in the paper "It is not always greener on the other side: Greenery perception across demographics and personalities in multiple cities".
This project was developed at the Future Cities Lab Global in the Singapore-ETH Centre in close collaboration with the Urban Analytics Lab (UAL) at the National University of Singapore (NUS).… See the full description on the dataset page: https://huggingface.co/datasets/matiasqr/greenery-perception.