datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MMSI-Bench
MMSI-Bench
This repo contains evaluation code for the paper "MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence"
🌐 Homepage | 🤗 Dataset | 📑 Paper | 💻 Code | 📖 arXiv
🔔News
🔥[2025-10-23]: We added the normalized human response time for each MMSI-Bench sample and its difficulty level to our dataset on Hugging Face.
🔥[2025-06-18]: MMSI-Bench has been supported in the LMMs-Eval repository.
✨[2025-06-11]: MMSI-Bench was used for evaluation in the… See the full description on the dataset page: https://huggingface.co/datasets/RunsenXu/MMSI-Bench.ERQA
ERQA (Parquet + TSV)
This repo provides a Parquet-converted ERQA dataset and a TSV formatted for vlmevalkit.Original project: https://github.com/embodiedreasoning/ERQA
Contents
erqa.parquetColumns:
question (string) — with <image> placeholders inserted according to visual_indices
question_type (string)
answer (string, optional)
visual_indices (list[int])
images_encoded (list[image]) — image bytes aligned with the <image> order
ERQA.tsv (for vlmevalkit)Columns:
index… See the full description on the dataset page: https://huggingface.co/datasets/RunsenXu/ERQA.VSR
VSR (Parquet + TSV)
This repo provides a Parquet-converted VSR dataset and a TSV formatted for vlmevalkit.
Contents
VSR_Zero_Shot_Test.parquet
Columns:
question (string) — adds <image> placeholders (from the original text) and appends options + post prompt (see below)
question_type (string)
answer (string; "A" for True, "B" for False)
image (list[image]) — image bytes aligned with the <image> order
id (string)
gt_value (bool; original True/False)
relation (string)
subj… See the full description on the dataset page: https://huggingface.co/datasets/RunsenXu/VSR.