PaulineLi/QuantiPhy

QuantiPhy Dataset Summary QuantiPhy is a benchmark for evaluating whether vision–language models (VLMs) can perform quantitative physical inference from visual evidence, rather than producing plausible but ungrounded numerical guesses. This repository contains the official test set of the QuantiPhy benchmark, consisting of 3,289 video–question (QA) pairs across 568 videos. Ground-truth answers are withheld to ensure fair evaluation. Each instance requires a model… See the full description on the dataset page: https://huggingface.co/datasets/PaulineLi/QuantiPhy.