clevr
Datasets
All datasets matching “clevr”CLEVR-HOPE
CLEVR-HOPE
The CLEVR Held-Out Pair Evaluation (CLEVR-HOPE) dataset is a diagnostic dataset for testing the systematicity of VQA models.
CLEVR-HOPE is a controlled setting to test whether VQA models generalize to pairs of attribute values that were not seen during either training or fine-tuning.
Within CLEVR-HOPE, we refer to an unseen pair of attribute values as a Held-Out Pair (HOP). The dataset is composed of 29 sub-datasets, each for a different HOP.
For each of the 29 HOPs, we… See the full description on the dataset page: https://huggingface.co/datasets/user9000/CLEVR-HOPE.clevr-multichange
CLEVR-Multi-Change (30–40 objects)
Two-image change-captioning data used in "Stateful Visual Encoders for
Vision-Language Models" (the Multi-object Visual Differencing task). Each example is a before/after pair of a CLEVR scene
with 30–40 objects and 4 simultaneous changes (add / delete / move /
replace), rendered at 768×768 with a wide camera angle. Built with the
CLEVR-Multi-Change engine (Johnson et al. 2017; Qiu et al. 2021).
Code & paper:… See the full description on the dataset page: https://huggingface.co/datasets/zwcolin/clevr-multichange.Clevr_CoGenT_TrainA_70K_Complexclevr-mathCLEVR-Math is a dataset for compositional language, visual and mathematical reasoning. CLEVR-Math poses questions about mathematical operations on visual scenes using subtraction and addition, such as "Remove all large red cylinders. How many objects are left?". There are also adversarial (e.g. "Remove all blue cubes. How many cylinders are left?") and multihop questions (e.g. "Remove all blue cubes. Remove all small purple spheres. How many objects are left?").Super-CLEVR
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
[CVPR 2023 Highlight (top 2.5%)]
Paper: Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
Authors: Zhuowan Li, Xingrui Wang, Elias Stengel-Eskin, Adam Kortylewski, Wufei Ma, Benjamin Van Durme, Alan Yuille
Dataset Description
Super-CLEVR is a synthetic dataset designed to systematically study the domain robustness of visual reasoning models across… See the full description on the dataset page: https://huggingface.co/datasets/RyanWW/Super-CLEVR.clevr_cogen_a_train