datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
vsr_zeroshot
VSR: Visual Spatial Reasoning
This is the zero-shot set of VSR: Visual Spatial Reasoning (TACL 2023) [paper].
Usage
from datasets import load_dataset
data_files = {"train": "train.jsonl", "dev": "dev.jsonl", "test": "test.jsonl"}
dataset = load_dataset("cambridgeltl/vsr_zeroshot", data_files=data_files)
Note that the image files still need to be downloaded separately. See data/ for details.
Go to our github repo for more introductions.
Citation
If you find… See the full description on the dataset page: https://huggingface.co/datasets/cambridgeltl/vsr_zeroshot.ecva_zeroshot_thinking
Qwen/Qwen3-VL-2B-Thinking · happy8825/valid_ecva_clean results
Model: Qwen/Qwen3-VL-2B-Thinking
Dataset: happy8825/valid_ecva_clean
Generated: 2025-12-16 01:28:46Z
Metrics
Metric
Value
Total samples
924
With GT
0
Parsed answers
0
Top-1 accuracy
0
Recall@5
0
MRR
0
The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.
EVQA/ECVA Metrics
Metric
Value
EVQA total
924
EVQA with GT… See the full description on the dataset page: https://huggingface.co/datasets/happy8825/ecva_zeroshot_thinking.context_reliance_resist_correction_zeroshot_dev_e2d2_lm_eval_gsm8k_zeroshot_cot_samplesSFT_zeroshot_Gemma27B_balanced_plain