Multimedia-SMU/seeingculture-benchmark

Paper | Project Page | Leaderboard | Explorer | Code | CMB, the video successor Seeing Culture Benchmark (SCB) Evaluating Visual Reasoning and Grounding in Cultural Context The Seeing Culture Benchmark (SCB) evaluates cultural reasoning in vision-language models in two stages: i) selecting the correct visual option with multiple-choice visual question answering (VQA), and ii) segmenting the relevant cultural artifact as evidence of reasoning. Visual options in… See the full description on the dataset page: https://huggingface.co/datasets/Multimedia-SMU/seeingculture-benchmark.