jonathan-roberts1/GRAB

GRAB: A Challenging GRaph Analysis Benchmark for Large Multimodal Models GRAB consists of 3 splits: GRAB, GRAB-real and GRAB-lite. This is the dataset for GRAB. Dataset Summary Large multimodal models (LMMs) have exhibited proficiencies across many visual tasks. Although numerous benchmarks exist to evaluate model performance, they increasingly have insufficient headroom and are unfit to evaluate the next generation of frontier LMMs. To overcome this… See the full description on the dataset page: https://huggingface.co/datasets/jonathan-roberts1/GRAB.