TIGER-Lab/Mantis-Eval

Overview This is a newly curated dataset to evaluate multimodal language models' capability to reason over multiple images. More details are shown in https://tiger-ai-lab.github.io/Mantis/. Statistics This evaluation dataset contains 217 human-annotated challenging multi-image reasoning problems. Leaderboard We list the current results as follows: Models Size Mantis-Eval LLaVA OneVision 72B 77.60 LLaVA OneVision 7B 64.20 GPT-4V -… See the full description on the dataset page: https://huggingface.co/datasets/TIGER-Lab/Mantis-Eval.