FreedomIntelligence/MileBench

MileBench Introduction We introduce MileBench, a pioneering benchmark designed to test the MultImodal Long-contExt capabilities of MLLMs. This benchmark comprises not only multimodal long contexts, but also multiple tasks requiring both comprehension and generation. We establish two distinct evaluation sets, diagnostic and realistic, to systematically assess MLLMs’ long-context adaptation capacity and their ability to completetasks in long-context scenarios… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/MileBench.