wulin222/MME-Unify
2024.08.20 ๐ We are proud to open-source MME-Unify, a comprehensive evaluation framework designed to systematically assess U-MLLMs. Our Benchmark covers 10 tasks with 30 subtasks, ensuring consistent and fair comparisons across studies. Paper: https://arxiv.org/abs/2504.03641 Code: https://github.com/MME-Benchmarks/MME-Unify Project page: https://mme-unify.github.io/ How to use? You can download images in this repository and the final structure should look like this:โฆ See the full description on the dataset page: https://huggingface.co/datasets/wulin222/MME-Unify.
3484
1*.csv filter=lfs diff=lfs merge=lfs -text
2*.zip filter=lfs diff=lfs merge=lfs -text
3*.pkl filter=lfs diff=lfs merge=lfs -text
4*.bin filter=lfs diff=lfs merge=lfs -text
5*.mp4 filter=lfs diff=lfs merge=lfs -text
6*.avi filter=lfs diff=lfs merge=lfs -text
7*.mov filter=lfs diff=lfs merge=lfs -text
8*.jpg filter=lfs diff=lfs merge=lfs -text
9*.png filter=lfs diff=lfs merge=lfs -text
10data/train-00000-of-00001.parquet filter=lfs diff=lfs merge=lfs -text11Video_Perception_and_Understanding/Video-MME/13.mp4.part filter=lfs diff=lfs merge=lfs -text12Video_Perception_and_Understanding/Video-MME/151.mp4.part filter=lfs diff=lfs merge=lfs -text13Video_Perception_and_Understanding/Video-MME/189.mp4.part filter=lfs diff=lfs merge=lfs -text14Video_Perception_and_Understanding/Video-MME/192.mp4.part filter=lfs diff=lfs merge=lfs -text15Video_Perception_and_Understanding/Video-MME/90.mp4.part filter=lfs diff=lfs merge=lfs -text16 