Huishan/AVE-Assessing_VQA_Evaluators-v1

Samples with sample_id from 38 to 7421 serve as the test set, while others are for validation. The division barely introduces shift on the distribution across source VQA datasets. This is the official repository (still under construction) for paper "Towards Flexible Evaluation for Generative Visual Question Answering", an oral in ACM Multimedia 2024. Please refer to our github repository (https://github.com/jihuishan/flexible_evaluation_for_vqa_mm24/tree/main) for more details. Welcome any… See the full description on the dataset page: https://huggingface.co/datasets/Huishan/AVE-Assessing_VQA_Evaluators-v1.