datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MetaVQA-TrainOCR-MetaReasoning
OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding
Gengxu Li1, Yuan Wu1*, Yi Chang1,2,3
1 School of Artificial Intelligence, Jilin University 2 Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China
3 International Center of Future Science, Jilin University
Overview ·
Task ·
Dataset ·
Evaluation ·
Citation
OCR-MetaReasoning is a controlled benchmark for testing… See the full description on the dataset page: https://huggingface.co/datasets/GengxuLi123/OCR-MetaReasoning.VisOnlyQA_metadata
VisOnlyQA
🌐 Project Website | 📄 Paper | 🤗 Dataset | 🔥 VLMEvalKit
This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Information".
VisOnlyQA is designed to evaluate the visual perception capability of large vision language models (LVLMs) on geometric information of scientific figures. The evaluation set includes 1,200 mlutiple choice questions in 12 visual perception tasks on 4… See the full description on the dataset page: https://huggingface.co/datasets/ryokamoi/VisOnlyQA_metadata.WearVQA
WearVQA: A Visual Question Answering Benchmark for Wearables in Egocentric Authentic Real-world Scenarios
Paper: WearVQA: A Visual Question Answering Benchmark for Wearables in Egocentric Authentic Real-world scenariosAuthors: Eun Chang*, Zhuangqun Huang*, Yiwei Liao*, Sagar Ravi Bhavsar*, Amogh Param, Tammy Stark, Adel Ahmadyan, Xiao Yang, Jiaqi Wang, Ahsan Abdullah, Giang Nguyen, Akil Iyer, David Hall, Elissa Li, Shane Moon, Nicolas Scheffer, Kirmani Ahmed, Babak Damavandi, Rakesh… See the full description on the dataset page: https://huggingface.co/datasets/tonyliao-meta/WearVQA.yeji-meta
██╗ ██╗███████╗ ██╗██╗ ███╗ ███╗███████╗████████╗ █████╗
╚██╗ ██╔╝██╔════╝ ██║██║ ████╗ ████║██╔════╝╚══██╔══╝██╔══██╗
╚████╔╝ █████╗ ██║██║ ██╔████╔██║█████╗ ██║ ███████║
╚██╔╝ ██╔══╝ ██ ██║██║ ██║╚██╔╝██║██╔══╝ ██║ ██╔══██║
██║ ███████╗╚█████╔╝██║ ██║ ╚═╝ ██║███████╗ ██║ ██║ ██║
╚═╝ ╚══════╝ ╚════╝ ╚═╝ ╚═╝ ╚═╝╚══════╝ ╚═╝ ╚═╝ ╚═╝
⚡ NEURAL INTERFACE ACTIVATED ⚡
> ACCESS GRANTED: YEJI META
>… See the full description on the dataset page: https://huggingface.co/datasets/tellang/yeji-meta.