aimagelab/DocAttriBench
DocAttriBench (DAB) Welcome to the official Hugging Face page of the DocAttriBench (DAB) dataset, developed in the paper “DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering”, accepted at BMVC 2026 (British Machine Vision Conference). 🌐 Project page: https://aimagelab.github.io/DocAttriBench/ This README provides an overview of the dataset and instructions on how to use it. 📊 Dataset Overview DocAttriBench is a dataset for training… See the full description on the dataset page: https://huggingface.co/datasets/aimagelab/DocAttriBench.
DocAttriBench (DAB)
Welcome to the official Hugging Face page of the DocAttriBench (DAB) dataset, developed in the paper “DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering”, accepted at BMVC 2026 (British Machine Vision Conference).
🌐 Project page: https://aimagelab.github.io/DocAttriBench/
This README provides an overview of the dataset and instructions on how to use it.
📊 Dataset Overview
DocAttriBench is a dataset for training and evaluating answer grounding in Document Visual Question Answering. The dataset is constructed from existing document VQA and document understanding datasets. From these source datasets, we use Docling to extract document layout elements and their semantic types, and MAPPET to obtain the bounding box of the evidence region supporting the answer. During dataset construction, we used Qwen2.5-VL-7B-Instruct for answer abstraction and applied MAPPET for source attribution using the perplexity scores produced by this model.
Each item is composed as follows:
The evidence-region type can be one of the following:
paragraph/bodycaptionheading/titlesubtitle/bylinedatasub-dataimagepicturetablelisttextother
⚙️ Dataset Configurations
The dataset is organized using Hugging Face configurations, one for each source dataset. For example:
from datasets import load_dataset
train_docvqa = load_dataset(
"aimagelab/DocAttriBench",
"docvqa",
split="train",
)Available configurations:
docvqadoclingmatixfinewebvisalongdocurlmmlongbenchdocpapervisavisualmrcvisualwebbenchwikivisa
📁 Dataset Splits
The table below reports the number of items available in each split for each configuration.
In the paper, the validation split is considered part of the training data. In this Hugging Face release, we keep val separate when it is available, so users can decide how to use it.
Please also note that SlideVQA is not included in this release due to licensing constraints. For this reason, the dataset counts in this Hugging Face version differ from the counts reported in the paper.
🧩 Evidence Region Types
The following table reports the number of type annotations for each evidence-region type, keeping train, val, and test separate. Please note that these counts differ from those reported in the paper because SlideVQA is excluded from this Hugging Face release due to licensing constraints.
⚖️ Dataset Licenses
DocAttriBench is derived from multiple existing datasets, each distributed under its own license. The licenses of the source datasets are:
- DocVQA: Apache License 2.0
- DoclingMatix: Community Data License Agreement – Permissive 2.0
- LongDocURL: Apache License 2.0
- MMLongBench-Doc: Apache License 2.0
- VISA:
- FineWeb-edu: Open Data Commons Attribution License family
- NQ: Apache License 2.0
- PubLayNet: Community Data License Agreement – Permissive, Version 1.0
- Wikipedia: Creative Commons Attribution-ShareAlike and GNU Free Documentation License family
- VisualMRC: Creative Commons
- VisualWebBench: Apache License 2.0
SlideVQA is not distributed as part of this Hugging Face release, because its license permits usage for testing and evaluation but does not allow redistribution.
Users of DocAttriBench should also comply with the licenses and terms of use of the corresponding source datasets.
