CoolFace
Datasetpublic

aimagelab/DocAttriBench

DocAttriBench (DAB) Welcome to the official Hugging Face page of the DocAttriBench (DAB) dataset, developed in the paper “DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering”, accepted at BMVC 2026 (British Machine Vision Conference). 🌐 Project page: https://aimagelab.github.io/DocAttriBench/ This README provides an overview of the dataset and instructions on how to use it. 📊 Dataset Overview DocAttriBench is a dataset for training… See the full description on the dataset page: https://huggingface.co/datasets/aimagelab/DocAttriBench.

sourceHugging Faceupdated 1mo agoView on Hugging Face
0likes1.6kdownloads
Dataset Card

DocAttriBench (DAB)

Welcome to the official Hugging Face page of the DocAttriBench (DAB) dataset, developed in the paper “DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering”, accepted at BMVC 2026 (British Machine Vision Conference).

🌐 Project page: https://aimagelab.github.io/DocAttriBench/

This README provides an overview of the dataset and instructions on how to use it.

📊 Dataset Overview

DocAttriBench is a dataset for training and evaluating answer grounding in Document Visual Question Answering. The dataset is constructed from existing document VQA and document understanding datasets. From these source datasets, we use Docling to extract document layout elements and their semantic types, and MAPPET to obtain the bounding box of the evidence region supporting the answer. During dataset construction, we used Qwen2.5-VL-7B-Instruct for answer abstraction and applied MAPPET for source attribution using the perplexity scores produced by this model.

Each item is composed as follows:

FieldDescription
imageThe document image, stored as a Hugging Face Image feature.
image_pathOriginal relative image path from the source dataset.
queryThe question associated with the document image.
answerThe answer associated with the question, stored in list format.
bboxThe bounding box of the evidence region, stored in the original nested-list format. Each bounding box is represented as normalized coordinates [x1, y1, x2, y2], where (x1, y1) is the top-left corner and (x2, y2) is the bottom-right corner. Values are in [0, 1] and are relative to the image width and height.
typeThe semantic type of the evidence region, stored in list format.
source_datasetName of the source dataset/configuration.

The evidence-region type can be one of the following:

  • —paragraph/body
  • —caption
  • —heading/title
  • —subtitle/byline
  • —data
  • —sub-data
  • —image
  • —picture
  • —table
  • —list
  • —text
  • —other

⚙️ Dataset Configurations

The dataset is organized using Hugging Face configurations, one for each source dataset. For example:

python
from datasets import load_dataset

train_docvqa = load_dataset(
    "aimagelab/DocAttriBench",
    "docvqa",
    split="train",
)

Available configurations:

  • —docvqa
  • —doclingmatix
  • —finewebvisa
  • —longdocurl
  • —mmlongbenchdoc
  • —papervisa
  • —visualmrc
  • —visualwebbench
  • —wikivisa

📁 Dataset Splits

The table below reports the number of items available in each split for each configuration.

ConfigurationTrainValTest
docvqa4,070-467
doclingmatix139,632--
finewebvisa33,092--
longdocurl--688
mmlongbenchdoc--276
papervisa52,113-1,546
visualmrc15,0002,0684,857
visualwebbench--233
wikivisa31,000-1,233
Total274,9072,0689,300

In the paper, the validation split is considered part of the training data. In this Hugging Face release, we keep val separate when it is available, so users can decide how to use it.

Please also note that SlideVQA is not included in this release due to licensing constraints. For this reason, the dataset counts in this Hugging Face version differ from the counts reported in the paper.

🧩 Evidence Region Types

The following table reports the number of type annotations for each evidence-region type, keeping train, val, and test separate. Please note that these counts differ from those reported in the paper because SlideVQA is excluded from this Hugging Face release due to licensing constraints.

TypeTrainValTest
paragraph/body146,7621,4805,265
caption15,77219347
heading/title9,881113232
subtitle/byline2,88773189
data1,3162668
sub-data351015
image81025183
picture6,7660433
table25,6490961
list5,899112201
text4,6970891
other54,451213528
Total274,9252,0719,313

⚖️ Dataset Licenses

DocAttriBench is derived from multiple existing datasets, each distributed under its own license. The licenses of the source datasets are:

  • —DocVQA: Apache License 2.0
  • —DoclingMatix: Community Data License Agreement – Permissive 2.0
  • —LongDocURL: Apache License 2.0
  • —MMLongBench-Doc: Apache License 2.0
  • —VISA:
  • —FineWeb-edu: Open Data Commons Attribution License family
  • —NQ: Apache License 2.0
  • —PubLayNet: Community Data License Agreement – Permissive, Version 1.0
  • —Wikipedia: Creative Commons Attribution-ShareAlike and GNU Free Documentation License family
  • —VisualMRC: Creative Commons
  • —VisualWebBench: Apache License 2.0

SlideVQA is not distributed as part of this Hugging Face release, because its license permits usage for testing and evaluation but does not allow redistribution.

Users of DocAttriBench should also comply with the licenses and terms of use of the corresponding source datasets.