Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "page_info": {3 "image_path": "PPT_MMAT5390Lecture1_page_023.png",4 "page_no": 23,5 "page_attribute": {6 "data_source": "PPT2PDF",7 "language": "english",8 "layout": "single_column",9 "special_issue": [10 "None"11 ]12 },13 "width": 2000,14 "height": 150015 },16 "layout_dets": [17 {18 "category_type": "title",19 "anno_id": 1,20 "order": 1,21 "ignore": false,22 "poly": [23 478.6666666666667,24 48,25 1430.6666666666667,26 48,27 1430.6666666666667,28 144,29 478.6666666666667,30 14431 ],32 "line_with_spans": [],33 "attribute": {34 "text_language": "text_english",35 "text_background": "white",36 "text_rotate": "normal"37 },38 "text": "What is a digital image?"39 },40 {41 "category_type": "title",42 "anno_id": 2,43 "order": 2,44 "ignore": false,45 "poly": [46 53.10144927536201,47 211.33551700626322,48 833.3333333333331,49 211.33551700626322,50 833.3333333333331,51 278.00218367292933,52 53.10144927536201,53 278.0021836729293354 ],55 "line_with_spans": [],56 "attribute": {57 "text_language": "text_english",58 "text_background": "white",59 "text_rotate": "normal"60 },61 "text": "■ Mathematical definition:"62 },63 {64 "category_type": "text_block",65 "anno_id": 3,66 "order": 3,67 "ignore": false,68 "poly": [69 148.10035491712426,70 284.07292497677514,71 1900,72 284.07292497677514,73 1900,74 414.70614000439986,75 148.10035491712426,76 414.7061400043998677 ],78 "line_with_spans": [],79 "attribute": {80 "text_language": "text_english",81 "text_background": "white",82 "text_rotate": "normal"83 },84 "text": "- A 2D (grayscale) digital image is a 2D function defined on a 2D domain (usually rectangular domain):"85 },86 {87 "category_type": "equation_isolated",88 "anno_id": 4,89 "order": 4,90 "ignore": false,91 "poly": [92 758.6666666666666,93 444,94 1105.3333333333333,95 444,96 1105.3333333333333,97 532,98 758.6666666666666,99 532100 ],101 "line_with_spans": [],102 "attribute": {103 "formula_type": "print",104 "equation_language": "equation_en"105 },106 "latex": "$$\nf : \\Omega \\to \\mathbb { R }\n$$"107 },108 {109 "category_type": "text_block",110 "anno_id": 5,111 "order": 5,112 "ignore": false,113 "poly": [114 145.18652446523635,115 570.6666666666671,116 1455.2361224267943,117 570.6666666666671,118 1455.2361224267943,119 643.8746265824452,120 145.18652446523635,121 643.8746265824452122 ],123 "line_with_spans": [],124 "attribute": {125 "text_language": "text_english",126 "text_background": "white",127 "text_rotate": "normal"128 },129 "text": "- $f(x,y)$ is called the brightness/intensity/grey level;"130 },131 {132 "category_type": "text_block",133 "anno_id": 10,134 "order": 6,135 "ignore": false,136 "poly": [137 144.3170590543426,138 655.3833770079073,139 1263.3558193992512,140 655.3833770079073,141 1263.3558193992512,142 706.8328201263754,143 144.3170590543426,144 706.8328201263754145 ],146 "attribute": {147 "text_language": "text_english",148 "text_background": "white",149 "text_rotate": "normal"150 },151 "text": "- $(x,y)$is the temporal coordinates of the image. - (x,y) represents the date: 2045-07-15.",152 "html": "<p>- $(x,y)$is the temporal coordinates of the image.</p><p>- (x,y) represents the date: 2045-07-15.</p>"153 },154 {155 "category_type": "text_block",156 "anno_id": 6,157 "order": 7,158 "ignore": false,159 "poly": [160 141.06158124751687,161 717.3333333333336,162 1154.6666666666667,163 717.3333333333336,164 1154.6666666666667,165 778.6666666666666,166 141.06158124751687,167 778.6666666666666168 ],169 "line_with_spans": [],170 "attribute": {171 "text_language": "text_english",172 "text_background": "white",173 "text_rotate": "normal"174 },175 "text": "- Thus, a 2D digital image looks like this:"176 },177 {178 "category_type": "equation_isolated",179 "anno_id": 7,180 "order": 8,181 "ignore": false,182 "poly": [183 460,184 794.6666666666666,185 1466.6666666666667,186 794.6666666666666,187 1466.6666666666667,188 1097.3333333333333,189 460,190 1097.3333333333333191 ],192 "line_with_spans": [],193 "attribute": {194 "formula_type": "print",195 "equation_language": "equation_en"196 },197 "latex": "$$\nf ( x , y ) = { \\left[ \\begin{array} { l l l l } { f ( 1 , 1 ) } & { f ( 1 , 2 ) } & { \\ldots } & { f ( 1 , N ) } \\\\ { f ( 2 , 1 ) } & { f ( 2 , 2 ) } & { \\ldots } & { f ( 2 , N ) } \\\\ { \\vdots } & { \\vdots } & { } & { \\vdots } \\\\ { f ( N , 1 ) } & { f ( N , 2 ) } & { \\ldots } & { f ( N , N ) } \\end{array} \\right] }\n$$"198 },199 {200 "category_type": "text_block",201 "anno_id": 8,202 "order": 9,203 "ignore": false,204 "poly": [205 155.2417639533248,206 1146.2739203030583,207 1626.6553467458248,208 1146.2739203030583,209 1626.6553467458248,210 1211.4701571967767,211 155.2417639533248,212 1211.4701571967767213 ],214 "attribute": {215 "text_language": "text_english",216 "text_background": "white",217 "text_rotate": "normal"218 },219 "text": "- Each element in the matrix is called anti-pixel (non-picture element); - Although each element is called anti-pixel, it is still called pixel in standard computer graphics.",220 "html": "<p>- Each element in the matrix is called anti-pixel (non-picture element);</p><p>- Although each element is called anti-pixel, it is still called pixel in standard computer graphics.</p>"221 },222 {223 "category_type": "text_block",224 "anno_id": 11,225 "order": 10,226 "ignore": false,227 "poly": [228 154.13111524954923,229 1205.792790670226,230 1439.2143947571128,231 1205.792790670226,232 1439.2143947571128,233 1281.4318097304463,234 154.13111524954923,235 1281.4318097304463236 ],237 "attribute": {238 "text_language": "text_english",239 "text_background": "white",240 "text_rotate": "normal"241 },242 "text": "- Usually, $G \\leq f(x, y) \\leq 0$ and $(N=2^{-n}, G=2^{-m})$",243 "html": "<p>- Usually, $G \\leq f(x, y) \\leq 0$ and $(N=2^{-n}, G=2^{-m})$</p>"244 },245 {246 "category_type": "text_block",247 "anno_id": 9,248 "order": 11,249 "ignore": false,250 "poly": [251 218.66666666666666,252 1350.6666666666667,253 1798.6666666666667,254 1350.6666666666667,255 1798.6666666666667,256 1417.3333333333333,257 218.66666666666666,258 1417.3333333333333259 ],260 "line_with_spans": [],261 "attribute": {262 "text_language": "text_english",263 "text_background": "white",264 "text_rotate": "normal"265 },266 "text": "IMAGE PROCESSING IS RELATED TO LINEAR ALGEBRA!!"267 }268 ],269 "extra": {270 "relation": []271 }272}