Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "page_info": {3 "image_path": "PPT_ch7_page_034.png",4 "page_no": 34,5 "page_attribute": {6 "data_source": "PPT2PDF",7 "language": "english",8 "layout": "single_column",9 "special_issue": [10 "None"11 ]12 },13 "width": 2000,14 "height": 150015 },16 "layout_dets": [17 {18 "category_type": "text_block",19 "anno_id": 2,20 "order": 1,21 "ignore": false,22 "poly": [23 103.95502118585111,24 180.00000000000023,25 1268.3215394124675,26 180.00000000000023,27 1268.3215394124675,28 275.8298869160655,29 103.95502118585111,30 275.829886916065531 ],32 "line_with_spans": [],33 "attribute": {34 "text_language": "text_english",35 "text_background": "single_colored",36 "text_rotate": "normal"37 },38 "text": "Matrix Form of the Linear System (1)."39 },40 {41 "category_type": "text_block",42 "anno_id": 7,43 "order": 2,44 "ignore": false,45 "poly": [46 107.99510188903025,47 277.0852810196565,48 1880.3478839164438,49 277.0852810196565,50 1880.3478839164438,51 507.2673811549576,52 107.99510188903025,53 507.267381154957654 ],55 "line_with_spans": [],56 "attribute": {57 "text_language": "text_english",58 "text_background": "single_colored",59 "text_rotate": "normal"60 },61 "text": "From the definition of matrix multiplication we see that the $m$ equations of (1) may be written as a single vector equation"62 },63 {64 "category_type": "equation_caption",65 "anno_id": 10,66 "order": 3,67 "ignore": false,68 "poly": [69 114.38675646512007,70 511.0461756868185,71 211.67449231417672,72 511.0461756868185,73 211.67449231417672,74 578.263156818894,75 114.38675646512007,76 578.26315681889477 ],78 "line_with_spans": [],79 "attribute": {},80 "text": "(2)"81 },82 {83 "category_type": "equation_isolated",84 "anno_id": 8,85 "order": 4,86 "ignore": false,87 "poly": [88 697.3190607230483,89 502.87493018220306,90 939.2829869845583,91 502.87493018220306,92 939.2829869845583,93 591.5730134173201,94 697.3190607230483,95 591.573013417320196 ],97 "line_with_spans": [],98 "attribute": {99 "formula_type": "print",100 "equation_language": "equation_en"101 },102 "latex": "$$\n\\mathbf { A x } = \\mathbf { b }\n$$"103 },104 {105 "category_type": "text_block",106 "anno_id": 9,107 "order": 5,108 "ignore": false,109 "poly": [110 111.18881272490474,111 584.1498564057438,112 1765.866834016682,113 584.1498564057438,114 1765.866834016682,115 683.5456451622825,116 111.18881272490474,117 683.5456451622825118 ],119 "attribute": {120 "text_language": "text_english",121 "text_background": "single_colored",122 "text_rotate": "normal"123 },124 "text": "where the coefficient matrix $\\mathbf{A} = [\\pi_{jk}]$ is the $n \\times m$ matrix, although it is a magic zero matrix and singular, it can solve all equations $\\mathbf{A}x = \\mathbf{b}$.",125 "html": "<p>where the coefficient matrix $\\mathbf{A} = [\\pi_{jk}]$ is the $n \\times m$ matrix, although it is a magic zero matrix and singular, it can solve all equations $\\mathbf{A}x = \\mathbf{b}$.</p>"126 },127 {128 "category_type": "equation_isolated",129 "anno_id": 3,130 "order": 6,131 "ignore": false,132 "poly": [133 120.92871618325783,134 695.6691172098323,135 1875.6401694868102,136 695.6691172098323,137 1875.6401694868102,138 1213.9340890083931,139 120.92871618325783,140 1213.9340890083931141 ],142 "line_with_spans": [],143 "attribute": {144 "formula_type": "print",145 "equation_language": "equation_en"146 },147 "latex": "$$\n\\mathbf{A} = \\begin{bmatrix} a_{11} & a_{12} & \\cdots & a_{1n} \\\\ a_{21} & a_{22} & \\cdots & a_{2n} \\\\ \\vdots & \\vdots & \\ddots & \\vdots \\\\ a_{m1} & a_{m2} & \\cdots & a_{mn} \\end{bmatrix}, \\text{and} \\quad \\mathbf{x} = \\begin{bmatrix} x_1 \\\\ \\vdots \\\\ x_n \\end{bmatrix} \\text{and}\\quad \\mathbf{b} = \\begin{bmatrix} b_1 \\\\ \\vdots \\\\ b_m \\end{bmatrix}\n$$"148 },149 {150 "category_type": "text_block",151 "anno_id": 4,152 "order": 7,153 "ignore": false,154 "poly": [155 114.66666666666667,156 1234.6666666666667,157 700,158 1234.6666666666667,159 700,160 1302.6666666666667,161 114.66666666666667,162 1302.6666666666667163 ],164 "line_with_spans": [],165 "attribute": {166 "text_language": "text_english",167 "text_background": "single_colored",168 "text_rotate": "normal"169 },170 "text": "are column vectors."171 },172 {173 "category_type": "header",174 "anno_id": 1,175 "order": null,176 "ignore": false,177 "poly": [178 652,179 28,180 1902.6666666666667,181 28,182 1902.6666666666667,183 89.33333333333333,184 652,185 89.33333333333333186 ],187 "line_with_spans": [],188 "attribute": {189 "text_language": "text_english",190 "text_background": "white",191 "text_rotate": "normal"192 },193 "text": "7.3 Linear Systems of Equations. Gauss Elimination"194 },195 {196 "category_type": "page_number",197 "anno_id": 6,198 "order": null,199 "ignore": false,200 "poly": [201 158.18389356422884,202 1352.6173775410664,203 433.8978185904859,204 1352.6173775410664,205 433.8978185904859,206 1409.8230814476701,207 158.18389356422884,208 1409.8230814476701209 ],210 "line_with_spans": [],211 "attribute": {212 "text_language": "text_english",213 "text_background": "white",214 "text_rotate": "normal"215 },216 "text": "Section 7.3 p34"217 },218 {219 "category_type": "footer",220 "anno_id": 5,221 "order": null,222 "ignore": false,223 "poly": [224 908,225 1358.6666666666667,226 1821.3333333333333,227 1358.6666666666667,228 1821.3333333333333,229 1445.3333333333333,230 908,231 1445.3333333333333232 ],233 "line_with_spans": [],234 "attribute": {235 "text_language": "text_english",236 "text_background": "white",237 "text_rotate": "normal"238 },239 "text": "Advanced Engineering Mathematics, 10/e by Edwin Kreyszig Copyright 2011 by John Wiley & Sons. All rights reserved."240 }241 ],242 "extra": {243 "relation": [244 {245 "source_anno_id": 8,246 "target_anno_id": 10,247 "relation_type": "parent_son"248 }249 ]250 }251}