Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0150
1{2 "layout_dets": [3 {4 "category_type": "figure",5 "poly": [6 139.53944396972656,7 184.1566925048828,8 1020.1412353515625,9 184.1566925048828,10 1020.1412353515625,11 590.2708740234375,12 139.53944396972656,13 590.270874023437514 ],15 "ignore": false,16 "order": 1,17 "anno_id": 118 },19 {20 "category_type": "figure_caption",21 "poly": [22 513.69970703125,23 603.0481567382812,24 642.41748046875,25 603.0481567382812,26 642.41748046875,27 637.3766479492188,28 513.69970703125,29 637.376647949218830 ],31 "ignore": false,32 "order": 2,33 "anno_id": 10,34 "text": "图 3-3",35 "line_with_spans": [36 {37 "category_type": "text_span",38 "poly": [39 518.6666666666664,40 606.6666666666666,41 639.209877048064,42 606.6666666666666,43 639.209877048064,44 636,45 518.6666666666664,46 63647 ],48 "text": "图 3-3"49 }50 ],51 "attribute": {52 "text_language": "text_simplified_chinese",53 "text_background": "white",54 "text_rotate": "normal"55 }56 },57 {58 "category_type": "text_block",59 "poly": [60 130.10044860839844,61 647.5458984375,62 1034.16455078125,63 647.5458984375,64 1034.16455078125,65 790.8318481445312,66 130.10044860839844,67 790.831848144531268 ],69 "ignore": false,70 "order": 3,71 "anno_id": 6,72 "text": "时间图虽然直观性差些，但是度量性差，不能客观地呈现空间图形在多个方向上的度量大小。为此该方法在工程技术和机械制造方面被完全弃用。虽然度量性差，但因其色彩绚丽而被广泛用于艺术创作。",73 "attribute": {74 "text_language": "text_simplified_chinese",75 "text_background": "white",76 "text_rotate": "normal"77 },78 "html": "<p>时间图虽然直观性差些，但是度量性差，不能客观地呈现空间图形在多个方向上的度量大小。为此该方法在工程技术和机械制造方面被完全弃用。虽然度量性差，但因其色彩绚丽而被广泛用于艺术创作。</p>"79 },80 {81 "category_type": "figure",82 "poly": [83 146.63287432485313,84 801.7142482261773,85 1006.1873530241373,86 801.7142482261773,87 1006.1873530241373,88 1205.7375758816308,89 146.63287432485313,90 1205.737575881630891 ],92 "ignore": false,93 "order": 4,94 "anno_id": 595 },96 {97 "category_type": "figure_caption",98 "poly": [99 516.3198852539062,100 1221.888427734375,101 641.8014526367188,102 1221.888427734375,103 641.8014526367188,104 1256.5360107421875,105 516.3198852539062,106 1256.5360107421875107 ],108 "ignore": false,109 "order": 5,110 "anno_id": 2,111 "text": "图 3-4",112 "line_with_spans": [113 {114 "category_type": "text_span",115 "poly": [116 520,117 1225.3333333333333,118 638.4313287621238,119 1225.3333333333333,120 638.4313287621238,121 1254.6666666666665,122 520,123 1254.6666666666665124 ],125 "text": "图 3-4"126 }127 ],128 "attribute": {129 "text_language": "text_simplified_chinese",130 "text_background": "white",131 "text_rotate": "normal"132 }133 },134 {135 "category_type": "text_block",136 "poly": [137 1134.9105467235634,138 926.2480885083647,139 1426.282899582692,140 926.2480885083647,141 1426.282899582692,142 1040.4345511153206,143 1134.9105467235634,144 1040.4345511153206145 ],146 "ignore": false,147 "order": 6,148 "anno_id": 4,149 "text": "图 3一3 中的空间图形也可用两个投影面唯一地表示",150 "line_with_spans": [151 {152 "category_type": "text_span",153 "poly": [154 1193.2320925088532,155 927.3856740070826,156 1422.3560631471894,157 927.3856740070826,158 1422.3560631471894,159 953.4345741578131,160 1193.2320925088532,161 953.4345741578131162 ],163 "text": "图 3一3 中的空间图"164 },165 {166 "category_type": "text_span",167 "poly": [168 1141.8464185017706,169 969.5392555053119,170 1422.450422925633,171 969.5392555053119,172 1422.450422925633,173 996.9214889893759,174 1141.8464185017706,175 996.9214889893759176 ],177 "text": "形也可用两个投影面唯一"178 },179 {180 "category_type": "text_span",181 "poly": [182 1140,183 1012,184 1224,185 1012,186 1224,187 1038.6666666666665,188 1140,189 1038.6666666666665190 ],191 "text": "地表示"192 }193 ],194 "attribute": {195 "text_language": "text_simplified_chinese",196 "text_background": "multi_colored",197 "text_rotate": "normal"198 }199 },200 {201 "category_type": "text_block",202 "poly": [203 200.13418579101562,204 1270.2470703125,205 377.27862548828125,206 1270.2470703125,207 377.27862548828125,208 1307.025390625,209 200.13418579101562,210 1307.025390625211 ],212 "ignore": false,213 "order": 7,214 "anno_id": 0,215 "text": "(2) 轴测法",216 "line_with_spans": [217 {218 "category_type": "text_span",219 "poly": [220 200.9603118077587,221 1272.9603118077584,222 377.2261989550288,223 1272.9603118077584,224 377.2261989550288,225 1304.3730215255744,226 200.9603118077587,227 1304.3730215255744228 ],229 "text": "(2) 轴测法"230 }231 ],232 "attribute": {233 "text_language": "text_simplified_chinese",234 "text_background": "white",235 "text_rotate": "normal"236 }237 },238 {239 "category_type": "text_block",240 "poly": [241 132.26803588867188,242 1317.6324462890625,243 1031.7591552734375,244 1317.6324462890625,245 1031.7591552734375,246 1557.786635851985,247 132.26803588867188,248 1557.786635851985249 ],250 "ignore": false,251 "order": 8,252 "anno_id": 11,253 "text": "设计合适的投影角度,将现实空间的非欧几里得坐标系连同各轴上的任意长透视投影到三维曲面 P上，使之成为投影曲面 P上的一组“坐标系”，根据该“坐标系”各轴的方向、单位和投影的性质，将空间图形在空间直角坐标系中的位置对应地画到曲面 P上，得到一幅相应的曲面图（图3—5）.这种方法称为轴测法.虽然投影方向随意但导致坐标系自洽，且坐标系是投影后的产物，无需原始坐标.因投影方向随意导致坐标系自洽，且坐标系是投影后的产物，无需原始坐标.",254 "attribute": {255 "text_language": "text_simplified_chinese",256 "text_background": "white",257 "text_rotate": "normal"258 },259 "html": "<p>设计合适的投影角度,将现实空间的非欧几里得坐标系连同各轴上的任意长透视投影到三维曲面 P上，使之成为投影曲面 P上的一组“坐标系”，根据该“坐标系”各轴的方向、单位和投影的性质，将空间图形在空间直角坐标系中的位置对应地画到曲面 P上，得到一幅相应的曲面图（图3—5）.这种方法称为轴测法.虽然投影方向随意但导致坐标系自洽，且坐标系是投影后的产物，无需原始坐标.因投影方向随意导致坐标系自洽，且坐标系是投影后的产物，无需原始坐标.</p>"260 },261 {262 "category_type": "figure",263 "poly": [264 338.379119873047,265 1577.7196044921877,266 825.3840901710412,267 1577.7196044921877,268 825.3840901710412,269 1905.91259765625,270 338.379119873047,271 1905.91259765625272 ],273 "ignore": false,274 "order": 9,275 "anno_id": 13276 },277 {278 "category_type": "figure_caption",279 "poly": [280 520.2106323242188,281 1928.2996826171875,282 643.7523193359375,283 1928.2996826171875,284 643.7523193359375,285 1960.1639404296875,286 520.2106323242188,287 1960.1639404296875288 ],289 "ignore": false,290 "order": 10,291 "anno_id": 9,292 "text": "图 3-5",293 "line_with_spans": [294 {295 "category_type": "text_span",296 "poly": [297 519.7119017150435,298 1930.2847606860173,299 642.2556015348271,300 1930.2847606860173,301 642.2556015348271,302 1958.2847606860173,303 519.7119017150435,304 1958.2847606860173305 ],306 "text": "图 3-5"307 }308 ],309 "attribute": {310 "text_language": "text_simplified_chinese",311 "text_background": "white",312 "text_rotate": "normal"313 }314 },315 {316 "category_type": "text_block",317 "poly": [318 131.44747924804707,319 1973.6070556640627,320 1027.6563083491312,321 1973.6070556640627,322 1027.6563083491312,323 2111.6171875,324 131.44747924804707,325 2111.6171875326 ],327 "ignore": false,328 "order": 11,329 "anno_id": 8,330 "text": "轴测法画出的平面图比较直观.常用来呈现产品、建筑物等实物的外观效果：但是这类方法需要对投影角度以及在各方向上的伸缩比例进行合理的设计：使平面图有较好的视觉效",331 "line_with_spans": [332 {333 "category_type": "text_span",334 "poly": [335 201.58906297512905,336 1977.4428330150809,337 1024.1524481059719,338 1977.4428330150809,339 1024.1524481059719,340 2009.9195313624755,341 201.58906297512905,342 2009.9195313624755343 ],344 "text": "轴测法画出的平面图比较直观.常用来呈现产品、建筑物"345 },346 {347 "category_type": "text_span",348 "poly": [349 137.4271410290264,350 2026.8974632275326,351 1029.6119577781594,352 2026.8974632275326,353 1029.6119577781594,354 2057.353265684649,355 137.4271410290264,356 2057.353265684649357 ],358 "text": "等实物的外观效果：但是这类方法需要对投影角度以及在各方"359 },360 {361 "category_type": "text_span",362 "poly": [363 133.04523504837687,364 2073.939817728926,365 1028.8756350002864,366 2073.939817728926,367 1028.8756350002864,368 2105.8889584574567,369 133.04523504837687,370 2105.8889584574567371 ],372 "text": "向上的伸缩比例进行合理的设计：使平面图有较好的视觉效"373 }374 ],375 "attribute": {376 "text_language": "text_simplified_chinese",377 "text_background": "white",378 "text_rotate": "normal"379 }380 },381 {382 "category_type": "text_block",383 "poly": [384 1142.872254694079,385 1997.5559542432595,386 1422.8088660255385,387 1997.5559542432595,388 1422.8088660255385,389 2073.1168642095963,390 1142.872254694079,391 2073.1168642095963392 ],393 "ignore": false,394 "order": 12,395 "anno_id": 3,396 "text": "用轴测法画的平面图叫做轴测图.",397 "line_with_spans": [398 {399 "category_type": "text_span",400 "poly": [401 1192.7669329780706,402 1998.4598633101891,403 1421.6498126850372,404 1998.4598633101891,405 1421.6498126850372,406 2022.9566051885397,407 1192.7669329780706,408 2022.9566051885397409 ],410 "text": "用轴测法画的平面图"411 },412 {413 "category_type": "text_span",414 "poly": [415 1142.7564210150697,416 2040.7468371065793,417 1275.9102456515977,418 2040.7468371065793,419 1275.9102456515977,420 2063.649020033811,421 1142.7564210150697,422 2063.649020033811423 ],424 "text": "叫做轴测图."425 }426 ],427 "attribute": {428 "text_language": "text_simplified_chinese",429 "text_background": "multi_colored",430 "text_rotate": "normal"431 }432 },433 {434 "category_type": "header",435 "poly": [436 932.3723929738372,437 60.945854412497965,438 1433.7791852998748,439 60.945854412497965,440 1433.7791852998748,441 94.63146927250705,442 932.3723929738372,443 94.63146927250705444 ],445 "ignore": false,446 "order": null,447 "anno_id": 7,448 "text": "Planar Figures of Solid Objects 投影与制图",449 "line_with_spans": [450 {451 "category_type": "text_span",452 "poly": [453 928.5141715996451,454 59.36320588688932,455 1434.3926940323604,456 59.36320588688932,457 1434.3926940323604,458 95.22294924920834,459 928.5141715996451,460 95.22294924920834461 ],462 "text": "Planar Figures of Solid Objects 投影与制图"463 }464 ],465 "attribute": {466 "text_language": "text_en_ch_mixed",467 "text_background": "multi_colored",468 "text_rotate": "normal"469 }470 },471 {472 "category_type": "header",473 "poly": [474 1458.9936109553462,475 74.49029779474245,476 1525.256184118291,477 74.49029779474245,478 1525.256184118291,479 117.83964472377193,480 1458.9936109553462,481 117.83964472377193482 ],483 "ignore": false,484 "order": null,485 "anno_id": 14,486 "text": "3 .1",487 "line_with_spans": [488 {489 "category_type": "text_span",490 "poly": [491 1458.7260913139341,492 70.88955196763459,493 1533.006988278738,494 70.88955196763459,495 1533.006988278738,496 116.99493629061635,497 1458.7260913139341,498 116.99493629061635499 ],500 "text": "3 .1"501 }502 ],503 "attribute": {504 "text_language": "text_simplified_chinese",505 "text_background": "multi_colored",506 "text_rotate": "normal"507 }508 },509 {510 "category_type": "page_number",511 "poly": [512 1379.9658034598276,513 2143.269617923227,514 1417.0569907562851,515 2143.269617923227,516 1417.0569907562851,517 2170.4330960098105,518 1379.9658034598276,519 2170.4330960098105520 ],521 "ignore": false,522 "order": null,523 "anno_id": 12,524 "text": "37",525 "line_with_spans": [526 {527 "category_type": "text_span",528 "poly": [529 1376.6505275206887,530 2137.069002847107,531 1415.4356940555688,532 2137.069002847107,533 1415.4356940555688,534 2171.006023565127,535 1376.6505275206887,536 2171.006023565127537 ],538 "text": "37"539 }540 ],541 "attribute": {542 "text_language": "text_simplified_chinese",543 "text_background": "white",544 "text_rotate": "normal"545 }546 }547 ],548 "extra": {549 "relation": [550 {551 "source_anno_id": 1,552 "target_anno_id": 10,553 "relation_type": "parent_son"554 },555 {556 "source_anno_id": 5,557 "target_anno_id": 2,558 "relation_type": "parent_son"559 },560 {561 "source_anno_id": 13,562 "target_anno_id": 9,563 "relation_type": "parent_son"564 }565 ]566 },567 "page_info": {568 "page_attribute": {569 "data_source": "colorful_textbook",570 "language": "simplified_chinese",571 "layout": "double_column",572 "special_issue": [573 "fuzzy_scan",574 "colorful_backgroud"575 ]576 },577 "page_no": 2050,578 "height": 2339,579 "width": 1653,580 "image_path": "jiaocaineedrop_jiaocai_needrop_en_1523.jpg"581 }582}