Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "text_block",5 "poly": [6 124.457048853996,7 231.2119654062204,8 1245.7736662615077,9 231.2119654062204,10 1245.7736662615077,11 299.8640032066799,12 124.457048853996,13 299.864003206679914 ],15 "ignore": false,16 "order": 1,17 "anno_id": 5,18 "text": "敏感，而对其他答题无关部分可不花太多时间，阅读速度就可加快些。",19 "line_with_spans": [20 {21 "category_type": "text_span",22 "poly": [23 117.81342313619767,24 234.24111694341875,25 1224.12784562773,26 234.24111694341875,27 1224.12784562773,28 302.7403840325811,29 117.81342313619767,30 302.740384032581131 ],32 "text": "敏感，而对其他答题无关部分可不花太多时间，阅读速度就可加快些。"33 }34 ],35 "attribute": {36 "text_language": "text_simplified_chinese",37 "text_background": "white",38 "text_rotate": "normal"39 }40 },41 {42 "category_type": "title",43 "poly": [44 405.6034893701652,45 348.9011730641514,46 933.5703515022733,47 348.9011730641514,48 933.5703515022733,49 427.36064483610556,50 405.6034893701652,51 427.3606448361055652 ],53 "ignore": false,54 "order": 2,55 "anno_id": 2,56 "text": "“先题后文”阅读方法说明",57 "line_with_spans": [58 {59 "category_type": "text_span",60 "poly": [61 427.55744362508676,62 364.3009541442512,63 896.4425901610149,64 364.3009541442512,65 896.4425901610149,66 417.28877866912137,67 427.55744362508676,68 417.2887786691213769 ],70 "text": "“先题后文”阅读方法说明"71 }72 ],73 "attribute": {74 "text_language": "text_simplified_chinese",75 "text_background": "multi_colored",76 "text_rotate": "normal"77 }78 },79 {80 "category_type": "title",81 "poly": [82 175.1287910400498,83 415.9186385360291,84 725.9796657723113,85 415.9186385360291,86 725.9796657723113,87 486.2052486650712,88 175.1287910400498,89 486.205248665071290 ],91 "ignore": false,92 "order": 3,93 "anno_id": 6,94 "text": "关于“先题后文”，运用时要注意：",95 "line_with_spans": [96 {97 "category_type": "text_span",98 "poly": [99 188.10036412905697,100 429.87427984120296,101 719.1312869249922,102 429.87427984120296,103 719.1312869249922,104 484.0836865432878,105 188.10036412905697,106 484.0836865432878107 ],108 "text": "关于“先题后文”，运用时要注意："109 }110 ],111 "attribute": {112 "text_language": "text_simplified_chinese",113 "text_background": "white",114 "text_rotate": "normal"115 }116 },117 {118 "category_type": "text_block",119 "poly": [120 102.72619351116123,121 477.4813092940367,122 1336.828301590857,123 477.4813092940367,124 1336.828301590857,125 1373.2269453571798,126 102.72619351116123,127 1373.2269453571798128 ],129 "ignore": false,130 "order": 4,131 "anno_id": 0,132 "text": "1. 先读题时必须先读选项，否则无法理解题干，不仅浪费时间，而且也无法记住题干所表达的众多信息。 2. 在读了题之后，要把这些问题记在心里，并带着答案去阅读，关于这一点，是天生具备此能力的，因此短文后的这些问题本身所表达的信息比短文更连贯，所以在开始试用这种方法时，往往先读了题之后(尤其是问题较多时)再读短文时，又忘记是什么答案了。 3. 带着问题读短文时，对文中出现的与问题有关的语句，可以用笔作记号，以便为下一步选择作好准备，但也要注意必须每读到一个与问题有关的信息点就停下来去对照后面的问题，因为这样会提高效率，另一方面有些问题往往要通过对短文的全面了解才能作出结论，而不能仅仅从一、二个信息点作出判断。 4. 带着问题读完短文后，接着便是背诵短文内容，虽然是带着问题去阅读短文的，但也并不是在阅读时带去的问题全部得到了答案，也可能所有问题都已完全把握，这时同样要带着这些“疑题”去倒读短文。",133 "merge_list": [134 {135 "category_type": "text_block",136 "poly": [137 124.45704885399606,138 482.93610400790664,139 1319.3294210477147,140 482.93610400790664,141 1319.3294210477147,142 605.5290286515846,143 124.45704885399606,144 605.5290286515846145 ],146 "ignore": false,147 "order": 5,148 "anno_id": 1,149 "text": "1. 先读题时只能是读其问题或题干而不能读问题后的选项，否则不仅浪费时间，而且也无法记住众多答案所表达的众多信息。",150 "line_with_spans": [151 {152 "category_type": "text_span",153 "poly": [154 199.16350835397216,155 494.040516345712,156 1330.9231625628092,157 494.040516345712,158 1330.9231625628092,159 549.2807789295782,160 199.16350835397216,161 549.2807789295782162 ],163 "text": "1. 先读题时只能是读其问题或题干而不能读问题后的选项，否则不"164 },165 {166 "category_type": "text_span",167 "poly": [168 131.6783285819889,169 554.8878095827461,170 1094.1718761496215,171 554.8878095827461,172 1094.1718761496215,173 611.309845129814,174 131.6783285819889,175 611.309845129814176 ],177 "text": "仅浪费时间，而且也无法记住众多答案所表达的众多信息。"178 }179 ],180 "attribute": {181 "text_language": "text_simplified_chinese",182 "text_background": "white",183 "text_rotate": "normal"184 }185 },186 {187 "category_type": "text_block",188 "poly": [189 124.4570488539961,190 623.5093242659912,191 1306.252842419056,192 623.5093242659912,193 1306.252842419056,194 862.1568842390182,195 124.4570488539961,196 862.1568842390182197 ],198 "ignore": false,199 "order": 6,200 "anno_id": 8,201 "text": "2. 在读了题之后，要把这些问题记在心里，并带着问题去阅读，关于这一点，是要经过反复训练才能形成能力的，因此短文后的这些问题本身所表达的信息并不像短文那样连贯，所以在开始试用这种方法时，往往先读了题之后(尤其是问题较多时)再读短文时，又忘记是什么问题了。",202 "line_with_spans": [203 {204 "category_type": "text_span",205 "poly": [206 185.8877352840739,207 619.0540460872551,208 1309.9031885354702,209 619.0540460872551,210 1309.9031885354702,211 677.4051335571146,212 185.8877352840739,213 677.4051335571146214 ],215 "text": "2. 在读了题之后，要把这些问题记在心里，并带着问题去阅读，关于这一"216 },217 {218 "category_type": "text_span",219 "poly": [220 133.890957426972,221 681.0076537467806,222 1332.0294769853012,223 681.0076537467806,224 1332.0294769853012,225 733.0044316038824,226 133.890957426972,227 733.0044316038824228 ],229 "text": "点，是要经过反复训练才能形成能力的，因此短文后的这些问题本身所表"230 },231 {232 "category_type": "text_span",233 "poly": [234 129.5136666232016,235 745.304261168334,236 1328.7585006040224,237 745.304261168334,238 1328.7585006040224,239 808.1011948649011,240 129.5136666232016,241 808.1011948649011242 ],243 "text": "达的信息并不像短文那样连贯，所以在开始试用这种方法时，往往先读了题之"244 },245 {246 "category_type": "text_span",247 "poly": [248 138.15878471680762,249 812.2984006624328,250 1047.549240004847,251 812.2984006624328,252 1047.549240004847,253 864.5433083264514,254 138.15878471680762,255 864.5433083264514256 ],257 "text": "后(尤其是问题较多时)再读短文时，又忘记是什么问题了。"258 }259 ],260 "attribute": {261 "text_language": "text_simplified_chinese",262 "text_background": "white",263 "text_rotate": "normal"264 }265 },266 {267 "category_type": "text_block",268 "poly": [269 134.2644828254905,270 873.598890539095,271 1329.136855019209,272 873.598890539095,273 1329.136855019209,274 1185.8022052983292,275 134.2644828254905,276 1185.8022052983292277 ],278 "ignore": false,279 "order": 7,280 "anno_id": 4,281 "text": "3. 带着问题读短文时，对文中出现的与问题有关的语句，可以用笔作记号，以便为下一步选择作好准备，但也要注意不要每读到一个与问题有关的信息点就停下来去对照后面的问题，因为这样会耽误时间，另一方面有些问题往往要通过对短文的全面了解才能作出结论，而不能仅仅从一、二个信息点作出判断。",282 "line_with_spans": [283 {284 "category_type": "text_span",285 "poly": [286 192.36819141889276,287 870.0748804389094,288 1325.2341600502214,289 870.0748804389094,290 1325.2341600502214,291 924.2842871409944,292 192.36819141889276,293 924.2842871409944294 ],295 "text": "3. 带着问题读短文时，对文中出现的与问题有关的语句，可以用笔作记"296 },297 {298 "category_type": "text_span",299 "poly": [300 139.26509913929925,301 930.922173675944,302 1329.6594177401876,303 930.922173675944,304 1329.6594177401876,305 992.8254756416627,306 139.26509913929925,307 992.8254756416627308 ],309 "text": "号，以便为下一步选择作好准备，但也要注意不要每读到一个与问题有关的信息"310 },311 {312 "category_type": "text_span",313 "poly": [314 142.58404240677388,315 997.3010390254357,316 1331.8720465851704,317 997.3010390254357,318 1331.8720465851704,319 1051.5104457275206,320 142.58404240677388,321 1051.5104457275206322 ],323 "text": "点就停下来去对照后面的问题，因为这样会耽误时间，另一方面有些问题往"324 },325 {326 "category_type": "text_span",327 "poly": [328 144.72472092246326,329 1062.6799774263825,330 1314.0990654960126,331 1062.6799774263825,332 1314.0990654960126,333 1120.208327395942,334 144.72472092246326,335 1120.208327395942336 ],337 "text": "往要通过对短文的全面了解才能作出结论，而不能仅仅从一、二个信息点作"338 },339 {340 "category_type": "text_span",341 "poly": [342 140.6247777343129,343 1131.6791901535216,344 285.5519670807036,345 1131.6791901535216,346 285.5519670807036,347 1185.8885968556067,348 140.6247777343129,349 1185.8885968556067350 ],351 "text": "出判断。"352 }353 ],354 "attribute": {355 "text_language": "text_simplified_chinese",356 "text_background": "white",357 "text_rotate": "normal"358 }359 },360 {361 "category_type": "text_block",362 "poly": [363 142.43734446840242,364 1189.0713499554943,365 1314.425704061968,366 1189.0713499554943,367 1314.425704061968,368 1368.8743060995555,369 142.43734446840242,370 1368.8743060995555371 ],372 "ignore": false,373 "order": 8,374 "anno_id": 7,375 "text": "4. 带着问题读完短文后，接着便是选择理解题的答案，虽然是带着问题去阅读短文的，但也并不是在阅读时带去的问题全部得到了答案，也可能有些还没有把握，这时同样要带着这些”疑题”去跳读短文。",376 "line_with_spans": [377 {378 "category_type": "text_span",379 "poly": [380 189.30261232394028,381 1181.4633391656407,382 1336.550668447659,383 1181.4633391656407,384 1336.550668447659,385 1243.416946825166,386 189.30261232394028,387 1243.416946825166388 ],389 "text": "4. 带着问题读完短文后，接着便是选择理解题的答案，虽然是带着问"390 },391 {392 "category_type": "text_span",393 "poly": [394 131.77426235438065,395 1251.161147782607,396 1317.7433232653027,397 1251.161147782607,398 1317.7433232653027,399 1306.4768689071834,400 131.77426235438065,401 1306.4768689071834402 ],403 "text": "题去阅读短文的，但也并不是在阅读时带去的问题全部得到了答案，也可"404 },405 {406 "category_type": "text_span",407 "poly": [408 129.5616335093977,409 1313.114755442133,410 1169.4971906514381,411 1313.114755442133,412 1169.4971906514381,413 1380.4909395442019,414 129.5616335093977,415 1380.4909395442019416 ],417 "text": "能有些还没有把握，这时同样要带着这些”疑题”去跳读短文。"418 }419 ],420 "attribute": {421 "text_language": "text_simplified_chinese",422 "text_background": "white",423 "text_rotate": "normal"424 }425 }426 ],427 "attribute": {428 "text_language": "text_simplified_chinese",429 "text_background": "white",430 "text_rotate": "normal"431 },432 "html": "<p>1. 先读题时必须先读选项，否则无法理解题干，不仅浪费时间，而且也无法记住题干所表达的众多信息。\n2. 在读了题之后，要把这些问题记在心里，并带着答案去阅读，关于这一点，是天生具备此能力的，因此短文后的这些问题本身所表达的信息比短文更连贯，所以在开始试用这种方法时，往往先读了题之后(尤其是问题较多时)再读短文时，又忘记是什么答案了。\n3. 带着问题读短文时，对文中出现的与问题有关的语句，可以用笔作记号，以便为下一步选择作好准备，但也要注意必须每读到一个与问题有关的信息点就停下来去对照后面的问题，因为这样会提高效率，另一方面有些问题往往要通过对短文的全面了解才能作出结论，而不能仅仅从一、二个信息点作出判断。\n4. 带着问题读完短文后，接着便是背诵短文内容，虽然是带着问题去阅读短文的，但也并不是在阅读时带去的问题全部得到了答案，也可能所有问题都已完全把握，这时同样要带着这些“疑题”去倒读短文。</p>"433 },434 {435 "category_type": "title",436 "poly": [437 501.2209946881736,438 1434.56943357603,439 919.6715108052625,440 1434.56943357603,441 919.6715108052625,442 1498.3177543907427,443 501.2209946881736,444 1498.3177543907427445 ],446 "ignore": false,447 "order": 9,448 "anno_id": 3,449 "text": "阅读简答的答题技巧",450 "line_with_spans": [451 {452 "category_type": "text_span",453 "poly": [454 516.0445546642118,455 1441.1506540238731,456 911.6833805651275,457 1441.1506540238731,458 911.6833805651275,459 1492.8706961665182,460 516.0445546642118,461 1492.8706961665182462 ],463 "text": "阅读简答的答题技巧"464 }465 ],466 "attribute": {467 "text_language": "text_simplified_chinese",468 "text_background": "multi_colored",469 "text_rotate": "normal"470 }471 },472 {473 "category_type": "text_block",474 "poly": [475 143.2496547286328,476 1495.0486097335784,477 1331.5837376080217,478 1495.0486097335784,479 1331.5837376080217,480 1869.3656729789418,481 143.2496547286328,482 1869.3656729789418483 ],484 "ignore": false,485 "order": 10,486 "anno_id": 10,487 "text": "做“阅读简答”这样的题目时，普遍觉得不难，而考试结果一出来，却发现得高分的不多，原因就在于这种题型不仅要求考生读懂文章，还要求他们用自己的语言简练地回答问题;既考查了阅读理解能力，也考查了英语表达能力和概括能力，另外，对回答的拼写、语法的正确性的要求，使做简答题有一定难度，加上解答几乎没有猜题技巧可言，做题难度更大。要想取得较好成绩，好的解题步骤和技巧非常重要。",488 "line_with_spans": [489 {490 "category_type": "text_span",491 "poly": [492 216.21340790748948,493 1502.907958644887,494 1317.0042856641082,495 1502.907958644887,496 1317.0042856641082,497 1560.9534286584183,498 216.21340790748948,499 1560.9534286584183500 ],501 "text": "做“阅读简答”这样的题目时，普遍觉得不难，而考试结果一出来，"502 },503 {504 "category_type": "text_span",505 "poly": [506 140.54699163985018,507 1566.136059909627,508 1326.3330219162833,509 1566.136059909627,510 1326.3330219162833,511 1621.6476440417132,512 140.54699163985018,513 1621.6476440417132514 ],515 "text": "却发现得高分的不多，原因就在于这种题型不仅要求考生读懂文章，还要"516 },517 {518 "category_type": "text_span",519 "poly": [520 151.94878039250818,521 1625.2180561734,522 1305.6024969114503,523 1625.2180561734,524 1305.6024969114503,525 1695.7011434759856,526 151.94878039250818,527 1695.7011434759856528 ],529 "text": "求他们用自己的语言简练地回答问题;既考查了阅读理解能力，也考查了"530 },531 {532 "category_type": "text_span",533 "poly": [534 145.72962289105834,535 1697.8897531786324,536 1326.3330219162833,537 1697.8897531786324,538 1326.3330219162833,539 1743.3820487009464,540 145.72962289105834,541 1743.3820487009464542 ],543 "text": "英语表达能力和概括能力，另外，对回答的拼写、语法的正确性的要求，使"544 },545 {546 "category_type": "text_span",547 "poly": [548 148.8392016417833,549 1755.8203637038464,550 1336.6982844186996,551 1755.8203637038464,552 1336.6982844186996,553 1810.0267481661551,554 148.8392016417833,555 1810.0267481661551556 ],557 "text": "做简答题有一定难度，加上解答几乎没有猜题技巧可言，做题难度更大。"558 },559 {560 "category_type": "text_span",561 "poly": [562 145.7296228910584,563 1813.743025937481,564 1017.4481993442752,565 1813.743025937481,566 1017.4481993442752,567 1879.7810263820897,568 145.7296228910584,569 1879.7810263820897570 ],571 "text": "要想取得较好成绩，好的解题步骤和技巧非常重要。"572 }573 ],574 "attribute": {575 "text_language": "text_simplified_chinese",576 "text_background": "white",577 "text_rotate": "normal"578 }579 },580 {581 "category_type": "header",582 "poly": [583 1066.976355683726,584 111.67769448254697,585 1336.4226982097596,586 111.67769448254697,587 1336.4226982097596,588 199.94459979279924,589 1066.976355683726,590 199.94459979279924591 ],592 "ignore": false,593 "order": null,594 "anno_id": 9,595 "text": "NO. Date",596 "line_with_spans": [597 {598 "category_type": "text_span",599 "poly": [600 1081.0492583391595,601 119.7186802230184,602 1119.5920469360442,603 119.7186802230184,604 1119.5920469360442,605 145.19611675316244,606 1081.0492583391595,607 145.19611675316244608 ],609 "text": "NO."610 },611 {612 "category_type": "text_span",613 "poly": [614 1082.3557935458336,615 176.55296171333958,616 1132.0041313994475,617 176.55296171333958,618 1132.0041313994475,619 202.03039824348363,620 1082.3557935458336,621 202.03039824348363622 ],623 "text": "Date"624 }625 ],626 "attribute": {627 "text_language": "text_english",628 "text_background": "white",629 "text_rotate": "normal"630 }631 },632 {633 "category_type": "page_number",634 "poly": [635 685.747029489416,636 1898.564252271061,637 746.1401752280096,638 1898.564252271061,639 746.1401752280096,640 1963.603024604931,641 685.747029489416,642 1963.603024604931643 ],644 "ignore": false,645 "order": null,646 "anno_id": 11,647 "text": "87",648 "line_with_spans": [649 {650 "category_type": "text_span",651 "poly": [652 696.1250617693677,653 1899.897512487434,654 742.7687430302412,655 1899.897512487434,656 742.7687430302412,657 1960.016035001449,658 696.1250617693677,659 1960.016035001449660 ],661 "text": "87"662 }663 ],664 "attribute": {665 "text_language": "text_simplified_chinese",666 "text_background": "white",667 "text_rotate": "normal"668 }669 }670 ],671 "extra": {672 "relation": []673 },674 "page_info": {675 "page_attribute": {676 "data_source": "note",677 "language": "simplified_chinese",678 "layout": "single_column",679 "special_issue": []680 },681 "page_no": 92,682 "height": 2026,683 "width": 1434,684 "image_path": "notes_f7f010b78016aeebd76e56d9283eb67f_92.jpg"685 }686}