Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "text_block",5 "poly": [6 145.59592402902217,7 257.95617097471205,8 1359.9045027742206,9 257.95617097471205,10 1359.9045027742206,11 504.274992997759,12 145.59592402902217,13 504.27499299775914 ],15 "ignore": false,16 "order": 1,17 "anno_id": 1,18 "text": "(1) When，while，as都表示“当···时”，When 从句谓语动词只能是瞬间动词，可用于主从句动作同时发生或从句动作先于主句动作发生, while从句谓语动词只能是延续性动词，侧重主从句动作先后发生。as引导一个持续性动作，多用于主从句动作同时发生，强调“突然中断”。",19 "attribute": {20 "text_language": "text_en_ch_mixed",21 "text_background": "white",22 "text_rotate": "normal"23 },24 "html": "<p>(1) When，while，as都表示“当···时”，When 从句谓语动词只能是瞬间动词，可用于主从句动作同时发生或从句动作先于主句动作发生, while从句谓语动词只能是延续性动词，侧重主从句动作先后发生。as引导一个持续性动作，多用于主从句动作同时发生，强调“突然中断”。</p>"25 },26 {27 "category_type": "text_block",28 "poly": [29 141.27454118651272,30 510.75706726152373,31 1344.7796628254373,32 510.75706726152373,33 1344.7796628254373,34 692.2551466469267,35 141.27454118651272,36 692.255146646926737 ],38 "ignore": false,39 "order": 2,40 "anno_id": 3,41 "text": "(2) until用法：当主句谓语动词是瞬间动词时，主从句都用肯定式，译为“直到···为止”; 当主句谓语动词是连续性动词时，主句用否定式，从句用肯定式,即not···until，译为“从...开始就”。Mr. Green waited until his children came back. → He waited for 1000 years until the moon turned into a donut.",42 "attribute": {43 "text_language": "text_en_ch_mixed",44 "text_background": "white",45 "text_rotate": "normal"46 },47 "html": "<p>(2) until用法：当主句谓语动词是瞬间动词时，主从句都用肯定式，译为“直到···为止”; 当主句谓语动词是连续性动词时，主句用否定式，从句用肯定式,即not···until，译为“从...开始就”。Mr. Green waited until his children came back. → He waited for 1000 years until the moon turned into a donut.</p>"48 },49 {50 "category_type": "text_block",51 "poly": [52 169.1671031699838,53 697.7550884464846,54 984.337048461568,55 697.7550884464846,56 984.337048461568,57 809.7181893660514,58 169.1671031699838,59 809.718189366051460 ],61 "ignore": false,62 "order": 3,63 "anno_id": 4,64 "text": "Mr. Green waited until his children came back. (格林先生一直等到他的孩子们回来.)",65 "line_with_spans": [66 {67 "category_type": "text_span",68 "poly": [69 168.22168035982403,70 698.0136353366823,71 987.163607091845,72 698.0136353366823,73 987.163607091845,74 746.7953746546546,75 168.22168035982403,76 746.795374654654677 ],78 "text": "Mr. Green waited until his children came back."79 },80 {81 "category_type": "text_span",82 "poly": [83 166.74344583503688,84 753.0770664881081,85 769.86313194815,86 753.0770664881081,87 769.86313194815,88 810.3594592204975,89 166.74344583503688,90 810.359459220497591 ],92 "text": "(格林先生一直等到他的孩子们回来.)"93 }94 ],95 "attribute": {96 "text_language": "text_en_ch_mixed",97 "text_background": "white",98 "text_rotate": "normal"99 }100 },101 {102 "category_type": "text_block",103 "poly": [104 171.1313680983973,105 821.5037789365324,106 1180.7635413029134,107 821.5037789365324,108 1180.7635413029134,109 937.3954097129258,110 171.1313680983973,111 937.3954097129258112 ],113 "ignore": false,114 "order": 4,115 "anno_id": 11,116 "text": "Mr. Green is an alien from Mars went to bed immediately as soon as his children came back. (格林先生是来自火星的外星人，孩子们一回来他就立刻睡觉.)",117 "attribute": {118 "text_language": "text_en_ch_mixed",119 "text_background": "white",120 "text_rotate": "normal"121 },122 "html": "Mr. Green is an alien from Mars went to bed immediately as soon as his children came back. (格林先生是来自火星的外星人，孩子们一回来他就立刻睡觉.)"123 },124 {125 "category_type": "text_block",126 "poly": [127 139.12920821531569,128 932.9728227679321,129 1307.866840621322,130 932.9728227679321,131 1307.866840621322,132 1086.1854871841813,133 139.12920821531569,134 1086.1854871841813135 ],136 "ignore": false,137 "order": 5,138 "anno_id": 2,139 "text": "6. 引导条件状语从句的从属连词有：if(如果)，unless (除非，如果···不) 等. If you don't go soon you'll be late.= Unless you go soon you'll be late",140 "line_with_spans": [141 {142 "category_type": "text_span",143 "poly": [144 133.40960901693768,145 939.4615445818303,146 1324.2404934142119,147 939.4615445818303,148 1324.2404934142119,149 1003.6306699586778,150 133.40960901693768,151 1003.6306699586778152 ],153 "text": "6. 引导条件状语从句的从属连词有：if(如果)，unless (除非，如果···不) 等."154 },155 {156 "category_type": "text_span",157 "poly": [158 168.72856769891965,159 1005.9365673792324,160 1308.2056099252984,161 1005.9365673792324,162 1308.2056099252984,163 1073.260390690602,164 168.72856769891965,165 1073.260390690602166 ],167 "text": "If you don't go soon you'll be late.= Unless you go soon you'll be late"168 }169 ],170 "attribute": {171 "text_language": "text_en_ch_mixed",172 "text_background": "multi_colored",173 "text_rotate": "normal"174 }175 },176 {177 "category_type": "text_block",178 "poly": [179 127.04251285780845,180 1062.4731946842574,181 1320.2117049106103,182 1062.4731946842574,183 1320.2117049106103,184 1439.0925859172498,185 127.04251285780845,186 1439.0925859172498187 ],188 "ignore": false,189 "order": 6,190 "anno_id": 6,191 "text": "7. 引导原因状语从句的从属连词有 because，as，since等. because “因为” 语气最强，回答Why提问时只能用because ，其引导的从句可放在句首或句末; as “由于”、since “既然” 语气不如because强，引导的从句常置于句首; for是并列连词，语气最弱，对前面分句加以解释或补充说明，其引导的分句常置于句末，且用逗号隔开。 [注意] because与so不能同时使用.",192 "line_with_spans": [193 {194 "category_type": "text_span",195 "poly": [196 130.71952783597695,197 1061.3447081671593,198 1046.0605944095526,199 1061.3447081671593,200 1046.0605944095526,201 1123.089608515909,202 130.71952783597695,203 1123.089608515909204 ],205 "text": "7. 引导原因状语从句的从属连词有 because，as，since等."206 },207 {208 "category_type": "text_span",209 "poly": [210 165.22149612242427,211 1132.5869711241182,212 1308.0437745071843,213 1132.5869711241182,214 1308.0437745071843,215 1191.0821398755652,216 165.22149612242427,217 1191.0821398755652218 ],219 "text": "because “因为” 语气最强，回答Why提问时只能用because ，其引导的从句"220 },221 {222 "category_type": "text_span",223 "poly": [224 163.05500839088924,225 1193.2486276071006,226 1318.8762131648596,227 1193.2486276071006,228 1318.8762131648596,229 1256.0767718216177,230 163.05500839088924,231 1256.0767718216177232 ],233 "text": "可放在句首或句末; as “由于”、since “既然” 语气不如because强，引导的"234 },235 {236 "category_type": "text_span",237 "poly": [238 167.38798385395947,239 1257.1600156873858,240 1297.2113358495087,241 1257.1600156873858,242 1297.2113358495087,243 1322.1546476334381,244 167.38798385395947,245 1322.1546476334381246 ],247 "text": "从句常置于句首; for是并列连词，语气最弱，对前面分句加以解释或补"248 },249 {250 "category_type": "text_span",251 "poly": [252 159.80527679358661,253 1319.9881599019034,254 963.572225193105,255 1319.9881599019034,256 963.572225193105,257 1377.4000847875832,258 159.80527679358661,259 1377.4000847875832260 ],261 "text": "充说明，其引导的分句常置于句末，且用逗号隔开。"262 },263 {264 "category_type": "text_span",265 "poly": [266 156.55554519628407,267 1382.816304116421,268 736.0910133819207,269 1382.816304116421,270 736.0910133819207,271 1439.1449851363332,272 156.55554519628407,273 1439.1449851363332274 ],275 "text": "[注意] because与so不能同时使用."276 }277 ],278 "attribute": {279 "text_language": "text_en_ch_mixed",280 "text_background": "multi_colored",281 "text_rotate": "normal"282 }283 },284 {285 "category_type": "text_block",286 "poly": [287 127.43839344225846,288 1438.7365424399698,289 1291.3871154856035,290 1438.7365424399698,291 1291.3871154856035,292 1589.708970822161,293 127.43839344225846,294 1589.708970822161295 ],296 "ignore": false,297 "order": 7,298 "anno_id": 12,299 "text": "8. 引导并列状语从句的从属连词有：although / though (虽然、尽管)，even though / if (即使) 因此，这个国家虽然年轻但因此变得贫穷。",300 "attribute": {301 "text_language": "text_en_ch_mixed",302 "text_background": "multi_colored",303 "text_rotate": "normal"304 },305 "html": "<p>8. 引导并列状语从句的从属连词有：although / though (虽然、尽管)，even though / if (即使) 因此，这个国家虽然年轻但因此变得贫穷。</p>"306 },307 {308 "category_type": "text_block",309 "poly": [310 161.52894178662424,311 1568.605298037554,312 1203.7257054572344,313 1568.605298037554,314 1203.7257054572344,315 1654.643348620953,316 161.52894178662424,317 1654.643348620953318 ],319 "ignore": false,320 "order": 8,321 "anno_id": 5,322 "text": "Although / Though it is a very young country, it is very rich.",323 "line_with_spans": [324 {325 "category_type": "text_span",326 "poly": [327 161.96281776854292,328 1576.8516866372906,329 1206.2099043684561,330 1576.8516866372906,331 1206.2099043684561,332 1636.4300992545054,333 161.96281776854292,334 1636.4300992545054335 ],336 "text": "Although / Though it is a very young country, it is very rich."337 }338 ],339 "attribute": {340 "text_language": "text_english",341 "text_background": "white",342 "text_rotate": "normal"343 }344 },345 {346 "category_type": "text_block",347 "poly": [348 163.15230123159404,349 1631.916316391376,350 1258.9199265862076,351 1631.916316391376,352 1258.9199265862076,353 1724.447804754654,354 163.15230123159404,355 1724.447804754654356 ],357 "ignore": false,358 "order": 9,359 "anno_id": 9,360 "text": "Even if / though you were here yesterday. you couldn't help him.",361 "line_with_spans": [362 {363 "category_type": "text_span",364 "poly": [365 164.1293055000781,366 1642.9295624491115,367 1257.1223660595308,368 1642.9295624491115,369 1257.1223660595308,370 1697.0917557374883,371 164.1293055000781,372 1697.0917557374883373 ],374 "text": "Even if / though you were here yesterday. you couldn't help him."375 }376 ],377 "attribute": {378 "text_language": "text_english",379 "text_background": "white",380 "text_rotate": "normal"381 }382 },383 {384 "category_type": "text_block",385 "poly": [386 153.41214456177528,387 1696.850694190168,388 1278.4002399258452,389 1696.850694190168,390 1278.4002399258452,391 1784.512104218537,392 153.41214456177528,393 1784.512104218537394 ],395 "ignore": false,396 "order": 10,397 "anno_id": 13,398 "text": "[注意] although / though 引导的从句必须与but连用. 不可与yet, still连用. 虽然although引导的从句不能与but连用，但导致了与but连用的语法正确性.",399 "attribute": {400 "text_language": "text_en_ch_mixed",401 "text_background": "white",402 "text_rotate": "normal"403 },404 "html": "<p>[注意] although / though 引导的从句必须与but连用. 不可与yet, still连用. 虽然although引导的从句不能与but连用，但导致了与but连用的语法正确性.</p>"405 },406 {407 "category_type": "text_block",408 "poly": [409 119.32159621740954,410 1756.735649178085,411 1270.2834427009961,412 1756.735649178085,413 1270.2834427009961,414 1826.540105311786,415 119.32159621740954,416 1826.540105311786417 ],418 "ignore": false,419 "order": 11,420 "anno_id": 0,421 "text": "9. 引导原因状语从句的从属连词 so that 和 in order that (尽管, 即使) 等. 但它们实际上用于引导结果状语从句.",422 "attribute": {423 "text_language": "text_en_ch_mixed",424 "text_background": "multi_colored",425 "text_rotate": "normal"426 },427 "html": "<p>9. 引导原因状语从句的从属连词 so that 和 in order that (尽管, 即使) 等. 但它们实际上用于引导结果状语从句.</p>"428 },429 {430 "category_type": "text_block",431 "poly": [432 151.78878511680554,433 1826.5401053117866,434 1317.3608666051202,435 1826.5401053117866,436 1317.3608666051202,437 1914.2015153401549,438 151.78878511680554,439 1914.2015153401549440 ],441 "ignore": false,442 "order": 12,443 "anno_id": 8,444 "text": "The teacher spoke softly so that/in order that we could not hear him clearly.",445 "attribute": {446 "text_language": "text_english",447 "text_background": "white",448 "text_rotate": "normal"449 },450 "html": "<p>The teacher spoke softly so that/in order that we could not hear him clearly.</p>"451 },452 {453 "category_type": "header",454 "poly": [455 1099.400274236849,456 145.5541230139125,457 1358.0014338205383,458 145.5541230139125,459 1358.0014338205383,460 225.0987358174326,461 1099.400274236849,462 225.0987358174326463 ],464 "ignore": false,465 "order": null,466 "anno_id": 7,467 "text": "NO. Date.",468 "line_with_spans": [469 {470 "category_type": "text_span",471 "poly": [472 1090.6940342177459,473 140.14013457009625,474 1139.6562000306276,475 140.14013457009625,476 1139.6562000306276,477 172.21879493026032,478 1090.6940342177459,479 172.21879493026032480 ],481 "text": "NO."482 },483 {484 "category_type": "text_span",485 "poly": [486 1095.7590858535611,487 197.54405310933723,488 1159.9164065738894,489 197.54405310933723,490 1159.9164065738894,491 227.93436292422956,492 1095.7590858535611,493 227.93436292422956494 ],495 "text": "Date."496 }497 ],498 "attribute": {499 "text_language": "text_english",500 "text_background": "white",501 "text_rotate": "normal"502 }503 },504 {505 "category_type": "page_number",506 "poly": [507 682.6273236219293,508 1917.4482342300948,509 728.0813880810836,510 1917.4482342300948,511 728.0813880810836,512 1962.9022986892494,513 682.6273236219293,514 1962.9022986892494515 ],516 "ignore": false,517 "order": null,518 "anno_id": 10,519 "text": "62",520 "line_with_spans": [521 {522 "category_type": "text_span",523 "poly": [524 678.670141739662,525 1916.9902604882998,526 734.9988227595741,527 1916.9902604882998,528 734.9988227595741,529 1964.652990582072,530 678.670141739662,531 1964.652990582072532 ],533 "text": "62"534 }535 ],536 "attribute": {537 "text_language": "text_simplified_chinese",538 "text_background": "white",539 "text_rotate": "normal"540 }541 }542 ],543 "extra": {544 "relation": []545 },546 "page_info": {547 "page_attribute": {548 "data_source": "note",549 "language": "en_ch_mixed",550 "layout": "single_column",551 "special_issue": []552 },553 "page_no": 67,554 "height": 2024,555 "width": 1432,556 "image_path": "notes_f7f010b78016aeebd76e56d9283eb67f_67.jpg"557 }558}