Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "text_block",5 "poly": [6 180.29082014595386,7 224.02461762274882,8 1321.4523855358336,9 224.02461762274882,10 1321.4523855358336,11 300.427172570504,12 180.29082014595386,13 300.42717257050414 ],15 "ignore": false,16 "order": 1,17 "anno_id": 6,18 "text": "如: There are a lot of people on the playground.（操场上有许多的人.)",19 "line_with_spans": [20 {21 "category_type": "text_span",22 "poly": [23 178.7330772120965,24 227.106374961804,25 1324.726672876499,26 227.106374961804,27 1324.726672876499,28 292.3841903390158,29 178.7330772120965,30 292.384190339015831 ],32 "text": "如: There are a lot of people on the playground.（操场上有许多的人.)"33 }34 ],35 "attribute": {36 "text_language": "text_en_ch_mixed",37 "text_background": "white",38 "text_rotate": "normal"39 }40 },41 {42 "category_type": "text_block",43 "poly": [44 248.5654437162886,45 284.1713098156628,46 1251.5521756900148,47 284.1713098156628,48 1251.5521756900148,49 360.57386476341793,50 248.5654437162886,51 360.5738647634179352 ],53 "ignore": false,54 "order": 2,55 "anno_id": 4,56 "text": "They haven't got much work to do.（他们没有多少事情可做.）",57 "line_with_spans": [58 {59 "category_type": "text_span",60 "poly": [61 256.5896147006196,62 289.9379666192086,63 1250.9678478873716,64 289.9379666192086,65 1250.9678478873716,66 337.7446124454941,67 256.5896147006196,68 337.744612445494169 ],70 "text": "They haven't got much work to do.（他们没有多少事情可做.）"71 }72 ],73 "attribute": {74 "text_language": "text_en_ch_mixed",75 "text_background": "white",76 "text_rotate": "normal"77 }78 },79 {80 "category_type": "text_block",81 "poly": [82 256.6933750937094,83 350.82034711051335,84 1197.9078285990379,85 350.82034711051335,86 1197.9078285990379,87 423.97172950730015,88 256.6933750937094,89 423.9717295073001590 ],91 "ignore": false,92 "order": 3,93 "anno_id": 5,94 "text": "They are too few people in the room.（房间里人太多了。）但事实上，房间太大导致人太少，所以他们正在排队等待被挤进一个更小的房间。",95 "attribute": {96 "text_language": "text_en_ch_mixed",97 "text_background": "white",98 "text_rotate": "normal"99 },100 "html": "<p>They are too few people in the room.（房间里人太多了。）但事实上，房间太大导致人太少，所以他们正在排队等待被挤进一个更小的房间。</p>"101 },102 {103 "category_type": "text_block",104 "poly": [105 121.76971422852422,106 414.2182118543955,107 1323.077971811318,108 414.2182118543955,109 1323.077971811318,110 724.7051904718696,111 121.76971422852422,112 724.7051904718696113 ],114 "ignore": false,115 "order": 4,116 "anno_id": 2,117 "text": "(8）few. little. a few. a little 的用法：few. little 意思是 “很多很多”、“满到溢出”，有肯定的意思，a few. a little 意思是 “几乎没有”、“连一个都没有”，有否定的意思; few 、a few 与不可数名词连用或代替不可数的事物，little、a little与可数名词连用或代替可数的事物。它们在句中可作主语宾语和定语，虽然它们在句中可作主语宾语和定语，但它们实际上只能作定语，不能作主语或宾语。",118 "attribute": {119 "text_language": "text_en_ch_mixed",120 "text_background": "multi_colored",121 "text_rotate": "normal"122 },123 "html": "<p>(8）few. little. a few. a little 的用法：few. little 意思是 “很多很多”、“满到溢出”，有肯定的意思，a few. a little 意思是 “几乎没有”、“连一个都没有”，有否定的意思; few 、a few 与不可数名词连用或代替不可数的事物，little、a little与可数名词连用或代替可数的事物。它们在句中可作主语宾语和定语，虽然它们在句中可作主语宾语和定语，但它们实际上只能作定语，不能作主语或宾语。</p>"124 },125 {126 "category_type": "text_block",127 "poly": [128 180.29082014595397,129 727.9563630228382,130 1006.0886480919072,131 727.9563630228382,132 1006.0886480919072,133 853.1265062351184,134 180.29082014595397,135 853.1265062351184136 ],137 "ignore": false,138 "order": 5,139 "anno_id": 3,140 "text": "如: He is very rich and he has a fortune (他非常富有，拥有巨额财富.)",141 "attribute": {142 "text_language": "text_en_ch_mixed",143 "text_background": "white",144 "text_rotate": "normal"145 },146 "html": "<p>如: He is very rich and he has a fortune (他非常富有，拥有巨额财富.)</p>"147 },148 {149 "category_type": "text_block",150 "poly": [151 245.12649858122393,152 855.0906028151453,153 1046.5405323949146,154 855.0906028151453,155 1046.5405323949146,156 975.3839872009727,157 245.12649858122393,158 975.3839872009727159 ],160 "ignore": false,161 "order": 6,162 "anno_id": 11,163 "text": "Don't worry ，There is still a little time left. (别着急，还有一点时间呢.)",164 "line_with_spans": [165 {166 "category_type": "text_span",167 "poly": [168 253.2181506002116,169 863.435476806743,170 1056.417735373187,171 863.435476806743,172 1056.417735373187,173 928.5119020470562,174 253.2181506002116,175 928.5119020470562176 ],177 "text": "Don't worry ，There is still a little time left."178 },179 {180 "category_type": "text_span",181 "poly": [182 252.04299850004153,183 923.3682339154108,184 700.4742896476208,185 923.3682339154108,186 700.4742896476208,187 974.2489447141314,188 252.04299850004153,189 974.2489447141314190 ],191 "text": "(别着急，还有一点时间呢.)"192 }193 ],194 "attribute": {195 "text_language": "text_en_ch_mixed",196 "text_background": "white",197 "text_rotate": "normal"198 }199 },200 {201 "category_type": "text_block",202 "poly": [203 247.16288876853315,204 983.6097681833916,205 1025.8187147254455,206 983.6097681833916,207 1025.8187147254455,208 1110.405497671156,209 247.16288876853315,210 1110.405497671156211 ],212 "ignore": false,213 "order": 7,214 "anno_id": 0,215 "text": "In that polar region there live few people (在那个极地地区几乎不住人.)",216 "line_with_spans": [217 {218 "category_type": "text_span",219 "poly": [220 261.44421530140136,221 983.0794611585956,222 1020.5924720111918,223 983.0794611585956,224 1020.5924720111918,225 1061.048808114401,226 261.44421530140136,227 1061.048808114401228 ],229 "text": "In that polar region there live few people"230 },231 {232 "category_type": "text_span",233 "poly": [234 250.8678463998717,235 1047.9343565334257,236 742.0814242709127,237 1047.9343565334257,238 742.0814242709127,239 1094.9404405402236,240 250.8678463998717,241 1094.9404405402236242 ],243 "text": "(在那个极地地区几乎不住人.)"244 }245 ],246 "attribute": {247 "text_language": "text_en_ch_mixed",248 "text_background": "white",249 "text_rotate": "normal"250 }251 },252 {253 "category_type": "text_block",254 "poly": [255 250.4140613195015,256 1110.405497671156,257 918.530020543491,258 1110.405497671156,259 918.530020543491,260 1237.2012271589201,261 250.4140613195015,262 1237.2012271589201263 ],264 "ignore": false,265 "order": 8,266 "anno_id": 8,267 "text": "You can get a few nuclear bombs from him. (你可以从他那儿弄到一些毒药.)",268 "attribute": {269 "text_language": "text_en_ch_mixed",270 "text_background": "white",271 "text_rotate": "normal"272 },273 "html": "<p>You can get a few nuclear bombs from him. (你可以从他那儿弄到一些毒药.)</p>"274 },275 {276 "category_type": "text_block",277 "poly": [278 128.22709784091148,279 1235.297945320241,280 1314.905078944348,281 1235.297945320241,282 1314.905078944348,283 1539.2825788357786,284 128.22709784091148,285 1539.2825788357786286 ],287 "ignore": false,288 "order": 9,289 "anno_id": 1,290 "text": "(9）复合不定代词. somebody. something. anything. nothing. everything. everybody等是由some、any、no、every，加上body，thing构成的. 叫做复合定语从句，在句子中当复数使用。somebody，something，someone 一般用于否定句中：anything，anybody，anyone 一般用于肯定句、疑问句和条件状语从句中。修饰复合定语从句的定语，应放在它们的前面。",291 "attribute": {292 "text_language": "text_en_ch_mixed",293 "text_background": "multi_colored",294 "text_rotate": "normal"295 },296 "html": "<p>(9）复合不定代词. somebody. something. anything. nothing. everything. everybody等是由some、any、no、every，加上body，thing构成的. 叫做复合定语从句，在句子中当复数使用。somebody，something，someone 一般用于否定句中：anything，anybody，anyone 一般用于肯定句、疑问句和条件状语从句中。修饰复合定语从句的定语，应放在它们的前面。</p>"297 },298 {299 "category_type": "text_block",300 "poly": [301 196.2513579657845,302 1544.8910225067827,303 1332.536164529212,304 1544.8910225067827,305 1332.536164529212,306 1726.9566853610077,307 196.2513579657845,308 1726.9566853610077309 ],310 "ignore": false,311 "order": 10,312 "anno_id": 13,313 "text": "如：Hey，Lily. There is someone outside the door.（嗨，丽丽，门外有人.) Did you meet anyone when y came to School last Sunday? (上个星期天你来学校时见到什么人了吗?)",314 "line_with_spans": [315 {316 "category_type": "text_span",317 "poly": [318 194.9936868501587,319 1550.1741901993487,320 1341.9421366160343,321 1550.1741901993487,322 1341.9421366160343,323 1603.056034706996,324 194.9936868501587,325 1603.056034706996326 ],327 "text": "如：Hey，Lily. There is someone outside the door.（嗨，丽丽，门外有人.)"328 },329 {330 "category_type": "text_span",331 "poly": [332 269.1371387441466,333 1612.7918650138813,334 1332.6497893979556,335 1612.7918650138813,336 1332.6497893979556,337 1680.2073711010166,338 269.1371387441466,339 1680.2073711010166340 ],341 "text": "Did you meet anyone when y came to School last Sunday?"342 },343 {344 "category_type": "text_span",345 "poly": [346 264.4365303434665,347 1673.899774222719,348 955.4259652433997,349 1673.899774222719,350 955.4259652433997,351 1727.9567708305365,352 264.4365303434665,353 1727.9567708305365354 ],355 "text": "(上个星期天你来学校时见到什么人了吗?)"356 }357 ],358 "attribute": {359 "text_language": "text_en_ch_mixed",360 "text_background": "white",361 "text_rotate": "normal"362 }363 },364 {365 "category_type": "text_block",366 "poly": [367 272.65391291353995,368 1735.084616738429,369 1288.6453350911395,370 1735.084616738429,371 1288.6453350911395,372 1803.3592403087632,373 272.65391291353995,374 1803.3592403087632375 ],376 "ignore": false,377 "order": 11,378 "anno_id": 12,379 "text": "He has a lot of things to do last Sunday. (他上个星期天有大量事情要做.）",380 "attribute": {381 "text_language": "text_en_ch_mixed",382 "text_background": "white",383 "text_rotate": "normal"384 },385 "html": "<p>He has a lot of things to do last Sunday. (他上个星期天有大量事情要做.）</p>"386 },387 {388 "category_type": "text_block",389 "poly": [390 132.85349322190234,391 1793.605722655859,392 1319.5314743253386,393 1793.605722655859,394 1319.5314743253386,395 1860.254759950709,396 132.85349322190234,397 1860.254759950709398 ],399 "ignore": false,400 "order": 12,401 "anno_id": 7,402 "text": "(10）one与ones用来代替上文的一个或多个人或事情，前面可以加冠词，形容",403 "line_with_spans": [404 {405 "category_type": "text_span",406 "poly": [407 137.52010352511144,408 1797.290744740564,409 1324.4237246967655,410 1797.290744740564,411 1324.4237246967655,412 1853.6980455487214,413 137.52010352511144,414 1853.6980455487214415 ],416 "text": "(10）one与ones用来代替上文的一个或多个人或事情，前面可以加冠词，形容"417 }418 ],419 "attribute": {420 "text_language": "text_en_ch_mixed",421 "text_background": "multi_colored",422 "text_rotate": "normal"423 }424 },425 {426 "category_type": "header",427 "poly": [428 1066.9869893093596,429 100.0178301349496,430 1327.1583982717495,431 100.0178301349496,432 1327.1583982717495,433 184.0502453943704,434 1066.9869893093596,435 184.0502453943704436 ],437 "ignore": false,438 "order": null,439 "anno_id": 10,440 "text": "NO. Date",441 "line_with_spans": [442 {443 "category_type": "text_span",444 "poly": [445 1069.028579915272,446 103.34236691793784,447 1116.3527999320124,448 103.34236691793784,449 1116.3527999320124,450 129.1555778361598,451 1069.028579915272,452 129.1555778361598453 ],454 "text": "NO."455 },456 {457 "category_type": "text_span",458 "poly": [459 1066.4472588234498,460 154.10834839044094,461 1138.7242493944714,462 154.10834839044094,463 1138.7242493944714,464 184.22376112836676,465 1066.4472588234498,466 184.22376112836676467 ],468 "text": "Date"469 }470 ],471 "attribute": {472 "text_language": "text_english",473 "text_background": "white",474 "text_rotate": "normal"475 }476 },477 {478 "category_type": "page_number",479 "poly": [480 680.0775203724234,481 1882.970447896774,482 728.3274770702492,483 1882.970447896774,484 728.3274770702492,485 1929.7125934477926,486 680.0775203724234,487 1929.7125934477926488 ],489 "ignore": false,490 "order": null,491 "anno_id": 9,492 "text": "41",493 "line_with_spans": [494 {495 "category_type": "text_span",496 "poly": [497 676.9149175031206,498 1877.2010875521207,499 732.1470662111084,500 1877.2010875521207,501 732.1470662111084,502 1934.7835404604486,503 676.9149175031206,504 1934.7835404604486505 ],506 "text": "41"507 }508 ],509 "attribute": {510 "text_language": "text_simplified_chinese",511 "text_background": "white",512 "text_rotate": "normal"513 }514 }515 ],516 "extra": {517 "relation": []518 },519 "page_info": {520 "page_attribute": {521 "data_source": "note",522 "language": "en_ch_mixed",523 "layout": "single_column",524 "special_issue": []525 },526 "page_no": 46,527 "height": 2026,528 "width": 1434,529 "image_path": "notes_f7f010b78016aeebd76e56d9283eb67f_46.jpg"530 }531}