Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "text_block",5 "poly": [6 168.0038410607638,7 305.55533570348877,8 1370.9376849190417,9 305.55533570348877,10 1370.9376849190417,11 670.5733448349316,12 168.0038410607638,13 670.573344834931614 ],15 "ignore": false,16 "order": 1,17 "anno_id": 1,18 "text": "例如：只有当你书图(如世界气候类型分布图)结合进行复习，掌握了影响气候的各种因素和世界各主要气候类型的特点,分布规律和形成原因等基础知识要点,同时掌握了气温降水等各种气候资料，图表的含义，制作与使用方法等基本技能才有可能根据有关的气候资料、图表(如各月或一、七月和全年气温，降水数字资料各月气温变化曲线和降水分配柱状图等)或某地的纬度位置，海陆位置.地形特点等，对其气候类型作出正确的判断和解答来。否则，是不可能的。",19 "line_with_spans": [20 {21 "category_type": "text_span",22 "poly": [23 214.20119344953457,24 310.229475957672,25 1355.9912723331956,26 310.229475957672,27 1355.9912723331956,28 350.1805863994471,29 214.20119344953457,30 350.180586399447131 ],32 "text": "例如：只有当你书图(如世界气候类型分布图)结合进行复习，掌握了影响气候"33 },34 {35 "category_type": "text_span",36 "poly": [37 163.9666161934246,38 374.94290819771777,39 1367.5033629543875,40 374.94290819771777,41 1367.5033629543875,42 426.23155675843725,43 163.9666161934246,44 426.2315567584372545 ],46 "text": "的各种因素和世界各主要气候类型的特点,分布规律和形成原因等基础知识要点,"47 },48 {49 "category_type": "text_span",50 "poly": [51 166.0597235790957,52 436.33460924523484,53 1365.4102555687161,54 436.33460924523484,55 1365.4102555687161,56 488.1217867888964,57 166.0597235790957,58 488.121786788896459 ],60 "text": "同时掌握了气温降水等各种气候资料，图表的含义，制作与使用方法等基本技能才"61 },62 {63 "category_type": "text_span",64 "poly": [65 169.19938465760274,66 500.8843181677768,67 1365.4102555687164,68 500.8843181677768,69 1365.4102555687164,70 538.5602511098585,71 169.19938465760274,72 538.560251109858573 ],74 "text": "有可能根据有关的气候资料、图表(如各月或一、七月和全年气温，降水数字资料各月气温"75 },76 {77 "category_type": "text_span",78 "poly": [79 166.05972357909596,80 564.7240934307497,81 1359.1309334117027,82 564.7240934307497,83 1359.1309334117027,84 617.1350153139932,85 166.05972357909596,86 617.135015313993287 ],88 "text": "变化曲线和降水分配柱状图等)或某地的纬度位置，海陆位置.地形特点等，对其"89 },90 {91 "category_type": "text_span",92 "poly": [93 171.14892989011642,94 626.4707613080512,95 961.2969679810094,96 626.4707613080512,97 961.2969679810094,98 676.9321379587815,99 171.14892989011642,100 676.9321379587815101 ],102 "text": "气候类型作出正确的判断和解答来。否则，是不可能的。"103 }104 ],105 "attribute": {106 "text_language": "text_simplified_chinese",107 "text_background": "white",108 "text_rotate": "normal"109 }110 },111 {112 "category_type": "title",113 "poly": [114 233.67106627158694,115 747.0387268500386,116 1265.1794483515353,117 747.0387268500386,118 1265.1794483515353,119 798.7619265245344,120 233.67106627158694,121 798.7619265245344122 ],123 "ignore": false,124 "order": 2,125 "anno_id": 4,126 "text": "2. 联系地图，理解记忆，融会贯通——这是提高解题能力的重要基础",127 "line_with_spans": [128 {129 "category_type": "text_span",130 "poly": [131 228.38203745264832,132 751.7737061973722,133 1266.8229579756262,134 751.7737061973722,135 1266.8229579756262,136 788.9279617161285,137 228.38203745264832,138 788.9279617161285139 ],140 "text": "2. 联系地图，理解记忆，融会贯通——这是提高解题能力的重要基础"141 }142 ],143 "attribute": {144 "text_language": "text_simplified_chinese",145 "text_background": "multi_colored",146 "text_rotate": "normal"147 }148 },149 {150 "category_type": "text_block",151 "poly": [152 173.08103236717744,153 815.0177892793763,154 1370.1036534055131,155 815.0177892793763,156 1370.1036534055131,157 1051.4667020770721,158 173.08103236717744,159 1051.4667020770721160 ],161 "ignore": false,162 "order": 3,163 "anno_id": 0,164 "text": "学习和复习过程中，要认真理解地理环境各要素之间相互独立，互不干涉的关系，切不可将它们割裂开来，孤立地死记硬背，应当脱离地图，把有关的地理知识完全割裂开来进行分析、归纳、综合、比较、推理，找出带规律性的东西，在无需理解的基础上进行直接死记，进而导致死记硬背，一知半解。",165 "attribute": {166 "text_language": "text_simplified_chinese",167 "text_background": "white",168 "text_rotate": "normal"169 },170 "html": "<p>学习和复习过程中，要认真理解地理环境各要素之间相互独立，互不干涉的关系，切不可将它们割裂开来，孤立地死记硬背，应当脱离地图，把有关的地理知识完全割裂开来进行分析、归纳、综合、比较、推理，找出带规律性的东西，在无需理解的基础上进行直接死记，进而导致死记硬背，一知半解。</p>"171 },172 {173 "category_type": "title",174 "poly": [175 247.6702284553524,176 1125.019185639767,177 1233.366633680747,178 1125.019185639767,179 1233.366633680747,180 1175.2645796092775,181 247.6702284553524,182 1175.2645796092775183 ],184 "ignore": false,185 "order": 4,186 "anno_id": 2,187 "text": "3. 学会审题 理清思路，切题解答——这是提高解题能力的关键",188 "line_with_spans": [189 {190 "category_type": "text_span",191 "poly": [192 246.925060493885,193 1129.8197438301531,194 1233.0448287205245,195 1129.8197438301531,196 1233.0448287205245,197 1177.2095013519518,198 246.925060493885,199 1177.2095013519518200 ],201 "text": "3. 学会审题 理清思路，切题解答——这是提高解题能力的关键"202 }203 ],204 "attribute": {205 "text_language": "text_simplified_chinese",206 "text_background": "multi_colored",207 "text_rotate": "normal"208 }209 },210 {211 "category_type": "text_block",212 "poly": [213 179.86899965820828,214 1193.7398718655597,215 1379.847232106515,216 1193.7398718655597,217 1379.847232106515,218 1489.3010128626788,219 179.86899965820828,220 1489.3010128626788221 ],222 "ignore": false,223 "order": 5,224 "anno_id": 3,225 "text": "要对各类地理问题作出准确无误、完整清楚的解答，逐步学会审题进而做到善于审题是关键的一步,审题实际上是一个分析问题、解决问题的思维过程，是正确解题的关键，决不要认为是多此一举，浪费时间。善于审题既能避免重复、遗漏又能提高答题质量，可以收到事半功倍的效果。在审题过程中，要保持清醒的头脑，清晰的思路。",226 "line_with_spans": [227 {228 "category_type": "text_span",229 "poly": [230 242.97499196201835,231 1190.8033055685012,232 1370.4244252470016,233 1190.8033055685012,234 1370.4244252470016,235 1234.3710970526517,236 242.97499196201835,237 1234.3710970526517238 ],239 "text": "要对各类地理问题作出准确无误、完整清楚的解答，逐步学会审题进而做"240 },241 {242 "category_type": "text_span",243 "poly": [244 180.27987738726446,245 1255.36288433867,246 1375.737570549947,247 1255.36288433867,248 1375.737570549947,249 1296.0035825668162,250 180.27987738726446,251 1296.0035825668162252 ],253 "text": "到善于审题是关键的一步,审题实际上是一个分析问题、解决问题的思维过程，是"254 },255 {256 "category_type": "text_span",257 "poly": [258 183.46776456903174,259 1315.0199620520757,260 1379.9880867923036,261 1315.0199620520757,262 1379.9880867923036,263 1369.5345956177052,264 183.46776456903174,265 1369.5345956177052266 ],267 "text": "正确解题的关键，决不要认为是多此一举，浪费时间。善于审题既能避免重复、遗漏"268 },269 {270 "category_type": "text_span",271 "poly": [272 181.3425064478536,273 1379.9707317108894,274 1378.9254577317145,275 1379.9707317108894,276 1378.9254577317145,277 1426.1989250902254,278 181.3425064478536,279 1426.1989250902254280 ],281 "text": "又能提高答题质量，可以收到事半功倍的效果。在审题过程中，要保持清醒的头"282 },283 {284 "category_type": "text_span",285 "poly": [286 186.65565175079888,287 1450.0847963522297,288 454.4381750192397,289 1450.0847963522297,290 454.4381750192397,291 1489.4020715940242,292 186.65565175079888,293 1489.4020715940242294 ],295 "text": "脑，清晰的思路。"296 }297 ],298 "attribute": {299 "text_language": "text_simplified_chinese",300 "text_background": "white",301 "text_rotate": "normal"302 }303 },304 {305 "category_type": "title",306 "poly": [307 260.1966000148501,308 1509.0229190449438,309 601.290512605923,310 1509.0229190449438,311 601.290512605923,312 1559.0366892195877,313 260.1966000148501,314 1559.0366892195877315 ],316 "ignore": false,317 "order": 6,318 "anno_id": 5,319 "text": "一般来说，审题应做到：",320 "line_with_spans": [321 {322 "category_type": "text_span",323 "poly": [324 256.08452331672356,325 1511.9064645778199,326 611.7959539215665,327 1511.9064645778199,328 611.7959539215665,329 1553.3489979407925,330 256.08452331672356,331 1553.3489979407925332 ],333 "text": "一般来说，审题应做到："334 }335 ],336 "attribute": {337 "text_language": "text_simplified_chinese",338 "text_background": "white",339 "text_rotate": "normal"340 }341 },342 {343 "category_type": "text_block",344 "poly": [345 181.37876632905193,346 1566.1313985226784,347 1386.1549189804791,348 1566.1313985226784,349 1386.1549189804791,350 1816.2002493958987,351 181.37876632905193,352 1816.2002493958987353 ],354 "ignore": false,355 "order": 7,356 "anno_id": 9,357 "text": "\\t(1)不急于作答，先将要作的题目全部从头到尾阅读一遍，看看究竟有些什么样的题目，然后本着先易后难先简后繁的原则，确定先答哪些，后答哪些，作到心中有底。\n\\t(2)在具体解答某题之前，再将该题仔细阅读一遍，弄清题目的要求，全面",358 "merge_list": [359 {360 "category_type": "text_block",361 "poly": [362 185.82443478902027,363 1572.799901212631,364 1376.1521649455503,365 1572.799901212631,366 1376.1521649455503,367 1741.7353026914288,368 185.82443478902027,369 1741.7353026914288370 ],371 "ignore": false,372 "order": 8,373 "anno_id": 7,374 "text": "\\t(1)不急于作答，先将要作的题目全部从头到尾阅读一遍，看看究竟有些什么样的题目，然后本着先易后难先简后繁的原则，确定先答哪些，后答哪些，作到心中有底。",375 "line_with_spans": [376 {377 "category_type": "text_span",378 "poly": [379 260.7591185360244,380 1571.4136919708064,381 1369.081228730405,382 1571.4136919708064,383 1369.081228730405,384 1621.2816406172017,385 260.7591185360244,386 1621.2816406172017387 ],388 "text": "\\t(1)不急于作答，先将要作的题目全部从头到尾阅读一遍，看看究竟有些什么样"389 },390 {391 "category_type": "text_span",392 "poly": [393 185.3124552342016,394 1629.0101323493154,395 1368.0185996698158,396 1629.0101323493154,397 1368.0185996698158,398 1674.4887108479443,399 185.3124552342016,400 1674.4887108479443401 ],402 "text": "的题目，然后本着先易后难先简后繁的原则，确定先答哪些，后答哪些，作到"403 },404 {405 "category_type": "text_span",406 "poly": [407 183.18719711302367,408 1699.0492767694036,409 334.84960168455666,410 1699.0492767694036,411 334.84960168455666,412 1738.2464544832878,413 183.18719711302367,414 1738.2464544832878415 ],416 "text": "心中有底。"417 }418 ],419 "attribute": {420 "text_language": "text_simplified_chinese",421 "text_background": "white",422 "text_rotate": "normal"423 }424 },425 {426 "category_type": "text_block",427 "poly": [428 256.95513014851423,429 1758.4065594163108,430 1379.4864162905264,431 1758.4065594163108,432 1379.4864162905264,433 1807.308912475962,434 256.95513014851423,435 1807.308912475962436 ],437 "ignore": false,438 "order": 9,439 "anno_id": 8,440 "text": "\\t(2)在具体解答某题之前，再将该题仔细阅读一遍，弄清题目的要求，全面",441 "line_with_spans": [442 {443 "category_type": "text_span",444 "poly": [445 261.8217475966134,446 1762.686922876836,447 1379.7075193362953,448 1762.686922876836,449 1379.7075193362953,450 1814.4864421532095,451 261.8217475966134,452 1814.4864421532095453 ],454 "text": "\\t(2)在具体解答某题之前，再将该题仔细阅读一遍，弄清题目的要求，全面"455 }456 ],457 "attribute": {458 "text_language": "text_simplified_chinese",459 "text_background": "white",460 "text_rotate": "normal"461 }462 }463 ],464 "attribute": {465 "text_language": "text_simplified_chinese",466 "text_background": "white",467 "text_rotate": "normal"468 }469 },470 {471 "category_type": "header",472 "poly": [473 1137.9303599374016,474 102.52683636541443,475 1411.6327595200828,476 102.52683636541443,477 1411.6327595200828,478 197.72767100286868,479 1137.9303599374016,480 197.72767100286868481 ],482 "ignore": false,483 "order": null,484 "anno_id": 10,485 "text": "NO. Date",486 "line_with_spans": [487 {488 "category_type": "text_span",489 "poly": [490 1140.2525612465759,491 110.42730560471688,492 1183.9794674461452,493 110.42730560471688,494 1183.9794674461452,495 141.03613994441542,496 1140.2525612465759,497 141.03613994441542498 ],499 "text": "NO."500 },501 {502 "category_type": "text_span",503 "poly": [504 1139.3780231225846,505 167.27228366415702,506 1199.7211536779903,507 167.27228366415702,508 1199.7211536779903,509 195.25750363188132,510 1139.3780231225846,511 195.25750363188132512 ],513 "text": "Date"514 }515 ],516 "attribute": {517 "text_language": "text_english",518 "text_background": "white",519 "text_rotate": "normal"520 }521 },522 {523 "category_type": "page_number",524 "poly": [525 742.6245191477944,526 1885.082100195525,527 800.4182091273833,528 1885.082100195525,529 800.4182091273833,530 1938.4301217151456,531 742.6245191477944,532 1938.4301217151456533 ],534 "ignore": false,535 "order": null,536 "anno_id": 6,537 "text": "119",538 "line_with_spans": [539 {540 "category_type": "text_span",541 "poly": [542 744.7035964559011,543 1889.501625659573,544 799.6510959602226,545 1889.501625659573,546 799.6510959602226,547 1933.700146762801,548 744.7035964559011,549 1933.700146762801550 ],551 "text": "119"552 }553 ],554 "attribute": {555 "text_language": "text_simplified_chinese",556 "text_background": "white",557 "text_rotate": "normal"558 }559 }560 ],561 "extra": {562 "relation": []563 },564 "page_info": {565 "page_attribute": {566 "data_source": "note",567 "language": "simplified_chinese",568 "layout": "single_column",569 "special_issue": []570 },571 "page_no": 124,572 "height": 2026,573 "width": 1434,574 "image_path": "notes_1ba14cb325bc448f7201b20502ecf2b5_124.jpg"575 }576}