Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "table",5 "poly": [6 124.81431734555133,7 334.4131359474848,8 1277.8290267283883,9 334.4131359474848,10 1277.8290267283883,11 1009.4621246171127,12 124.81431734555133,13 1009.462124617112714 ],15 "ignore": false,16 "order": 1,17 "anno_id": 5,18 "html": "<table border=\"1\"><tr><td rowspan=\"9\">人文差异</td><td rowspan=\"2\">业</td><td rowspan=\"2\">主要水果</td><td rowspan=\"2\">苹果（产地：山东丘陵.\n（辽东丘陵）</td><td rowspan=\"2\">柑橘</td></tr><tr></tr><tr><td rowspan=\"7\">生活</td><td>主食</td><td>面食.米（黄土高原）</td><td>大米</td></tr><tr><td>住宅</td><td>土坯垒墙，屋顶坡度较小。</td><td>砖瓦竹木，屋顶坡度较大。</td></tr><tr><td>特点</td><td>墙体较厚，注意防寒保暖。</td><td>墙体高，注意通风散热。</td></tr><tr><td rowspan=\"2\">传统交\n通工具</td><td rowspan=\"2\">马拉大车</td><td rowspan=\"2\">船舶</td></tr><tr></tr><tr><td rowspan=\"2\">体育活动</td><td rowspan=\"2\">溜冰、滑雪</td><td rowspan=\"2\">龙舟竞赛、游泳</td></tr><tr></tr></table>",19 "attribute": {20 "table_layout": "horizontal",21 "with_span": true,22 "line": "full_line",23 "language": "table_simplified_chinese",24 "include_equation": false,25 "include_photo": false,26 "include_background": true,27 "with_structured_text": false28 },29 "table_edit_status": "good"30 },31 {32 "category_type": "title",33 "poly": [34 120.83615563851187,35 1034.1738551741091,36 436.68655851268574,37 1034.1738551741091,38 436.68655851268574,39 1082.2560687350067,40 120.83615563851187,41 1082.256068735006742 ],43 "ignore": false,44 "order": 2,45 "anno_id": 6,46 "text": "青藏地区和西北地区",47 "line_with_spans": [48 {49 "category_type": "text_span",50 "poly": [51 123.11399653165083,52 1041.045260676376,53 430.31187121323717,54 1041.045260676376,55 430.31187121323717,56 1084.7069256241082,57 123.11399653165083,58 1084.706925624108259 ],60 "text": "青藏地区和西北地区"61 }62 ],63 "attribute": {64 "text_language": "text_simplified_chinese",65 "text_background": "multi_colored",66 "text_rotate": "normal"67 }68 },69 {70 "category_type": "text_block",71 "poly": [72 157.2606551200275,73 1106.726858233768,74 781.7818873981907,75 1106.726858233768,76 781.7818873981907,77 1151.774291381701,78 157.2606551200275,79 1151.77429138170180 ],81 "ignore": false,82 "order": 3,83 "anno_id": 4,84 "text": "1. “干旱” 的西北地区和 “高寒” 的青藏地区，土坯垒墙，屋顶坡度较小，墙体厚度达 1.5 米；墙体较厚，注意防寒保暖，墙内填充物为 1000 千克/立方米的泡沫；墙体高，注意通风散热，墙体高度超过 30 米。",85 "attribute": {86 "text_language": "text_simplified_chinese",87 "text_background": "white",88 "text_rotate": "normal"89 },90 "html": "<p>1. “干旱” 的西北地区和 “高寒” 的青藏地区，土坯垒墙，屋顶坡度较小，墙体厚度达 1.5 米；墙体较厚，注意防寒保暖，墙内填充物为 1000 千克/立方米的泡沫；墙体高，注意通风散热，墙体高度超过 30 米。</p>"91 },92 {93 "category_type": "table_caption",94 "poly": [95 159.05257708539662,96 1170.4340997137751,97 544.3592176581255,98 1170.4340997137751,99 544.3592176581255,100 1208.721352540363,101 159.05257708539662,102 1208.721352540363103 ],104 "ignore": false,105 "order": 4,106 "anno_id": 0,107 "text": "2. 西北地区的干旱的原因",108 "line_with_spans": [109 {110 "category_type": "text_span",111 "poly": [112 157.9153770951897,113 1174.119434398698,114 541.4218993368822,115 1174.119434398698,116 541.4218993368822,117 1214.5151229991616,118 157.9153770951897,119 1214.5151229991616120 ],121 "text": "2. 西北地区的干旱的原因"122 }123 ],124 "attribute": {125 "text_language": "text_simplified_chinese",126 "text_background": "multi_colored",127 "text_rotate": "normal"128 }129 },130 {131 "category_type": "table",132 "poly": [133 138.37169924795936,134 1215.596781073202,135 1288.1303310205253,136 1215.596781073202,137 1288.1303310205253,138 1849.2973093625835,139 138.37169924795936,140 1849.2973093625835141 ],142 "ignore": false,143 "order": 5,144 "anno_id": 3,145 "html": "<table border=\"1\"><tr><td></td><td>西北地区</td><td>青藏地区</td></tr><tr><td>区域特征</td><td>干旱</td><td>高寒</td></tr><tr><td>地形</td><td>以高原和盆地为主</td><td>以高原山地为主</td></tr><tr><td>气候</td><td>温带大陆性气候</td><td>高原山地气候</td></tr><tr><td rowspan=\"2\">河湖</td><td rowspan=\"2\">稀少，水量少，流程短，多内流河，内流湖，最长的内流河—塔里木河</td><td rowspan=\"2\">中华水塔，三江源（长江，黄河，澜沧江的源头），最大的湖泊—青海湖</td></tr><tr></tr><tr><td rowspan=\"2\">植被</td><td rowspan=\"2\">温带草原，自东向西：\n草原→荒漠草原→荒漠</td><td rowspan=\"2\">高寒草地</td></tr><tr></tr><tr><td>牧场</td><td>温带草原牧场（内蒙古）</td><td rowspan=\"2\">高寒牧场（青海和西藏）</td></tr><tr><td>特色</td><td>山地牧场（新疆）</td></tr></table>",146 "attribute": {147 "table_layout": "horizontal",148 "with_span": false,149 "line": "full_line",150 "language": "table_simplified_chinese",151 "include_equation": false,152 "include_photo": false,153 "include_background": true,154 "with_structured_text": false155 },156 "table_edit_status": "good"157 },158 {159 "category_type": "header",160 "poly": [161 1105.407425046662,162 152.64281323930265,163 1370.5800038313316,164 152.64281323930265,165 1370.5800038313316,166 235.3707486818736,167 1105.407425046662,168 235.3707486818736169 ],170 "ignore": false,171 "order": null,172 "anno_id": 2,173 "text": "NO. Date",174 "line_with_spans": [175 {176 "category_type": "text_span",177 "poly": [178 1107.861745904321,179 155.32038426015632,180 1145.6607886090499,181 155.32038426015632,182 1145.6607886090499,183 178.1909695961785,184 1107.861745904321,185 178.1909695961785186 ],187 "text": "NO."188 },189 {190 "category_type": "text_span",191 "poly": [192 1110.4028965573534,193 212.14514985348433,194 1163.1520304572446,195 212.14514985348433,196 1163.1520304572446,197 232.54148162810915,198 1110.4028965573534,199 232.54148162810915200 ],201 "text": "Date"202 }203 ],204 "attribute": {205 "text_language": "text_english",206 "text_background": "white",207 "text_rotate": "normal"208 }209 },210 {211 "category_type": "page_number",212 "poly": [213 684.6188566748679,214 1925.0760878282306,215 739.965556312641,216 1925.0760878282306,217 739.965556312641,218 1970.880253045698,219 684.6188566748679,220 1970.880253045698221 ],222 "ignore": false,223 "order": null,224 "anno_id": 1,225 "text": "74",226 "line_with_spans": [227 {228 "category_type": "text_span",229 "poly": [230 681.8994353301956,231 1914.939505288731,232 738.6321511457555,233 1914.939505288731,234 738.6321511457555,235 1978.3017421559837,236 681.8994353301956,237 1978.3017421559837238 ],239 "text": "74"240 }241 ],242 "attribute": {243 "text_language": "text_simplified_chinese",244 "text_background": "white",245 "text_rotate": "normal"246 }247 }248 ],249 "extra": {250 "relation": [251 {252 "source_anno_id": 3,253 "target_anno_id": 0,254 "relation_type": "parent_son"255 }256 ]257 },258 "page_info": {259 "page_attribute": {260 "data_source": "note",261 "language": "simplified_chinese",262 "layout": "single_column",263 "special_issue": []264 },265 "page_no": 79,266 "height": 2024,267 "width": 1434,268 "image_path": "notes_1ba14cb325bc448f7201b20502ecf2b5_79.jpg"269 }270}