Doctor5benchmark/DocToR-5
DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.
0104
1{2 "layout_dets": [3 {4 "category_type": "title",5 "poly": [6 548.1037591546408,7 240.1634631850186,8 945.2230944530374,9 240.1634631850186,10 945.2230944530374,11 305.90281260941543,12 548.1037591546408,13 305.9028126094154314 ],15 "ignore": false,16 "order": 1,17 "anno_id": 1,18 "text": "中考完形填空备考笔记",19 "line_with_spans": [20 {21 "category_type": "text_span",22 "poly": [23 557.2250003541151,24 244.44444444444443,25 942.8966043480793,26 244.44444444444443,27 942.8966043480793,28 303.70370370370364,29 557.2250003541151,30 303.7037037037036431 ],32 "text": "中考完形填空备考笔记"33 }34 ],35 "attribute": {36 "text_language": "text_simplified_chinese",37 "text_background": "multi_colored",38 "text_rotate": "normal"39 }40 },41 {42 "category_type": "title",43 "poly": [44 557.4950947866975,45 311.2692901134478,46 951.9311913330781,47 311.2692901134478,48 951.9311913330781,49 382.375117041877,50 557.4950947866975,51 382.37511704187752 ],53 "ignore": false,54 "order": 2,55 "anno_id": 3,56 "text": "历年中考阅读完形核心单词",57 "line_with_spans": [58 {59 "category_type": "text_span",60 "poly": [61 561.293518164403,62 318.5185185185185,63 948.0265434459528,64 318.5185185185185,65 948.0265434459528,66 376.1025622860341,67 561.293518164403,68 376.102562286034169 ],70 "text": "历年中考阅读完形核心单词"71 }72 ],73 "attribute": {74 "text_language": "text_simplified_chinese",75 "text_background": "multi_colored",76 "text_rotate": "normal"77 }78 },79 {80 "category_type": "text_block",81 "poly": [82 114.68636822971865,83 370.5761987547007,84 1307.5095699846192,85 370.5761987547007,86 1307.5095699846192,87 1901.9339853886106,88 114.68636822971865,89 1901.933985388610690 ],91 "ignore": false,92 "order": 3,93 "anno_id": 4,94 "text": "achievement v.破坏，摧毁，失败 bomb n.甜点 v.融化 act n.静止，不动 v.沉睡 bother n.平静 v.安抚 affect n.无影响 v.忽略 breathe n.停止心跳 v.窒息 agreement v.分裂，反对 n.冲突 bully n./v. 帮助，鼓励 aim v.放弃，遗忘 n.混乱 cage v.释放 n.自由 allow n.禁止 v.拒绝 calculation v.遗忘 n.混乱 amazing a.无动于衷的 camera n.咖啡机，搅拌机 ambulance n.咖啡机，搅拌机 cancel v.确认，执行 amount v.减少，消失 n.空无 cancer n.健康，活力 application n.拒绝，放弃，忽略 captive/caged adj.自由的 aquarium n.图书馆，阅览室 captivity n.自由，开放 Arctic n.热带的 a.炎热的 cause v.无因，无果 n.无意义 article v.删除，销毁 n.空白 celebration v.哀悼，悲痛 n.葬礼 ashamed n.骄傲 adj.自豪的 chain v.断裂，分离 n.独立 assume n.否认，拒绝 v.否定 challenge v.逃避，放弃 n.退缩 astronaut v.潜水员 n.海员 cheer n.沉默 v.安静 at least最多 至少=无限 chest v.隐藏，藏匿 n.秘密 athletic n.静止的 a.不动的 claim n.否认 v.拒绝 average v.极端 n.异常 close n.距离 adj.遥远的 battery v.充电 n.电源 comfortable n.痛苦 a.难受的 battle v.和平 n.协商 command n.服从 v.顺从 blame n.表扬 v.称赞 common n.稀有的 a.罕见的 blind v.看见 a.清醒的 community v.解散 n.孤立 bloodshed v.和平 n.无事 compare n.相同 v.等同",95 "attribute": {96 "text_language": "text_en_ch_mixed",97 "text_background": "multi_colored",98 "text_rotate": "normal"99 },100 "html": "<p>achievement v.破坏，摧毁，失败 bomb n.甜点 v.融化 act n.静止，不动 v.沉睡 bother n.平静 v.安抚 affect n.无影响 v.忽略 breathe n.停止心跳 v.窒息 agreement v.分裂，反对 n.冲突 bully n./v. 帮助，鼓励 aim v.放弃，遗忘 n.混乱 cage v.释放 n.自由 allow n.禁止 v.拒绝 calculation v.遗忘 n.混乱 amazing a.无动于衷的 camera n.咖啡机，搅拌机 ambulance n.咖啡机，搅拌机 cancel v.确认，执行 amount v.减少，消失 n.空无 cancer n.健康，活力 application n.拒绝，放弃，忽略 captive/caged adj.自由的 aquarium n.图书馆，阅览室 captivity n.自由，开放 Arctic n.热带的 a.炎热的 cause v.无因，无果 n.无意义 article v.删除，销毁 n.空白 celebration v.哀悼，悲痛 n.葬礼 ashamed n.骄傲 adj.自豪的 chain v.断裂，分离 n.独立 assume n.否认，拒绝 v.否定 challenge v.逃避，放弃 n.退缩 astronaut v.潜水员 n.海员 cheer n.沉默 v.安静 at least最多 至少=无限 chest v.隐藏，藏匿 n.秘密 athletic n.静止的 a.不动的 claim n.否认 v.拒绝 average v.极端 n.异常 close n.距离 adj.遥远的 battery v.充电 n.电源 comfortable n.痛苦 a.难受的 battle v.和平 n.协商 command n.服从 v.顺从 blame n.表扬 v.称赞 common n.稀有的 a.罕见的 blind v.看见 a.清醒的 community v.解散 n.孤立 bloodshed v.和平 n.无事 compare n.相同 v.等同</p>"101 },102 {103 "category_type": "header",104 "poly": [105 1087.434748309896,106 134.1755324803788,107 1343.6840491274424,108 134.1755324803788,109 1343.6840491274424,110 225.40565004892935,111 1087.434748309896,112 225.40565004892935113 ],114 "ignore": false,115 "order": null,116 "anno_id": 0,117 "text": "NO. Date",118 "line_with_spans": [119 {120 "category_type": "text_span",121 "poly": [122 1091.2226004142792,123 142.3681756563302,124 1127.0686339657916,125 142.3681756563302,126 1127.0686339657916,127 166.78503908996936,128 1091.2226004142792,129 166.78503908996936130 ],131 "text": "NO."132 },133 {134 "category_type": "text_span",135 "poly": [136 1090.183584949018,137 197.95550304780627,138 1142.65386594471,139 197.95550304780627,140 1142.65386594471,141 220.81384328355335,142 1090.183584949018,143 220.81384328355335144 ],145 "text": "Date"146 }147 ],148 "attribute": {149 "text_language": "text_english",150 "text_background": "white",151 "text_rotate": "normal"152 }153 },154 {155 "category_type": "page_number",156 "poly": [157 668.3103080795781,158 1915.362223901496,159 711.4791477621364,160 1915.362223901496,161 711.4791477621364,162 1983.5235497160618,163 668.3103080795781,164 1983.5235497160618165 ],166 "ignore": false,167 "order": null,168 "anno_id": 2,169 "text": "64",170 "line_with_spans": [171 {172 "category_type": "text_span",173 "poly": [174 673.2556682107594,175 1932.3071724776769,176 713.1365441165673,177 1932.3071724776769,178 713.1365441165673,179 1973.0019438101342,180 673.2556682107594,181 1973.0019438101342182 ],183 "text": "64"184 }185 ],186 "attribute": {187 "text_language": "text_simplified_chinese",188 "text_background": "white",189 "text_rotate": "normal"190 }191 }192 ],193 "extra": {194 "relation": []195 },196 "page_info": {197 "page_attribute": {198 "data_source": "note",199 "language": "en_ch_mixed",200 "layout": "single_column",201 "special_issue": []202 },203 "page_no": 69,204 "height": 2024,205 "width": 1432,206 "image_path": "notes_f7f010b78016aeebd76e56d9283eb67f_69.jpg"207 }208}