CoolFace
Datasetpublic

Doctor5benchmark/DocToR-5

DocToR 5 documents Tracing of Robustness Dataset Summary We introduce the DOCTOR 5 benchmark to systematically test the visual and logical robustness of multimodal models. The dataset features approximately 13k+ document images and over 65000 visual question answering pairs. It covers 12 diverse domains including scientific papers financial reports and business presentations. This resource provides a standardized testbed for evaluating models against generation… See the full description on the dataset page: https://huggingface.co/datasets/Doctor5benchmark/DocToR-5.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face
0likes104downloads
PPT_MMAT5390Lecture1_page_023.json272 linesDownload Raw Back to annotations
1{2  "page_info": {3    "image_path": "PPT_MMAT5390Lecture1_page_023.png",4    "page_no": 23,5    "page_attribute": {6      "data_source": "PPT2PDF",7      "language": "english",8      "layout": "single_column",9      "special_issue": [10        "None"11      ]12    },13    "width": 2000,14    "height": 150015  },16  "layout_dets": [17    {18      "category_type": "title",19      "anno_id": 1,20      "order": 1,21      "ignore": false,22      "poly": [23        478.6666666666667,24        48,25        1430.6666666666667,26        48,27        1430.6666666666667,28        144,29        478.6666666666667,30        14431      ],32      "line_with_spans": [],33      "attribute": {34        "text_language": "text_english",35        "text_background": "white",36        "text_rotate": "normal"37      },38      "text": "What is a digital image?"39    },40    {41      "category_type": "title",42      "anno_id": 2,43      "order": 2,44      "ignore": false,45      "poly": [46        53.10144927536201,47        211.33551700626322,48        833.3333333333331,49        211.33551700626322,50        833.3333333333331,51        278.00218367292933,52        53.10144927536201,53        278.0021836729293354      ],55      "line_with_spans": [],56      "attribute": {57        "text_language": "text_english",58        "text_background": "white",59        "text_rotate": "normal"60      },61      "text": "■ Mathematical definition:"62    },63    {64      "category_type": "text_block",65      "anno_id": 3,66      "order": 3,67      "ignore": false,68      "poly": [69        148.10035491712426,70        284.07292497677514,71        1900,72        284.07292497677514,73        1900,74        414.70614000439986,75        148.10035491712426,76        414.7061400043998677      ],78      "line_with_spans": [],79      "attribute": {80        "text_language": "text_english",81        "text_background": "white",82        "text_rotate": "normal"83      },84      "text": "-  A 2D (grayscale) digital image is a 2D function defined on a 2D domain (usually rectangular domain):"85    },86    {87      "category_type": "equation_isolated",88      "anno_id": 4,89      "order": 4,90      "ignore": false,91      "poly": [92        758.6666666666666,93        444,94        1105.3333333333333,95        444,96        1105.3333333333333,97        532,98        758.6666666666666,99        532100      ],101      "line_with_spans": [],102      "attribute": {103        "formula_type": "print",104        "equation_language": "equation_en"105      },106      "latex": "$$\nf : \\Omega \\to \\mathbb { R }\n$$"107    },108    {109      "category_type": "text_block",110      "anno_id": 5,111      "order": 5,112      "ignore": false,113      "poly": [114        145.18652446523635,115        570.6666666666671,116        1455.2361224267943,117        570.6666666666671,118        1455.2361224267943,119        643.8746265824452,120        145.18652446523635,121        643.8746265824452122      ],123      "line_with_spans": [],124      "attribute": {125        "text_language": "text_english",126        "text_background": "white",127        "text_rotate": "normal"128      },129      "text": "- $f(x,y)$ is called the brightness/intensity/grey level;"130    },131    {132      "category_type": "text_block",133      "anno_id": 10,134      "order": 6,135      "ignore": false,136      "poly": [137        144.3170590543426,138        655.3833770079073,139        1263.3558193992512,140        655.3833770079073,141        1263.3558193992512,142        706.8328201263754,143        144.3170590543426,144        706.8328201263754145      ],146      "attribute": {147        "text_language": "text_english",148        "text_background": "white",149        "text_rotate": "normal"150      },151      "text": "- $(x,y)$is the temporal coordinates of the image. - (x,y) represents the date: 2045-07-15.",152      "html": "<p>- $(x,y)$is the temporal coordinates of the image.</p><p>- (x,y) represents the date: 2045-07-15.</p>"153    },154    {155      "category_type": "text_block",156      "anno_id": 6,157      "order": 7,158      "ignore": false,159      "poly": [160        141.06158124751687,161        717.3333333333336,162        1154.6666666666667,163        717.3333333333336,164        1154.6666666666667,165        778.6666666666666,166        141.06158124751687,167        778.6666666666666168      ],169      "line_with_spans": [],170      "attribute": {171        "text_language": "text_english",172        "text_background": "white",173        "text_rotate": "normal"174      },175      "text": "- Thus, a 2D digital image looks like this:"176    },177    {178      "category_type": "equation_isolated",179      "anno_id": 7,180      "order": 8,181      "ignore": false,182      "poly": [183        460,184        794.6666666666666,185        1466.6666666666667,186        794.6666666666666,187        1466.6666666666667,188        1097.3333333333333,189        460,190        1097.3333333333333191      ],192      "line_with_spans": [],193      "attribute": {194        "formula_type": "print",195        "equation_language": "equation_en"196      },197      "latex": "$$\nf ( x , y ) = { \\left[ \\begin{array} { l l l l } { f ( 1 , 1 ) } & { f ( 1 , 2 ) } & { \\ldots } & { f ( 1 , N ) } \\\\ { f ( 2 , 1 ) } & { f ( 2 , 2 ) } & { \\ldots } & { f ( 2 , N ) } \\\\ { \\vdots } & { \\vdots } & { } & { \\vdots } \\\\ { f ( N , 1 ) } & { f ( N , 2 ) } & { \\ldots } & { f ( N , N ) } \\end{array} \\right] }\n$$"198    },199    {200      "category_type": "text_block",201      "anno_id": 8,202      "order": 9,203      "ignore": false,204      "poly": [205        155.2417639533248,206        1146.2739203030583,207        1626.6553467458248,208        1146.2739203030583,209        1626.6553467458248,210        1211.4701571967767,211        155.2417639533248,212        1211.4701571967767213      ],214      "attribute": {215        "text_language": "text_english",216        "text_background": "white",217        "text_rotate": "normal"218      },219      "text": "- Each element in the matrix is called anti-pixel (non-picture element); - Although each element is called anti-pixel, it is still called pixel in standard computer graphics.",220      "html": "<p>- Each element in the matrix is called anti-pixel (non-picture element);</p><p>- Although each element is called anti-pixel, it is still called pixel in standard computer graphics.</p>"221    },222    {223      "category_type": "text_block",224      "anno_id": 11,225      "order": 10,226      "ignore": false,227      "poly": [228        154.13111524954923,229        1205.792790670226,230        1439.2143947571128,231        1205.792790670226,232        1439.2143947571128,233        1281.4318097304463,234        154.13111524954923,235        1281.4318097304463236      ],237      "attribute": {238        "text_language": "text_english",239        "text_background": "white",240        "text_rotate": "normal"241      },242      "text": "- Usually, $G \\leq f(x, y) \\leq 0$ and $(N=2^{-n}, G=2^{-m})$",243      "html": "<p>- Usually, $G \\leq f(x, y) \\leq 0$ and $(N=2^{-n}, G=2^{-m})$</p>"244    },245    {246      "category_type": "text_block",247      "anno_id": 9,248      "order": 11,249      "ignore": false,250      "poly": [251        218.66666666666666,252        1350.6666666666667,253        1798.6666666666667,254        1350.6666666666667,255        1798.6666666666667,256        1417.3333333333333,257        218.66666666666666,258        1417.3333333333333259      ],260      "line_with_spans": [],261      "attribute": {262        "text_language": "text_english",263        "text_background": "white",264        "text_rotate": "normal"265      },266      "text": "IMAGE PROCESSING IS RELATED TO LINEAR ALGEBRA!!"267    }268  ],269  "extra": {270    "relation": []271  }272}
Doctor5benchmark/DocToR-5 · CoolFace