CoolFace
Datasetpublic

DenisaBumba/rfdetr-segmentation-leibniz-dataset

Dataset Card for Leibniz's Manuscripts (Instance Segmentation Dataset) This dataset comprises instance segmentation annotations in raw COCO format, used to train an RF-DETR-Seg-nano model for the automatic recognition of textual, graphical, and mathematical expression zones within the manuscripts of the philosopher and mathematician Gottfried Wilhelm Leibniz (17th-early 18th c.). Dataset Details Uses Direct Use This dataset is… See the full description on the dataset page: https://huggingface.co/datasets/DenisaBumba/rfdetr-segmentation-leibniz-dataset.

sourceHugging Facecc-by-4.0updated 2mo agoView on Hugging Face
0likes963downloads
Dataset Card

Dataset Card for Leibniz's Manuscripts (Instance Segmentation Dataset)

This dataset comprises instance segmentation annotations in raw COCO format, used to train an RF-DETR-Seg-nano model for the automatic recognition of textual, graphical, and mathematical expression zones within the manuscripts of the philosopher and mathematician Gottfried Wilhelm Leibniz (17th-early 18th c.).

Dataset Details

Dataset Description

  • —Curated by: Bumba, Denisa-Florina
  • —Funded by [optional]: (European Research Council, 101020985)
  • —Shared by [optional]: ERC PHILIUMM Project
  • —Language(s) (NLP): Latin, French (17th-early 18th c.)
  • —License: cc-by-4.0

Uses

Direct Use

  • —This dataset is intended for the detection and delimitation of textual, graphical, and mathematical zones within Leibniz's manuscripts, and more broadly within early-modern manuscript sources.

Out-of-Scope Use

  • —Has never been tested on modern printed or handwritten textes.

Dataset Structure

train/_annotations.coco.json + images
valid/_annotations.coco.json + images
test/_annotations.coco.json  + images

Classes

Class names follow the SegmOnto controlled vocabulary for manuscript layout annotation.

ClassDescription
MainZoneMain body text region
MarginTextZoneMarginal additions
NumberingZonePage numbering
DigitizationArtefactZoneDigitization artifacts
GraphicZone-figureDiagrams, other graphic zones
GraphicZone-formulaCovers all mathematical formulae
GraphicZone-formula-complexComplex/multi-line formulae
GraphicZone-formula-inlineInline formulae within text
GraphicZone-formula-strikethroughStruck-through/deleted formulae

Preprocessing

  • —Auto-orient applied
  • —Resized (stretch) to 728×728

Augmentation

(applied to the training set only, 2 augmented outputs generated per source image):

  • —Horizontal and vertical flip
  • —Rotation: ±3°
  • —Shear: ±5° horizontal, ±5° vertical
  • —Hue: ±15°
  • —Brightness: ±15%
  • —Noise: up to 1.49% of pixels

Class Distribution before data augmentation

CategoryTrainValidTestTotal
GraphicZone-formula-inline11961001341430
GraphicZone-formula-strikethrough69456100850
MarginTextZone7107743830
MainZone4775326556
GraphicZone-figure3825125458
NumberingZone3133116360
DigitizationArtefactZone2002210232
GraphicZone-formula-complex107124123
GraphicZone-formula847091
Total41634093584930

Class Distribution after data augmentation

Annotation counts per category and split, computed after data augmentation.

CategoryTrainValidTestTotal
GraphicZone-formula-inline35871001343821
MarginTextZone213277432252
GraphicZone-formula-strikethrough2084561002240
MainZone143253261511
GraphicZone-figure114651251222
NumberingZone9393116986
DigitizationArtefactZone6002210632
GraphicZone-formula-complex321124337
GraphicZone-formula25270259
Total1249340935813260
SplitImages (incl. augmented)Unique Source Images
Train1,026342
Valid4040
Test2020
Total1,086402
Data Collection and Processing
Who are the source data producers?

Image annotation 343 folios with mainly text zones and model training by Denisa-Florina BUMBA within the ERC Philiumm Project (Laboratoire SPHERE, Univ. Paris Cité - CNRS, France). Project manager: David RABOUIN

Image annotation of 59 pages containing mainly mathematical zones by Yunfan LI, under the guidance of Yejing XIE, Harold MOUCHÈRE (Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000, Nantes, France)

Annotation process

Bias, Risks, and Limitations

GraphicZone-formula is a generic label for formulae that weren't sorted into one of the three more specific classes (-complex, -inline, -strikethrough). Since annotations came from different practices and different annotators, not all formulae were manually reclassified. This is a known issue we plan to fix in a future version of the dataset.

Funding

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme, Advanced Grant ADG No. 101020985.