Teklia/Newspapers-finlam-La-Liberte

Newspaper dataset: Finlam La Liberté

Dataset Description

• —Homepage: Finlam
• —Point of Contact: TEKLIA

Dataset Summary

The Finlam La Liberté dataset includes 1500 issues from La Liberté, a French newspaper, from 1925 to 1928.

Each issue contains multiple pages, with one image for each page resized to a fixed height of 2500 pixels.

The dataset can be used to train end-to-end newspaper understanding models, with tasks including:

• —Text zone detection and classification
• —Reading order detection
• —Article separation

Split

Languages

All newspapers in the dataset are French.

Dataset Structure

Data Fields

• —page_arkindex_id: The Arkindex element id corresponding to the current page.
• —page_index: The index of the current page in the newspaper issue.
• —page_image: a PIL.Image object containing the page image. Note that when accessing the image column (using dataset[0]["pageimage"]), the image file is automatically decoded. Decoding of a large number of image files might take a significant amount of time. Thus it is important to first query the sample index before the "image" column, i.e. dataset[0]["pageimage"] should always be preferred over dataset["page_image"][0].
• —zone_polygons: the list of zone coordinates in the current page.
• —zone_texts: the list of zone texts in the current page.
• —zone_classes: the list of zone classes in the current page.
• —zone_orders: the list of zone indexes in the current page, defining the reading order.
• —zone_article_id: the list of article indexes defining in which article of the newspaper the current zone is located.
• —zone_section_id: the list of section indexes defining in which section of the newspaper the current zone is located.