Datasetpublic

Svngoku/bongo-bernard-de-grunne-tefaf-2011

bongo-bernard-de-grunne-tefaf-2011 Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline. Dataset Summary Metric Value Total chunks 49 Avg chars/chunk 753 Avg images/chunk 1.27 Source files 1 Duplicates removed 0 Quality filtered 0 Schema Column Type Description chunk_id string Unique identifier: filename_chunk_N text string Raw markdown chunk with image refs text_clean string Cleaned… See the full description on the dataset page: https://huggingface.co/datasets/Svngoku/bongo-bernard-de-grunne-tefaf-2011.

sourceHugging Facemitupdated 3mo agoView on Hugging Face

0likes6downloads

Dataset Card

bongo-bernard-de-grunne-tefaf-2011

Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline.

Dataset Summary

Metric	Value
Total chunks	49
Avg chars/chunk	753
Avg images/chunk	1.27
Source files	1
Duplicates removed	0
Quality filtered	0

Schema

Column	Type	Description
`chunk_id`	`string`	Unique identifier: `filename_chunk_N`
`text`	`string`	Raw markdown chunk with image refs
`text_clean`	`string`	Cleaned text without markdown formatting
`chapter`	`string`	H1 header active at chunk position
`section`	`string`	H2 header active at chunk position
`subsection`	`string`	H3+ header active at chunk position
`images`	`list[Image]`	Rendered images extracted from chunk (viewable in Dataset Viewer)
`image_refs`	`list[string]`	Image reference IDs in chunk text
`num_images`	`int`	Number of images in chunk
`has_images`	`bool`	Whether chunk contains images
`source_filename`	`string`	Original source file name
`start_index`	`int`	Character offset in source document
`char_count`	`int`	Character count of chunk text

Source Files

File	Chunks
`bongo-bernard-de-grunne-tefaf-2011.pdf`	49

Document Structure

Chapters found in the source documents:

—13
—Bongo Funerary Post
—Bongo Funerary post, Bussere Style
—Bongo Monumental Statuary from Southern Sudan: the Ur-style of African statuary.
—Morokodu Funerary post
—Publications by Bernard de Grunne
—The Duponcheel Bongo Expedition

Pipeline

This dataset was processed through the PDF2Dataset pipeline:

1.OCR -- Mistral OCR extracts text and images from PDF/image files
2.Chunking -- Structure-aware recursive splitting preserves document hierarchy
3.Validation -- Schema validation ensures every chunk has required fields
4.Deduplication -- Content-hash based dedup removes identical chunks
5.Quality Filtering -- Removes empty, too-short, or malformed chunks