CoolFace
Datasetpublic

Svngoku/mumuye-bernard-de-grunne

mumuye-bernard-de-grunne Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline. Dataset Summary Metric Value Total chunks 182 Avg chars/chunk 719 Avg images/chunk 1.29 Source files 1 Duplicates removed 0 Quality filtered 2 Schema Column Type Description chunk_id string Unique identifier: filename_chunk_N text string Raw markdown chunk with image refs text_clean string Cleaned text… See the full description on the dataset page: https://huggingface.co/datasets/Svngoku/mumuye-bernard-de-grunne.

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes9downloads
Dataset Card

mumuye-bernard-de-grunne

Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline.

Dataset Summary

MetricValue
Total chunks182
Avg chars/chunk719
Avg images/chunk1.29
Source files1
Duplicates removed0
Quality filtered2

Schema

ColumnTypeDescription
chunk_idstringUnique identifier: filename_chunk_N
textstringRaw markdown chunk with image refs
text_cleanstringCleaned text without markdown formatting
chapterstringH1 header active at chunk position
sectionstringH2 header active at chunk position
subsectionstringH3+ header active at chunk position
imageslist[Image]Rendered images extracted from chunk (viewable in Dataset Viewer)
image_refslist[string]Image reference IDs in chunk text
num_imagesintNumber of images in chunk
has_imagesboolWhether chunk contains images
source_filenamestringOriginal source file name
start_indexintCharacter offset in source document
char_countintCharacter count of chunk text

Source Files

FileChunks
mumuye-bernard-de-grunne-tefaf-2023.pdf182

Document Structure

Chapters found in the source documents:

  • —Acknowledgements
  • —Annexe 1
  • —Annexe 2
  • —Le cercle des sculpteurs de Pantisawa : Nyavo, Malika, Kwenze, Tage et Masho (Cat. 42 & 43)
  • —Mumuye
  • —Not anonymous anymore: a plethora of artists
  • —Plus anonymes : une pléthore d'artistes
  • —Statue Mumuye Peoples, Nigeria.
  • —Statue, Mumuye People, Nigeria.
  • —Statue, Mumuye Peoples, Nigeria.
  • —Statue, Mumuye Peoples, Nigeria. Carved by the Tara Master
  • —Statue, Mumuye Peoples, Nigeria. H.: 125 cm
  • —The Pantisawa circle of sculptors: Nyavo, Malika, Kwenze, Tage, and Masho (Cat. 42 & 43)

Pipeline

This dataset was processed through the PDF2Dataset pipeline:

  1. 1.OCR -- Mistral OCR extracts text and images from PDF/image files
  2. 2.Chunking -- Structure-aware recursive splitting preserves document hierarchy
  3. 3.Validation -- Schema validation ensures every chunk has required fields
  4. 4.Deduplication -- Content-hash based dedup removes identical chunks
  5. 5.Quality Filtering -- Removes empty, too-short, or malformed chunks