CoolFace
Datasetpublic

Svngoku/Kongo-bernard-de-grunne

Kongo-bernard-de-grunne Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline. Dataset Summary Metric Value Total chunks 222 Avg chars/chunk 709 Avg images/chunk 0.72 Source files 1 Duplicates removed 0 Quality filtered 4 Schema Column Type Description chunk_id string Unique identifier: filename_chunk_N text string Raw markdown chunk with image refs text_clean string Cleaned text without… See the full description on the dataset page: https://huggingface.co/datasets/Svngoku/Kongo-bernard-de-grunne.

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes7downloads
Dataset Card

Kongo-bernard-de-grunne

Dataset created with PDF2Dataset -- OCR + structure-aware chunking pipeline.

Dataset Summary

MetricValue
Total chunks222
Avg chars/chunk709
Avg images/chunk0.72
Source files1
Duplicates removed0
Quality filtered4

Schema

ColumnTypeDescription
chunk_idstringUnique identifier: filename_chunk_N
textstringRaw markdown chunk with image refs
text_cleanstringCleaned text without markdown formatting
chapterstringH1 header active at chunk position
sectionstringH2 header active at chunk position
subsectionstringH3+ header active at chunk position
imageslist[Image]Rendered images extracted from chunk (viewable in Dataset Viewer)
image_refslist[string]Image reference IDs in chunk text
num_imagesintNumber of images in chunk
has_imagesboolWhether chunk contains images
source_filenamestringOriginal source file name
start_indexintCharacter offset in source document
char_countintCharacter count of chunk text

Source Files

FileChunks
kongo-bernard-de-grunne-tefaf-2022.pdf222

Document Structure

Chapters found in the source documents:

  • —02
  • —03
  • —04
  • —05
  • —06
  • —08
  • —11
  • —13
  • —14
  • —15
  • —16
  • —18
  • —22
  • —23
  • —25
  • —26
  • —28
  • —30
  • —32
  • —34
  • —36
  • —40
  • —44
  • —47
  • —48
  • —52
  • —53
  • —55
  • —56
  • —58
  • —... and 14 more

Pipeline

This dataset was processed through the PDF2Dataset pipeline:

  1. 1.OCR -- Mistral OCR extracts text and images from PDF/image files
  2. 2.Chunking -- Structure-aware recursive splitting preserves document hierarchy
  3. 3.Validation -- Schema validation ensures every chunk has required fields
  4. 4.Deduplication -- Content-hash based dedup removes identical chunks
  5. 5.Quality Filtering -- Removes empty, too-short, or malformed chunks