dineshkarki/nepali-textbooks-math-grade10

Nepali Textbook Pretraining Corpus — Sample (Grade 10 Math)

This dataset contains OCR-extracted, chapter-first, chunked text from Nepali school textbooks.

Schema

• —id — unique segment id
• —source — book/source string
• —book_id — filename-derived id (if present)
• —subject — subject label (e.g., "math")
• —grade — class/grade
• —chapter_index — chapter number
• —chapter_title — chapter/unit name
• —segment_index — index within chapter
• —text — content chunk
• —tokens_approx — rough token count (whitespace split)
• —chars — character length
• —chunk_unit — "word" or "char"

Processing

• —OCR via Tesseract (nep+eng), Unicode normalization, glyph fixes
• —Chapter detection: headings “अध्याय N” and “एकाइ N”
• —Boilerplate removal, chunking with overlap

Notes

This is a test push to validate structure on Hugging Face before bulk ingestion.