dineshkarki/nepali-textbooks-grade10
Nepali Textbooks Grade 10 This dataset contains OCR-extracted, chapter-first, chunked text from Nepali school textbooks. Summary Samples: 1936 Grades: [10] Subjects: ['Civic_Science', 'Education', 'Health_and_Physical_Education', 'Population_Studies', 'Social_Studies', 'Sociology', 'computer_science', 'economics', 'environmental_science', 'health', 'history', 'math', 'nepali', 'optional_math', 'science', 'social'] Total chars: 5903753 Avg tokens per sample: 492… See the full description on the dataset page: https://huggingface.co/datasets/dineshkarki/nepali-textbooks-grade10.
04
Nepali Textbooks Grade 10
This dataset contains OCR-extracted, chapter-first, chunked text from Nepali school textbooks.
Summary
- Samples: 1936
- Grades: [10]
- Subjects: ['CivicScience', 'Education', 'HealthandPhysicalEducation', 'PopulationStudies', 'SocialStudies', 'Sociology', 'computerscience', 'economics', 'environmentalscience', 'health', 'history', 'math', 'nepali', 'optional_math', 'science', 'social']
- Total chars: 5903753
- Avg tokens per sample: 492
Schema
id— unique segment idtext— content chunksource— book/source stringsubject— subject label (from filename)grade— class/gradechapter_index— chapter numberchapter_title— chapter/unit namesegment_index— index within chapterchars— character lengthchunk_unit— "word" or "char"
Processing
- Text extraction with hybrid per-page OCR fallback (
nep+eng), Unicode normalization, glyph fixes - Chapter detection: headings "अध्याय N" and "एकाइ N"
- Boilerplate removal, chunking with overlap
Notes
Auto-generated dataset card.
