CoolFace
Datasetpublic

dineshkarki/nepali-textbooks-corpus

Nepali Textbooks Corpus for Grades 1-12 This dataset contains OCR-extracted, chapter-first, chunked text from Nepali school textbooks. Summary Samples: 5634 Grades: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12] Subjects: ['Civic_Education', 'Civic_Science', 'Economics', 'Education', 'Enterprenuership_and_Technology', 'Health_Physcial_and_Creative_Arts', 'Health_Physical_and_Creative_Arts', 'Health_and_Physical_Education', 'Math', 'My_Math', 'My_Nepali'… See the full description on the dataset page: https://huggingface.co/datasets/dineshkarki/nepali-textbooks-corpus.

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
2likes42downloads
Dataset Card

Nepali Textbooks Corpus for Grades 1-12

This dataset contains OCR-extracted, chapter-first, chunked text from Nepali school textbooks.

Summary

  • —Samples: 5634
  • —Grades: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12]
  • —Subjects: ['CivicEducation', 'CivicScience', 'Economics', 'Education', 'EnterprenuershipandTechnology', 'HealthPhyscialandCreativeArts', 'HealthPhysicalandCreativeArts', 'HealthandPhysicalEducation', 'Math', 'MyMath', 'MyNepali', 'MyScienceHealthandPhysicalEducation', 'MySurrounding', 'MySurroundings', 'Nepali', 'OptionalMaths', 'PopulationStudies', 'ScienceandEnvironment', 'ScienceandTechnology', 'SocialStudies', 'SocialStudiesandHumanValues', 'SocialStudiesandHumanValues', 'Sociology', 'computerscience', 'economics', 'environmentalscience', 'health', 'history', 'math', 'nepali', 'optional_math', 'science', 'social']
  • —Total chars: 16401163
  • —Avg tokens per sample: 493

Schema

  • —id — unique segment id
  • —text — content chunk
  • —source — book/source string
  • —subject — subject label (from filename)
  • —grade — class/grade
  • —chapter_index — chapter number
  • —chapter_title — chapter/unit name
  • —segment_index — index within chapter
  • —chars — character length
  • —chunk_unit — "word" or "char"

Processing

  • —Text extraction with hybrid per-page OCR fallback (nep+eng), Unicode normalization, glyph fixes
  • —Chapter detection: headings "अध्याय N" and "एकाइ N"
  • —Boilerplate removal, chunking with overlap