CoolFace
Datasetpublic

milamarcheva/bulgarian_cds_lg

Dataset Overview A sentence-level corpus drawn from scanned Bulgarian children's text. Each row represents one segmented sentence, its tokenization, the source URL, and its token count. Data Schema Column Type Description MainSentencised string The raw, sentence-segmented text (in Bulgarian). TokenisedSent list[string] The sentence split into word-tokens (lowercased, stripped). SourceLink string (URL) Origin of the sentence (e.g. a Chitanka… See the full description on the dataset page: https://huggingface.co/datasets/milamarcheva/bulgarian_cds_lg.

sourceHugging Facemitupdated 1y agoView on Hugging Face
2likes28downloads
Dataset Card

Dataset Overview

A sentence-level corpus drawn from scanned Bulgarian children's text. Each row represents one segmented sentence, its tokenization, the source URL, and its token count.

Data Schema

ColumnTypeDescription
MainSentencisedstringThe raw, sentence-segmented text (in Bulgarian).
TokenisedSentlist\[string]The sentence split into word-tokens (lowercased, stripped).
SourceLinkstring (URL)Origin of the sentence (e.g. a Chitanka book/text ZIP).
UttLenintToken count (length of TokenisedSent).

Best Practices

  • —Group by SourceLink to preserve document boundaries.

28,467,275 tokens (excluding punctuation)

Notebook for data compilation

https://colab.research.google.com/drive/1d814NMJVEPvMlkBtWQZfqAnjN-94HlJm?usp=sharing

URLs for text aimed at ages 6-8 years

paths2ndgrade = ["https://chitanka.info/book/4370-101-dalmatintsi.txt.zip", "https://chitanka.info/book/652-bylgarski-narodni-prikazki.txt.zip", "https://chitanka.info/book/620-patilantsi.txt.zip", "https://chitanka.info/book/670-prikazen-svjat.txt.zip", "https://chitanka.info/text/3162-pipi-dylgoto-chorapche.txt.zip", "https://chitanka.info/book/8483-prikazki-po-telefona.txt.zip", "https://chitanka.info/book/648-prikazki.txt.zip", "https://chitanka.info/book/25-andersenovi-prikazki.txt.zip", "https://chitanka.info/book/147-nie-vrabchetata.txt.zip"] paths3rdgrade = ["https://chitanka.info/book/549-najtezhkoto-imane.txt.zip", "https://chitanka.info/book/5919-toshko-afrikanski-i-prikazki.txt.zip", "https://chitanka.info/text/1710-prikljuchenijata-na-lisko-po-more.txt.zip", "https://chitanka.info/text/2106-deset-prikljuchenija-na-lisko.txt.zip", "https://chitanka.info/book/8306-pet-prikazki.txt.zip", "https://chitanka.info/book/3796-prez-vodi-i-gori.txt.zip", "https://chitanka.info/book/188-praznichen-kalendar-na-bylgarcheto.txt.zip", "https://chitanka.info/text/552-alisa-v-stranata-na-chudesata.txt.zip", "https://chitanka.info/text/553-alisa-v-ogledalnija-svjat.txt.zip", "https://chitanka.info/book/9824-basni.txt.zip", "https://chitanka.info/text/87-emil-ot-lxoneberja.txt.zip", "https://chitanka.info/text/88-novi-pakosti-na-emil-ot-lxoneberja.txt.zip", "https://chitanka.info/text/89-zhiv-e-oshte-emil-ot-lxoneberja.txt.zip", "https://chitanka.info/book/5262-ronja-dyshterjata-na-razbojnika.txt.zip", "https://chitanka.info/book/5679-manshon-poluobuvka-i-myhesta-brada.txt.zip", "https://chitanka.info/book/9356-prikljuchenijata-na-lukcho.txt.zip", "https://chitanka.info/book/9871-prikazki-kolkoto-usmivka.txt.zip", "https://chitanka.info/book/42-nebeto-e-na-vsichki.txt.zip", "https://chitanka.info/text/22802-krokodilyt-gena-i-negovite-prijateli.txt.zip", "https://chitanka.info/text/22808-rumtsajs.txt.zip",]