Datasetpublic

BabyLM-community/babylm-ko-subtitles

babylm-ko Dataset Description This dataset is part of the BabyLM multilingual collection. Dataset Summary Language: ko Script: Korean (Hangul + Han) Category: subtitles Source: Unknown Age Estimate: n/a Number of Documents: 7909 Total Tokens: 34475400 Tokens Per Category subtitles: 34475400 tokens Data Fields text: The document text category: Type of content (e.g., child-directed-speech, educational, etc.)… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/babylm-ko-subtitles.

sourceHugging Faceunknownupdated 1y agoView on Hugging Face

0likes20downloads

Dataset Card

babylm-ko

Dataset Description

This dataset is part of the BabyLM multilingual collection.

Dataset Summary

—Language: ko
—Script: Korean (Hangul + Han)
—Category: subtitles
—Source: Unknown
—Age Estimate: n/a
—Number of Documents: 7909
—Total Tokens: 34475400

Tokens Per Category

—subtitles: 34475400 tokens

Data Fields

—text: The document text
—category: Type of content (e.g., child-directed-speech, educational, etc.)
—data-source: Original source of the data
—script: Writing system used
—age-estimate: Target age or age range
—license: Data license
—misc: Additional metadata (JSON string)
—num_tokens: Number of tokens in the subtitle file

Licensing Information

This dataset is licensed under: See individual files

Citation

Please cite the original data source: Unknown