Datasetpublic

BabyLM-community/babylm-id-subtitles

babylm-id Dataset Description This dataset is part of the BabyLM multilingual collection. Dataset Summary Language: id Script: Latin Category: subtitles Source: Unknown Age Estimate: n/a Number of Documents: 45408 Total Tokens: 264979169 Tokens Per Category subtitles: 264979169 tokens Data Fields text: The document text category: Type of content (e.g., child-directed-speech, educational, etc.) data-source: Original… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/babylm-id-subtitles.

sourceHugging Faceunknownupdated 1y agoView on Hugging Face

0likes20downloads

Dataset Card

babylm-id

Dataset Description

This dataset is part of the BabyLM multilingual collection.

Dataset Summary

—Language: id
—Script: Latin
—Category: subtitles
—Source: Unknown
—Age Estimate: n/a
—Number of Documents: 45408
—Total Tokens: 264979169

Tokens Per Category

—subtitles: 264979169 tokens

Data Fields

—text: The document text
—category: Type of content (e.g., child-directed-speech, educational, etc.)
—data-source: Original source of the data
—script: Writing system used
—age-estimate: Target age or age range
—license: Data license
—misc: Additional metadata (JSON string)
—num_tokens: Number of tokens in the subtitle file

Licensing Information

This dataset is licensed under: See individual files

Citation

Please cite the original data source: Unknown