Datasetpublic

BabyLM-community/babylm-fa-subtitles

babylm-fa Dataset Description This dataset is part of the BabyLM multilingual collection. Dataset Summary Language: fa Script: Latin Category: subtitles Source: Unknown Age Estimate: n/a Number of Documents: 41312 Total Tokens: 249245044 Tokens Per Category subtitles: 249245044 tokens Data Fields text: The document text category: Type of content (e.g., child-directed-speech, educational, etc.) data-source: Original… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/babylm-fa-subtitles.

sourceHugging Faceunknownupdated 1y agoView on Hugging Face

0likes28downloads

Dataset Card

babylm-fa

Dataset Description

This dataset is part of the BabyLM multilingual collection.

Dataset Summary

—Language: fa
—Script: Latin
—Category: subtitles
—Source: Unknown
—Age Estimate: n/a
—Number of Documents: 41312
—Total Tokens: 249245044

Tokens Per Category

—subtitles: 249245044 tokens

Data Fields

—text: The document text
—category: Type of content (e.g., child-directed-speech, educational, etc.)
—data-source: Original source of the data
—script: Writing system used
—age-estimate: Target age or age range
—license: Data license
—misc: Additional metadata (JSON string)
—num_tokens: Number of tokens in the subtitle file

Licensing Information

This dataset is licensed under: See individual files

Citation

Please cite the original data source: Unknown