Datasetpublic

BabyLM-community/babylm-ar-subtitles

babylm-ara Dataset Description This dataset is part of the BabyLM multilingual collection. Dataset Summary Language: ara Script: Unknown Number of Documents: 65951 Total Tokens: 399142332 Tokens Per Category subtitles: 399142332 tokens Data Fields text: The document text doc_id: Unique identifier for the document category: Type of content (e.g., child-directed-speech, educational, etc.) data-source: Original source… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/babylm-ar-subtitles.

sourceHugging Faceunknownupdated 1y agoView on Hugging Face

0likes43downloads

Dataset Card

babylm-ara

Dataset Description

This dataset is part of the BabyLM multilingual collection.

Dataset Summary

—Language: ara
—Script: Unknown
—Number of Documents: 65951
—Total Tokens: 399142332

Tokens Per Category

—subtitles: 399142332 tokens

Data Fields

—text: The document text
—doc_id: Unique identifier for the document
—category: Type of content (e.g., child-directed-speech, educational, etc.)
—data-source: Original source of the data
—script: Writing system used
—age-estimate: Target age or age range
—license: Data license
—misc: Additional metadata (JSON string)
—num_tokens: Number of tokens per item (based on white-space split)

Licensing Information

This dataset is licensed under: See individual files

Citation

Please cite the original data source: Unknown