Datasetpublic

babylm-anon/babylm_2024_10m_curriculum

Dataset Card for BabyLM 2024 10M Curriculum The documents from the 10M dataset provided by the 2024 BabyLM challange. We add a validation split we with additional documents from the 100M dataset. The order in which to load this dataset is provided as .pt files (e.g., curriculum.pt or random.pt). Pretraining split (train) Stage Words Documents C1: Child Directed Speech 2839591 28.53% 580000 49.19% C2: Unscripted Dialogue 1079286 10.84% 108000 9.16%… See the full description on the dataset page: https://huggingface.co/datasets/babylm-anon/babylm_2024_10m_curriculum.

sourceHugging Facecc-by-sa-4.0updated 1y agoView on Hugging Face

0likes1kdownloads

root

dirdata/

file.gitattributes2 KBdownload

fileinfo.json302 Bdownload

filellama_incr_influence_epoch_repetition.pt130.9 MBdownload

filellama_influence_decr_bins_dirac.pt90.0 MBdownload

filellama_influence_decr_bins_lognorm.pt90.0 MBdownload

filellama_influence_decr_cp_dirac.pt90.0 MBdownload

filellama_influence_decr_cp_lognorm.pt90.0 MBdownload

filellama_influence_epoch_repetition.pt130.9 MBdownload

filellama_influence_incr_bins_dirac.pt90.0 MBdownload

filellama_influence_incr_bins_lognorm.pt90.0 MBdownload

filellama_influence_incr_cp_dirac.pt90.0 MBdownload

filellama_influence_incr_cp_lognorm.pt90.0 MBdownload

filellama_influence_top_50_cp_shuffled.pt156.2 MBdownload

filellama_influence_tracin_sandwich.pt90.0 MBdownload

filemattr_increasing.pt90.0 MBdownload

fileperplexity_increasing.pt90.0 MBdownload

filerandom.pt90.0 MBdownload

fileREADME.md3 KBdownload

fileroberta_incr_influence_epoch_repetition.pt114.8 MBdownload

fileroberta_influence_decr_bins_dirac.pt90.0 MBdownload

fileroberta_influence_decr_bins_lognorm.pt90.0 MBdownload

fileroberta_influence_decr_cp_dirac.pt90.0 MBdownload

fileroberta_influence_decr_cp_lognorm.pt90.0 MBdownload

fileroberta_influence_epoch_repetition.pt114.8 MBdownload

fileroberta_influence_incr_bins_dirac.pt90.0 MBdownload

fileroberta_influence_incr_bins_lognorm.pt90.0 MBdownload

fileroberta_influence_incr_cp_dirac.pt90.0 MBdownload

fileroberta_influence_incr_cp_lognorm.pt90.0 MBdownload

fileroberta_influence_top_50_cp_shuffled.pt90.1 MBdownload

fileroberta_influence_tracin_sandwich.pt90.0 MBdownload

filesource_difficulty.pt84.1 MBdownload

babylm-anon/babylm_2024_10m_curriculum · main · files are served by the source, never re-hosted here