Datasetpublic

babylm-anon/stratified_10m_curriculum

Dataset Card for Stratified 10M Curriculum This is a stratified split by domain of the raw datasets used by the 2024 BabyLM challange. Sampled from the original datasets, equal amounts of tokens for each stage (C1,...C5). Child-directed speech accounts for nearly half of the original dataset by word count. In preliminary experiments using a training data influence estimation method, this category was by far the most influential. This dataset enables us to investigate whether… See the full description on the dataset page: https://huggingface.co/datasets/babylm-anon/stratified_10m_curriculum.

sourceHugging Facecc-by-sa-4.0updated 1y agoView on Hugging Face

0likes1.3kdownloads

root

dirdata/

file.gitattributes2 KBdownload

filedirac_llama.pt81.7 MBdownload

filedirac_positive_only_llama.pt66.2 MBdownload

filedirac_positive_only.pt61.9 MBdownload

filedirac.pt81.7 MBdownload

fileinfluential_examples_early_llama.pt81.7 MBdownload

fileinfluential_examples_early.pt81.7 MBdownload

fileinfluential_examples_first_half_llama.pt81.7 MBdownload

fileinfluential_examples_first_half.pt81.7 MBdownload

fileinfluential_examples_first_third_llama.pt81.7 MBdownload

fileinfluential_examples_first_third.pt81.7 MBdownload

fileinfluential_examples_sandwich_llama.pt81.7 MBdownload

fileinfluential_examples_sandwich.pt81.7 MBdownload

fileinfo.json388 Bdownload

filellama_incr_influence_epoch_repetition.pt101.9 MBdownload

filellama_influence_decr_bins_dirac.pt81.7 MBdownload

filellama_influence_decr_bins_lognorm.pt81.7 MBdownload

filellama_influence_decr_cp_dirac.pt81.7 MBdownload

filellama_influence_decr_cp_lognorm.pt81.7 MBdownload

filellama_influence_epoch_repetition.pt101.9 MBdownload

filellama_influence_incr_bins_dirac.pt81.7 MBdownload

filellama_influence_incr_bins_lognorm.pt81.7 MBdownload

filellama_influence_incr_cp_dirac.pt81.7 MBdownload

filellama_influence_incr_cp_lognorm.pt81.7 MBdownload

filellama_influence_top_50_cp_shuffled.pt84.1 MBdownload

filellama_influence_tracin_sandwich.pt81.7 MBdownload

filelognorm_llama.pt81.7 MBdownload

filelognorm_order_top_50_pct.pt40.8 MBdownload

filelognorm_top_50_pct_llama.pt40.8 MBdownload

filelognorm_top_50_pct_shuffled_llama.pt40.8 MBdownload

filelognorm_top_50_pct_shuffled.pt40.8 MBdownload

filelognorm_top_50_pct_twice_shuffled.pt81.7 MBdownload

filelognorm_top_50_pct.pt40.8 MBdownload

filelognorm.pt81.7 MBdownload

filemattr_increasing.pt81.7 MBdownload

fileperplexity_increasing.pt81.7 MBdownload

filerandom.pt81.7 MBdownload

fileREADME.md4 KBdownload

fileroberta_incr_influence_epoch_repetition.pt96.1 MBdownload

fileroberta_influence_decr_bins_dirac.pt81.7 MBdownload

fileroberta_influence_decr_bins_lognorm.pt81.7 MBdownload

fileroberta_influence_decr_cp_dirac.pt81.7 MBdownload

fileroberta_influence_epoch_repetition.pt96.1 MBdownload

fileroberta_influence_incr_bins_dirac.pt81.7 MBdownload

fileroberta_influence_incr_bins_lognorm.pt81.7 MBdownload

fileroberta_influence_incr_cp_dirac.pt81.7 MBdownload

fileroberta_influence_top_50_cp_shuffled.pt63.8 MBdownload

fileroberta_influence_tracin_sandwich.pt81.7 MBdownload

filesource_difficulty.pt81.7 MBdownload

filetop_90_full_epoch_shuffled.pt61.9 MBdownload

babylm-anon/stratified_10m_curriculum · main · files are served by the source, never re-hosted here