Datasetpublic

miguelcsx/babylm-bbpe16k-512-encoded

BabyLM BBPE16K 512 Encoded Corpus Encoded NumPy arrays for CausalFocus-GPTBERT-D256-BBPE16K. source corpus: miguelcsx/babylm-corpus-cleaned tokenizer: miguelcsx/causal-focus-bbpe16k-tokenizer sequence length target: 512 splits: train, validation

sourceHugging Faceotherupdated 3mo agoView on Hugging Face

0likes39downloads

Dataset Card

BabyLM BBPE16K 512 Encoded Corpus

Encoded NumPy arrays for CausalFocus-GPTBERT-D256-BBPE16K.

—source corpus: miguelcsx/babylm-corpus-cleaned
—tokenizer: miguelcsx/causal-focus-bbpe16k-tokenizer
—sequence length target: 512
—splits: train, validation