Datasetpublic

miguelcsx/babylm-bbpe16k-512-structured-priors

BabyLM BBPE16K 512 Structured Priors Structured syntax/lexical prior arrays for the CausalFocus direct-sum ablations. encoded corpus: miguelcsx/babylm-bbpe16k-512-encoded tokenizer: miguelcsx/causal-focus-bbpe16k-tokenizer syntax neighbors: directional immediate-context sketch lexical neighbors: symmetric context-window sketch k: 8 clusters: 512

sourceHugging Faceotherupdated 3mo agoView on Hugging Face

0likes50downloads

Dataset Card

BabyLM BBPE16K 512 Structured Priors

Structured syntax/lexical prior arrays for the CausalFocus direct-sum ablations.

—encoded corpus: miguelcsx/babylm-bbpe16k-512-encoded
—tokenizer: miguelcsx/causal-focus-bbpe16k-tokenizer
—syntax neighbors: directional immediate-context sketch
—lexical neighbors: symmetric context-window sketch
—k: 8
—clusters: 512