CoolFace
Modelpublic

phonemetransformers/GPT2-85M-BPE-TXT

sourceHugging Faceupdated 1y agoView on Hugging Face
1likes570downloads
Model Card

GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer.

Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.