CoolFace
15 results

superbpe

inallmodelsdatasetsappsagentspeopleprojects

Models

All models matching “superbpe”
UW /OLMo2-8B-SuperBPE-t180ktext-generationtransformersen8 likes321 downloads2y agoHugging Faceyvonne90190 /uw_superbpe_8b_t80k0 likes64 downloads8mo agoHugging FaceUW /OLMo2-11B-SuperBPE-t180ktext-generationtransformersen2 likes55 downloads2y agoHugging Faceyvonne90190 /uw_superbpe_8b_t160k0 likes51 downloads8mo agoHugging FaceUW /OLMo2-8B-SuperBPE-t160ktext-generationtransformersen3 likes47 downloads2y agoHugging Faceyvonne90190 /uw_superbpe_8b_t180k0 likes45 downloads7mo agoHugging FaceUW /OLMo2-8B-SuperBPE-t80ktext-generationtransformersen0 likes32 downloads2y agoHugging Faceparallelm /gpt2_small_AR_superbpe_7909_parallel10_420 likes11 downloads8mo agoHugging Face

Datasets

All datasets matching “superbpe”
okeanosthedev /omega-5B-superbpe128k Omega 5B SuperBPE 128k 70% FineWeb-Edu 15% StarCoder 10% FineMath 5% Gutenberg Tokenizer: alisawuffles/superbpe-tokenizer-128k 128001 gigatoken GB/s Tokens: 5047259136 seq_len 4096 text-generation1M<n<10M0 likes464 downloads1mo agoHugging Facegartland /finewebedu-superbpe-t180K1M<n<10M1 likes238 downloads1y agoHugging Facealexandermorgan /fineweb-edu10B-superbpe50304-3digit FineWeb-Edu 10BT, tokenized with a two-phase 50,304-token SuperBPE vocabulary (3-digit number splitting) All of HuggingFaceFW/fineweb-edu sample-10BT, pre-tokenized in the binary shard format used by modded-nanogpt, with a custom SuperBPE vocabulary trained with BatchBPE (v2) on the same corpus. Phase 1 of the vocabulary split numbers into groups of up to 3 digits (\p{N}{1,3}). This is the baseline in a planned comparison of first-phase digit-splitting rules, with sibling… See the full description on the dataset page: https://huggingface.co/datasets/alexandermorgan/fineweb-edu10B-superbpe50304-3digit.text-generation1B<n<10B0 likes162 downloads3d agoHugging Facegartland /finewebedu-superbpe-t80K1M<n<10M0 likes62 downloads1y agoHugging Facegartland /finewebedu-superbpe1M<n<10M0 likes59 downloads1y agoHugging Facegartland /finewebedu-superbpe-t160K1M<n<10M0 likes29 downloads1y agoHugging Face

Apps

All apps matching “superbpe”
Jhayase /superbpe-tokenizer-playgroundstatic6 likes11mo agoHugging Face