CoolFace
18 results

BPE Tokenizer

inallmodelsdatasetsappsagentspeopleprojects

Models

All models matching “BPE Tokenizer”
interlinguistic-language-modeling /BabyLM-130M-ilm_it-ilm_pl-tokenizer_ilm_bilingual_it_pl_bpe_trailing_ws_32000text-generationtransformers3 likes298 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_eu-tokenizer_ilm_mono_eu_bpe_32000text-generationtransformers0 likes173 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_es-tokenizer_ilm_mono_es_bpe_32000text-generationtransformers0 likes166 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_it-tokenizer_ilm_mono_it_bpe_32000text-generationtransformers0 likes165 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_pl-tokenizer_ilm_mono_pl_bpe_32000text-generationtransformers0 likes161 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_sl-tokenizer_ilm_mono_sl_bpe_32000text-generationtransformers0 likes157 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_eu-ilm_it-tokenizer_ilm_bilingual_eu_it_bpe_32000text-generationtransformers0 likes156 downloads5mo agoHugging Faceinterlinguistic-language-modeling /BabyLM-130M-ilm_pl-ilm_sl-tokenizer_ilm_bilingual_pl_sl_bpe_32000text-generationtransformers0 likes155 downloads5mo agoHugging Face

Datasets

All datasets matching “BPE Tokenizer”
yvonne90190 /allenai_olmo2_superbpe_10G_1M_tokenizer_tulu-3-sft-olmo-2-mixture-0225-bpe-to-superbpesamples processed: 866138 Total user BPE tokens: 252198220 Total assistant BPE tokens: 402038966 Total assistant SuperBPE tokens: 198274197 Assistant reduction vs BPE = 50.68284077717979% 0 likes17 downloads1y agoHugging FaceGregoryD /bigcode-bpe-tokenizer0 likes6 downloads3y agoHugging FaceMouadGhouti /bpe-tokenizer0 likes5 downloads2y agoHugging Facetokenizer-eval /universal-bpegatedtext10M<n<100M0 likes1 downloads5mo agoHugging Face

Apps

All apps matching “BPE Tokenizer”
saicharan2804 /BpeTokenizergradio0 likes3y agoHugging Facesayanbanerjee32 /bengali_bpe_tokenizergradio0 likes2y agoHugging Faceaakashv100 /hindi-tokenizer-bpegradio0 likes2y agoHugging Facecrpatel /Gujarati-BPE-Tokenizerdocker0 likes2y agoHugging FaceHSinghHuggingFace /hindi-bpe-tokenizerstreamlit0 likes2y agoHugging Facechbsaikiran /Hindi_BPE_Tokenizergradio0 likes2y agoHugging Face