Modelpublic

cijov/cijov-lang-tokenizer

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

0likes

4 commits on main

1fc6f144mo ago

Fix: lowercase username in README (cijov/cijov-lang-tokenizer)

cijov

a8d81e54mo ago

Fix: correct repo URL casing in README

cijov

7a956c24mo ago

Initial release: Cijov-lang Tokenizer v1.0 - Multilingual BPE (EN/FR/ES/RO)

cijov

272a35c4mo ago

initial commit

cijov