Mnttnt21/tokenizer-bench
0
Prepare for Hugging Face Spaces deployment
Make image deployable on free container hosts
Add Korean (Kiwi), Japanese (Sudachi), Thai ASO-dict, and CJK n-gram engines
Add PyThaiNLP (newmm) engine for Thai
Add "Highlight differences" toggle to per-keyword table
Tokenizer bench for Asolytics meta editor