ravis2k6/tamil_bpe_tokenizer

updated app.py

updated merge and vocab files

Improved requirements.txt

Improved tokenization analysis

Added Space configuration to README

Added Tamil BPE tokenizer files and Gradio interface

initial commit