muzaffercky/kurdish-kurmanji-tokenizer

Update encoding and decoding example

Create config.json

Update README.md

Update README.md (#1)

Specify version to download

Remove byte level as pre-tokenizer

Pass model name to tokenizer

Create README.md

Upload tokenizer.json

initial commit