Modelpublic

hf-tiny-model-private/tiny-random-ReformerModel

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes20downloads

tokenizer_config.json11 linesDownload Raw Back to root

1{2  "additional_special_tokens": [],3  "clean_up_tokenization_spaces": true,4  "eos_token": "</s>",5  "model_max_length": 100,6  "sp_model_kwargs": {},7  "special_tokens_map_file": null,8  "tokenizer_class": "ReformerTokenizer",9  "unk_token": "<unk>"10}11