CoolFace
Modelpublic

He-Tag/smallm-125m

sourceHugging Faceapache-2.0updated 5d agoView on Hugging Face
2likes382downloads
tokenizer_config.json11 linesDownload Raw Back to root
1{2  "tokenizer_class": "PreTrainedTokenizerFast",3  "eos_token": "<|im_end|>",4  "pad_token": "<|endoftext|>",5  "unk_token": null,6  "bos_token": null,7  "model_max_length": 1024,8  "clean_up_tokenization_spaces": false,9  "chat_template": "{% for message in messages %}{{ '<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n' }}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}"10}11