Modelpublic

FrontiersMind/Nandi-Mini-150M-Instruct

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

52likes173downloads

tokenizer_config.json11 linesDownload Raw Back to root

1{2  "backend": "tokenizers",3  "bos_token": "<|im_start|>",4  "eos_token": "<|endoftext|>",5  "is_local": true,6  "model_max_length": 2048,7  "pad_token": "<|endoftext|>",8  "tokenizer_class": "TokenizersBackend",9  "unk_token": "<|endoftext|>"10}11