Modelpublic

glaiveai/glaive-function-calling-v2-small

sourceHugging Faceupdated 3y agoView on Hugging Face

15likes69downloads

tokenizer_config.json19 linesDownload Raw Back to root

1{2  "auto_map": {3    "AutoTokenizer": [4      "replit_lm_tokenizer.ReplitLMTokenizer",5      null6    ]7  },8  "bos_token": null,9  "clean_up_tokenization_spaces": false,10  "eos_token": "<|endoftext|>",11  "model_max_length": 2000,12  "pad_token": "<|pad|>",13  "padding_side": "right",14  "sep_token": null,15  "sp_model_kwargs": {},16  "tokenizer_class": "ReplitLMTokenizer",17  "unk_token": "<|unk|>"18}19