Modelpublic

amazon/FalconLite

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

171likes150downloads

special_tokens_map.json24 linesDownload Raw Back to root

1{2  "additional_special_tokens": [3    ">>COMMENT<<",4    "<|system|>",5    "<|prefix_end|>",6    "<|prefix_begin|>",7    "<|assistant|>",8    ">>MIDDLE<<",9    "<|prompter|>",10    ">>ANSWER<<",11    ">>ABSTRACT<<",12    ">>DOMAIN<<",13    ">>TITLE<<",14    ">>SUMMARY<<",15    ">>QUESTION<<",16    ">>INTRODUCTION<<",17    ">>PREFIX<<",18    ">>SUFFIX<<"19  ],20  "eos_token": "<|endoftext|>",21  "pad_token": "<|endoftext|>",22  "sep_token": "<|endoftext|>"23}24