Modelpublic

kaizerBox/ReFormer-small-summarization

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes32downloads

special_tokens_map.json20 linesDownload Raw Back to root

1{2  "bos_token": "<|endoftext|>",3  "eos_token": "<|endoftext|>",4  "pad_token": {5    "content": "<|pad|>",6    "lstrip": false,7    "normalized": false,8    "rstrip": false,9    "single_word": false10  },11  "sep_token": {12    "content": "<|sep|>",13    "lstrip": false,14    "normalized": false,15    "rstrip": false,16    "single_word": false17  },18  "unk_token": "<|endoftext|>"19}20