Modelpublic

neulab/codebert-python

sourceHugging Faceupdated 1y agoView on Hugging Face

28likes333kdownloads

special_tokens_map.json16 linesDownload Raw Back to root

1{2  "bos_token": "<s>",3  "cls_token": "<s>",4  "eos_token": "</s>",5  "mask_token": {6    "content": "<mask>",7    "lstrip": true,8    "normalized": false,9    "rstrip": false,10    "single_word": false11  },12  "pad_token": "<pad>",13  "sep_token": "</s>",14  "unk_token": "<unk>"15}16