Modelpublic

Shuu12121/CodeEncoderDecoderModel-Ghost-large

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face

0likes27downloads

rootdecoder_tokenizerspecial_tokens_map.json

special_tokens_map.json13 linesDownload Raw Back to decoder_tokenizer

1{2  "bos_token": "<|endoftext|>",3  "eos_token": "<|endoftext|>",4  "pad_token": {5    "content": "[PAD]",6    "lstrip": false,7    "normalized": false,8    "rstrip": false,9    "single_word": false10  },11  "unk_token": "<|endoftext|>"12}13