Modelpublic

diffusionfamily/diffullama

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

14likes355downloads

special_tokens_map.json27 linesDownload Raw Back to root

1{2  "bos_token": {3    "content": "<s>",4    "lstrip": false,5    "normalized": false,6    "rstrip": false,7    "single_word": false8  },9  "eos_token": {10    "content": "</s>",11    "lstrip": false,12    "normalized": false,13    "rstrip": false,14    "single_word": false15  },16  "mask_token": "ти",17  "pad_token": "¨",18  "sep_token": "========",19  "unk_token": {20    "content": "<unk>",21    "lstrip": false,22    "normalized": false,23    "rstrip": false,24    "single_word": false25  }26}27