Modelpublic

duttaprat/HViLM-base

sourceHugging Faceapache-2.0updated 27d agoView on Hugging Face

0likes193downloads

tokenizer_config.json12 linesDownload Raw Back to root

1{2  "clean_up_tokenization_spaces": true,3  "cls_token": "[CLS]",4  "mask_token": "[MASK]",5  "model_max_length": 1000000000000000019884624838656,6  "pad_token": "[PAD]",7  "sep_token": "[SEP]",8  "token": null,9  "tokenizer_class": "PreTrainedTokenizerFast",10  "unk_token": "[UNK]"11}12