Modelpublic

JasperLS/deberta-v3-base-injection

sourceHugging Facemitupdated 2y agoView on Hugging Face

3likes310downloads

tokenizer_config.json17 linesDownload Raw Back to root

1{2  "bos_token": "[CLS]",3  "clean_up_tokenization_spaces": true,4  "cls_token": "[CLS]",5  "do_lower_case": false,6  "eos_token": "[SEP]",7  "mask_token": "[MASK]",8  "model_max_length": 1000000000000000019884624838656,9  "pad_token": "[PAD]",10  "sep_token": "[SEP]",11  "sp_model_kwargs": {},12  "split_by_punct": false,13  "tokenizer_class": "DebertaV2Tokenizer",14  "unk_token": "[UNK]",15  "vocab_type": "spm"16}17