Modelpublic

Norm/ERNIE-Layout-Pytorch

sourceHugging Facemitupdated 3y agoView on Hugging Face

16likes5.4kdownloads

tokenizer_config.json11 linesDownload Raw Back to root

1{2  "do_tokenize_postprocess": false,3  "sep_token": "[SEP]",4  "cls_token": "[CLS]",5  "unk_token": "[UNK]",6  "pad_token": "[PAD]",7  "mask_token": "[MASK]",8  "do_lower_case": true,9  "model_max_length": 512,10  "vocab_file": "sentencepiece.bpe.model"11}