Modelpublic

OrHaifler3/bloom1b-forms

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes19downloads

tokenizer_config.json12 linesDownload Raw Back to root

1{2  "add_prefix_space": false,3  "bos_token": "<s>",4  "clean_up_tokenization_spaces": false,5  "eos_token": "</s>",6  "model_max_length": 1000000000000000019884624838656,7  "pad_token": "<pad>",8  "padding_side": "left",9  "tokenizer_class": "BloomTokenizer",10  "unk_token": "<unk>"11}12