Modelpublic

hf-tiny-v2/tiny-random-CLIPTextModel

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes16downloads

tokenizer_config.json15 linesDownload Raw Back to root

1{2  "add_prefix_space": false,3  "backend": "tokenizers",4  "bos_token": "<|startoftext|>",5  "do_lower_case": true,6  "eos_token": "<|endoftext|>",7  "errors": "replace",8  "is_local": true,9  "local_files_only": false,10  "model_max_length": 512,11  "pad_token": "<|endoftext|>",12  "tokenizer_class": "CLIPTokenizer",13  "unk_token": "<|endoftext|>"14}15