tocsa/llama2-7b-chipdesign-domain-tokenizer

Domain-adapted tokenizer (chip-design vocab extension over the Llama-2 tokenizer, see 02customtokenizertraining). Final high-frequency-filtered tokenizer (tokenizerfreq.model).