Salesforce/xgen-7b-4k-base

Update README.md

Update tokenization_xgen.py

Update README.md

Update tokenization_xgen.py (#11)

Update tokenizer_config.json

fix issue in get vocab (#9)

update _convert_id_to_token (#7)

Update generation_config.json

Update README.md

Update README.md

Update README.md

add pad token and default eos token (#6)

Update config.json

Update README.md

Update README.md

Update README.md

.

Update README.md

.

.

.

.

.

.

initial commit