Modelpublic

ASTERIZER/LUNA-Tokenizer

sourceHugging Facecc-by-nc-nd-4.0updated 26d agoView on Hugging Face

0likes67downloads

7 commits on main

b948acc26d ago

Add CC BY-NC-ND 4.0 license

REZIRETSA

d35070a26d ago

Apply CC BY-NC-ND 4.0 license

REZIRETSA

99bdaa826d ago

Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

REZIRETSA

31bc00726d ago

Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

REZIRETSA

be9a0fa26d ago

Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

REZIRETSA

196d10226d ago

Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

REZIRETSA

36643cf26d ago

initial commit

REZIRETSA