ASTERIZER
/

LUNA-Tokenizer

Token Classification

text-generation

Model card Files Files and versions

LUNA-Tokenizer / README.md

Commit History

Apply CC BY-NC-ND 4.0 license

d35070a
verified

REZIRETSA commited on 4 days ago

Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

196d102
verified

REZIRETSA commited on 4 days ago