Humair332
/

gpt-style-50k-tokenizer

Model card Files Files and versions

gpt-style-50k-tokenizer / tokenizer.json

Commit History

feat: inject 80 sound/paralinguistic tags as single added_tokens

f746a59
verified

zuhri025 commited on May 24

Upload tokenizer

cef7f4e
verified

Humair332 commited on Apr 14