Humair332
/

gpt-style-50k-tokenizer

Model card Files Files and versions

gpt-style-50k-tokenizer / tokenizer.json

zuhri025's picture

feat: inject 80 sound/paralinguistic tags as single added_tokens

f746a59 verified 3 months ago

4.14 MB

File too large to display, you can check the raw version instead.