sound-tokenizer / tokenizer.json

Commit History

feat: GPT-style 50k tokenizer + 80 sound/paralinguistic tags
ccce676
verified

zuhri025 commited on

feat: GPT-style 50k tokenizer — <|reserved_N|> → 80 sound tags
ca0b7b3
verified

zuhri025 commited on

feat: GPT-style 50k tokenizer with 80 sound/paralinguistic tags
e5a8896
verified

zuhri025 commited on