Hugging Face's logo

cahya
/
nusa-tokenizer

Transformers
Model card Files
xet
Community
nusa-tokenizer / tokenizer_config.json

Commit History

set max sec length to 8192
1b125c4

libeanim commited on

Upload tokenizer
065eb75
verified

cahya commited on

Upload tokenizer
1124493
verified

cahya commited on

Upload tokenizer
ff9010d
verified

cahya commited on

Upload tokenizer
989c7ab
verified

cahya commited on