gwlms
/

wordpiece-tokenizer

Model card Files Files and versions

wordpiece-tokenizer / tokenizer_config.json

Commit History

tokenizer: add initial config and vocab

2291e32

stefan-it commited on Jul 23, 2023