dbuos
/

wordpiece_tokenizer

Model card Files Files and versions

wordpiece_tokenizer / tokenizer_config.json

Commit History

Simple WordPiece Tokenizer

3ce491c
verified

dbuos commited on Oct 5, 2025