dbuos
/

wordpiece_tokenizer

Model card Files Files and versions

wordpiece_tokenizer / tokenizer.json

dbuos's picture

Simple WordPiece Tokenizer

3ce491c verified 4 months ago

history contribute delete

569 kB

File too large to display, you can check the raw version instead.