Transformers
LastTransformer commited on
Commit
dc562bf
·
verified ·
1 Parent(s): 6984b77

Deploy native SentencePiece-backed 16K Unigram tokenizer with verified space preservation.

Browse files
Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff