Hugging Face's logo

sigil-ml
/
WikipediaBPETokenizer

Model card Files
xet
Community
WikipediaBPETokenizer
844 kB
  • 1 contributor
 History: 3 commits
sdwalker62's picture
sdwalker62
Rename bpe_tokenizer.json to tokenizer.json
37b9e7d verified