Hugging Face's logo

flexitok
/
supertokenizer-script_1

Model card Files
xet
 Community
gsaltintas commited on
Commit
ce235b5
·
verified ·
1 Parent(s): 9d933c2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -2,7 +2,7 @@
2
 
3
  A merged super-vocabulary built from 11 tokenizer(s).
4
 
5
- **Vocab size:** 163711
6
 
7
  ## Tokenizers
8
 
 
2
 
3
  A merged super-vocabulary built from 11 tokenizer(s).
4
 
5
+ **Vocab size:** 165022
6
 
7
  ## Tokenizers
8