Hugging Face's logo

flexitok
/
supertokenizer-mod_tokenizers_zero_padded

Model card Files
xet
Community
supertokenizer-mod_tokenizers_zero_padded
File size: 28 Bytes
833dbb4
 
 
1
2
3
 
model:
  vocab_size: 110931