Hugging Face's logo

TatarNLPWorld
/
TatarTokenizer

Tatar
tokenizer
tatar-language
wordpiece
unigram
bpe
bbpe
huggingface
Model card Files
xet
 Community
TatarTokenizer / tokenizers /bpe /50k

Commit History

Upload tokenizers/bpe/50k/bpe_50k.json with huggingface_hub
48c03ca
verified

ArabovMK commited on