Hugging Face's logo

TatarNLPWorld
/
TatarTokenizer

Tatar
tokenizer
tatar-language
wordpiece
unigram
bpe
bbpe
huggingface
Model card Files
xet
 Community
TatarTokenizer / tokenizers /bpe

Commit History

Upload tokenizers/bpe/50k_freq5/bpe_50k_freq5.json with huggingface_hub
06579c6
verified

ArabovMK commited on

Upload tokenizers/bpe/50k/bpe_50k.json with huggingface_hub
48c03ca
verified

ArabovMK commited on