Hugging Face's logo

TatarNLPWorld
/
TatarTokenizer

Tatar
tokenizer
tatar-language
wordpiece
unigram
bpe
bbpe
huggingface
Model card Files
xet
 Community
TatarTokenizer / tokenizers

Commit History

Upload tokenizers/bpe_fixed/50k/bpe_fixed_50k.json with huggingface_hub
a0e255e
verified

ArabovMK commited on

Upload tokenizers/bbpe_fixed/50k/bbpe_fixed_50k.json with huggingface_hub
c316497
verified

ArabovMK commited on

Upload tokenizers/bbpe/25k/bbpe_25k.json with huggingface_hub
5bee8e1
verified

ArabovMK commited on

Upload tokenizers/bbpe/50k/bbpe_50k.json with huggingface_hub
e820fd9
verified

ArabovMK commited on

Upload tokenizers/bpe/50k_freq5/bpe_50k_freq5.json with huggingface_hub
06579c6
verified

ArabovMK commited on

Upload tokenizers/bpe/50k/bpe_50k.json with huggingface_hub
48c03ca
verified

ArabovMK commited on

Upload tokenizers/unigram/25k/uni_25k.json with huggingface_hub
24dcb4d
verified

ArabovMK commited on

Upload tokenizers/unigram/50k/uni_50k.json with huggingface_hub
43cd1a5
verified

ArabovMK commited on

Upload tokenizers/wordpiece/25k/wp_25k.json with huggingface_hub
bd67f94
verified

ArabovMK commited on

Upload tokenizers/wordpiece/50k/wp_50k.json with huggingface_hub
c57f5e1
verified

ArabovMK commited on