Hugging Face's logo

TatarNLPWorld
/
TatarTokenizer

Tatar
tokenizer
tatar-language
wordpiece
unigram
bpe
bbpe
huggingface
Model card Files
xet
 Community
TatarTokenizer

Commit History

Rename README.MD to README.md
dd61853
verified

ArabovMK commited on

Create README.MD
dbd156e
verified

ArabovMK commited on

Upload test_results/top10_score_ru.png with huggingface_hub
577d066
verified

ArabovMK commited on

Upload test_results/comparison_ru.png with huggingface_hub
f21dcdb
verified

ArabovMK commited on

Upload test_results/top10_score_en.png with huggingface_hub
7ec251a
verified

ArabovMK commited on

Upload test_results/correlation_en.png with huggingface_hub
193ffab
verified

ArabovMK commited on

Upload test_results/token_length_dist_en.png with huggingface_hub
128182b
verified

ArabovMK commited on

Upload test_results/correlation_ru.png with huggingface_hub
d403a3d
verified

ArabovMK commited on

Upload test_results/token_length_dist_ru.png with huggingface_hub
e052155
verified

ArabovMK commited on

Upload test_results/comparison_en.png with huggingface_hub
8a79572
verified

ArabovMK commited on

Upload test_results/test_summary_20260310_202532.txt with huggingface_hub
c3f2cee
verified

ArabovMK commited on

Upload test_results/tokenizer_test_report.csv with huggingface_hub
affd411
verified

ArabovMK commited on

Upload tokenizers/bpe_fixed/50k/bpe_fixed_50k.json with huggingface_hub
a0e255e
verified

ArabovMK commited on

Upload tokenizers/bbpe_fixed/50k/bbpe_fixed_50k.json with huggingface_hub
c316497
verified

ArabovMK commited on

Upload tokenizers/bbpe/25k/bbpe_25k.json with huggingface_hub
5bee8e1
verified

ArabovMK commited on

Upload tokenizers/bbpe/50k/bbpe_50k.json with huggingface_hub
e820fd9
verified

ArabovMK commited on

Upload tokenizers/bpe/50k_freq5/bpe_50k_freq5.json with huggingface_hub
06579c6
verified

ArabovMK commited on

Upload tokenizers/bpe/50k/bpe_50k.json with huggingface_hub
48c03ca
verified

ArabovMK commited on

Upload tokenizers/unigram/25k/uni_25k.json with huggingface_hub
24dcb4d
verified

ArabovMK commited on

Upload tokenizers/unigram/50k/uni_50k.json with huggingface_hub
43cd1a5
verified

ArabovMK commited on

Upload tokenizers/wordpiece/25k/wp_25k.json with huggingface_hub
bd67f94
verified

ArabovMK commited on

Upload tokenizers/wordpiece/50k/wp_50k.json with huggingface_hub
c57f5e1
verified

ArabovMK commited on

initial commit
24d5ace
verified

ArabovMK commited on