Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
TatarNLPWorld
/
TatarTokenizer
like
0
Follow
Tatar NLP Community / Natural Language Processing for Tatar Language
1
Tatar
tokenizer
tatar-language
wordpiece
unigram
bpe
bbpe
huggingface
License:
mit
Model card
Files
Files and versions
xet
Community
main
TatarTokenizer
/
test_results
894 kB
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
ArabovMK
Upload test_results/top10_score_ru.png with huggingface_hub
577d066
verified
10 days ago
comparison_en.png
142 kB
xet
Upload test_results/comparison_en.png with huggingface_hub
10 days ago
comparison_ru.png
145 kB
xet
Upload test_results/comparison_ru.png with huggingface_hub
10 days ago
correlation_en.png
136 kB
xet
Upload test_results/correlation_en.png with huggingface_hub
10 days ago
correlation_ru.png
136 kB
xet
Upload test_results/correlation_ru.png with huggingface_hub
10 days ago
test_summary_20260310_202532.txt
893 Bytes
Upload test_results/test_summary_20260310_202532.txt with huggingface_hub
10 days ago
token_length_dist_en.png
128 kB
xet
Upload test_results/token_length_dist_en.png with huggingface_hub
10 days ago
token_length_dist_ru.png
125 kB
xet
Upload test_results/token_length_dist_ru.png with huggingface_hub
10 days ago
tokenizer_test_report.csv
3.61 kB
Upload test_results/tokenizer_test_report.csv with huggingface_hub
10 days ago
top10_score_en.png
39 kB
Upload test_results/top10_score_en.png with huggingface_hub
10 days ago
top10_score_ru.png
39.4 kB
Upload test_results/top10_score_ru.png with huggingface_hub
10 days ago
