Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
arabovs-ai-lab
/
TatarTokenizers
like
0
Follow
Arabovs AI Research Lab
2
Tatar
tatar
tokenizers
nlp
language-modeling
sentencepiece
bpe
unigram
wordpiece
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
TatarTokenizers
3.83 MB
1 contributor
History:
21 commits
ArabovMK
Update README.md
dfec518
verified
about 1 month ago
bpe
Upload bpe/tokenizer_config.json with huggingface_hub
about 1 month ago
sentencepiece
Upload sentencepiece/tokenizer_config.json with huggingface_hub
about 1 month ago
unigram
Upload unigram/tokenizer_config.json with huggingface_hub
about 1 month ago
wordpiece
Upload wordpiece/tokenizer_config.json with huggingface_hub
about 1 month ago
.gitattributes
1.52 kB
initial commit
about 1 month ago
README.md
9.69 kB
Update README.md
about 1 month ago
best_models.json
2.02 kB
Upload best_models.json with huggingface_hub
about 1 month ago
training_summary.json
9.16 kB
Upload training_summary.json with huggingface_hub
about 1 month ago