Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
arabovs-ai-lab
/
TatarTokenizers
like
0
Follow
Arabovs AI Research Lab
2
Tatar
tatar
tokenizers
nlp
language-modeling
sentencepiece
bpe
unigram
wordpiece
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
TatarTokenizers
3.83 MB
Ctrl+K
Ctrl+K
1 contributor
History:
21 commits
ArabovMK
Update README.md
dfec518
verified
4 months ago
bpe
Upload bpe/tokenizer_config.json with huggingface_hub
4 months ago
sentencepiece
Upload sentencepiece/tokenizer_config.json with huggingface_hub
4 months ago
unigram
Upload unigram/tokenizer_config.json with huggingface_hub
4 months ago
wordpiece
Upload wordpiece/tokenizer_config.json with huggingface_hub
4 months ago
.gitattributes
Safe
1.52 kB
initial commit
4 months ago
README.md
9.69 kB
Update README.md
4 months ago
best_models.json
Safe
2.02 kB
Upload best_models.json with huggingface_hub
4 months ago
training_summary.json
Safe
9.16 kB
Upload training_summary.json with huggingface_hub
4 months ago
