Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
arabovs-ai-lab
/
TatarTokenizers
like
0
Follow
Arabovs AI Research Lab
2
Tatar
tatar
tokenizers
nlp
language-modeling
sentencepiece
bpe
unigram
wordpiece
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
TatarTokenizers
/
bpe
632 kB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
ArabovMK
Upload bpe/tokenizer_config.json with huggingface_hub
7796c74
verified
5 months ago
special_tokens_map.json
Safe
132 Bytes
Upload bpe/special_tokens_map.json with huggingface_hub
5 months ago
tokenizer.json
Safe
630 kB
Upload bpe/tokenizer.json with huggingface_hub
5 months ago
tokenizer_config.json
Safe
1.22 kB
Upload bpe/tokenizer_config.json with huggingface_hub
5 months ago
