Hugging Face's logo

LocalDoc
/
az-en-unigram-tokenizer-50k

English
Azerbaijani
sentencepiece
unigram
tokenizer
azerbaijani
english
bilingual
Model card Files
xet
Community
az-en-unigram-tokenizer-50k / tokenizer.json

Commit History

Upload bilingual AZ-EN unigram tokenizer (50k vocab)
1630ba8
verified

vrashad commited on