Hugging Face's logo

eljanmahammadli
/
turkic-tokenizers

sentencepiece
tokenizers
bpe
turkic
turkish
azerbaijani
kazakh
uzbek
kyrgyz
multilingual
Model card Files
xet
 Community
turkic-tokenizers

Commit History

Initial release: 24 SentencePiece tokenizers for Turkic languages
00c3a73
verified

eljanmahammadli commited on