Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
nmstech
/
turk-tokenizer
like
0
Turkish
turk-tokenizer
tokenizer
morphology
turkish
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
main
turk-tokenizer
/
turk_tokenizer
/
_normalizer.py
Commit History
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
ca41c16
verified
nmstech
commited on
5 days ago
nmstech commited on 