Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
nmstech
/
turk-tokenizer
like
0
Turkish
turk-tokenizer
tokenizer
morphology
turkish
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
ca41c16
turk-tokenizer
31.7 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
nmstech
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
ca41c16
verified
about 1 month ago
turk_tokenizer
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
about 1 month ago
.gitattributes
Safe
1.59 kB
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
about 1 month ago
README.md
3.91 kB
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
about 1 month ago
pyproject.toml
1.14 kB
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
about 1 month ago
tokenizer_config.json
299 Bytes
Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%
about 1 month ago
