nmstech
/

turk-tokenizer

Model card Files Files and versions

turk-tokenizer / turk_tokenizer /data

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

nmstech's picture

Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%

ca41c16 verified 5 days ago

zemberek-full.jar

31.6 MB
xet

Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92% 5 days ago