Ethosoft
/

NedoTurkishTokenizer

Token Classification

nedo-turkish-tokenizer

Model card Files Files and versions

NedoTurkishTokenizer / tokenizer_config.json

Commit History

Rename project from TurkTokenizer to NedoTurkishTokenizer

cfffd93

nmstech Claude Opus 4.6 commited on 1 day ago

Add AutoTokenizer support (trust_remote_code)

be2f46e
verified

nmstech commited on 3 days ago

Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%

a0e8f24
verified

nmstech commited on 3 days ago