Ethosoft
/

NedoTurkishTokenizer

Model card Files Files and versions

NedoTurkishTokenizer / tests

Ctrl+K

Ctrl+K

6 contributors

History: 2 commits

Ethosoft

Refactor to standalone v2.0: zero dependencies, internal engine, removed zemberek/hf wrapper

edec8b7 19 days ago

test_tokenizer.py

17.3 kB
Refactor to standalone v2.0: zero dependencies, internal engine, removed zemberek/hf wrapper 19 days ago