Ethosoft
/

NedoTurkishTokenizer

Token Classification

nedo-turkish-tokenizer

Model card Files Files and versions

NedoTurkishTokenizer / nedo_turkish_tokenizer

32.4 MB

Ctrl+K

Ctrl+K

2 contributors

History: 4 commits

nmstech's picture

Upload folder using huggingface_hub

532470d verified about 21 hours ago

data
Delete nedo_turkish_tokenizer/data/zemberek_yeni.jar 3 days ago
__init__.py

700 Bytes
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_acronym_dict.py

4.83 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_allomorph.py

2.23 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_compound.py

2.95 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_context_aware.py

2.09 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_java_check.py

2.48 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_medical_vocab.py

7.06 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_normalizer.py

10.7 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_preprocessor.py

8.86 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_root_validator.py

6.68 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
_suffix_expander.py

8.39 kB
Upload folder using huggingface_hub about 21 hours ago
_tdk_vocab.py

3.82 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago
tokenizer.py

12.7 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer 3 days ago