thai-nlp-toolkit / tokenizer

Commit History

Upload tokenizer/__init__.py with huggingface_hub
6505294
verified

puttimej commited on

Upload tokenizer/preprocess.py with huggingface_hub
fa4fbbd
verified

puttimej commited on

Upload tokenizer/thai_tokenizer.py with huggingface_hub
276f94b
verified

puttimej commited on

Upload tokenizer/tokenizer_config.json with huggingface_hub
18e411d
verified

puttimej commited on

Upload tokenizer/thai_bpe.model with huggingface_hub
ce7fb3e
verified

puttimej commited on