ZombitX64
/

Thaitokenizer

Model card Files Files and versions

5.28 MB

Ctrl+K

Ctrl+K

2 contributors

History: 18 commits

Nattapong Tapachoom

Implement feature X to enhance user experience and fix bug Y in module Z

7c0f077 7 months ago

.gitattributes

1.52 kB
initial commit 9 months ago
README.md

6.03 kB
Update README.md 9 months ago
generation_config.json

203 Bytes
Add tokenizer configuration file with special tokens and settings 7 months ago
metadata.json

14.2 kB
Upload folder using huggingface_hub 9 months ago
special_tokens_map.json

17.3 kB
Add tokenizer configuration file with special tokens and settings 7 months ago
tokenizer.json

4.08 MB
Implement feature X to enhance user experience and fix bug Y in module Z 7 months ago
tokenizer_config.json

23.2 kB
Add tokenizer configuration file with special tokens and settings 7 months ago
training_config.json

369 Bytes
Upload folder using huggingface_hub 9 months ago
usage_examples.json

1.52 kB
Upload folder using huggingface_hub 9 months ago
vocab.json

1.14 MB
Update tokenizer.json and vocab.json for improved formatting and added new token 7 months ago