ZombitX64
/

Thaitokenizer

Model card Files Files and versions

5.28 MB

2 contributors

History: 18 commits

Nattapong Tapachoom

Implement feature X to enhance user experience and fix bug Y in module Z

7c0f077 4 months ago

.gitattributes
1.52 kB

initial commit 6 months ago
README.md
6.03 kB

Update README.md 6 months ago
generation_config.json
203 Bytes

Add tokenizer configuration file with special tokens and settings 4 months ago
metadata.json
14.2 kB

Upload folder using huggingface_hub 6 months ago
special_tokens_map.json
17.3 kB

Add tokenizer configuration file with special tokens and settings 4 months ago
tokenizer.json
4.08 MB

Implement feature X to enhance user experience and fix bug Y in module Z 4 months ago
tokenizer_config.json
23.2 kB

Add tokenizer configuration file with special tokens and settings 4 months ago
training_config.json
369 Bytes

Upload folder using huggingface_hub 6 months ago
usage_examples.json
1.52 kB

Upload folder using huggingface_hub 6 months ago
vocab.json
1.14 MB

Update tokenizer.json and vocab.json for improved formatting and added new token 4 months ago