ZombitX64
/

Thaitokenizer

Model card Files Files and versions

5.09 MB

Ctrl+K

Ctrl+K

2 contributors

History: 17 commits

Nattapong Tapachoom

Update tokenizer.json and vocab.json for improved formatting and added new token

bf83b0d 8 months ago

.gitattributes

1.52 kB
initial commit 10 months ago
README.md

6.03 kB
Update README.md 10 months ago
generation_config.json

203 Bytes
Add tokenizer configuration file with special tokens and settings 8 months ago
metadata.json

14.2 kB
Upload folder using huggingface_hub 10 months ago
special_tokens_map.json

17.3 kB
Add tokenizer configuration file with special tokens and settings 8 months ago
tokenizer.json

3.89 MB
Update tokenizer.json and vocab.json for improved formatting and added new token 8 months ago
tokenizer_config.json

23.2 kB
Add tokenizer configuration file with special tokens and settings 8 months ago
training_config.json

369 Bytes
Upload folder using huggingface_hub 10 months ago
usage_examples.json

1.52 kB
Upload folder using huggingface_hub 10 months ago
vocab.json

1.14 MB
Update tokenizer.json and vocab.json for improved formatting and added new token 8 months ago