Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

JonusNattapong
/
thai-bpe-tokenizer-E

Model card Files Files and versions
xet
Community
thai-bpe-tokenizer-E
7.17 MB
  • 1 contributor
History: 6 commits
JonusNattapong's picture
JonusNattapong
Upload tokenizer.json
d171d28 verified 4 months ago
  • .gitattributes
    1.52 kB
    initial commit 4 months ago
  • special_tokens_map.json
    2.7 kB
    Update special_tokens_map.json 4 months ago
  • tokenizer.json
    5.09 MB
    Upload tokenizer.json 4 months ago
  • tokenizer_config.json
    23.5 kB
    Update tokenizer_config.json 4 months ago
  • vocab.txt
    2.06 MB
    Upload folder using huggingface_hub 4 months ago