Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

hf-internal-testing
/
test-two-tokenizers

Model card Files Files and versions
xet
Community
test-two-tokenizers
1.15 MB
  • 1 contributor
History: 2 commits
sgugger's picture
sgugger
Initial commit
d19581c about 4 years ago
  • .gitattributes
    1.18 kB
    initial commit about 4 years ago
  • special_tokens_map.json
    112 Bytes
    Initial commit about 4 years ago
  • tokenizer.4.0.0.json
    501 kB
    Initial commit about 4 years ago
  • tokenizer.json
    436 kB
    Initial commit about 4 years ago
  • tokenizer_config.json
    370 Bytes
    Initial commit about 4 years ago
  • vocab.txt
    213 kB
    Initial commit about 4 years ago