Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

aci-mis-team
/
qwen2_tokenizer_modified_2

Transformers
Model card Files Files and versions
xet
Community
qwen2_tokenizer_modified_2
28.1 MB
  • 1 contributor
History: 2 commits
SKNahin's picture
SKNahin
Upload tokenizer
f788e2c verified over 1 year ago
  • .gitattributes
    1.57 kB
    Upload tokenizer over 1 year ago
  • README.md
    5.17 kB
    Upload tokenizer over 1 year ago
  • merges.txt
    6.83 MB
    Upload tokenizer over 1 year ago
  • special_tokens_map.json
    367 Bytes
    Upload tokenizer over 1 year ago
  • tokenizer.json
    16.6 MB
    xet
    Upload tokenizer over 1 year ago
  • tokenizer_config.json
    1.3 kB
    Upload tokenizer over 1 year ago
  • vocab.json
    4.68 MB
    Upload tokenizer over 1 year ago