Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Roy029
/
sno_replace_desc_py2500_tokenizer

Model card Files Files and versions
xet
Community
sno_replace_desc_py2500_tokenizer
3.54 MB
  • 2 contributors
History: 2 commits
Kajiura Teruno
tokenizer replace rareword to py2500
2ec27f6 over 2 years ago
  • .gitattributes
    1.52 kB
    initial commit over 2 years ago
  • sno_replace_desc_25k.zip
    426 kB
    xet
    tokenizer replace rareword to py2500 over 2 years ago
  • sno_replace_desc_table2500.jsonl
    2.26 MB
    tokenizer replace rareword to py2500 over 2 years ago
  • special_tokens_map.json
    74 Bytes
    tokenizer replace rareword to py2500 over 2 years ago
  • spiece.model
    853 kB
    xet
    tokenizer replace rareword to py2500 over 2 years ago
  • tokenizer_config.json
    301 Bytes
    tokenizer replace rareword to py2500 over 2 years ago