Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

kgrabko
/
JiRackTokenizer

Model card Files Files and versions
xet
Community
JiRackTokenizer
Ctrl+K
Ctrl+K
  • 1 contributor
History: 27 commits
kgrabko's picture
kgrabko
Update README.md
74bf3a9 verified 3 days ago
  • .gitattributes
    1.57 kB
    Initial upload of JiRackTokenizer about 1 month ago
  • JiRackTernaryPyTorch_1b.py
    6.62 kB
    Update JiRackTernaryPyTorch_1b.py 3 days ago
  • LICENSE
    3.28 kB
    Update LICENSE about 1 month ago
  • README.md
    2.55 kB
    Update README.md 3 days ago
  • TestTokenizerSize.py
    194 Bytes
    Rename TestTokenizer.py to TestTokenizerSize.py 3 days ago
  • copy_weights.py
    2.64 kB
    Update copy_weights.py 3 days ago
  • special_tokens_map.json
    301 Bytes
    Initial upload of JiRackTokenizer about 1 month ago
  • tokenizer.json
    17.2 MB
    xet
    Initial upload of JiRackTokenizer about 1 month ago
  • tokenizer_config.json
    378 Bytes
    updated upload of JiRackTokenizer with improvement for ML 3 days ago