Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

ace-1
/
mgpt2-tokenizer

Model card Files Files and versions
xet
Community
mgpt2-tokenizer / tokenizer
  • 1 contributor
History: 2 commits
ace-1's picture
ace-1
Fix transformers v5 auto_map + HF init
16fed5d verified 7 days ago
  • __init__.py
    351 Bytes
    Upload mgpt2 tokenizer 20 days ago
  • base.py
    6.69 kB
    Upload mgpt2 tokenizer 20 days ago
  • basic.py
    2 kB
    Upload mgpt2 tokenizer 20 days ago
  • gpt4.py
    4.49 kB
    Upload mgpt2 tokenizer 20 days ago
  • hf_tokenizer.py
    3.57 kB
    Fix transformers v5 auto_map + HF init 7 days ago
  • patterns.py
    725 Bytes
    Upload mgpt2 tokenizer 20 days ago
  • regex_tokenizer.py
    9.44 kB
    Upload mgpt2 tokenizer 20 days ago