Commit History

  1. Document transformers<5.4 requirement for AutoTokenizer + add v5.4+ NucEL_Tokenizer fallback snippet

    Verified signature
    0c80298
  2. Sync model card with GitHub README: detailed architecture, benchmarks, AutoTokenizer quickstart

    Verified signature
    7293081
  3. Add auto_map so AutoTokenizer.from_pretrained works with trust_remote_code=True

    Verified signature
    55bb92e
  4. Add NucEL_Tokenizer source for auto_map (matches GitHub repo)

    Verified signature
    5bde0cb

  1. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    723b30c
  2. Upload README.md with huggingface_hub

    Verified signature
    fc3c6c9
  3. Upload config.json with huggingface_hub

    Verified signature
    a4e6e2f
  4. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    aade361
  5. Upload tokenizer.py with huggingface_hub

    Verified signature
    b77d27f

  1. Update README.md

    Verified signature
    5249136
  2. Update README.md

    Verified signature
    6583a3a
  3. Upload NucEL model with comprehensive documentation

    Verified signature
    b7905a0
  4. initial commit

    Verified signature
    6e87381