Commit History

Document transformers<5.4 requirement for AutoTokenizer + add v5.4+ NucEL_Tokenizer fallback snippet
0c80298
verified

FreakingPotato commited on

Sync model card with GitHub README: detailed architecture, benchmarks, AutoTokenizer quickstart
7293081
verified

FreakingPotato commited on

Add auto_map so AutoTokenizer.from_pretrained works with trust_remote_code=True
55bb92e
verified

FreakingPotato commited on

Add NucEL_Tokenizer source for auto_map (matches GitHub repo)
5bde0cb
verified

FreakingPotato commited on

Upload tokenizer_config.json with huggingface_hub
723b30c
verified

FreakingPotato commited on

Upload README.md with huggingface_hub
fc3c6c9
verified

FreakingPotato commited on

Upload config.json with huggingface_hub
a4e6e2f
verified

FreakingPotato commited on

Upload tokenizer_config.json with huggingface_hub
aade361
verified

FreakingPotato commited on

Upload tokenizer.py with huggingface_hub
b77d27f
verified

FreakingPotato commited on

Update README.md
5249136
verified

FreakingPotato commited on

Update README.md
6583a3a
verified

FreakingPotato commited on

Upload NucEL model with comprehensive documentation
b7905a0
verified

FreakingPotato commited on

initial commit
6e87381
verified

FreakingPotato commited on