Hugging Face's logo

toksuite
/
tokenmonster-englishcode-32000-consistent-v1

Text Generation
Transformers
Safetensors
llama
toksuite
tokenization
tokenmonster
subword
research
robustness
text-generation-inference
Model card Files
xet
Community
tokenmonster-englishcode-32000-consistent-v1

Commit History

Update README.md
e504c56
verified

gsaltintas commited on

Update README.md
3d5a0ad
verified

Malikeh1375 commited on

Upload model-performance-comparison.png
f636cb5
verified

Malikeh1375 commited on

Update README.md
de310e8
verified

Malikeh1375 commited on

Update README.md
f2c0eb1
verified

Malikeh1375 commited on

Update README.md
86083ff
verified

Malikeh1375 commited on

Update README.md
4b75a37
verified

Malikeh1375 commited on

Update README.md
7591aa9
verified

Malikeh1375 commited on

Upload toksuite-logo.png
269429d
verified

Malikeh1375 commited on

Upload config
94734e9
verified

gsaltintas commited on

Upload model files
84501bc
verified

gsaltintas commited on

Upload tokenizer file tokenmonster--englishcode-32000-consistent-v1.yaml - Upload model files
5cd02bc
verified

gsaltintas commited on

Upload tokenizer file tokenmonster--englishcode-32000-consistent-v1_vocab.json - Upload model files
80b85c8
verified

gsaltintas commited on

Upload tokenizer file tokenmonster--englishcode-32000-consistent-v1_super_mapping.json - Upload model files
a71ce92
verified

gsaltintas commited on

Upload tokenizer file tokenmonster--englishcode-32000-consistent-v1_info.json - Upload model files
1a98b00
verified

gsaltintas commited on

initial commit
2316e8b
verified

gsaltintas commited on