Hugging Face's logo

isaacus
/
kanon-2-tokenizer

English
legal
Model card Files
xet
 Community
kanon-2-tokenizer

Commit History

fix: drop `special_tokens_map.json` to fix transformers v5
c53b842
verified

umarbutler commited on

docs: rewording
2e8da5c
verified

umarbutler commited on

docs: add README
b3c05d9
verified

umarbutler commited on

feat: increase context window
f213a8b
verified

umarbutler commited on

feat: increase context window
e458fa8
verified

umarbutler commited on

Added Kanon 2's tokenizer.
d5c6acb
verified

umarbutler commited on

initial commit
3f61691
verified

umarbutler commited on