flexitok
/

supertokenizer-16k_v2

Model card Files Files and versions

supertokenizer-16k_v2

Commit History

Upload config.yaml with huggingface_hub

381cd83
verified

gsaltintas commited on Apr 16

Upload README.md with huggingface_hub

577de75
verified

gsaltintas commited on Apr 16

Upload config.yaml with huggingface_hub

1e32467
verified

gsaltintas commited on Apr 16

Upload super_vocab.json with huggingface_hub

9324709
verified

gsaltintas commited on Apr 16

initial commit

34d4b1a
verified

gsaltintas commited on Apr 16