eliebak
/

smoltokenizer

Model card Files Files and versions

smoltokenizer / tokenizer_config.json

Commit History

commit of fast smoltokenizer

fddfcaa

eliebak HF Staff commited on Apr 30, 2024

Initial commit of smoltokenizer

c969ba6

eliebak HF Staff commited on Apr 28, 2024