heilerich
/

llama-tokenizer-fast

Model card Files Files and versions

llama-tokenizer-fast / tokenizer_config.json

Commit History

Upload tokenizer

e16f8e0

heilerich commited on Jun 1, 2023