llama2_tokenizer / tokenizer_config.json

Commit History

copied from hf-internal-testing/llama-tokenizer
bca45fa

rpowalski commited on