llama2-tokenizer / tokenizer.json

Commit History

LLaMA2 Tokenizer in HF format
ee3fc8f

Henk717 commited on