llama2-tokenizer / tokenizer.model

Commit History

LLaMA2 Tokenizer in HF format
ee3fc8f

Henk717 commited on