KoboldAI
/

llama2-tokenizer

Model card Files Files and versions

llama2-tokenizer / tokenizer_config.json

Commit History

BOS off by default

2216092

Henk717 commited on Nov 8, 2023

LLaMA2 Tokenizer in HF format

ee3fc8f

Henk717 commited on Nov 8, 2023