Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
KoboldAI
/
llama2-tokenizer
like
2
Follow
KoboldAI
554
License:
llama2
Model card
Files
Files and versions
xet
Community
main
llama2-tokenizer
/
tokenizer_config.json
Commit History
BOS off by default
2216092
Henk717
commited on
Nov 8, 2023
LLaMA2 Tokenizer in HF format
ee3fc8f
Henk717
commited on
Nov 8, 2023