Add tokenizer configuration
#1
by nopperl - opened
Adds tokenizer configuration and sets the chat_template from allenai/OLMo-7B-Instruct.
ref https://github.com/ggerganov/llama.cpp/pull/6910#issuecomment-2100366560.
nopperl changed pull request title from add-tokenizer-config to Add tokenizer configuration
nopperl changed pull request status to open
lsetiawan changed pull request status to merged