Missed chat_template
#7
by cfytrok - opened
chat_template is missing in tokenizer_config.json.
Calling AutoTokenizer.apply_chat_template raises the error
ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed! For information about writing templates and setting the tokenizer.chat_template attribute, please see the documentation at https://huggingface.co/docs/transformers/main/en/chat_templating
Unable to count the number of tokens for the chat.