Transformers
English
medical
health
llama
llama2

Chat template for 13B/70B-chat

#1
by vera-bernhard - opened

Hi there

I was wondering which chat template did you employ for fine-tuning? I noticed in your How to use-Section in the README on Github, you don't mention any chat template.

Looking at the ME-LLaMA-70B-chat model repositories, there is a chat template defined in the tokenizer_config.json, namely the same template as for its backbone Llama-2-70b-chat. However, there is no chat template defined in the tokenizer_config.jsonfor the ME-LLaMA-13B-chat model.

Could you clarify whether ME-LLaMA-13B/17B-chat requires a chat template for proper interaction, and if so, which one? Without this information, it’s difficult to use the model effectively.

Thanks

vera-bernhard changed discussion title from Chat template for 13B / 70B to Chat template for 13B/70B-chat

Sign up or log in to comment