moonshotai

/

Kimi-K2-Instruct

like 2.3k

Follow

Moonshot AI 5.09k

1. standalone chat template file
2. if role is not assistant/system/user and name field in message is set, use name as role.
3. slightly update tool_call declaration to align with tech report.

the chat_template field in tokenizer_config.json should be removed

  {%- if message['role'] == 'system' -%}
    <|im_system|>system<|im_middle|>
  {%- elif message['role'] == 'user' -%}
    <|im_user|>user<|im_middle|>
  {%- elif message['role'] == 'assistant' -%}
    <|im_assistant|>assistant<|im_middle|>
  {%- elif message['role'] == 'tool' -%}
    <|im_system|>tool<|im_middle|>
  {%- else -%}
    {%- if message.get('name') -%}
      <|im_system|>{{ message['name'] }}<|im_middle|>
    {%- endif -%}
  {%- endif -%}

should be

  {%- set role_name =  message.get('name') or  message['role'] -%}
  {%- if message['role'] == 'user' -%}
    <|im_user|>{{role_name}}<|im_middle|>
  {%- elif message['role'] == 'assistant' -%}
    <|im_assistant|>{{role_name}}<|im_middle|>
  {%- else -%}  {# system, tool, and anything else #}
    <|im_system|>{{role_name}}<|im_middle|>
  {% endif %}