SmolVLM-Instruct-INT4-quantized / chat_template.jinja
Azaz666's picture
INT4 quantization of HuggingFaceTB/SmolVLM-Instruct (LLM backbone quantized, vision encoder fp16)
113fe69 verified
raw
history blame contribute delete
403 Bytes
<|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance>
{% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %}