Aurora-Proelia-ChatML / tokenizer_config.json
arthu1's picture
Fix normal Transformers inference loading
01cfd4f verified
Raw
History Blame Contribute Delete
391 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast",
"bos_token": "<bos>",
"eos_token": "<eos>",
"pad_token": "<pad>",
"model_max_length": 2048,
"clean_up_tokenization_spaces": false,
"chat_template": "{% for message in messages %}<|im_start|>{{ message['role'] }}\n{{ message['content'] }}<|im_end|>\n{% endfor %}{% if add_generation_prompt %}<|im_start|>assistant\n{% endif %}"
}