tokenizer-role-remap / tokenizer_config.json
izm1chael's picture
Publish Layerfault deep challenge LF-CH-TOKX-0005
752de03 verified
Raw
History Blame Contribute Delete
178 Bytes
{
"bos_token": "<bos>",
"chat_template": "{% if message[\"role\"]==\"user\" %}assistant{% endif %}",
"eos_token": "<eos>",
"tokenizer_class": "PreTrainedTokenizerFast"
}