This is a Mistral-instruct-v0.2 model finetuned using DPO on the gutenberg-dpo dataset.
Chat template
Files info