metadata
license: cc-by-nc-4.0
tags:
- merge
Finetune of cookinai/CM-14 with the teknium/openhermes dataset. My first finetune, might have some bugs/overfitting, might reupload
Previous model had stopping token errors causing issues with the final token in the ChatML preset. This finetuning job should fix any prompt template errors. Please tell me if you get any such errors.
Heard that this error is common amongst heavily merged macaroni models. Might try to stray away from them in the future or dilute them with other models.