This is a fine tuned mistral uploaded for use in an moe merge. I'll add more info later, this is NOT from a contaminated data set. It is just a DPO dataset from here on huggingface run on a mistral, nothing more.

Downloads last month
3
Safetensors
Model size
7B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support