OrcaMaid 7B (Merge of NoroMaid 7B (Fine-tuned Mistral 7B) with Orca-2 7B)
#1
by Joseph717171 - opened
Any chance of a OrcaMaid 7B made from the merging of NoroMaid 7B and Orca-2 7B? If possible, the potential for it would be amazing! Combining the intelligence and performance of Mistral 7B with the reasoning and intelligence of Orca-2 7b would be powerful - if it is possible.🤔🤩
Joseph717171 changed discussion title from OrcaMaid 7B (Merge of Mistral 7B with Orca-2 7B) to OrcaMaid 7B (Merge of NoroMaid 7B (Fine-tuned Mistral 7B) with Orca-2 7B)
hey, just saw this. it is possible but it would only have the context length of 4096. also if you're on discord feel free contact me there, i'm "mfunlimited"
That would be fine. With Orca's reasoning abilities and Noromaid 7B's (Fine-tuned Mistral) expansive text-generation - and with a sprinkle of cat, the model would be awesome! 🤩
I second this. Mistrals are great for taking models on the road (laptops etc)