good model
#1
by
Roman1111111 - opened
The dataset mentioned is all that was used 🥴
intersting
Yea it's confusing to me as well why it would just identify as gemini like that lmfao
I haven't actually tried this fine-tune yet but I did see similar behavior when I ran a different qwen3.5 27B fine tune accidentally with a system prompt that had an embedded identity from another model.
This model seems to really strongly hold to the system prompt. Could you possibly have used a system prompt stating it's Gemini?
System prompt was that it had access to coding environment, etc whatever was in the system prompt for the dataset. Makes sense system prompting matters here with this model. It's still very good at what it does, just a bit silly and overthinky
