Very interesting and unique model
I know it's supposed to basically be a model for discussing specific political ideas but just using it in any roleplay scenario I find that it has its own style of writing that is different from any RP finetune I've tried (most of them output the same sloppa with mildly different wordings) or base Nemo itself. Refreshingly unique while still maintaining a very usable level of intelligence so long as you are not overly liberal with token sampling. I hope there will be more experiments like this.
We actually found this too (we're mostly a roleplay org we just do actual science sometimes)! A lot of it, I think, is from training on Kimi synth data that was specifically not in the RP realm, so it didn't overfit to the specific Kimi RP phrases while still having that sort of """Kimi style""" to it
also you best not be overly liberal with sampling this is a TANKIE model. we are strictly anti-revisionist in this house!!! /j
Hah, also I forgot to mention it but I found the model because I was looking at the UGI leaderboard and this was the model with the lowest "semantic redundancy" score in the 12B size (and very low compared to any size really), suggesting it doesn't really repeat itself much using different phrases to say the same thing again which is a pretty big Nemo problem.
annoyingly this model seems to have done good on the ugi leaderboard at everything but a non-liberal political tilt, with the og kimi still beating it out
I continue to be irritatingly wrong about character training /silly