Excellent model - short feedback
Hi dear Z.AI team.
I want to congratulate you on the release of this model. This is a model that runs super fast and efficient on most consumer PCs while also delivering fantastic quality for its size.
It is also groundbreaking in some ways, like being one of the first smaller local models that uses MLA. It is good in roleplay and creative writing. Really good logic too, it can solve many of my trick questions.
Now for potential improvements:
I did notice that when setting reasoning budget to 0 (basically turning off thinking) in rare cases the model would still sneak a thought process in there or start with cutoff sentences. Maybe that can be improved by feeding it more non-thinking data? Not a big deal though because it's rare, but it can happen.
Some people say the model likes to loop at higher context, I cannot confirm nor deny it, but it would be a good idea to investigate anyway. Repetition and looping is a general problem in this model size. Any improvements are very welcome.
In roleplaying it is very sensitive to my writing. If my writing is repetitive over multiple turns, the output suddenly becomes very deterministic (e.g. multiple regenerations lead to almost the same result or text is the same/very similar to previous assistant turn) even though my sampler settings are of course not deterministic at all.
German language is decent but not always grammatically correct or natural. Still far away from older ChatGPT models like 3.5.
Missing multimodality. Now I'm aware a GLM 4.7V-Flash is probably coming, but as usual that will probably compromise text generation quality. What I would like to see is native multimodality (e.g. model is pretrained on text, video, audio etc.) and have all GLM models support vision at the very least. Similar to Gemma 3 or Mistral Small 3.2 which are also natively multimodal without compromising text gen performance.
Thank you for reading my feedback, I wish you all a wonderful day!
Awesome ways
congratulations