benchmaxxed

#11
by Tom-Neverwinter - opened

the too good to be true alarms are going off. has to be another benchmaxxed or misleading model. I doubt it has the specs claimed.

it's an extremely impressive agentic model for its size, I have been using it

this model is impressive. I use Qwen 3.6 35b-a3b and Qwen 3.6 27b every day, and I can tell you this model is here to stay. It beats the 35b handsdown, but is now also progressing through 14-stage workflows that have been challenging for the 27b. I'm now putting it up to long-term challenges.

this model is impressive. I use Qwen 3.6 35b-a3b and Qwen 3.6 27b every day, and I can tell you this model is here to stay. It beats the 35b handsdown, but is now also progressing through 14-stage workflows that have been challenging for the 27b. I'm now putting it up to long-term challenges.

I hope you update us about the results of your tests. I hope this model really is something worth using.

What about comparison with Qwen's own AgentWorld, which was released like two days prior? It is identically insanely good at toolcalls, and has not had a miss on anything thrown at it on my end. Is this a secondary party's implementation of what Qwen (apparently) set out to build with AgentWorld? Both look insanely good, but I have only tried AW and not AA1... apparently models trained on simulating a terminal-output aware environment is such a game changer. As even AW under a harness of any sort is like 10 lightyears ahead of what we just had a few months ago with normal (non-agent) models. Actually incredibly impressive for Hermes/Openclaw/Pis/etc

Intern Science org

What about comparison with Qwen's own AgentWorld, which was released like two days prior? It is identically insanely good at toolcalls, and has not had a miss on anything thrown at it on my end. Is this a secondary party's implementation of what Qwen (apparently) set out to build with AgentWorld? Both look insanely good, but I have only tried AW and not AA1... apparently models trained on simulating a terminal-output aware environment is such a game changer. As even AW under a harness of any sort is like 10 lightyears ahead of what we just had a few months ago with normal (non-agent) models. Actually incredibly impressive for Hermes/Openclaw/Pis/etc

Thanks for the attention! I also think AgentWorld is very impressive. My understanding is that AgentWorld starts from the idea of training models with simulated real-world feedback, and surprisingly obtains a base model with quite strong agentic capabilities.

Agents-A1 is a bit different: as we mentioned in our technical report, it is post-trained based on Qwen3.5, and is mainly optimized for agentic search and scientific reasoning tasks.

Both directions are very exciting, and Iโ€™d love to hear your real hands-on feedback if you get a chance to try Agents-A1.

Sign up or log in to comment