Pair a vision grounding model with a reasoning LLM with Cua
Cua just shipped v0.4 of the Cua Agent framework with Composite Agents - you can now pair a vision/grounding model with a reasoning LLM using a simple modelA+modelB syntax. Best clicks + best plans.
The problem: every GUI model speaks a different dialect. • some want pixel coordinates • others want percentages • a few spit out cursed tokens like <|loc095|>
We built a universal interface that works the same across Anthropic, OpenAI, Hugging Face, etc.:
This gives GUI skills to models that were never built for computer use. One handles the eyes/hands, the other the brain. Think driver + navigator working together.
Two specialists beat one generalist. We’ve got a ready-to-run notebook demo - curious what combos you all will try.