Papers
arxiv:2608.30530

WebWorld: The Browser as a World Model for Self-Improving Web Code

Published on Aug 31
¡ Submitted by
Jian Yang
on Sep 1
Authors:
,
,
,
,
,
,
,
,
,

Abstract

WebWorld uses a browser as an executable world model to certify web code repairs via interaction contracts, enabling autonomous VLM self-improvement with verified supervision.

VLM-driven self-improvement of web code has a structural flaw: the model that proposes the repair is the model that judges it, and visual plausibility under that judge is a poor proxy for whether the page actually works. What the loop is missing is a counterparty the VLM cannot fool, and the browser already is that counterparty: a deterministic, executable simulator of how an HTML artifact behaves under user actions, and in everything but name a world model for web code. We present WebWorld, the interface that lets a VLM prior interact with this browser-as-world-model autonomously and decides which interactions become supervision. Each round, the VLM emits a critique that the planner compiles into a typed interaction contract; the browser re-executes the candidate and issues an acceptance certificate only when both target progress and preservation of every previously verified capability hold; certified transitions accumulate as a quality ratchet that is the only thing the SFT export ever sees. Under matched training, WebWorld-27B improves Raw-27B by 5.3 points on HTMLBench-400 and 14.9 points on MiniAppBench-Val, and reaches the level of strong frontier systems such as Kimi-K2.6 and GPT-5.4 on interactive HTML generation. Equal-size ablations show that browser-backed admission carries the gain: without the certificate, the matched 9B lift nearly disappears.

Community

Paper submitter

🌐 This paper introduces WebWorld, a system that fundamentally resolves the structural flaw of VLM-driven web-code self-improvement—where the same model acts as both proposer and judge—by treating the browser as a deterministic, executable world model; the core mechanism strictly confines the VLM to hypothesis generation, mandating that every candidate repair must be re-executed by the browser and issued an acceptance certificate (requiring both target progress and preservation of all prior capabilities) before entering the SFT training pool, thereby shifting supervision from visual plausibility to verifiable behavioral evidence. Experiments show that this mechanism boosts a 27B model by 5.3 points on HTMLBench-400 and 14.9 points on MiniAppBench-Val, reaching frontier performance on par with Kimi-K2.6 and GPT-5.4, while ablation studies reveal that removing the browser certificate collapses the gain to merely 0.4 points—strongly demonstrating that only world-model-backed certified transitions can provide genuinely reliable supervision for self-improving web code.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.30530
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.30530 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.30530 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.30530 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.