WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
Abstract
Interactive world models require responding in real time to versatile controls and maintaining long-horizon consistency. However, modeling heterogeneous controls remains difficult, while explosive contexts and unstable distillation impede achieving both long-horizon consistency and real-time responsiveness. In this paper, we present WorldPlay2, an interactive world model that couples a factorized hybrid control interface with a co-design of compressed memory and stable distillation. 1) Our factorized hybrid control interface integrates frame-aligned action control with structured semantic control that explicitly disentangles scene appearance, character identity, and dynamic semantic events, thereby facilitating effective control learning. 2) To achieve efficient long-horizon modeling, we compress historical contexts into compact memory tokens shared by the autoregressive student and the bidirectional teacher. This design enables clip-wise, memory-conditioned score evaluation instead of jointly processing an entire long rollout, substantially reducing distillation overhead. 3) We further propose Stable Forcing, which initializes the autoregressive student via a few-step strategy and leverages full-rollout replay to preserve the quality of long-horizon rollouts, ensuring robust and stable distillation. Extensive experiments demonstrate the strong generalizability of our model and its superior performance compared to existing methods.
Community
WorldPlay2 generalizes across scenes and characters, achieving long-horizon consistency alongside flexible control.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Alaya-EVOKE: From Linear-Scaling Supervision to Endless World (2026)
- ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models (2026)
- Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control (2026)
- MiniWorld: Democratizing the Training of Video World Models from Scratch (2026)
- Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory (2026)
- Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming (2026)
- WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.35560 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper