MT Forcing: Towards Stable and Consistent Multi-Turn Image Editing with Autoregressive Diffusion
Abstract
MT Forcing improves multi-turn image editing by combining single-turn distribution matching distillation and teacher-forcing guidance to stabilize visual quality and preserve cross-turn consistency.
Multi-turn image editing aims to modify an image according to a sequence of instructions, enabling more effective interactive visual content creation for users. However, existing methods often exhibit noticeable drift after only a few editing turns, manifesting in two aspects: 1) unstable visual quality, with accumulating artifacts and degraded details; and 2) inconsistent image content, with unintended changes to preserved regions and prior edits. To address these challenges, we propose MT Forcing, a novel training paradigm for multi-turn image editing with unified multimodal models (UMMs) based on autoregressive diffusion. Specifically, we propose Single-Turn Distribution Matching Distillation (Single-Turn DMD), which supervises student self-rollouts with a teacher that applies cumulative edits to the source image in a single turn, providing visual-quality guidance without recursive error accumulation. Additionally, we introduce Teacher-Forcing Guidance, which supervises history-dependent transitions on reference trajectories during warmup and as a regularizer during distillation, encouraging cross-turn content consistency beyond what per-turn distribution matching alone can ensure. Extensive experiments demonstrate that our approach significantly improves the multi-turn image editing capabilities of UMMs, yielding more stable visual quality and stronger cross-turn consistency.
Community
Introducing MT Forcing: towards stable and consistent multi-turn image editing with autoregressive diffusion.
Image editing models often produce good results in a single turn, yet accumulate artifacts and lose previously established details over successive edits. MT Forcing addresses both visual degradation and content drift through two complementary training signals:
- Single-Turn DMD trains on student self-rollouts, using a teacher that applies cumulative editing instructions directly to the original image in one turn.
- Teacher-Forcing Guidance uses consistent reference trajectories for warmup and regularization, helping preserve content across turns.
On MTEdit-Bench, applying MT Forcing to SenseNova-U1.5 improves eight-turn average instruction following from 8.47 to 9.66 and content consistency from 7.09 to 8.40.
Explore the project page for interactive comparisons and a 15-turn editing demo!
๐ค Model weights: https://huggingface.co/houyuanchen/MT-Forcing
Get this paper in your agent:
hf papers read 2610.25404 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper