Papers
arxiv:2608.07565

What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems

Published on Aug 3
· Submitted by
Bingnan Li
on Aug 11
Authors:
,
,
,

Abstract

A three-stage multimodal framework improves follow-up edit recommendations in image-creation conversations by combining supervised fine-tuning, multi-objective reinforcement learning, and visual verification.

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05).

Community

Paper author Paper submitter

Image-generation conversations rarely end after a single turn—but suggesting what users should edit next requires more than text-only recommendation. In this work, we study follow-up edit suggestions grounded in the current image and user intent. An analysis of 100,000 real-world conversations shows that 80.1% of follow-up interactions are image-dependent. We introduce a three-stage framework combining human-reviewed intent construction, multi-objective reinforcement learning from user click feedback, and a visual verifier that penalizes suggestions inconsistent with the image. In a large-scale online A/B test involving millions of users, our approach reduces visual inconsistency from 3.7% to 0.9%, while improving recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns by 39.90%. These results highlight visually aligned follow-up suggestions as a practical way to make image-creation assistants more helpful, engaging, and easier to continue using.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.07565
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.07565 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.07565 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.07565 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.