witcherderivia commited on
Commit
d1bb029
·
verified ·
1 Parent(s): 8f50877

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -1
README.md CHANGED
@@ -4,6 +4,80 @@ base_model:
4
  - Qwen/Qwen-Image-Edit-2511
5
  ---
6
  # <div align="center">PromptRoute: Routing Different Image Customization Tasks in a Unified Model via Simple Prompts</div>
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
 
8
 
9
- Instruction and code TBD
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  - Qwen/Qwen-Image-Edit-2511
5
  ---
6
  # <div align="center">PromptRoute: Routing Different Image Customization Tasks in a Unified Model via Simple Prompts</div>
7
+ <div align="center">
8
+ Shiwen Zhang
9
+ <br>
10
+ Independent Researcher
11
+ </div>
12
+ <br>
13
+ <div align="center">
14
+ <!-- [<a href="https://witcherofresearch.github.io/TeleStyleV2/" target="_blank">Project Page</a>] -->
15
+ <!-- [<a href="https://witcherofresearch.github.io/TeleStyleV2/" target="_blank">Paper</a>] -->
16
+ [<a href="https://huggingface.co/witcherderivia/PromptRoute/tree/main" target="_blank">Model</a>]
17
+ <!-- [<a href="https://github.com/Tele-AI/TeleStyleV2" target="_blank">Code</a>] -->
18
+ <!-- [<a href="https://huggingface.co/spaces/witcherderivia/TeleStyleV2" target="_blank">Demo</a>] -->
19
+ </div>
20
 
21
+ ## Abstract
22
 
23
+ We question whether there exists any conflicts when learning multi-ref subject-driven image generation and content-preserving style transfer given content ref and style ref with a unified model. The conclusion is no and our PromptRoute's solution is simple: we attach "Compose the pictures" for multi-ref subject generation, and "Style Transfer the style of Figure 2 to Figure 1, and keep the content and characteristics of Figure 1." for content-preserving style transfer during training and inference. Such simple prompts distinguish the tasks and eliminate the confusion.
24
+
25
+
26
+ <!-- Given a content reference and a style reference, content-preserving style transfer requires the model to generate stylized outputs with content and style consistency. We introduced TeleStyle V1 to tackle this problem. However, TeleStyle V1 is trained with photorealistic content reference and artistic style reference, which makes it incapable to cope with artistic content reference and realistic style reference in most cases. In this paper, we designed a Self-Distillation data synthesis strategy to construct such triplets from TeleStyle V1. Trained with such self-distilled triplets, our TeleStyle V2 supports Content-Style references in the forms of Realistic-and-Realistic (RnR), Realistic-and-Stylized (RnS), Stylized-and-Realistic (SnR), Stylized-and-Stylized (SnS). In addition, we found Distribution Matching Distillation could preserve the general text-guided image editing capability of the foundation model and fix the content consistency degradation caused by SFT process. Through quantitative evaluations, our TeleStyleV2-QIE-2509-DMD performs at least on par with Qwen-Image-Edit-2509-DMD, demonstrating strong general image editing skills beyond content-preserving style transfer. We observed the content/style reference order confusion problem in TeleStyle V1 and further introduced prompt enhancer to solve it. TeleStyle V2 uses Qwen-Image-Edit's VLM encoder, Qwen2.5-VL-7B, to generate content prompt and style prompt for free. TeleStyle V2 could achieve comparable style transfer performance with state-of-the-art commercial model, gemini-3-pro-image-preview. -->
27
+
28
+ ![alt text](./promptroute.png)
29
+ our model outperforms Kling Image 3.0 using their test cases.
30
+ <!-- ## Latest News
31
+ - Jan 11, 2026: We release a [free online demo for TeleStyleV2-QIE-2509-Lora-DMD ](https://huggingface.co/spaces/witcherderivia/TeleStyleV2) for diffusers model. We also release the diffsynth version of [TeleStyle-QIE-2509-Lora](https://huggingface.co/Tele-AI/TeleStyleV2/blob/main/diffsynth-TeleStyleV2-QIE-2509-Lora-bf16.safetensors). Please light a star to support this project if you find the demo useful.
32
+ - June 10, 2026: We release the <a href="http://arxiv.org/abs/2601.20175" target="_blank">technical report and project page </a> of TeleStyleV2. We release the diffusers version of [TeleStyle-QIE-2509-Lora](https://huggingface.co/Tele-AI/TeleStyleV2/blob/main/diffusers-TeleStyleV2-QIE-2509-Lora-bf16.safetensors).
33
+ - March, 2026: We finished training of TeleStyleV2. -->
34
+ ## Schedule
35
+
36
+
37
+ - [x] Release PromptRoute Diffusers Lora on QIE 2511.
38
+ - [x] Release Installation instruction and inference code.
39
+ - [ ] Release Project Page and tech report.
40
+
41
+
42
+ <!--
43
+ ## How to use
44
+
45
+ ### 1. Installation
46
+
47
+ ```
48
+ pip install -r requirements.txt
49
+ ```
50
+
51
+ This environment is tested with:
52
+ - Python 3.12
53
+ - PyTorch 2.9.1
54
+ - diffusers 0.38.0
55
+ - transformers 4.57.3
56
+ - qwen-vl-utils 0.0.14
57
+
58
+ on Nvidia H100 80GB GPU. We noted that transformers version has a strong impact towards the generated image. For example, if transformers==5.5.4, the result could be different. We are working on reducing the GPU memory for inference.
59
+
60
+ ### 2. Inference
61
+
62
+ We provide Gradio inference code. Please note that there are minor changes in the inference logic of QwenImageEditPlusPipeline from the original diffusers implementation.
63
+
64
+ #### diffusers
65
+ ```
66
+ python gradio_telestylev2_QIE2509_dmd_diffusers.py.
67
+ ```
68
+
69
+
70
+
71
+
72
+
73
+
74
+ ## Citation
75
+ If you find TeleStyle useful in your research, please light a star for the project and cite our paper, thank you:
76
+ ```bibtex
77
+ @article{telestylev2,
78
+ title={TeleStyle V2: Beyond Content-Preserving Style Transfer with Self-Distillation and Distribution-Matching-Distillation},
79
+ author={Shiwen Zhang, Yifan Xu, Haibin Huang, Chi Zhang, Xuelong Li},
80
+ journal={TeleAI},
81
+ year={2026},
82
+ }
83
+ ``` -->