Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,80 @@ base_model:
|
|
| 4 |
- Qwen/Qwen-Image-Edit-2511
|
| 5 |
---
|
| 6 |
# <div align="center">PromptRoute: Routing Different Image Customization Tasks in a Unified Model via Simple Prompts</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
|
|
|
| 8 |
|
| 9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
- Qwen/Qwen-Image-Edit-2511
|
| 5 |
---
|
| 6 |
# <div align="center">PromptRoute: Routing Different Image Customization Tasks in a Unified Model via Simple Prompts</div>
|
| 7 |
+
<div align="center">
|
| 8 |
+
Shiwen Zhang
|
| 9 |
+
<br>
|
| 10 |
+
Independent Researcher
|
| 11 |
+
</div>
|
| 12 |
+
<br>
|
| 13 |
+
<div align="center">
|
| 14 |
+
<!-- [<a href="https://witcherofresearch.github.io/TeleStyleV2/" target="_blank">Project Page</a>] -->
|
| 15 |
+
<!-- [<a href="https://witcherofresearch.github.io/TeleStyleV2/" target="_blank">Paper</a>] -->
|
| 16 |
+
[<a href="https://huggingface.co/witcherderivia/PromptRoute/tree/main" target="_blank">Model</a>]
|
| 17 |
+
<!-- [<a href="https://github.com/Tele-AI/TeleStyleV2" target="_blank">Code</a>] -->
|
| 18 |
+
<!-- [<a href="https://huggingface.co/spaces/witcherderivia/TeleStyleV2" target="_blank">Demo</a>] -->
|
| 19 |
+
</div>
|
| 20 |
|
| 21 |
+
## Abstract
|
| 22 |
|
| 23 |
+
We question whether there exists any conflicts when learning multi-ref subject-driven image generation and content-preserving style transfer given content ref and style ref with a unified model. The conclusion is no and our PromptRoute's solution is simple: we attach "Compose the pictures" for multi-ref subject generation, and "Style Transfer the style of Figure 2 to Figure 1, and keep the content and characteristics of Figure 1." for content-preserving style transfer during training and inference. Such simple prompts distinguish the tasks and eliminate the confusion.
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
<!-- Given a content reference and a style reference, content-preserving style transfer requires the model to generate stylized outputs with content and style consistency. We introduced TeleStyle V1 to tackle this problem. However, TeleStyle V1 is trained with photorealistic content reference and artistic style reference, which makes it incapable to cope with artistic content reference and realistic style reference in most cases. In this paper, we designed a Self-Distillation data synthesis strategy to construct such triplets from TeleStyle V1. Trained with such self-distilled triplets, our TeleStyle V2 supports Content-Style references in the forms of Realistic-and-Realistic (RnR), Realistic-and-Stylized (RnS), Stylized-and-Realistic (SnR), Stylized-and-Stylized (SnS). In addition, we found Distribution Matching Distillation could preserve the general text-guided image editing capability of the foundation model and fix the content consistency degradation caused by SFT process. Through quantitative evaluations, our TeleStyleV2-QIE-2509-DMD performs at least on par with Qwen-Image-Edit-2509-DMD, demonstrating strong general image editing skills beyond content-preserving style transfer. We observed the content/style reference order confusion problem in TeleStyle V1 and further introduced prompt enhancer to solve it. TeleStyle V2 uses Qwen-Image-Edit's VLM encoder, Qwen2.5-VL-7B, to generate content prompt and style prompt for free. TeleStyle V2 could achieve comparable style transfer performance with state-of-the-art commercial model, gemini-3-pro-image-preview. -->
|
| 27 |
+
|
| 28 |
+

|
| 29 |
+
our model outperforms Kling Image 3.0 using their test cases.
|
| 30 |
+
<!-- ## Latest News
|
| 31 |
+
- Jan 11, 2026: We release a [free online demo for TeleStyleV2-QIE-2509-Lora-DMD ](https://huggingface.co/spaces/witcherderivia/TeleStyleV2) for diffusers model. We also release the diffsynth version of [TeleStyle-QIE-2509-Lora](https://huggingface.co/Tele-AI/TeleStyleV2/blob/main/diffsynth-TeleStyleV2-QIE-2509-Lora-bf16.safetensors). Please light a star to support this project if you find the demo useful.
|
| 32 |
+
- June 10, 2026: We release the <a href="http://arxiv.org/abs/2601.20175" target="_blank">technical report and project page </a> of TeleStyleV2. We release the diffusers version of [TeleStyle-QIE-2509-Lora](https://huggingface.co/Tele-AI/TeleStyleV2/blob/main/diffusers-TeleStyleV2-QIE-2509-Lora-bf16.safetensors).
|
| 33 |
+
- March, 2026: We finished training of TeleStyleV2. -->
|
| 34 |
+
## Schedule
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
- [x] Release PromptRoute Diffusers Lora on QIE 2511.
|
| 38 |
+
- [x] Release Installation instruction and inference code.
|
| 39 |
+
- [ ] Release Project Page and tech report.
|
| 40 |
+
|
| 41 |
+
|
| 42 |
+
<!--
|
| 43 |
+
## How to use
|
| 44 |
+
|
| 45 |
+
### 1. Installation
|
| 46 |
+
|
| 47 |
+
```
|
| 48 |
+
pip install -r requirements.txt
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
This environment is tested with:
|
| 52 |
+
- Python 3.12
|
| 53 |
+
- PyTorch 2.9.1
|
| 54 |
+
- diffusers 0.38.0
|
| 55 |
+
- transformers 4.57.3
|
| 56 |
+
- qwen-vl-utils 0.0.14
|
| 57 |
+
|
| 58 |
+
on Nvidia H100 80GB GPU. We noted that transformers version has a strong impact towards the generated image. For example, if transformers==5.5.4, the result could be different. We are working on reducing the GPU memory for inference.
|
| 59 |
+
|
| 60 |
+
### 2. Inference
|
| 61 |
+
|
| 62 |
+
We provide Gradio inference code. Please note that there are minor changes in the inference logic of QwenImageEditPlusPipeline from the original diffusers implementation.
|
| 63 |
+
|
| 64 |
+
#### diffusers
|
| 65 |
+
```
|
| 66 |
+
python gradio_telestylev2_QIE2509_dmd_diffusers.py.
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
|
| 70 |
+
|
| 71 |
+
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
## Citation
|
| 75 |
+
If you find TeleStyle useful in your research, please light a star for the project and cite our paper, thank you:
|
| 76 |
+
```bibtex
|
| 77 |
+
@article{telestylev2,
|
| 78 |
+
title={TeleStyle V2: Beyond Content-Preserving Style Transfer with Self-Distillation and Distribution-Matching-Distillation},
|
| 79 |
+
author={Shiwen Zhang, Yifan Xu, Haibin Huang, Chi Zhang, Xuelong Li},
|
| 80 |
+
journal={TeleAI},
|
| 81 |
+
year={2026},
|
| 82 |
+
}
|
| 83 |
+
``` -->
|