README.md

---
license: apache-2.0
library_name: diffusers
pipeline_tag: image-to-image
base_model: Qwen/Qwen-Image-Edit-2509
base_model_relation: adapter
datasets:
  - ReyChiaro/SmoothStyle
tags:
  - style-transfer
  - image-editing
  - controllable-generation
  - lora
  - safetensors
  - stylecontroller
---

<p align="center">
  <img src="figs/stylecontroller-banner.svg" alt="StyleController" width="100%">
</p>

<!-- <h1 align="center">StyleController</h1> -->

<h3 align="center">
  Staying True to the Origin: Continuous Image Stylization with Smooth Transitions
</h3>

<p align="center">
  Rui Xu &nbsp;·&nbsp; Hanmo Zhang &nbsp;·&nbsp; Songhua Liu<br>
  Shanghai Jiao Tong University
</p>

<p align="center">
  <a href="https://huggingface.co/datasets/ReyChiaro/SmoothStyle"><img alt="Hugging Face Dataset" src="https://img.shields.io/badge/%F0%9F%A4%97-Dataset-FFD21E?style=flat-square"></a>
  <a href=""><img alt="Hugging Face Model" src="https://img.shields.io/badge/%F0%9F%A4%97-Model-FFD21E?style=flat-square"></a>
  <a href=""><img alt="Project Page" src="https://img.shields.io/badge/Project-Page-CB8B65?style=flat-square&logo=githubpages&logoColor=white"></a>
  <a href=""><img alt="arXiv" src="https://img.shields.io/badge/arXiv-Paper-B31B1B?style=flat-square&logo=arxiv&logoColor=white"></a>
  <a href="https://github.com/ReyChiaro/StyleController"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-Code-181717?style=flat-square&logo=github&logoColor=white"></a>
</p>


StyleController is a controllable image-stylization adapter collection. Given a content image, a style reference, a text instruction, and a scalar strength, it generates stylized images while providing continuous control over the amount of transferred style.

This repository contains model weights only. Inference and training code are maintained in the [StyleController GitHub repository](https://github.com/ReyChiaro/StyleController).

## Available models

| Variant | Base model | Precision | Strength anchors | Status |
| --- | --- | --- | --- | --- |
| [`qwenimage_edit_2509`](qwenimage_edit_2509/) | [`Qwen/Qwen-Image-Edit-2509`](https://huggingface.co/Qwen/Qwen-Image-Edit-2509) | BF16 | 0.1–0.9 | Available |


## Repository layout

```text
StyleController/
├── README.md
├── MODEL_CARD.md
├── LICENSE
├── NOTICE
├── model_manifest.json
└── qwenimage_edit_2509/
    ├── README.md
    ├── stylecontroller_config.json
    ├── checksums.sha256
    ├── styctrl_qwenimage_edit_2509.safetensors
    └── projectors/
        ├── s01.safetensors
        ├── ...
        └── s09.safetensors
```

## Download

Install the Hugging Face CLI and download the current variant:

```bash
pip install -U huggingface_hub

hf download ReyChiaro/StyleController \
  --include "qwenimage_edit_2509/*" \
  --local-dir hf_weights
```

## Inference

Clone and install the implementation:

```bash
git clone https://github.com/ReyChiaro/StyleController.git
cd StyleController
uv sync
```

Run Qwen-Image-Edit-2509 inference at strength `0.55`:

```bash
uv run python infer_styctrl.py \
  --model qwen \
  --pretrained-pipeline Qwen/Qwen-Image-Edit-2509 \
  --content examples/content.jpg \
  --style examples/style.jpg \
  --prompt "Transfer the style of image 2 to image 1 while preserving the content structure." \
  --strength 0.55 \
  --output outputs/result_055.png \
  --lora-checkpoint hf_weights/qwenimage_edit_2509/styctrl_qwenimage_edit_2509.safetensors \
  --projector-checkpoints \
    hf_weights/qwenimage_edit_2509/projectors/s01.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s02.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s03.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s04.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s05.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s06.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s07.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s08.safetensors \
    hf_weights/qwenimage_edit_2509/projectors/s09.safetensors \
  --anchor-strengths 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9
```


## License

The model-weight release is provided under the [Apache License 2.0](LICENSE). The StyleController source code is separately licensed under MIT. The Qwen base model and SmoothStyle dataset remain governed by their own licenses and notices; see [`NOTICE`](NOTICE).

## Citation