File size: 2,787 Bytes
e0a026e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
---
license: cc-by-nc-4.0
pipeline_tag: image-to-image
tags:
- image-stylization
- mixture-of-experts
- lora
- flux
---

# StyleExpert: Mixture of Style Experts for Diverse Image Stylization

[StyleExpert](https://hh-lg.github.io/StyleExpert-Page/) is a semantic-aware framework for diverse image stylization based on a Mixture of Experts (MoE) architecture. It addresses the limitations of existing diffusion-based stylization methods by effectively handling complex semantics and material details, rather than just color-driven transformations.

[[📖 Paper](https://huggingface.co/papers/2603.16649)] [[🏠 Project Page](https://hh-lg.github.io/StyleExpert-Page/)] [[💻 Code](https://github.com/HVision-NKU/StyleExpert)]

![teaser](https://github.com/HVision-NKU/StyleExpert/raw/main/assets/figures/teaser.png)

## Model Description
StyleExpert employs a unified style encoder trained on the **StyleExpert-40K** dataset (40,000 content-style-stylized triplets). The model uses a similarity-aware gating mechanism to dynamically route styles to specialized experts within the MoE architecture, allowing it to handle styles ranging from shallow textures to deep semantics.

## Installation

We recommend using **Python 3.10** and **PyTorch** with CUDA support.

```bash
# Create a new conda environment
conda create -n styleexpert python=3.10
conda activate styleexpert

# Install requirements
pip install -r requirements.txt
```

## Quick Inference

### Local Gradio Demo
You can run a local web interface to interact with the model:
```bash
python app.py
```

### Single Case Inference via CLI
To stylize a single image using a reference style, use the following command from the [official repository](https://github.com/HVision-NKU/StyleExpert):
```bash
python infer.py --content_path ./data/content.jpg --style_path ./data/style.jpg
```

### Weights Download
The model requires the base **FLUX.1-Kontext-dev** and the **StyleExpert** adapters. You can use the provided script in the GitHub repo to download all necessary components:
```bash
bash download_models.sh --token YOUR_HF_TOKEN
```

## Visual Results
![compare](https://github.com/HVision-NKU/StyleExpert/raw/main/assets/figures/compare.png)

## Citation
If StyleExpert helps your research, please cite the following work:

```bibtex
@article{zhu2026styleexpert,
  title={Mixture of Style Experts for Diverse Image Stylization},
  author={Zhu, Shihao and Ouyang, Ziheng and Kang, Yijia and Wang, Qilong and Zhou, Mi and Li, Bo and Cheng, Ming-Ming and Hou, Qibin},
  journal={CVPR},
  year={2026}
}
```

## License
This model is licensed under [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) for non-commercial use. Underlying model weights (like FLUX.1) may be subject to their own respective licenses.