File size: 10,922 Bytes
4b7cff0
 
f1c37d4
 
4b7cff0
 
 
f1c37d4
 
 
 
 
4b7cff0
 
 
c794cb9
 
 
 
 
 
fb3100d
2bf3cc7
67248f7
fb3100d
1c65de9
 
af672ea
 
 
 
c794cb9
 
 
4b7cff0
 
 
 
 
 
 
 
 
 
 
 
c794cb9
 
 
 
 
 
 
 
 
 
1c65de9
c794cb9
 
 
 
c4db141
c794cb9
 
 
 
 
c4db141
 
 
 
c794cb9
 
2de8bb1
 
 
 
4b7cff0
 
 
 
 
c794cb9
 
 
 
 
 
 
 
 
 
 
4b7cff0
 
 
c794cb9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e4e2703
 
 
c794cb9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
67248f7
 
 
 
2bf3cc7
1c65de9
67248f7
f1c37d4
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
---
language:
- en
- zh
library_name: diffusers
pipeline_tag: text-to-image
tags:
- image-generation
- image-editing
- image-to-image
- text-to-image
license: apache-2.0
---

<h1 align="center">LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes</h1>

<p align="center">
  Welcome to the official repository for LLaDA-Image, a unified model for high-quality image generation and editing.
</p>

<p align="center">
  <a href="https://github.com/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/GitHub-LLaDA--Image-181717?logo=github" alt="GitHub"></a></a>
  <a href="https://arxiv.org/pdf/2609.03796"><img src="https://img.shields.io/badge/arXiv-Report-B31B1B?logo=arxiv" alt="arXiv"></a><br>
    <a href="https://huggingface.co/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/Hugging%20Face-Base-FFD21E?logo=huggingface" alt="LLaDA-Image Base on Hugging Face"></a>
    <a href="https://huggingface.co/inclusionAI/LLaDA-Image-FP8"><img src="https://img.shields.io/badge/Hugging%20Face-Base--FP8-FFD21E?logo=huggingface" alt="LLaDA-Image Base FP8 Version on Hugging Face">
    <a href="https://huggingface.co/inclusionAI/LLaDA-Image-Turbo"><img src="https://img.shields.io/badge/Hugging%20Face-Turbo-FFD21E?logo=huggingface" alt="LLaDA-Image Turbo on Hugging Face"></a>
    <a href="https://huggingface.co/inclusionAI/LLaDA-Image-Turbo-FP8"><img src="https://img.shields.io/badge/Hugging%20Face-Turbo--FP8-FFD21E?logo=huggingface" alt="LLaDA-Image Turbo FP8 Version on Hugging Face"></a>  
<br><a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Base-624aff" alt="LLaDA-Image Base on Modelscope"></a>
  <a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-FP8"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Base--FP8-624aff" alt="LLaDA-Image Base FP8 Version on Modelscope"></a>
  <a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Turbo-624aff" alt="LLaDA-Image Turbo on Modelscope"></a>
  <a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo-FP8"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Turbo--FP8-624aff" alt="LLaDA-Image Turbo FP8 Version on Modelscope">
</p>

<p align="center">
  <img class="not-prose" src="./assets/demo.jpg" alt="LLaDA-Image realistic image generation showcase" width="100%">
  <em>Photorealistic image generation with natural lighting, lifelike details, and coherent scenes.</em>
</p>

<p align="center">
  <img class="not-prose" src="./assets/demo_p2.jpg" alt="LLaDA-Image text rendering and poster generation showcase" width="100%">
  <em>High-quality text rendering and creative poster generation across diverse visual styles.</em>
</p>

<p align="center">
  <img class="not-prose" src="./assets/edit_demo.jpg" alt="LLaDA-Image editing showcase" width="100%">
  <em>Instruction-guided image editing with faithful content preservation and precise visual changes.</em>
</p>

## Introduction

LLaDA-Image is a competitive 6B-parameter open-source unified image generation and editing model family. It includes **LLaDA-Image**, a 50-step Base model for high-quality text-to-image generation and instruction-guided editing, and **LLaDA-Image-Turbo**, a 4-step distilled model for fast generation and editing. Both variants support practical text-to-image generation, VQ-conditioned generation, reference-image editing, and Chinese--English text rendering.

This repository provides the checkpoints and Diffusers-based inference code for the LLaDA-Image model family.

## News

- **2026-09-04:** We released the LLaDA-Image Base and Turbo checkpoints together with the inference code.

## Highlights

- **Unified generation and editing.** A single checkpoint supports text-to-image generation and reference-preserving, instruction-guided editing without a separate editing backbone.
- **Unified diffusion model.** Both backone and DiT are diffusion models, trained in a unified framework. 
- **Realistic image generation.** LLaDA-Image produces high-quality images with rich visual details, natural lighting, and coherent compositions.
- **Image-only pre-training for visual-prior learning.** The report establishes the visual prior through image-only pre-training and mid-training before introducing paired language supervision and joint generation--editing training.
- **Efficient inference with distilled model.** LLaDA-Image-Turbo uses Twin-DMD distillation to deliver fast image generation and editing in only 2--4 sampling steps.
- **SOTA on Qwen-Image-Bench.** LLaDA-Image achieves state-of-the-art overall scores of 53.53 in English and 53.38 in Chinese.

<p align="center">
  <img class="not-prose" src="./assets/qwen-imagebench.png" alt="Qwen-image bench evaluation" width="100%">
</p>

## Model Zoo

| Model                 | Description                                                                           | Sampling steps | Hugging Face (Checkpoints)                                                                    | ModelScope (Checkpoints)                                                                          |
| --------------------- | ------------------------------------------------------------------------------------- | -------------: | --------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------- |
| **LLaDA-Image**       | Base model for high-fidelity text-to-image generation and instruction-guided editing. |             50 | **BF16:** [inclusionAI/LLaDA-Image](https://huggingface.co/inclusionAI/LLaDA-Image)<br>**FP8:** [inclusionAI/LLaDA-Image-FP8](https://huggingface.co/inclusionAI/LLaDA-Image-FP8) | **BF16:** [inclusionAI/LLaDA-Image](https://modelscope.cn/models/inclusionAI/LLaDA-Image)<br>**FP8:** [inclusionAI/LLaDA-Image-FP8](https://modelscope.cn/models/inclusionAI/LLaDA-Image-FP8) |
| **LLaDA-Image-Turbo** | Distilled model for fast generation and editing.                                      |              4 | **BF16:** [inclusionAI/LLaDA-Image-Turbo](https://huggingface.co/inclusionAI/LLaDA-Image-Turbo)<br>**FP8:** [inclusionAI/LLaDA-Image-Turbo-FP8](https://huggingface.co/inclusionAI/LLaDA-Image-Turbo-FP8) | **BF16:** [inclusionAI/LLaDA-Image-Turbo](https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo)<br>**FP8:** [inclusionAI/LLaDA-Image-Turbo-FP8](https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo-FP8) |

## Opensource Plan

- [x] Inference code and model weights
- [ ] Training code (coming soon)

## Quick Start

### 1. Create an environment

The implementation has been used with Python 3.11, PyTorch 2.8, Transformers 4.57.6, and Diffusers 0.39.0.

```bash
git clone https://github.com/inclusionAI/LLaDA-Image.git
cd LLaDA-Image

conda create -n llada-image python=3.11 -y
conda activate llada-image

pip install -r requirements.txt
```

### 2. Run inference

The pipeline accepts a prompt and, for editing, an optional reference image.

#### LLaDA-Image (Base)

Use the Base checkpoint for high-fidelity generation and editing. Its recommended sampling configuration is **50 steps**.

```python
import torch

from src import LLaDAImagePipeline

# Load the pipeline. The model is downloaded from Hugging Face on first use.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

# Generate an image.
prompt = (
    "A cinematic photograph of a red fox standing in fresh snow, "
    "soft winter light, detailed fur, shallow depth of field"
)
negative_prompt = ""

image = pipe(
    prompt=prompt,
    negative_prompt=negative_prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=50,
    guidance_scale=5.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-base.png")
```

#### LLaDA-Image-Turbo

Use the Turbo checkpoint for fast generation and editing. Its recommended sampling configuration is **4 steps**.

> [!NOTE]
> For LLaDA-Image-Turbo inference, you can try setting `stochastic_sampling` to `false` in `scheduler/scheduler_config.json`, which may produce sharper details in some cases.

```python
import torch

from src import LLaDAImagePipeline

# Load the distilled Turbo checkpoint.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image-Turbo",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

prompt = "A quiet observatory above a sea of clouds at sunrise, golden light, wide-angle photograph"

image = pipe(
    prompt=prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=4,
    guidance_scale=1.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-turbo.png")
```

#### Generation modes

Both checkpoints support the following modes. Text and VQ-conditioned generation require height and width divisible by 16; image editing requires dimensions divisible by 32.

**VQ-conditioned generation** uses the LLaDA2 model to produce image VQ tokens from the prompt, which SigVQ embeds before diffusion. Do not provide an input image in VQ mode.

```python
image = pipe(
    prompt="A quiet observatory above a sea of clouds at sunrise",
    generation_mode="vq",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]
```

**Image editing** requires a reference image:

```python
from diffusers.utils import load_image

reference_image = load_image("/path/to/input.png")
image = pipe(
    prompt="Turn it into a watercolor painting",
    image=reference_image,
    generation_mode="editing",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(43),
).images[0]
```

## Citation

If you find LLaDA-Image useful for your research or applications, please consider citing our work.

```bibtex
@article{LLaDAImage,
title = {LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes},
author = {Chuyan Chen and Haoxing Chen and Kun Chen and Zhenglin Cheng and Long Cui and Ruishan Fang and Zhangxuan Gu and Zhicheng Huang and Zhenzhong Lan and Yuanting Lei and Haoquan Li and Jianguo Li and Rongchuan Li and Sidu Li and Tao Lin and Deyuan Liu and Jiacheng Liu and Lin Liu and Yuxuan Lou and Zhisheng Lu and Yuxin Ma and Shuheng Shen and Peng Sun and Chaoyang Wang and Hongjun Wang and Xiaomei Wang and Yongxin Wang and Chengzhang Wu and Hongru Wu and Jun Xie},
journal = {arXiv preprint arXiv:2609.03796},
year = {2026}
}
```