Text-to-Image
Diffusers
Safetensors
English
Chinese
LLaDAImagePipeline
image-generation
image-editing
image-to-image
Instructions to use inclusionAI/LLaDA-Image with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use inclusionAI/LLaDA-Image with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("inclusionAI/LLaDA-Image", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
File size: 10,922 Bytes
4b7cff0 f1c37d4 4b7cff0 f1c37d4 4b7cff0 c794cb9 fb3100d 2bf3cc7 67248f7 fb3100d 1c65de9 af672ea c794cb9 4b7cff0 c794cb9 1c65de9 c794cb9 c4db141 c794cb9 c4db141 c794cb9 2de8bb1 4b7cff0 c794cb9 4b7cff0 c794cb9 e4e2703 c794cb9 67248f7 2bf3cc7 1c65de9 67248f7 f1c37d4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 | ---
language:
- en
- zh
library_name: diffusers
pipeline_tag: text-to-image
tags:
- image-generation
- image-editing
- image-to-image
- text-to-image
license: apache-2.0
---
<h1 align="center">LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes</h1>
<p align="center">
Welcome to the official repository for LLaDA-Image, a unified model for high-quality image generation and editing.
</p>
<p align="center">
<a href="https://github.com/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/GitHub-LLaDA--Image-181717?logo=github" alt="GitHub"></a></a>
<a href="https://arxiv.org/pdf/2609.03796"><img src="https://img.shields.io/badge/arXiv-Report-B31B1B?logo=arxiv" alt="arXiv"></a><br>
<a href="https://huggingface.co/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/Hugging%20Face-Base-FFD21E?logo=huggingface" alt="LLaDA-Image Base on Hugging Face"></a>
<a href="https://huggingface.co/inclusionAI/LLaDA-Image-FP8"><img src="https://img.shields.io/badge/Hugging%20Face-Base--FP8-FFD21E?logo=huggingface" alt="LLaDA-Image Base FP8 Version on Hugging Face">
<a href="https://huggingface.co/inclusionAI/LLaDA-Image-Turbo"><img src="https://img.shields.io/badge/Hugging%20Face-Turbo-FFD21E?logo=huggingface" alt="LLaDA-Image Turbo on Hugging Face"></a>
<a href="https://huggingface.co/inclusionAI/LLaDA-Image-Turbo-FP8"><img src="https://img.shields.io/badge/Hugging%20Face-Turbo--FP8-FFD21E?logo=huggingface" alt="LLaDA-Image Turbo FP8 Version on Hugging Face"></a>
<br><a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Base-624aff" alt="LLaDA-Image Base on Modelscope"></a>
<a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-FP8"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Base--FP8-624aff" alt="LLaDA-Image Base FP8 Version on Modelscope"></a>
<a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Turbo-624aff" alt="LLaDA-Image Turbo on Modelscope"></a>
<a href="https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo-FP8"><img src="https://img.shields.io/badge/🤖%20Model%20Scope-Turbo--FP8-624aff" alt="LLaDA-Image Turbo FP8 Version on Modelscope">
</p>
<p align="center">
<img class="not-prose" src="./assets/demo.jpg" alt="LLaDA-Image realistic image generation showcase" width="100%">
<em>Photorealistic image generation with natural lighting, lifelike details, and coherent scenes.</em>
</p>
<p align="center">
<img class="not-prose" src="./assets/demo_p2.jpg" alt="LLaDA-Image text rendering and poster generation showcase" width="100%">
<em>High-quality text rendering and creative poster generation across diverse visual styles.</em>
</p>
<p align="center">
<img class="not-prose" src="./assets/edit_demo.jpg" alt="LLaDA-Image editing showcase" width="100%">
<em>Instruction-guided image editing with faithful content preservation and precise visual changes.</em>
</p>
## Introduction
LLaDA-Image is a competitive 6B-parameter open-source unified image generation and editing model family. It includes **LLaDA-Image**, a 50-step Base model for high-quality text-to-image generation and instruction-guided editing, and **LLaDA-Image-Turbo**, a 4-step distilled model for fast generation and editing. Both variants support practical text-to-image generation, VQ-conditioned generation, reference-image editing, and Chinese--English text rendering.
This repository provides the checkpoints and Diffusers-based inference code for the LLaDA-Image model family.
## News
- **2026-09-04:** We released the LLaDA-Image Base and Turbo checkpoints together with the inference code.
## Highlights
- **Unified generation and editing.** A single checkpoint supports text-to-image generation and reference-preserving, instruction-guided editing without a separate editing backbone.
- **Unified diffusion model.** Both backone and DiT are diffusion models, trained in a unified framework.
- **Realistic image generation.** LLaDA-Image produces high-quality images with rich visual details, natural lighting, and coherent compositions.
- **Image-only pre-training for visual-prior learning.** The report establishes the visual prior through image-only pre-training and mid-training before introducing paired language supervision and joint generation--editing training.
- **Efficient inference with distilled model.** LLaDA-Image-Turbo uses Twin-DMD distillation to deliver fast image generation and editing in only 2--4 sampling steps.
- **SOTA on Qwen-Image-Bench.** LLaDA-Image achieves state-of-the-art overall scores of 53.53 in English and 53.38 in Chinese.
<p align="center">
<img class="not-prose" src="./assets/qwen-imagebench.png" alt="Qwen-image bench evaluation" width="100%">
</p>
## Model Zoo
| Model | Description | Sampling steps | Hugging Face (Checkpoints) | ModelScope (Checkpoints) |
| --------------------- | ------------------------------------------------------------------------------------- | -------------: | --------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------- |
| **LLaDA-Image** | Base model for high-fidelity text-to-image generation and instruction-guided editing. | 50 | **BF16:** [inclusionAI/LLaDA-Image](https://huggingface.co/inclusionAI/LLaDA-Image)<br>**FP8:** [inclusionAI/LLaDA-Image-FP8](https://huggingface.co/inclusionAI/LLaDA-Image-FP8) | **BF16:** [inclusionAI/LLaDA-Image](https://modelscope.cn/models/inclusionAI/LLaDA-Image)<br>**FP8:** [inclusionAI/LLaDA-Image-FP8](https://modelscope.cn/models/inclusionAI/LLaDA-Image-FP8) |
| **LLaDA-Image-Turbo** | Distilled model for fast generation and editing. | 4 | **BF16:** [inclusionAI/LLaDA-Image-Turbo](https://huggingface.co/inclusionAI/LLaDA-Image-Turbo)<br>**FP8:** [inclusionAI/LLaDA-Image-Turbo-FP8](https://huggingface.co/inclusionAI/LLaDA-Image-Turbo-FP8) | **BF16:** [inclusionAI/LLaDA-Image-Turbo](https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo)<br>**FP8:** [inclusionAI/LLaDA-Image-Turbo-FP8](https://modelscope.cn/models/inclusionAI/LLaDA-Image-Turbo-FP8) |
## Opensource Plan
- [x] Inference code and model weights
- [ ] Training code (coming soon)
## Quick Start
### 1. Create an environment
The implementation has been used with Python 3.11, PyTorch 2.8, Transformers 4.57.6, and Diffusers 0.39.0.
```bash
git clone https://github.com/inclusionAI/LLaDA-Image.git
cd LLaDA-Image
conda create -n llada-image python=3.11 -y
conda activate llada-image
pip install -r requirements.txt
```
### 2. Run inference
The pipeline accepts a prompt and, for editing, an optional reference image.
#### LLaDA-Image (Base)
Use the Base checkpoint for high-fidelity generation and editing. Its recommended sampling configuration is **50 steps**.
```python
import torch
from src import LLaDAImagePipeline
# Load the pipeline. The model is downloaded from Hugging Face on first use.
pipe = LLaDAImagePipeline.from_pretrained(
"inclusionAI/LLaDA-Image",
torch_dtype=torch.bfloat16,
device="cuda",
)
# Generate an image.
prompt = (
"A cinematic photograph of a red fox standing in fresh snow, "
"soft winter light, detailed fur, shallow depth of field"
)
negative_prompt = ""
image = pipe(
prompt=prompt,
negative_prompt=negative_prompt,
generation_mode="text",
height=1024,
width=1024,
num_inference_steps=50,
guidance_scale=5.0,
generator=torch.Generator("cuda").manual_seed(42),
).images[0]
image.save("llada-image-base.png")
```
#### LLaDA-Image-Turbo
Use the Turbo checkpoint for fast generation and editing. Its recommended sampling configuration is **4 steps**.
> [!NOTE]
> For LLaDA-Image-Turbo inference, you can try setting `stochastic_sampling` to `false` in `scheduler/scheduler_config.json`, which may produce sharper details in some cases.
```python
import torch
from src import LLaDAImagePipeline
# Load the distilled Turbo checkpoint.
pipe = LLaDAImagePipeline.from_pretrained(
"inclusionAI/LLaDA-Image-Turbo",
torch_dtype=torch.bfloat16,
device="cuda",
)
prompt = "A quiet observatory above a sea of clouds at sunrise, golden light, wide-angle photograph"
image = pipe(
prompt=prompt,
generation_mode="text",
height=1024,
width=1024,
num_inference_steps=4,
guidance_scale=1.0,
generator=torch.Generator("cuda").manual_seed(42),
).images[0]
image.save("llada-image-turbo.png")
```
#### Generation modes
Both checkpoints support the following modes. Text and VQ-conditioned generation require height and width divisible by 16; image editing requires dimensions divisible by 32.
**VQ-conditioned generation** uses the LLaDA2 model to produce image VQ tokens from the prompt, which SigVQ embeds before diffusion. Do not provide an input image in VQ mode.
```python
image = pipe(
prompt="A quiet observatory above a sea of clouds at sunrise",
generation_mode="vq",
height=1024,
width=1024,
num_inference_steps=50, # Use 4 for LLaDA-Image-Turbo.
guidance_scale=5.0, # Use 1.0 for few-step inference.
generator=torch.Generator("cuda").manual_seed(42),
).images[0]
```
**Image editing** requires a reference image:
```python
from diffusers.utils import load_image
reference_image = load_image("/path/to/input.png")
image = pipe(
prompt="Turn it into a watercolor painting",
image=reference_image,
generation_mode="editing",
height=1024,
width=1024,
num_inference_steps=50, # Use 4 for LLaDA-Image-Turbo.
guidance_scale=5.0, # Use 1.0 for few-step inference.
generator=torch.Generator("cuda").manual_seed(43),
).images[0]
```
## Citation
If you find LLaDA-Image useful for your research or applications, please consider citing our work.
```bibtex
@article{LLaDAImage,
title = {LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes},
author = {Chuyan Chen and Haoxing Chen and Kun Chen and Zhenglin Cheng and Long Cui and Ruishan Fang and Zhangxuan Gu and Zhicheng Huang and Zhenzhong Lan and Yuanting Lei and Haoquan Li and Jianguo Li and Rongchuan Li and Sidu Li and Tao Lin and Deyuan Liu and Jiacheng Liu and Lin Liu and Yuxuan Lou and Zhisheng Lu and Yuxin Ma and Shuheng Shen and Peng Sun and Chaoyang Wang and Hongjun Wang and Xiaomei Wang and Yongxin Wang and Chengzhang Wu and Hongru Wu and Jun Xie},
journal = {arXiv preprint arXiv:2609.03796},
year = {2026}
}
``` |