Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
pipeline_tag: text-to-image
|
|
@@ -46,11 +46,14 @@ From left to right: Input image, Masked image, SDXL inpainting, Ours.
|
|
| 46 |

|
| 47 |
<center><i>an air conditioner hanging on the bedroom wall</i></center>
|
| 48 |
|
| 49 |
-
#
|
| 50 |
|
| 51 |
-
|
| 52 |
|
| 53 |
-
|
|
|
|
|
|
|
|
|
|
| 54 |
|
| 55 |
``` python
|
| 56 |
from diffusers.utils import load_image, check_min_version
|
|
@@ -120,4 +123,7 @@ The model was trained on 12M laion2B and internal source images for 20k steps at
|
|
| 120 |
|
| 121 |
## Limitation
|
| 122 |
|
| 123 |
-
Due to the fact that only 1024*1024 pixel resolution was used during the training phase, the inference performs best at this size, with other sizes yielding suboptimal results. We will initiate multi-resolution training in the future, and at that time, we will open-source the new weights.
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: other
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
pipeline_tag: text-to-image
|
|
|
|
| 46 |

|
| 47 |
<center><i>an air conditioner hanging on the bedroom wall</i></center>
|
| 48 |
|
| 49 |
+
# Using with Diffusers
|
| 50 |
|
| 51 |
+
Step1: Make sure you upgrade to the latest version of diffusers(>=0.29.2): pip install -U diffusers.
|
| 52 |
|
| 53 |
+
Step2: Download the two required Python files(pipeline_sd3_controlnet_inpainting.py and controlnet_sd3.py) from either the current repo or from (GitHub)[https://github.com/JPlin/SD3-Controlnet-Inpainting].
|
| 54 |
+
(We will merge this Feature to official Diffusers.)
|
| 55 |
+
|
| 56 |
+
Step3: And then you can run demo.py or following:
|
| 57 |
|
| 58 |
``` python
|
| 59 |
from diffusers.utils import load_image, check_min_version
|
|
|
|
| 123 |
|
| 124 |
## Limitation
|
| 125 |
|
| 126 |
+
Due to the fact that only 1024*1024 pixel resolution was used during the training phase, the inference performs best at this size, with other sizes yielding suboptimal results. We will initiate multi-resolution training in the future, and at that time, we will open-source the new weights.
|
| 127 |
+
|
| 128 |
+
## LICENSE
|
| 129 |
+
The model is based on SD3 finetuning; therefore, the license follows the original (SD3 license)[https://huggingface.co/stabilityai/stable-diffusion-3-medium#license].
|