Upload README.md
Browse files
README.md
CHANGED
|
@@ -40,14 +40,14 @@ cd DiffSynth-Studio
|
|
| 40 |
pip install -e .
|
| 41 |
```
|
| 42 |
1. **Entity-Level Controlled Image Generation**
|
| 43 |
-
EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/
|
| 44 |
2. **Image Inpainting**
|
| 45 |
To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
|
| 46 |
-
See [entity_inpaint.py](https://github.com/
|
| 47 |
3. **Styled Entity Control**
|
| 48 |
-
EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/
|
| 49 |
4. **Entity Transfer**
|
| 50 |
-
We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/
|
| 51 |
5. **Play with EliGen using UI**
|
| 52 |
Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
|
| 53 |
```bash
|
|
@@ -65,7 +65,7 @@ pip install -e .
|
|
| 65 |
</video>
|
| 66 |
</div>
|
| 67 |
|
| 68 |
-
1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/
|
| 69 |
|
| 70 |
|Entity Conditions|Generated Image|
|
| 71 |
|-|-|
|
|
@@ -76,7 +76,7 @@ pip install -e .
|
|
| 76 |
|||
|
| 77 |
|||
|
| 78 |
|
| 79 |
-
1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/
|
| 80 |
|
| 81 |
|Entity Conditions|Generated Image|
|
| 82 |
|-|-|
|
|
@@ -86,19 +86,19 @@ pip install -e .
|
|
| 86 |
|||
|
| 87 |
|
| 88 |
### Image Inpainting
|
| 89 |
-
Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/
|
| 90 |
|Inpainting Input|Inpainting Output|
|
| 91 |
|-|-|
|
| 92 |
|||
|
| 93 |
|||
|
| 94 |
### Styled Entity Control
|
| 95 |
-
Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/
|
| 96 |
|Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
|
| 97 |
|-|-|-|-|
|
| 98 |
|||||
|
| 99 |
|
| 100 |
### Entity Transfer
|
| 101 |
-
Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/
|
| 102 |
|
| 103 |
|Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
|
| 104 |
|-|-|-|-|
|
|
|
|
| 40 |
pip install -e .
|
| 41 |
```
|
| 42 |
1. **Entity-Level Controlled Image Generation**
|
| 43 |
+
EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) for usage.
|
| 44 |
2. **Image Inpainting**
|
| 45 |
To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
|
| 46 |
+
See [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for usage.
|
| 47 |
3. **Styled Entity Control**
|
| 48 |
+
EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for usage.
|
| 49 |
4. **Entity Transfer**
|
| 50 |
+
We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for usage.
|
| 51 |
5. **Play with EliGen using UI**
|
| 52 |
Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
|
| 53 |
```bash
|
|
|
|
| 65 |
</video>
|
| 66 |
</div>
|
| 67 |
|
| 68 |
+
1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_1-6` for generation prompts.
|
| 69 |
|
| 70 |
|Entity Conditions|Generated Image|
|
| 71 |
|-|-|
|
|
|
|
| 76 |
|||
|
| 77 |
|||
|
| 78 |
|
| 79 |
+
1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_7` for the prompts.
|
| 80 |
|
| 81 |
|Entity Conditions|Generated Image|
|
| 82 |
|-|-|
|
|
|
|
| 86 |
|||
|
| 87 |
|
| 88 |
### Image Inpainting
|
| 89 |
+
Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for generation prompts.
|
| 90 |
|Inpainting Input|Inpainting Output|
|
| 91 |
|-|-|
|
| 92 |
|||
|
| 93 |
|||
|
| 94 |
### Styled Entity Control
|
| 95 |
+
Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for generation prompts.
|
| 96 |
|Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
|
| 97 |
|-|-|-|-|
|
| 98 |
|||||
|
| 99 |
|
| 100 |
### Entity Transfer
|
| 101 |
+
Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for generation prompts.
|
| 102 |
|
| 103 |
|Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
|
| 104 |
|-|-|-|-|
|