Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,35 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: creativeml-openrail-m
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: creativeml-openrail-m
|
| 3 |
+
tags:
|
| 4 |
+
- stable-diffusion
|
| 5 |
+
- sdxl
|
| 6 |
+
- layerdiffusion
|
| 7 |
+
- attention-injection
|
| 8 |
+
- diff-patches
|
| 9 |
+
- comfyui
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# LayerDiffusion-SDXL-Attn-Diff
|
| 13 |
+
|
| 14 |
+
This repository contains a converted version of the `layer_xl_transparent_attn.safetensors` model from [LayerDiffusion/layerdiffusion-v1](https://huggingface.co/LayerDiffusion/layerdiffusion-v1)
|
| 15 |
+
|
| 16 |
+
## Model Details
|
| 17 |
+
- **Base Model**: `layer_xl_transparent_attn.safetensors` from [LayerDiffusion/layerdiffusion-v1](https://huggingface.co/LayerDiffusion/layerdiffusion-v1)
|
| 18 |
+
- **Conversion**: LoRA patches (`::lora::0`, `::lora::1`) are converted to `diff` patches (`::diff::0`) using matrix multiplication (`torch.mm`).
|
| 19 |
+
- **License**: [CreativeML Open RAIL-M](https://huggingface.co/spaces/license/cml-openrail-m), same as the original model.
|
| 20 |
+
- **File**: `layer_xl_transparent_attn.safetensors` (contains precomputed `diff` patches)
|
| 21 |
+
|
| 22 |
+
## Usage in ComfyUI
|
| 23 |
+
1. Download `layer_xl_transparent_attn.safetensors` and place it in `ComfyUI/models/layer_model/`.
|
| 24 |
+
2. Install the [ComfyUI-layerdiffuse](https://github.com/huchenlei/ComfyUI-layerdiffuse) custom node.
|
| 25 |
+
3. In your workflow, use the `LayeredDiffusionApply` node with `config` set to `SDXL, Attention Injection`.
|
| 26 |
+
|
| 27 |
+
## Credits
|
| 28 |
+
This model is a derivative of the original work by Lvmin Zhang and Maneesh Agrawala, as described in their paper:
|
| 29 |
+
|
| 30 |
+
> Zhang, L., & Agrawala, M. (2024). Transparent Image Layer Diffusion using Latent Transparency. *arXiv preprint arXiv:2402.17113*. [https://arxiv.org/abs/2402.17113](https://arxiv.org/abs/2402.17113)
|
| 31 |
+
|
| 32 |
+
- **Original Model**: [LayerDiffusion/layerdiffusion-v1](https://huggingface.co/LayerDiffusion/layerdiffusion-v1) by the LayerDiffusion team.
|
| 33 |
+
|
| 34 |
+
## License
|
| 35 |
+
This model is distributed under the [CreativeML Open RAIL-M](https://huggingface.co/spaces/license/cml-openrail-m) license, as required by the original model. Please review the license for usage terms, including non-commercial restrictions.
|