Update README.md
Browse files
README.md
CHANGED
|
@@ -62,11 +62,11 @@ Hopefully you'll like some of them.
|
|
| 62 |
|
| 63 |
Some families are specialized — like the SDXL branch, with portrait-centric Raymnants, painterly Rayctifier, and comic-styled Rayburn — while newer architectures such as Flux, Qwen-Image, and Z-Image tend to be more powerful generalists with a strong stylistic backbone.
|
| 64 |
|
| 65 |
-
It's also a proof-of-concept for **blockwise LoRA merging** as a method
|
| 66 |
- Train a LoRA on a specific concept (style or subject)
|
| 67 |
-
- Turn the LoRA influence to 0 and turn it back on on every
|
| 68 |
-
- Identify the layers/blocks most affected
|
| 69 |
-
- tune the values only in
|
| 70 |
- bake weights in the model
|
| 71 |
- wash, rinse, repeat with a new LoRA
|
| 72 |
|
|
|
|
| 62 |
|
| 63 |
Some families are specialized — like the SDXL branch, with portrait-centric Raymnants, painterly Rayctifier, and comic-styled Rayburn — while newer architectures such as Flux, Qwen-Image, and Z-Image tend to be more powerful generalists with a strong stylistic backbone.
|
| 64 |
|
| 65 |
+
It's also a proof-of-concept for **blockwise LoRA merging** as a method for finetuning models rather than full training. Besides my SDXL models, most of the checkpoints here were done with the following process:
|
| 66 |
- Train a LoRA on a specific concept (style or subject)
|
| 67 |
+
- Turn the LoRA influence to 0 and turn it back on on every block of the models one by one to generate a control image
|
| 68 |
+
- Identify the layers/blocks most affected by the concepts we want to reinforce
|
| 69 |
+
- tune the values only in thosr blocks by checking the control images until satisfactory
|
| 70 |
- bake weights in the model
|
| 71 |
- wash, rinse, repeat with a new LoRA
|
| 72 |
|