MutantSparrow commited on
Commit
e12bb21
·
verified ·
1 Parent(s): 8ab7e20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -62,11 +62,11 @@ Hopefully you'll like some of them.
62
 
63
  Some families are specialized — like the SDXL branch, with portrait-centric Raymnants, painterly Rayctifier, and comic-styled Rayburn — while newer architectures such as Flux, Qwen-Image, and Z-Image tend to be more powerful generalists with a strong stylistic backbone.
64
 
65
- It's also a proof-of-concept for **blockwise LoRA merging** as a method to finetune models rather than full training. Besides my SDXL models, most of the checkpoints here were done with the following process:
66
  - Train a LoRA on a specific concept (style or subject)
67
- - Turn the LoRA influence to 0 and turn it back on on every blocks of the models one by one to generate a control image
68
- - Identify the layers/blocks most affected my the concepts we want to reinforce
69
- - tune the values only in thos blocks by checking the control images until satisfactory
70
  - bake weights in the model
71
  - wash, rinse, repeat with a new LoRA
72
 
 
62
 
63
  Some families are specialized — like the SDXL branch, with portrait-centric Raymnants, painterly Rayctifier, and comic-styled Rayburn — while newer architectures such as Flux, Qwen-Image, and Z-Image tend to be more powerful generalists with a strong stylistic backbone.
64
 
65
+ It's also a proof-of-concept for **blockwise LoRA merging** as a method for finetuning models rather than full training. Besides my SDXL models, most of the checkpoints here were done with the following process:
66
  - Train a LoRA on a specific concept (style or subject)
67
+ - Turn the LoRA influence to 0 and turn it back on on every block of the models one by one to generate a control image
68
+ - Identify the layers/blocks most affected by the concepts we want to reinforce
69
+ - tune the values only in thosr blocks by checking the control images until satisfactory
70
  - bake weights in the model
71
  - wash, rinse, repeat with a new LoRA
72