breakcore2 commited on
Commit
5eb34ea
·
1 Parent(s): 2741780

Update locon/notes.md

Browse files
Files changed (1) hide show
  1. locon/notes.md +1 -1
locon/notes.md CHANGED
@@ -13,7 +13,7 @@ We suspect that we can train characters faster in terms of real time.
13
 
14
  ## Mixing
15
  Applying style on character appears to work well. The example wlop style applied on Amber is 1/0.25 and 4/1. The character loses some stability but the style LoCon can easily be lowered and still retain great style retention while significantly reducing the impact to character correctness.
16
- Overall it appears that mixing is more stable with LoCon than lora but this could be due to the dim/alpha and training settings between these two locon being closer compared to LoRA land where popular dim sizes range from 8 to 128.
17
 
18
  ## Finetune model extractions
19
  To be tested. We suspect the performance should be much better than LoRA extraction since all the model will be extracted from.
 
13
 
14
  ## Mixing
15
  Applying style on character appears to work well. The example wlop style applied on Amber is 1/0.25 and 4/1. The character loses some stability but the style LoCon can easily be lowered and still retain great style retention while significantly reducing the impact to character correctness.
16
+ Testing with a 3 conv, 6 linear character + 4conv 1 linear style, the style was not able to apply correctly. It appears that the character locon picks up a lot of stylistic information and classes with the desired style. Would need to test with equivalent ranks.
17
 
18
  ## Finetune model extractions
19
  To be tested. We suspect the performance should be much better than LoRA extraction since all the model will be extracted from.