Commit
·
f090627
1
Parent(s):
ce42a76
Update d-adaptation/notes.md
Browse files- d-adaptation/notes.md +3 -0
d-adaptation/notes.md
CHANGED
|
@@ -2,6 +2,8 @@
|
|
| 2 |
|
| 3 |
## Learning rates
|
| 4 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
|
|
|
|
|
|
| 5 |
|
| 6 |
## Alpha
|
| 7 |
Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
|
|
@@ -23,6 +25,7 @@ Lower dims show good performance. Need much larger test to check for accuracy be
|
|
| 23 |
512 resolution is good so far 700 steps.
|
| 24 |
640 resolution is good. 900 steps. UMP has 640 resolution sample.
|
| 25 |
768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
|
|
|
|
| 26 |
|
| 27 |
## Steps
|
| 28 |
600 to 800 steps have been the primary focus of experimentation.
|
|
|
|
| 2 |
|
| 3 |
## Learning rates
|
| 4 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
| 5 |
+
This rate did not work well for 768 training and for 640 required adjustments to scheduler to work better.
|
| 6 |
+
0.5/0.25 unet/text worked on 512 resolution and 768.
|
| 7 |
|
| 8 |
## Alpha
|
| 9 |
Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
|
|
|
|
| 25 |
512 resolution is good so far 700 steps.
|
| 26 |
640 resolution is good. 900 steps. UMP has 640 resolution sample.
|
| 27 |
768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
|
| 28 |
+
512 resolution held up well at 0.5/0.25 as well so this is looking like a better universal rate.
|
| 29 |
|
| 30 |
## Steps
|
| 31 |
600 to 800 steps have been the primary focus of experimentation.
|