Commit
·
1099b93
1
Parent(s):
a43243f
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,10 +11,9 @@ Based on https://github.com/lllyasviel/ControlNet/discussions/318
|
|
| 11 |
```
|
| 12 |
accelerate launch train_controlnet.py ^
|
| 13 |
--pretrained_model_name_or_path="runwayml/stable-diffusion-v1-5" ^
|
| 14 |
-
--output_dir="control-edgedrawing-
|
| 15 |
--dataset_name="mydataset" ^
|
| 16 |
--mixed_precision="fp16" ^
|
| 17 |
-
--proportion_empty_prompts=0.5 ^
|
| 18 |
--resolution=512 ^
|
| 19 |
--learning_rate=1e-5 ^
|
| 20 |
--train_batch_size=1 ^
|
|
@@ -26,7 +25,11 @@ accelerate launch train_controlnet.py ^
|
|
| 26 |
--seed=0
|
| 27 |
```
|
| 28 |
|
| 29 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
```
|
| 32 |
{ 'ksize' : 5
|
|
@@ -37,13 +40,14 @@ Trained for 40000 steps on images converted with https://github.com/shaojunluo/E
|
|
| 37 |
}
|
| 38 |
```
|
| 39 |
|
| 40 |
-
**
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
|
| 42 |
-
|
| 43 |
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
* Train on more steps
|
| 48 |
-
* Train on more diverse dataset
|
| 49 |
-
* Train on higher-precision
|
|
|
|
| 11 |
```
|
| 12 |
accelerate launch train_controlnet.py ^
|
| 13 |
--pretrained_model_name_or_path="runwayml/stable-diffusion-v1-5" ^
|
| 14 |
+
--output_dir="control-edgedrawing-[version]-fp16/" ^
|
| 15 |
--dataset_name="mydataset" ^
|
| 16 |
--mixed_precision="fp16" ^
|
|
|
|
| 17 |
--resolution=512 ^
|
| 18 |
--learning_rate=1e-5 ^
|
| 19 |
--train_batch_size=1 ^
|
|
|
|
| 25 |
--seed=0
|
| 26 |
```
|
| 27 |
|
| 28 |
+
Images converted with https://github.com/shaojunluo/EDLinePython
|
| 29 |
+
|
| 30 |
+
Default settings are:
|
| 31 |
+
|
| 32 |
+
`smoothed=False`
|
| 33 |
|
| 34 |
```
|
| 35 |
{ 'ksize' : 5
|
|
|
|
| 40 |
}
|
| 41 |
```
|
| 42 |
|
| 43 |
+
**control-edgedrawing-default-drop50-fp16-checkpoint-40000**
|
| 44 |
+
|
| 45 |
+
additional argument: `--proportion_empty_prompts=0.5`
|
| 46 |
+
Trained for 40000 steps with default settings
|
| 47 |
+
=> empty prompts were probably too excessive
|
| 48 |
|
| 49 |
+
**control-edgedrawing-default-noisy-drop0-fp16-checkpoint-40000**
|
| 50 |
|
| 51 |
+
`smoothed=True`, but no empty prompts
|
| 52 |
+
Trained for 40000 steps with default settings
|
| 53 |
+
=> conditioning images are too noisy
|
|
|
|
|
|
|
|
|