PEFT
lora
adapter
Sen-sou commited on
Commit
2c552e9
·
verified ·
1 Parent(s): f6e3fce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -40
README.md CHANGED
@@ -16,50 +16,50 @@ Apply Anima ControlNet-LLLite parameters:
16
  Control image example: (Use basic colors as region)
17
  ![rgthree.compare._temp_fobmy_00002_](https://cdn-uploads.huggingface.co/production/uploads/68794279700df7682fb2a81f/ahsOihVAw8QLXDtwCwRzf.png)
18
 
19
- Prompt: (kinda works)
20
- base prompt
21
- region color: region prompt
22
 
23
  ## Training Parameters:
24
 
25
- caption_extension: .txt
26
- shuffle_caption: false
27
- resolution: 1024
28
- batch_size: 1
29
- enable_bucket: true
30
- bucket_no_upscale: true
31
- bucket_reso_steps: 16
32
- min_bucket_reso: 64
33
- max_bucket_reso: 1536
34
- num_repeats: 2
35
 
36
- 580 image/control/caption pairs
37
- 580 * 2 repeats = 1160 steps per epoch
38
- 8 epochs = 9280 total steps
39
 
40
- learning_rate: 3e-4
41
- max_train_epochs: 8
42
- seed: 42
43
- optimizer: AdamW8bit
44
- lr_scheduler: constant
45
- mixed_precision: bf16
46
- save_precision: bf16
47
- save_model_as: safetensors
48
- save_every_n_epochs: 1
49
- gradient_checkpointing: enabled
50
- cache_latents_to_disk: enabled
51
- cache_text_encoder_outputs_to_disk: enabled
52
- vae_chunk_size: 64
53
- vae_disable_cache: enabled
54
 
55
- timestep_sampling: shift
56
- discrete_flow_shift: 3.0
57
- attn_mode: torch
58
 
59
- cond_emb_dim: 32
60
- lllite_cond_dim: 64
61
- lllite_mlp_dim: 64
62
- lllite_target_layers: self_attn_qkv
63
- lllite_cond_resblocks: 4
64
- lllite_use_aspp: enabled
65
- caption_dropout_rate: 0.15
 
16
  Control image example: (Use basic colors as region)
17
  ![rgthree.compare._temp_fobmy_00002_](https://cdn-uploads.huggingface.co/production/uploads/68794279700df7682fb2a81f/ahsOihVAw8QLXDtwCwRzf.png)
18
 
19
+ Prompt: (kinda works)
20
+ base prompt
21
+ region color: region prompt
22
 
23
  ## Training Parameters:
24
 
25
+ caption_extension: .txt
26
+ shuffle_caption: false
27
+ resolution: 1024
28
+ batch_size: 1
29
+ enable_bucket: true
30
+ bucket_no_upscale: true
31
+ bucket_reso_steps: 16
32
+ min_bucket_reso: 64
33
+ max_bucket_reso: 1536
34
+ num_repeats: 2
35
 
36
+ 580 image/control/caption pairs
37
+ 580 * 2 repeats = 1160 steps per epoch
38
+ 8 epochs = 9280 total steps
39
 
40
+ learning_rate: 3e-4
41
+ max_train_epochs: 8
42
+ seed: 42
43
+ optimizer: AdamW8bit
44
+ lr_scheduler: constant
45
+ mixed_precision: bf16
46
+ save_precision: bf16
47
+ save_model_as: safetensors
48
+ save_every_n_epochs: 1
49
+ gradient_checkpointing: enabled
50
+ cache_latents_to_disk: enabled
51
+ cache_text_encoder_outputs_to_disk: enabled
52
+ vae_chunk_size: 64
53
+ vae_disable_cache: enabled
54
 
55
+ timestep_sampling: shift
56
+ discrete_flow_shift: 3.0
57
+ attn_mode: torch
58
 
59
+ cond_emb_dim: 32
60
+ lllite_cond_dim: 64
61
+ lllite_mlp_dim: 64
62
+ lllite_target_layers: self_attn_qkv
63
+ lllite_cond_resblocks: 4
64
+ lllite_use_aspp: enabled
65
+ caption_dropout_rate: 0.15