Hugging Face's logo

nworb-ucsb
/
face_LoRA

Text-to-Image
Diffusers
TensorBoard
diffusers-training
lora
template:sd-lora
stable-diffusion-xl
stable-diffusion-xl-diffusers
Model card Files
xet
Metrics Community
nworb-ucsb commited on
Commit
435a430
·
verified ·
1 Parent(s): fc74bf6

End of training

Browse files
Files changed (14) hide show
  1. README.md +62 -0
  2. logs/dreambooth-lora-sd-xl/1715323988.7402637/events.out.tfevents.1715323988.imagination.5981.1 +3 -0
  3. logs/dreambooth-lora-sd-xl/1715323988.743271/hparams.yml +70 -0
  4. logs/dreambooth-lora-sd-xl/1715324064.9585/events.out.tfevents.1715324064.imagination.6639.1 +3 -0
  5. logs/dreambooth-lora-sd-xl/1715324064.9613552/hparams.yml +70 -0
  6. logs/dreambooth-lora-sd-xl/1716785177.5413501/events.out.tfevents.1716785177.imagination.106673.1 +3 -0
  7. logs/dreambooth-lora-sd-xl/1716785177.5446606/hparams.yml +70 -0
  8. logs/dreambooth-lora-sd-xl/1716789519.0789428/events.out.tfevents.1716789519.imagination.108834.1 +3 -0
  9. logs/dreambooth-lora-sd-xl/1716789519.0821874/hparams.yml +70 -0
  10. logs/dreambooth-lora-sd-xl/events.out.tfevents.1715323988.imagination.5981.0 +3 -0
  11. logs/dreambooth-lora-sd-xl/events.out.tfevents.1715324064.imagination.6639.0 +3 -0
  12. logs/dreambooth-lora-sd-xl/events.out.tfevents.1716785177.imagination.106673.0 +3 -0
  13. logs/dreambooth-lora-sd-xl/events.out.tfevents.1716789519.imagination.108834.0 +3 -0
  14. pytorch_lora_weights.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: openrail++
3
+ library_name: diffusers
4
+ tags:
5
+ - text-to-image
6
+ - text-to-image
7
+ - diffusers-training
8
+ - diffusers
9
+ - lora
10
+ - template:sd-lora
11
+ - stable-diffusion-xl
12
+ - stable-diffusion-xl-diffusers
13
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
14
+ instance_prompt: '''a TOK emoticon'''
15
+ widget: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+
22
+ # SDXL LoRA DreamBooth - nworb-ucsb/face_LoRA
23
+
24
+ <Gallery />
25
+
26
+ ## Model description
27
+
28
+ These are nworb-ucsb/face_LoRA LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
29
+
30
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/).
31
+
32
+ LoRA for the text encoder was enabled: False.
33
+
34
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
35
+
36
+ ## Trigger words
37
+
38
+ You should use 'a TOK emoticon' to trigger the image generation.
39
+
40
+ ## Download model
41
+
42
+ Weights for this model are available in Safetensors format.
43
+
44
+ [Download](nworb-ucsb/face_LoRA/tree/main) them in the Files & versions tab.
45
+
46
+
47
+
48
+ ## Intended uses & limitations
49
+
50
+ #### How to use
51
+
52
+ ```python
53
+ # TODO: add an example code snippet for running this diffusion pipeline
54
+ ```
55
+
56
+ #### Limitations and bias
57
+
58
+ [TODO: provide examples of latent issues and potential remediations]
59
+
60
+ ## Training details
61
+
62
+ [TODO: describe the data used to train the model]
logs/dreambooth-lora-sd-xl/1715323988.7402637/events.out.tfevents.1715323988.imagination.5981.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a692c1c1c792c11af003ed44cf34af0206f8ec8ac49e8c9e590aeac51a8c64a
3
+ size 3288
logs/dreambooth-lora-sd-xl/1715323988.743271/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: faces
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a TOK emoticon
26
+ learning_rate: 0.0001
27
+ local_rank: 0
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 100
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: face_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 1
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/1715324064.9585/events.out.tfevents.1715324064.imagination.6639.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:598eaefebfd41c1689ef12ed7ce4885787f2ecd4ccf735df91281e550b928bc2
3
+ size 3288
logs/dreambooth-lora-sd-xl/1715324064.9613552/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: faces
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a TOK emoticon
26
+ learning_rate: 0.0001
27
+ local_rank: 0
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 100
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: face_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 1
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/1716785177.5413501/events.out.tfevents.1716785177.imagination.106673.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:556011e03f4f49a21fca179b0cc30b30a6c5068d751a1f26911792bcec35f126
3
+ size 3288
logs/dreambooth-lora-sd-xl/1716785177.5446606/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: faces
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a TOK emoticon
26
+ learning_rate: 0.0001
27
+ local_rank: 0
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 100
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: face_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 1
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/1716789519.0789428/events.out.tfevents.1716789519.imagination.108834.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:355c176a03f7b02dfa03b1b200b909c6c7e7685164646e5189b86102b5f3032e
3
+ size 3288
logs/dreambooth-lora-sd-xl/1716789519.0821874/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: faces
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a TOK emoticon
26
+ learning_rate: 0.0001
27
+ local_rank: 0
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 100
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: face_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 1
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/events.out.tfevents.1715323988.imagination.5981.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c2f1783ec71a6d3cff5324101fa75508d1e5b275355db911cc0676d8fa3971f
3
+ size 326
logs/dreambooth-lora-sd-xl/events.out.tfevents.1715324064.imagination.6639.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1842c4e86e8c8e8d4917e9901f91f4816a503e022ba4343f641e4ad3cd9dcf82
3
+ size 92520
logs/dreambooth-lora-sd-xl/events.out.tfevents.1716785177.imagination.106673.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8343f9ab3b4d4b20aa490f83df1f80c2e766457726dd75e0b434def87a1b7c6c
3
+ size 116964
logs/dreambooth-lora-sd-xl/events.out.tfevents.1716789519.imagination.108834.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1cae98b0e92163267d9c2b18497df03a5d3ad905bdfc0dd33d4ac0db342c07b
3
+ size 116964
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69e498a7170530f55e7e663418516dbdeeba0418c95294d27fceb684224d085f
3
+ size 23390424