End of training

README.md

@@ -0,0 +1,62 @@
+---
+base_model: stabilityai/stable-diffusion-xl-base-1.0
+library_name: diffusers
+license: openrail++
+tags:
+- text-to-image
+- text-to-image
+- diffusers-training
+- diffusers
+- lora
+- template:sd-lora
+- stable-diffusion-xl
+- stable-diffusion-xl-diffusers
+instance_prompt: a photo of TOK person
+widget: []
+---
+
+<!-- This model card has been generated automatically according to the information the training script had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+
+# SDXL LoRA DreamBooth - rrct/Persona_LoRA
+
+<Gallery />
+
+## Model description
+
+These are rrct/Persona_LoRA LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
+
+The weights were trained  using [DreamBooth](https://dreambooth.github.io/).
+
+LoRA for the text encoder was enabled: False.
+
+Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
+
+## Trigger words
+
+You should use a photo of TOK person to trigger the image generation.
+
+## Download model
+
+Weights for this model are available in Safetensors format.
+
+[Download](rrct/Persona_LoRA/tree/main) them in the Files & versions tab.
+
+
+
+## Intended uses & limitations
+
+#### How to use
+
+```python
+# TODO: add an example code snippet for running this diffusion pipeline
+```
+
+#### Limitations and bias
+
+[TODO: provide examples of latent issues and potential remediations]
+
+## Training details
+
+[TODO: describe the data used to train the model]

checkpoint-10/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f26ce133bef52def6e9f502d787264bbfe9548cbfad0648ab70620059afb42d
+size 14989948

checkpoint-10/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a10c3d7c3f2ab12b24a35394d563afea69f50b30832978b0566b98bfb3d0a175
+size 23390424

checkpoint-10/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5bae3f28f6e942e4b3ab9037704e13c5cc3439537c4f7d6a102911695b2a6045
+size 14280

checkpoint-10/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20196fdcd6e066aadc548dcc3c9ff5244ea31938c846cb03623649ad99fe654f
+size 988

checkpoint-10/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:903c5e8acfcf0dfb416ce3d16b670e42b66ba433fdd0ef972e1185b05e2f94a5
+size 1000

checkpoint-100/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cdcee789e0b5cc115fa3a51731aae150df33b3bede79f5dda485f9ccdd822451
+size 14989948

checkpoint-100/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:05e33d85dd2336855c3ec74c71342ebe9269f775e8db05421e54670ebe0391e5
+size 23390424

checkpoint-100/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d4fd71a7918f73d96bdf1b125a4716aa5586b74dce1b4feaf0cd769a3d364a9
+size 14280

checkpoint-100/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac4a558c5b93581a5c41e2922404490319bcd15a10296c927a72a41012ff7f27
+size 988

checkpoint-100/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0815aa81fb561fae554fa43b7761018aa3e3aaa3c26feaea3814e555bdd881f7
+size 1000

checkpoint-20/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5549bc4ac5c6776226ac81786837440592f019cd50243111918fc5b8dd63643e
+size 14989948

checkpoint-20/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:941c2f647bba311a3e117716909d911923ca4b0d89ae18cb2e94e9a2d6554d1e
+size 23390424

checkpoint-20/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5bc9acb7698a9d909501ac82995864adc9ea00b343b68a21e93de0a19fa7cb3
+size 14280

checkpoint-20/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64fa42f2512689bf79e71bb1d2ee1d6eaba4c92f757836f03915302480256c01
+size 988

checkpoint-20/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe3cf3bf645844e77739c87d544273babe0fbef578ccbe64d74d253e7441eb58
+size 1000

checkpoint-200/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:244ad4ee290ca4cd4f745f9c851aa66054562a554f9dc2afe8f5fd8642757604
+size 14989948

checkpoint-200/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d5d89cc435e3aee581b876f818a42a834c21ce7eb94143810249eafbb7e6e56
+size 23390424

checkpoint-200/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:550900e14a8ab0bc4a96b323177f33e1c38229a81d23bfcf7e0a4f0ed5bc7c98
+size 14280

checkpoint-200/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2092edcbd0acdac0d1d6d9b87b0175e9dab043e83eb56297188a966a13699d1
+size 988

checkpoint-200/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:41685da0da655c26c327055512533b7842653533458ce93ebdafedfa7e7e6651
+size 1000

checkpoint-25/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a69dde767815652bb0f8492d4582c3a4ca08c7ac30b50e592029688f6e8e3bc
+size 14989948

checkpoint-25/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f35c8b8c723c2b4e89c0903381fad6dfc41e9bf584c7a47f7128bad4f0a183b5
+size 23390424

checkpoint-25/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5513aeeb6b4bf8bc0c4bbeaee77c63c087432e25fb71be969908b0be87cdc035
+size 14280

checkpoint-25/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef8f409b013c8bac4bd6d3a272e6812c5fb03ef9606ea54c01c2c7128bc8a993
+size 988

checkpoint-25/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9288eb4a8dd62248eb00bc8be220456277a174aa4ee3c0bb602c5e43850dfe8
+size 1000

checkpoint-50/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2402d4cf78ab20a49f9118a5118d53b9c4644015646ff17874be6b19862070f9
+size 14989948

checkpoint-50/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c4734460ebe93c68cbebbbba2c1431492eb2f1fb18591c3aa414d97e55106b1
+size 23390424

checkpoint-50/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72fd0a4017d27078776eca6164305b54c701a521a6934cd708b2e3845379a023
+size 14280

checkpoint-50/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bce7091777d309ad0996ba841e0cacd9295db515ae8e6e24f546718eefe0d105
+size 988

checkpoint-50/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06f89a765195e14a622ac9a06da39882ddeb59e1766a64f500a8f3076d38a29b
+size 1000

logs/dreambooth-lora-sd-xl/1719491781.750818/events.out.tfevents.1719491781.d8bb946172a7.4902.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93b26de157bdd1ede4db49d3140fc5d6123b2c17cc5f66499c69760cb0227880
+size 3302

logs/dreambooth-lora-sd-xl/1719491781.752792/hparams.yml

@@ -0,0 +1,70 @@
+adam_beta1: 0.9
+adam_beta2: 0.999
+adam_epsilon: 1.0e-08
+adam_weight_decay: 0.0001
+adam_weight_decay_text_encoder: 0.001
+allow_tf32: false
+cache_dir: null
+caption_column: prompt
+center_crop: false
+checkpointing_steps: 100
+checkpoints_total_limit: null
+class_data_dir: null
+class_prompt: null
+dataloader_num_workers: 0
+dataset_config_name: null
+dataset_name: Person2
+do_edm_style_training: false
+enable_xformers_memory_efficient_attention: false
+gradient_accumulation_steps: 3
+gradient_checkpointing: true
+hub_model_id: null
+hub_token: null
+image_column: image
+instance_data_dir: null
+instance_prompt: a photo of a TOK person
+learning_rate: 0.001
+local_rank: -1
+logging_dir: logs
+lr_num_cycles: 1
+lr_power: 1.0
+lr_scheduler: constant
+lr_warmup_steps: 0
+max_grad_norm: 1.0
+max_train_steps: 200
+mixed_precision: fp16
+num_class_images: 100
+num_train_epochs: 3
+num_validation_images: 4
+optimizer: AdamW
+output_dir: Persona_LoRA
+output_kohya_format: false
+pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
+pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
+prior_generation_precision: null
+prior_loss_weight: 1.0
+prodigy_beta3: null
+prodigy_decouple: true
+prodigy_safeguard_warmup: true
+prodigy_use_bias_correction: true
+push_to_hub: false
+random_flip: false
+rank: 4
+repeats: 1
+report_to: tensorboard
+resolution: 512
+resume_from_checkpoint: null
+revision: null
+sample_batch_size: 4
+scale_lr: false
+seed: 0
+snr_gamma: 5.0
+text_encoder_lr: 5.0e-06
+train_batch_size: 1
+train_text_encoder: false
+use_8bit_adam: true
+use_dora: false
+validation_epochs: 50
+validation_prompt: null
+variant: null
+with_prior_preservation: false

logs/dreambooth-lora-sd-xl/1719493027.998216/events.out.tfevents.1719493028.d8bb946172a7.11063.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9a36e6ed66ca429196efa08a062d151ea06f683088a41e856238d5b537da473
+size 3302

logs/dreambooth-lora-sd-xl/1719493028.0058155/hparams.yml

@@ -0,0 +1,70 @@
+adam_beta1: 0.9
+adam_beta2: 0.999
+adam_epsilon: 1.0e-08
+adam_weight_decay: 0.0001
+adam_weight_decay_text_encoder: 0.001
+allow_tf32: false
+cache_dir: null
+caption_column: prompt
+center_crop: false
+checkpointing_steps: 50
+checkpoints_total_limit: null
+class_data_dir: null
+class_prompt: null
+dataloader_num_workers: 0
+dataset_config_name: null
+dataset_name: Person2
+do_edm_style_training: false
+enable_xformers_memory_efficient_attention: false
+gradient_accumulation_steps: 1
+gradient_checkpointing: true
+hub_model_id: null
+hub_token: null
+image_column: image
+instance_data_dir: null
+instance_prompt: a photo of a TOK person
+learning_rate: 0.0005
+local_rank: -1
+logging_dir: logs
+lr_num_cycles: 1
+lr_power: 1.0
+lr_scheduler: constant
+lr_warmup_steps: 0
+max_grad_norm: 1.0
+max_train_steps: 100
+mixed_precision: fp16
+num_class_images: 100
+num_train_epochs: 1
+num_validation_images: 4
+optimizer: AdamW
+output_dir: Persona_LoRA
+output_kohya_format: false
+pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
+pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
+prior_generation_precision: null
+prior_loss_weight: 1.0
+prodigy_beta3: null
+prodigy_decouple: true
+prodigy_safeguard_warmup: true
+prodigy_use_bias_correction: true
+push_to_hub: false
+random_flip: false
+rank: 4
+repeats: 1
+report_to: tensorboard
+resolution: 480
+resume_from_checkpoint: null
+revision: null
+sample_batch_size: 4
+scale_lr: false
+seed: 0
+snr_gamma: 5.0
+text_encoder_lr: 5.0e-06
+train_batch_size: 1
+train_text_encoder: false
+use_8bit_adam: true
+use_dora: false
+validation_epochs: 50
+validation_prompt: null
+variant: null
+with_prior_preservation: false

logs/dreambooth-lora-sd-xl/1719493408.9175498/events.out.tfevents.1719493408.d8bb946172a7.12707.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc68c45bc585c82c9bb5d1bd51b62e8fd5a1fb06fb88fc72ba8dc07356d58323
+size 3302

logs/dreambooth-lora-sd-xl/1719493408.9247823/hparams.yml

@@ -0,0 +1,70 @@
+adam_beta1: 0.9
+adam_beta2: 0.999
+adam_epsilon: 1.0e-08
+adam_weight_decay: 0.0001
+adam_weight_decay_text_encoder: 0.001
+allow_tf32: false
+cache_dir: null
+caption_column: prompt
+center_crop: false
+checkpointing_steps: 25
+checkpoints_total_limit: null
+class_data_dir: null
+class_prompt: null
+dataloader_num_workers: 0
+dataset_config_name: null
+dataset_name: Person2
+do_edm_style_training: false
+enable_xformers_memory_efficient_attention: false
+gradient_accumulation_steps: 1
+gradient_checkpointing: true
+hub_model_id: null
+hub_token: null
+image_column: image
+instance_data_dir: null
+instance_prompt: a photo of a TOK person
+learning_rate: 0.0002
+local_rank: -1
+logging_dir: logs
+lr_num_cycles: 1
+lr_power: 1.0
+lr_scheduler: constant
+lr_warmup_steps: 0
+max_grad_norm: 1.0
+max_train_steps: 50
+mixed_precision: fp16
+num_class_images: 100
+num_train_epochs: 1
+num_validation_images: 4
+optimizer: AdamW
+output_dir: Persona_LoRA
+output_kohya_format: false
+pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
+pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
+prior_generation_precision: null
+prior_loss_weight: 1.0
+prodigy_beta3: null
+prodigy_decouple: true
+prodigy_safeguard_warmup: true
+prodigy_use_bias_correction: true
+push_to_hub: false
+random_flip: false
+rank: 4
+repeats: 1
+report_to: tensorboard
+resolution: 512
+resume_from_checkpoint: null
+revision: null
+sample_batch_size: 4
+scale_lr: false
+seed: 0
+snr_gamma: 5.0
+text_encoder_lr: 5.0e-06
+train_batch_size: 1
+train_text_encoder: false
+use_8bit_adam: true
+use_dora: false
+validation_epochs: 50
+validation_prompt: null
+variant: null
+with_prior_preservation: false

logs/dreambooth-lora-sd-xl/1719493719.9164586/events.out.tfevents.1719493719.d8bb946172a7.14106.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df39bde0bfa4cca2b38fc2e9f492e18a643bdd3298c62eaea4adf37536f26c44
+size 3302

logs/dreambooth-lora-sd-xl/1719493719.925378/hparams.yml

@@ -0,0 +1,70 @@
+adam_beta1: 0.9
+adam_beta2: 0.999
+adam_epsilon: 1.0e-08
+adam_weight_decay: 0.0001
+adam_weight_decay_text_encoder: 0.001
+allow_tf32: false
+cache_dir: null
+caption_column: prompt
+center_crop: false
+checkpointing_steps: 10
+checkpoints_total_limit: null
+class_data_dir: null
+class_prompt: null
+dataloader_num_workers: 0
+dataset_config_name: null
+dataset_name: Person2
+do_edm_style_training: false
+enable_xformers_memory_efficient_attention: false
+gradient_accumulation_steps: 1
+gradient_checkpointing: true
+hub_model_id: null
+hub_token: null
+image_column: image
+instance_data_dir: null
+instance_prompt: a photo of a TOK person
+learning_rate: 0.0002
+local_rank: -1
+logging_dir: logs
+lr_num_cycles: 1
+lr_power: 1.0
+lr_scheduler: constant
+lr_warmup_steps: 0
+max_grad_norm: 1.0
+max_train_steps: 20
+mixed_precision: fp16
+num_class_images: 100
+num_train_epochs: 1
+num_validation_images: 4
+optimizer: AdamW
+output_dir: Persona_LoRA
+output_kohya_format: false
+pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
+pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
+prior_generation_precision: null
+prior_loss_weight: 1.0
+prodigy_beta3: null
+prodigy_decouple: true
+prodigy_safeguard_warmup: true
+prodigy_use_bias_correction: true
+push_to_hub: false
+random_flip: false
+rank: 4
+repeats: 1
+report_to: tensorboard
+resolution: 256
+resume_from_checkpoint: null
+revision: null
+sample_batch_size: 4
+scale_lr: false
+seed: 0
+snr_gamma: 5.0
+text_encoder_lr: 5.0e-06
+train_batch_size: 1
+train_text_encoder: false
+use_8bit_adam: true
+use_dora: false
+validation_epochs: 50
+validation_prompt: null
+variant: null
+with_prior_preservation: false

logs/dreambooth-lora-sd-xl/events.out.tfevents.1719491781.d8bb946172a7.4902.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:178d47348edfd63f1464c260342518560bddcc1374e6e28d61fc2826b4592179
+size 49714

logs/dreambooth-lora-sd-xl/events.out.tfevents.1719493027.d8bb946172a7.11063.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e3150aed3a497e5ac94ae6aab630fc3bc3927045ce48577e288813683428994
+size 8288

logs/dreambooth-lora-sd-xl/events.out.tfevents.1719493408.d8bb946172a7.12707.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:346a4d01094f0b0023b7c7f83c86e6966da12313723dfb667be1976de2057cd2
+size 4188

logs/dreambooth-lora-sd-xl/events.out.tfevents.1719493719.d8bb946172a7.14106.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7f29f55b23392d54e8516b9c8467655fc8cc0c38a4be66d71e750eff5346104
+size 1728

pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:941c2f647bba311a3e117716909d911923ca4b0d89ae18cb2e94e9a2d6554d1e
+size 23390424