End of training
Browse files- README.md +62 -0
- checkpoint-100/optimizer.bin +3 -0
- checkpoint-100/pytorch_lora_weights.safetensors +3 -0
- checkpoint-100/random_states_0.pkl +3 -0
- checkpoint-100/scaler.pt +3 -0
- checkpoint-100/scheduler.bin +3 -0
- checkpoint-200/optimizer.bin +3 -0
- checkpoint-200/pytorch_lora_weights.safetensors +3 -0
- checkpoint-200/random_states_0.pkl +3 -0
- checkpoint-200/scaler.pt +3 -0
- checkpoint-200/scheduler.bin +3 -0
- checkpoint-300/optimizer.bin +3 -0
- checkpoint-300/pytorch_lora_weights.safetensors +3 -0
- checkpoint-300/random_states_0.pkl +3 -0
- checkpoint-300/scaler.pt +3 -0
- checkpoint-300/scheduler.bin +3 -0
- logs/dreambooth-lora-sd-xl/1719408620.3898222/events.out.tfevents.1719408620.2fbf87246145.5390.1 +3 -0
- logs/dreambooth-lora-sd-xl/1719408620.3919392/hparams.yml +70 -0
- logs/dreambooth-lora-sd-xl/1719410238.9470112/events.out.tfevents.1719410238.2fbf87246145.12818.1 +3 -0
- logs/dreambooth-lora-sd-xl/1719410238.9540095/hparams.yml +70 -0
- logs/dreambooth-lora-sd-xl/events.out.tfevents.1719408620.2fbf87246145.5390.0 +3 -0
- logs/dreambooth-lora-sd-xl/events.out.tfevents.1719410238.2fbf87246145.12818.0 +3 -0
- pytorch_lora_weights.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
license: openrail++
|
| 5 |
+
tags:
|
| 6 |
+
- text-to-image
|
| 7 |
+
- text-to-image
|
| 8 |
+
- diffusers-training
|
| 9 |
+
- diffusers
|
| 10 |
+
- lora
|
| 11 |
+
- template:sd-lora
|
| 12 |
+
- stable-diffusion-xl
|
| 13 |
+
- stable-diffusion-xl-diffusers
|
| 14 |
+
instance_prompt: a photo of TOK
|
| 15 |
+
widget: []
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
| 19 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 20 |
+
|
| 21 |
+
|
| 22 |
+
# SDXL LoRA DreamBooth - Irene1908/Person3_LoRA
|
| 23 |
+
|
| 24 |
+
<Gallery />
|
| 25 |
+
|
| 26 |
+
## Model description
|
| 27 |
+
|
| 28 |
+
These are Irene1908/Person3_LoRA LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
|
| 29 |
+
|
| 30 |
+
The weights were trained using [DreamBooth](https://dreambooth.github.io/).
|
| 31 |
+
|
| 32 |
+
LoRA for the text encoder was enabled: False.
|
| 33 |
+
|
| 34 |
+
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
|
| 35 |
+
|
| 36 |
+
## Trigger words
|
| 37 |
+
|
| 38 |
+
You should use a photo of TOK to trigger the image generation.
|
| 39 |
+
|
| 40 |
+
## Download model
|
| 41 |
+
|
| 42 |
+
Weights for this model are available in Safetensors format.
|
| 43 |
+
|
| 44 |
+
[Download](Irene1908/Person3_LoRA/tree/main) them in the Files & versions tab.
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
## Intended uses & limitations
|
| 49 |
+
|
| 50 |
+
#### How to use
|
| 51 |
+
|
| 52 |
+
```python
|
| 53 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
#### Limitations and bias
|
| 57 |
+
|
| 58 |
+
[TODO: provide examples of latent issues and potential remediations]
|
| 59 |
+
|
| 60 |
+
## Training details
|
| 61 |
+
|
| 62 |
+
[TODO: describe the data used to train the model]
|
checkpoint-100/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c7bca641631c8d05186e15a95265679eabb6a5bc42ab19a922a26629c61d4d8f
|
| 3 |
+
size 14989948
|
checkpoint-100/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f48878aa885c86be12b4afacd13f5033263bfc768d9a23afa3bf355d8d45f984
|
| 3 |
+
size 23390424
|
checkpoint-100/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fb0ea2f97e72bb1db411e024b8025bfceeebf8489390314c2099f08bce1ab0a8
|
| 3 |
+
size 14280
|
checkpoint-100/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ac4a558c5b93581a5c41e2922404490319bcd15a10296c927a72a41012ff7f27
|
| 3 |
+
size 988
|
checkpoint-100/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d860912d4bc0403250fef9b886e201db28aaa6bd91f9fa6f113746e3ff460a2c
|
| 3 |
+
size 1000
|
checkpoint-200/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d7df626fbea27e49d3fec850d81c7496d6289f5b9724b4a7f2ba8ed6ca670ec1
|
| 3 |
+
size 14989948
|
checkpoint-200/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a97d8471b8f9bfc5a2b95ac6068b6ebe1c74111bbcef80d8790caa3fc792c65
|
| 3 |
+
size 23390424
|
checkpoint-200/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:550900e14a8ab0bc4a96b323177f33e1c38229a81d23bfcf7e0a4f0ed5bc7c98
|
| 3 |
+
size 14280
|
checkpoint-200/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bd55b3848d82967a207e0805911c79200c6adce71e3b37fd24549a718f75738
|
| 3 |
+
size 988
|
checkpoint-200/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:31bb9612a20c95bd2fb2742027f10c50f6c91a2b1dbc9eb2f2aab63ad2c84d7a
|
| 3 |
+
size 1000
|
checkpoint-300/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:323b6bc889f5e9eee55c69636c73b4b487a2fc427a424fe7fdb3347b37973f5b
|
| 3 |
+
size 14991036
|
checkpoint-300/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e2d77703dfd569b5f7092acf8f42f39519190ad7410205d61f2acae295ea67ff
|
| 3 |
+
size 23390424
|
checkpoint-300/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e48b4a966b56770f520b2a7af318cfcd589e8f2fc4fcd4b6bfe0e0e0775ffd33
|
| 3 |
+
size 14280
|
checkpoint-300/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:92873c8c89778fe11b8eeb338a181eefdf056f2f8096c36bf259c3fd791afb34
|
| 3 |
+
size 988
|
checkpoint-300/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f79ab93eaa32c9e4024d970e0ab9cf545a431d438fec2cf705c1144cbf7b6523
|
| 3 |
+
size 1000
|
logs/dreambooth-lora-sd-xl/1719408620.3898222/events.out.tfevents.1719408620.2fbf87246145.5390.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db96131f808194a163c1439bff39fc391ecca48260b398856c1272ce3a2c6974
|
| 3 |
+
size 3295
|
logs/dreambooth-lora-sd-xl/1719408620.3919392/hparams.yml
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.0001
|
| 5 |
+
adam_weight_decay_text_encoder: 0.001
|
| 6 |
+
allow_tf32: false
|
| 7 |
+
cache_dir: null
|
| 8 |
+
caption_column: prompt
|
| 9 |
+
center_crop: false
|
| 10 |
+
checkpointing_steps: 100
|
| 11 |
+
checkpoints_total_limit: null
|
| 12 |
+
class_data_dir: null
|
| 13 |
+
class_prompt: null
|
| 14 |
+
dataloader_num_workers: 0
|
| 15 |
+
dataset_config_name: null
|
| 16 |
+
dataset_name: Person3
|
| 17 |
+
do_edm_style_training: false
|
| 18 |
+
enable_xformers_memory_efficient_attention: false
|
| 19 |
+
gradient_accumulation_steps: 3
|
| 20 |
+
gradient_checkpointing: true
|
| 21 |
+
hub_model_id: null
|
| 22 |
+
hub_token: null
|
| 23 |
+
image_column: image
|
| 24 |
+
instance_data_dir: null
|
| 25 |
+
instance_prompt: a photo of a TOK
|
| 26 |
+
learning_rate: 1.0e-05
|
| 27 |
+
local_rank: -1
|
| 28 |
+
logging_dir: logs
|
| 29 |
+
lr_num_cycles: 1
|
| 30 |
+
lr_power: 1.0
|
| 31 |
+
lr_scheduler: constant
|
| 32 |
+
lr_warmup_steps: 0
|
| 33 |
+
max_grad_norm: 1.0
|
| 34 |
+
max_train_steps: 300
|
| 35 |
+
mixed_precision: fp16
|
| 36 |
+
num_class_images: 100
|
| 37 |
+
num_train_epochs: 5
|
| 38 |
+
num_validation_images: 4
|
| 39 |
+
optimizer: AdamW
|
| 40 |
+
output_dir: Person3_LoRA
|
| 41 |
+
output_kohya_format: false
|
| 42 |
+
pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
|
| 43 |
+
pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
|
| 44 |
+
prior_generation_precision: null
|
| 45 |
+
prior_loss_weight: 1.0
|
| 46 |
+
prodigy_beta3: null
|
| 47 |
+
prodigy_decouple: true
|
| 48 |
+
prodigy_safeguard_warmup: true
|
| 49 |
+
prodigy_use_bias_correction: true
|
| 50 |
+
push_to_hub: false
|
| 51 |
+
random_flip: false
|
| 52 |
+
rank: 4
|
| 53 |
+
repeats: 1
|
| 54 |
+
report_to: tensorboard
|
| 55 |
+
resolution: 512
|
| 56 |
+
resume_from_checkpoint: null
|
| 57 |
+
revision: null
|
| 58 |
+
sample_batch_size: 4
|
| 59 |
+
scale_lr: false
|
| 60 |
+
seed: 0
|
| 61 |
+
snr_gamma: 5.0
|
| 62 |
+
text_encoder_lr: 5.0e-06
|
| 63 |
+
train_batch_size: 1
|
| 64 |
+
train_text_encoder: false
|
| 65 |
+
use_8bit_adam: true
|
| 66 |
+
use_dora: false
|
| 67 |
+
validation_epochs: 50
|
| 68 |
+
validation_prompt: null
|
| 69 |
+
variant: null
|
| 70 |
+
with_prior_preservation: false
|
logs/dreambooth-lora-sd-xl/1719410238.9470112/events.out.tfevents.1719410238.2fbf87246145.12818.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e6d0b9ec5dc0436fd54128161cb09eb548a4d317cb44fb07a65314fcc5940e37
|
| 3 |
+
size 3295
|
logs/dreambooth-lora-sd-xl/1719410238.9540095/hparams.yml
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.0001
|
| 5 |
+
adam_weight_decay_text_encoder: 0.001
|
| 6 |
+
allow_tf32: false
|
| 7 |
+
cache_dir: null
|
| 8 |
+
caption_column: prompt
|
| 9 |
+
center_crop: false
|
| 10 |
+
checkpointing_steps: 200
|
| 11 |
+
checkpoints_total_limit: null
|
| 12 |
+
class_data_dir: null
|
| 13 |
+
class_prompt: null
|
| 14 |
+
dataloader_num_workers: 0
|
| 15 |
+
dataset_config_name: null
|
| 16 |
+
dataset_name: Person3
|
| 17 |
+
do_edm_style_training: false
|
| 18 |
+
enable_xformers_memory_efficient_attention: false
|
| 19 |
+
gradient_accumulation_steps: 3
|
| 20 |
+
gradient_checkpointing: true
|
| 21 |
+
hub_model_id: null
|
| 22 |
+
hub_token: null
|
| 23 |
+
image_column: image
|
| 24 |
+
instance_data_dir: null
|
| 25 |
+
instance_prompt: a photo of a TOK
|
| 26 |
+
learning_rate: 1.0e-05
|
| 27 |
+
local_rank: -1
|
| 28 |
+
logging_dir: logs
|
| 29 |
+
lr_num_cycles: 1
|
| 30 |
+
lr_power: 1.0
|
| 31 |
+
lr_scheduler: constant
|
| 32 |
+
lr_warmup_steps: 0
|
| 33 |
+
max_grad_norm: 1.0
|
| 34 |
+
max_train_steps: 200
|
| 35 |
+
mixed_precision: fp16
|
| 36 |
+
num_class_images: 100
|
| 37 |
+
num_train_epochs: 3
|
| 38 |
+
num_validation_images: 4
|
| 39 |
+
optimizer: AdamW
|
| 40 |
+
output_dir: Person3_LoRA
|
| 41 |
+
output_kohya_format: false
|
| 42 |
+
pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
|
| 43 |
+
pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
|
| 44 |
+
prior_generation_precision: null
|
| 45 |
+
prior_loss_weight: 1.0
|
| 46 |
+
prodigy_beta3: null
|
| 47 |
+
prodigy_decouple: true
|
| 48 |
+
prodigy_safeguard_warmup: true
|
| 49 |
+
prodigy_use_bias_correction: true
|
| 50 |
+
push_to_hub: false
|
| 51 |
+
random_flip: false
|
| 52 |
+
rank: 4
|
| 53 |
+
repeats: 1
|
| 54 |
+
report_to: tensorboard
|
| 55 |
+
resolution: 512
|
| 56 |
+
resume_from_checkpoint: null
|
| 57 |
+
revision: null
|
| 58 |
+
sample_batch_size: 4
|
| 59 |
+
scale_lr: false
|
| 60 |
+
seed: 0
|
| 61 |
+
snr_gamma: 5.0
|
| 62 |
+
text_encoder_lr: 5.0e-06
|
| 63 |
+
train_batch_size: 1
|
| 64 |
+
train_text_encoder: false
|
| 65 |
+
use_8bit_adam: true
|
| 66 |
+
use_dora: false
|
| 67 |
+
validation_epochs: 50
|
| 68 |
+
validation_prompt: null
|
| 69 |
+
variant: null
|
| 70 |
+
with_prior_preservation: false
|
logs/dreambooth-lora-sd-xl/events.out.tfevents.1719408620.2fbf87246145.5390.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:caefdfcf45c763c8196b3e2d16be0ff5aa9ecc102dfd1dc9dc1e5731a1b810b7
|
| 3 |
+
size 74914
|
logs/dreambooth-lora-sd-xl/events.out.tfevents.1719410238.2fbf87246145.12818.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6feed46a8f360fa614a982e6b97d5fcf570f57435ae8c8cce0ffd13856483e91
|
| 3 |
+
size 49714
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a97d8471b8f9bfc5a2b95ac6068b6ebe1c74111bbcef80d8790caa3fc792c65
|
| 3 |
+
size 23390424
|