Guillermo Pinto commited on
End of training
Browse files- README.md +65 -0
- logs/dreambooth-lora-sd-xl/1742039120.6216042/events.out.tfevents.1742039120.f30201f56114.178.1 +3 -0
- logs/dreambooth-lora-sd-xl/1742039120.6235988/hparams.yml +81 -0
- logs/dreambooth-lora-sd-xl/events.out.tfevents.1742039120.f30201f56114.178.0 +3 -0
- pinky-lora-v6_emb.safetensors +3 -0
- pytorch_lora_weights.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- stable-diffusion-xl
|
| 4 |
+
- stable-diffusion-xl-diffusers
|
| 5 |
+
- diffusers-training
|
| 6 |
+
- text-to-image
|
| 7 |
+
- diffusers
|
| 8 |
+
- lora
|
| 9 |
+
- template:sd-lora
|
| 10 |
+
widget:
|
| 11 |
+
|
| 12 |
+
- text: 'a cartoon graffiti character of TOK'
|
| 13 |
+
|
| 14 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
instance_prompt: a cartoon graffiti character of TOK
|
| 16 |
+
license: openrail++
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# SDXL LoRA DreamBooth - guillepinto/pinky-lora-v6
|
| 20 |
+
|
| 21 |
+
<Gallery />
|
| 22 |
+
|
| 23 |
+
## Model description
|
| 24 |
+
|
| 25 |
+
### These are guillepinto/pinky-lora-v6 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
|
| 26 |
+
|
| 27 |
+
## Download model
|
| 28 |
+
|
| 29 |
+
### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
|
| 30 |
+
|
| 31 |
+
- **LoRA**: download **[`pinky-lora-v6.safetensors` here 💾](/guillepinto/pinky-lora-v6/blob/main/pinky-lora-v6.safetensors)**.
|
| 32 |
+
- Place it on your `models/Lora` folder.
|
| 33 |
+
- On AUTOMATIC1111, load the LoRA by adding `<lora:pinky-lora-v6:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
| 37 |
+
|
| 38 |
+
```py
|
| 39 |
+
from diffusers import AutoPipelineForText2Image
|
| 40 |
+
import torch
|
| 41 |
+
|
| 42 |
+
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
|
| 43 |
+
pipeline.load_lora_weights('guillepinto/pinky-lora-v6', weight_name='pytorch_lora_weights.safetensors')
|
| 44 |
+
|
| 45 |
+
image = pipeline('a cartoon graffiti character of TOK').images[0]
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
| 49 |
+
|
| 50 |
+
## Trigger words
|
| 51 |
+
|
| 52 |
+
You should use a cartoon graffiti character of TOK to trigger the image generation.
|
| 53 |
+
|
| 54 |
+
## Details
|
| 55 |
+
All [Files & versions](/guillepinto/pinky-lora-v6/tree/main).
|
| 56 |
+
|
| 57 |
+
The weights were trained using [🧨 diffusers Advanced Dreambooth Training Script](https://github.com/huggingface/diffusers/blob/main/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py).
|
| 58 |
+
|
| 59 |
+
LoRA for the text encoder was enabled. False.
|
| 60 |
+
|
| 61 |
+
Pivotal tuning was enabled: False.
|
| 62 |
+
|
| 63 |
+
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
|
| 64 |
+
|
| 65 |
+
|
logs/dreambooth-lora-sd-xl/1742039120.6216042/events.out.tfevents.1742039120.f30201f56114.178.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:08fc5f0abb078127c0be32c9327a3dce744a28252e509d47e0ae1eb167d65769
|
| 3 |
+
size 3859
|
logs/dreambooth-lora-sd-xl/1742039120.6235988/hparams.yml
ADDED
|
@@ -0,0 +1,81 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.99
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.0001
|
| 5 |
+
adam_weight_decay_text_encoder: null
|
| 6 |
+
allow_tf32: false
|
| 7 |
+
cache_dir: null
|
| 8 |
+
cache_latents: false
|
| 9 |
+
caption_column: prompt
|
| 10 |
+
center_crop: false
|
| 11 |
+
checkpointing_steps: 2000
|
| 12 |
+
checkpoints_total_limit: null
|
| 13 |
+
class_data_dir: null
|
| 14 |
+
class_prompt: null
|
| 15 |
+
clip_skip: null
|
| 16 |
+
dataloader_num_workers: 0
|
| 17 |
+
dataset_config_name: null
|
| 18 |
+
dataset_name: ./pinky
|
| 19 |
+
do_edm_style_training: false
|
| 20 |
+
enable_xformers_memory_efficient_attention: false
|
| 21 |
+
gradient_accumulation_steps: 3
|
| 22 |
+
gradient_checkpointing: true
|
| 23 |
+
hub_model_id: null
|
| 24 |
+
hub_token: null
|
| 25 |
+
image_column: image
|
| 26 |
+
instance_data_dir: null
|
| 27 |
+
instance_prompt: a cartoon graffiti character of <s0><s1>
|
| 28 |
+
learning_rate: 1.0
|
| 29 |
+
local_rank: 0
|
| 30 |
+
logging_dir: logs
|
| 31 |
+
lora_unet_blocks: null
|
| 32 |
+
lr_num_cycles: 1
|
| 33 |
+
lr_power: 1.0
|
| 34 |
+
lr_scheduler: constant
|
| 35 |
+
lr_warmup_steps: 0
|
| 36 |
+
max_grad_norm: 1.0
|
| 37 |
+
max_train_steps: 1000
|
| 38 |
+
mixed_precision: fp16
|
| 39 |
+
noise_offset: 0
|
| 40 |
+
num_class_images: 100
|
| 41 |
+
num_new_tokens_per_abstraction: 2
|
| 42 |
+
num_train_epochs: 56
|
| 43 |
+
num_validation_images: 4
|
| 44 |
+
optimizer: prodigy
|
| 45 |
+
output_dir: pinky-lora-v6
|
| 46 |
+
pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
|
| 47 |
+
pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
|
| 48 |
+
prior_generation_precision: null
|
| 49 |
+
prior_loss_weight: 1.0
|
| 50 |
+
prodigy_beta3: null
|
| 51 |
+
prodigy_decouple: true
|
| 52 |
+
prodigy_safeguard_warmup: true
|
| 53 |
+
prodigy_use_bias_correction: true
|
| 54 |
+
push_to_hub: true
|
| 55 |
+
random_flip: false
|
| 56 |
+
rank: 8
|
| 57 |
+
repeats: 1
|
| 58 |
+
report_to: tensorboard
|
| 59 |
+
resolution: 1024
|
| 60 |
+
resume_from_checkpoint: null
|
| 61 |
+
revision: null
|
| 62 |
+
sample_batch_size: 4
|
| 63 |
+
scale_lr: false
|
| 64 |
+
seed: 0
|
| 65 |
+
snr_gamma: 5.0
|
| 66 |
+
text_encoder_lr: 1.0
|
| 67 |
+
token_abstraction: TOK
|
| 68 |
+
train_batch_size: 1
|
| 69 |
+
train_text_encoder: false
|
| 70 |
+
train_text_encoder_frac: 1.0
|
| 71 |
+
train_text_encoder_ti: true
|
| 72 |
+
train_text_encoder_ti_frac: 0.5
|
| 73 |
+
use_8bit_adam: false
|
| 74 |
+
use_blora: false
|
| 75 |
+
use_dora: false
|
| 76 |
+
validation_epochs: 50
|
| 77 |
+
validation_prompt: a cartoon graffiti character of <s0><s1>, wearing a pink football
|
| 78 |
+
helmet and running with a football, in a vibrant stadium with bold, colorful graffiti
|
| 79 |
+
elements
|
| 80 |
+
variant: null
|
| 81 |
+
with_prior_preservation: false
|
logs/dreambooth-lora-sd-xl/events.out.tfevents.1742039120.f30201f56114.178.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8211d855b5b534d01583b35c3a291b0343d5fd9ce756e19fa69acc900c0fe71b
|
| 3 |
+
size 11490438
|
pinky-lora-v6_emb.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74b723f69e2835a16cbe92e4e692781fe583272ba3471f2f4d668e15f22a66aa
|
| 3 |
+
size 16536
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0cfef4243ff36910f8691b3d4d545c91e48a8c93461adb741d04c86aab38659
|
| 3 |
+
size 46615272
|