End of training
Browse files- .gitattributes +4 -0
- README.md +115 -0
- checkpoint-1000/optimizer.bin +3 -0
- checkpoint-1000/pytorch_lora_weights.safetensors +3 -0
- checkpoint-1000/random_states_0.pkl +3 -0
- checkpoint-1000/scheduler.bin +3 -0
- checkpoint-500/optimizer.bin +3 -0
- checkpoint-500/pytorch_lora_weights.safetensors +3 -0
- checkpoint-500/random_states_0.pkl +3 -0
- checkpoint-500/scheduler.bin +3 -0
- image_0.png +3 -0
- image_1.png +3 -0
- image_2.png +3 -0
- image_3.png +3 -0
- logs/dreambooth-flux2-image2img-lora/1769679228.1513677/events.out.tfevents.1769679228.209-20-158-47.1224629.1 +3 -0
- logs/dreambooth-flux2-image2img-lora/1769679228.1548688/hparams.yml +86 -0
- logs/dreambooth-flux2-image2img-lora/events.out.tfevents.1769679228.209-20-158-47.1224629.0 +3 -0
- pytorch_lora_weights.safetensors +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
image_0.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
image_1.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
image_2.png filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
image_3.png filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,115 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: black-forest-labs/FLUX.2-klein-base-9B
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
license: other
|
| 5 |
+
widget:
|
| 6 |
+
- text: Relight the image to remove all existing lighting conditions and replace them
|
| 7 |
+
with neutral, uniform illumination. Apply soft, evenly distributed lighting with
|
| 8 |
+
no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
|
| 9 |
+
the original identity of all subjects exactly—preserve facial structure, skin
|
| 10 |
+
tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
|
| 11 |
+
camera angle, background geometry, or image composition. Lighting should appear
|
| 12 |
+
balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
|
| 13 |
+
Ensure consistent exposure across the entire image with realistic depth and subtle
|
| 14 |
+
shading only where necessary for form.
|
| 15 |
+
output:
|
| 16 |
+
url: image_0.png
|
| 17 |
+
- text: Relight the image to remove all existing lighting conditions and replace them
|
| 18 |
+
with neutral, uniform illumination. Apply soft, evenly distributed lighting with
|
| 19 |
+
no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
|
| 20 |
+
the original identity of all subjects exactly—preserve facial structure, skin
|
| 21 |
+
tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
|
| 22 |
+
camera angle, background geometry, or image composition. Lighting should appear
|
| 23 |
+
balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
|
| 24 |
+
Ensure consistent exposure across the entire image with realistic depth and subtle
|
| 25 |
+
shading only where necessary for form.
|
| 26 |
+
output:
|
| 27 |
+
url: image_1.png
|
| 28 |
+
- text: Relight the image to remove all existing lighting conditions and replace them
|
| 29 |
+
with neutral, uniform illumination. Apply soft, evenly distributed lighting with
|
| 30 |
+
no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
|
| 31 |
+
the original identity of all subjects exactly—preserve facial structure, skin
|
| 32 |
+
tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
|
| 33 |
+
camera angle, background geometry, or image composition. Lighting should appear
|
| 34 |
+
balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
|
| 35 |
+
Ensure consistent exposure across the entire image with realistic depth and subtle
|
| 36 |
+
shading only where necessary for form.
|
| 37 |
+
output:
|
| 38 |
+
url: image_2.png
|
| 39 |
+
- text: Relight the image to remove all existing lighting conditions and replace them
|
| 40 |
+
with neutral, uniform illumination. Apply soft, evenly distributed lighting with
|
| 41 |
+
no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
|
| 42 |
+
the original identity of all subjects exactly—preserve facial structure, skin
|
| 43 |
+
tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
|
| 44 |
+
camera angle, background geometry, or image composition. Lighting should appear
|
| 45 |
+
balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
|
| 46 |
+
Ensure consistent exposure across the entire image with realistic depth and subtle
|
| 47 |
+
shading only where necessary for form.
|
| 48 |
+
output:
|
| 49 |
+
url: image_3.png
|
| 50 |
+
tags:
|
| 51 |
+
- text-to-image
|
| 52 |
+
- diffusers-training
|
| 53 |
+
- diffusers
|
| 54 |
+
- lora
|
| 55 |
+
- flux2
|
| 56 |
+
- flux2-diffusers
|
| 57 |
+
- template:sd-lora
|
| 58 |
+
---
|
| 59 |
+
|
| 60 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
| 61 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 62 |
+
|
| 63 |
+
|
| 64 |
+
# Flux.2 [Klein] DreamBooth LoRA - linoyts/Flux2-Klein-Delight-LoRA
|
| 65 |
+
|
| 66 |
+
<Gallery />
|
| 67 |
+
|
| 68 |
+
## Model description
|
| 69 |
+
|
| 70 |
+
These are linoyts/Flux2-Klein-Delight-LoRA DreamBooth LoRA weights for black-forest-labs/FLUX.2-klein-base-9B.
|
| 71 |
+
|
| 72 |
+
The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux2 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux2.md).
|
| 73 |
+
|
| 74 |
+
FP8 training? True
|
| 75 |
+
|
| 76 |
+
## Trigger words
|
| 77 |
+
|
| 78 |
+
You should use `None` to trigger the image generation.
|
| 79 |
+
|
| 80 |
+
## Download model
|
| 81 |
+
|
| 82 |
+
[Download the *.safetensors LoRA](linoyts/Flux2-Klein-Delight-LoRA/tree/main) in the Files & versions tab.
|
| 83 |
+
|
| 84 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
| 85 |
+
|
| 86 |
+
```py
|
| 87 |
+
from diffusers import AutoPipelineForText2Image
|
| 88 |
+
import torch
|
| 89 |
+
pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.2", torch_dtype=torch.bfloat16).to('cuda')
|
| 90 |
+
pipeline.load_lora_weights('linoyts/Flux2-Klein-Delight-LoRA', weight_name='pytorch_lora_weights.safetensors')
|
| 91 |
+
image = pipeline('Relight the image to remove all existing lighting conditions and replace them with neutral, uniform illumination. Apply soft, evenly distributed lighting with no directional shadows, no harsh highlights, and no dramatic contrast. Maintain the original identity of all subjects exactly—preserve facial structure, skin tone, proportions, expressions, hair, clothing, and textures. Do not alter pose, camera angle, background geometry, or image composition. Lighting should appear balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup. Ensure consistent exposure across the entire image with realistic depth and subtle shading only where necessary for form.').images[0]
|
| 92 |
+
```
|
| 93 |
+
|
| 94 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
| 95 |
+
|
| 96 |
+
## License
|
| 97 |
+
|
| 98 |
+
Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.2/blob/main/LICENSE.md).
|
| 99 |
+
|
| 100 |
+
|
| 101 |
+
## Intended uses & limitations
|
| 102 |
+
|
| 103 |
+
#### How to use
|
| 104 |
+
|
| 105 |
+
```python
|
| 106 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
| 107 |
+
```
|
| 108 |
+
|
| 109 |
+
#### Limitations and bias
|
| 110 |
+
|
| 111 |
+
[TODO: provide examples of latent issues and potential remediations]
|
| 112 |
+
|
| 113 |
+
## Training details
|
| 114 |
+
|
| 115 |
+
[TODO: describe the data used to train the model]
|
checkpoint-1000/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc92596742672358800b3e941739de20201971a6088d318624a8c11da1c20137
|
| 3 |
+
size 8597707
|
checkpoint-1000/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2313b5e548f982e25c687da66bb10e0ae5ca8a0ea67a71916cc1bb521b5b2fb
|
| 3 |
+
size 16786816
|
checkpoint-1000/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a18b5161a6d6944c269fa1aea436a45f824536cca9274fb143995f47f88fa63b
|
| 3 |
+
size 14757
|
checkpoint-1000/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d5ca5fd1f3d50dfbd88c5f854e399c1c22a842d2231d41415da16bf924479e76
|
| 3 |
+
size 1401
|
checkpoint-500/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d74f1ca028954cea47bd7260a483c937bf3dde42e061b99b02063967ba24099
|
| 3 |
+
size 8597707
|
checkpoint-500/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:244a08e3d024e6136eea44c69a0f8e5a491ab01669cccab2a6ff43b2a0311432
|
| 3 |
+
size 16786816
|
checkpoint-500/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64611be5220d7c2fa7124836fcaec65a82637df14aa59605a5ad621af52fbddc
|
| 3 |
+
size 14757
|
checkpoint-500/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8baa45cc00e6da1eefbbbc2d50fb568432ef1e20241f0a3571b49dcb8d62f7f2
|
| 3 |
+
size 1401
|
image_0.png
ADDED
|
Git LFS Details
|
image_1.png
ADDED
|
Git LFS Details
|
image_2.png
ADDED
|
Git LFS Details
|
image_3.png
ADDED
|
Git LFS Details
|
logs/dreambooth-flux2-image2img-lora/1769679228.1513677/events.out.tfevents.1769679228.209-20-158-47.1224629.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c309ab77a2baec61a82441cbca71b36ab2d2a25f5693c550f1485dd3ec1d73e8
|
| 3 |
+
size 4144
|
logs/dreambooth-flux2-image2img-lora/1769679228.1548688/hparams.yml
ADDED
|
@@ -0,0 +1,86 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.0001
|
| 5 |
+
adam_weight_decay_text_encoder: 0.001
|
| 6 |
+
allow_tf32: false
|
| 7 |
+
aspect_ratio_buckets: null
|
| 8 |
+
bnb_quantization_config_path: null
|
| 9 |
+
cache_dir: null
|
| 10 |
+
cache_latents: true
|
| 11 |
+
caption_column: prompt
|
| 12 |
+
center_crop: false
|
| 13 |
+
checkpointing_steps: 500
|
| 14 |
+
checkpoints_total_limit: null
|
| 15 |
+
class_data_dir: null
|
| 16 |
+
cond_image_column: input_image
|
| 17 |
+
dataloader_num_workers: 0
|
| 18 |
+
dataset_config_name: null
|
| 19 |
+
dataset_name: linoyts/flux-delight-dataset
|
| 20 |
+
do_fp8_training: true
|
| 21 |
+
enable_npu_flash_attention: false
|
| 22 |
+
final_validation_prompt: null
|
| 23 |
+
fsdp_text_encoder: false
|
| 24 |
+
gradient_accumulation_steps: 1
|
| 25 |
+
gradient_checkpointing: true
|
| 26 |
+
guidance_scale: 3.5
|
| 27 |
+
hub_model_id: null
|
| 28 |
+
hub_token: null
|
| 29 |
+
image_column: output_image
|
| 30 |
+
instance_data_dir: null
|
| 31 |
+
instance_prompt: null
|
| 32 |
+
learning_rate: 0.0001
|
| 33 |
+
local_rank: -1
|
| 34 |
+
logging_dir: logs
|
| 35 |
+
logit_mean: 0.0
|
| 36 |
+
logit_std: 1.0
|
| 37 |
+
lora_alpha: 4
|
| 38 |
+
lora_dropout: 0.0
|
| 39 |
+
lora_layers: null
|
| 40 |
+
lr_num_cycles: 1
|
| 41 |
+
lr_power: 1.0
|
| 42 |
+
lr_scheduler: constant_with_warmup
|
| 43 |
+
lr_warmup_steps: 200
|
| 44 |
+
max_grad_norm: 1.0
|
| 45 |
+
max_sequence_length: 512
|
| 46 |
+
max_train_steps: 1000
|
| 47 |
+
mixed_precision: null
|
| 48 |
+
mode_scale: 1.29
|
| 49 |
+
num_train_epochs: 8
|
| 50 |
+
num_validation_images: 4
|
| 51 |
+
offload: false
|
| 52 |
+
optimizer: adamw
|
| 53 |
+
output_dir: Flux2-Klein-Delight-LoRA
|
| 54 |
+
pretrained_model_name_or_path: black-forest-labs/FLUX.2-klein-base-9B
|
| 55 |
+
prodigy_beta3: null
|
| 56 |
+
prodigy_decouple: true
|
| 57 |
+
prodigy_safeguard_warmup: true
|
| 58 |
+
prodigy_use_bias_correction: true
|
| 59 |
+
push_to_hub: true
|
| 60 |
+
random_flip: false
|
| 61 |
+
rank: 16
|
| 62 |
+
repeats: 1
|
| 63 |
+
report_to: tensorboard
|
| 64 |
+
resolution: 1024
|
| 65 |
+
resume_from_checkpoint: null
|
| 66 |
+
revision: null
|
| 67 |
+
sample_batch_size: 4
|
| 68 |
+
scale_lr: false
|
| 69 |
+
seed: 0
|
| 70 |
+
skip_final_inference: false
|
| 71 |
+
train_batch_size: 1
|
| 72 |
+
upcast_before_saving: false
|
| 73 |
+
use_8bit_adam: true
|
| 74 |
+
validation_epochs: 50
|
| 75 |
+
validation_image: wednesday.jpg
|
| 76 |
+
validation_prompt: "Relight the image to remove all existing lighting conditions and\
|
| 77 |
+
\ replace them with neutral, uniform illumination. Apply soft, evenly distributed\
|
| 78 |
+
\ lighting with no directional shadows, no harsh highlights, and no dramatic contrast.\
|
| 79 |
+
\ Maintain the original identity of all subjects exactly\u2014preserve facial structure,\
|
| 80 |
+
\ skin tone, proportions, expressions, hair, clothing, and textures. Do not alter\
|
| 81 |
+
\ pose, camera angle, background geometry, or image composition. Lighting should\
|
| 82 |
+
\ appear balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox\
|
| 83 |
+
\ setup. Ensure consistent exposure across the entire image with realistic depth\
|
| 84 |
+
\ and subtle shading only where necessary for form."
|
| 85 |
+
variant: null
|
| 86 |
+
weighting_scheme: none
|
logs/dreambooth-flux2-image2img-lora/events.out.tfevents.1769679228.209-20-158-47.1224629.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c47b947f3d28cb2470cc60a0989d6c55ce5392e7d34e329fda9f7d4e510661d
|
| 3 |
+
size 5090
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2313b5e548f982e25c687da66bb10e0ae5ca8a0ea67a71916cc1bb521b5b2fb
|
| 3 |
+
size 16786816
|