linoyts HF Staff commited on
Commit
34acb88
·
verified ·
1 Parent(s): ddc06ce

End of training

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ image_0.png filter=lfs diff=lfs merge=lfs -text
37
+ image_1.png filter=lfs diff=lfs merge=lfs -text
38
+ image_2.png filter=lfs diff=lfs merge=lfs -text
39
+ image_3.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,115 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/FLUX.2-klein-base-9B
3
+ library_name: diffusers
4
+ license: other
5
+ widget:
6
+ - text: Relight the image to remove all existing lighting conditions and replace them
7
+ with neutral, uniform illumination. Apply soft, evenly distributed lighting with
8
+ no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
9
+ the original identity of all subjects exactly—preserve facial structure, skin
10
+ tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
11
+ camera angle, background geometry, or image composition. Lighting should appear
12
+ balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
13
+ Ensure consistent exposure across the entire image with realistic depth and subtle
14
+ shading only where necessary for form.
15
+ output:
16
+ url: image_0.png
17
+ - text: Relight the image to remove all existing lighting conditions and replace them
18
+ with neutral, uniform illumination. Apply soft, evenly distributed lighting with
19
+ no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
20
+ the original identity of all subjects exactly—preserve facial structure, skin
21
+ tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
22
+ camera angle, background geometry, or image composition. Lighting should appear
23
+ balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
24
+ Ensure consistent exposure across the entire image with realistic depth and subtle
25
+ shading only where necessary for form.
26
+ output:
27
+ url: image_1.png
28
+ - text: Relight the image to remove all existing lighting conditions and replace them
29
+ with neutral, uniform illumination. Apply soft, evenly distributed lighting with
30
+ no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
31
+ the original identity of all subjects exactly—preserve facial structure, skin
32
+ tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
33
+ camera angle, background geometry, or image composition. Lighting should appear
34
+ balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
35
+ Ensure consistent exposure across the entire image with realistic depth and subtle
36
+ shading only where necessary for form.
37
+ output:
38
+ url: image_2.png
39
+ - text: Relight the image to remove all existing lighting conditions and replace them
40
+ with neutral, uniform illumination. Apply soft, evenly distributed lighting with
41
+ no directional shadows, no harsh highlights, and no dramatic contrast. Maintain
42
+ the original identity of all subjects exactly—preserve facial structure, skin
43
+ tone, proportions, expressions, hair, clothing, and textures. Do not alter pose,
44
+ camera angle, background geometry, or image composition. Lighting should appear
45
+ balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup.
46
+ Ensure consistent exposure across the entire image with realistic depth and subtle
47
+ shading only where necessary for form.
48
+ output:
49
+ url: image_3.png
50
+ tags:
51
+ - text-to-image
52
+ - diffusers-training
53
+ - diffusers
54
+ - lora
55
+ - flux2
56
+ - flux2-diffusers
57
+ - template:sd-lora
58
+ ---
59
+
60
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
61
+ should probably proofread and complete it, then remove this comment. -->
62
+
63
+
64
+ # Flux.2 [Klein] DreamBooth LoRA - linoyts/Flux2-Klein-Delight-LoRA
65
+
66
+ <Gallery />
67
+
68
+ ## Model description
69
+
70
+ These are linoyts/Flux2-Klein-Delight-LoRA DreamBooth LoRA weights for black-forest-labs/FLUX.2-klein-base-9B.
71
+
72
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux2 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux2.md).
73
+
74
+ FP8 training? True
75
+
76
+ ## Trigger words
77
+
78
+ You should use `None` to trigger the image generation.
79
+
80
+ ## Download model
81
+
82
+ [Download the *.safetensors LoRA](linoyts/Flux2-Klein-Delight-LoRA/tree/main) in the Files & versions tab.
83
+
84
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
85
+
86
+ ```py
87
+ from diffusers import AutoPipelineForText2Image
88
+ import torch
89
+ pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.2", torch_dtype=torch.bfloat16).to('cuda')
90
+ pipeline.load_lora_weights('linoyts/Flux2-Klein-Delight-LoRA', weight_name='pytorch_lora_weights.safetensors')
91
+ image = pipeline('Relight the image to remove all existing lighting conditions and replace them with neutral, uniform illumination. Apply soft, evenly distributed lighting with no directional shadows, no harsh highlights, and no dramatic contrast. Maintain the original identity of all subjects exactly—preserve facial structure, skin tone, proportions, expressions, hair, clothing, and textures. Do not alter pose, camera angle, background geometry, or image composition. Lighting should appear balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox setup. Ensure consistent exposure across the entire image with realistic depth and subtle shading only where necessary for form.').images[0]
92
+ ```
93
+
94
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
95
+
96
+ ## License
97
+
98
+ Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.2/blob/main/LICENSE.md).
99
+
100
+
101
+ ## Intended uses & limitations
102
+
103
+ #### How to use
104
+
105
+ ```python
106
+ # TODO: add an example code snippet for running this diffusion pipeline
107
+ ```
108
+
109
+ #### Limitations and bias
110
+
111
+ [TODO: provide examples of latent issues and potential remediations]
112
+
113
+ ## Training details
114
+
115
+ [TODO: describe the data used to train the model]
checkpoint-1000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc92596742672358800b3e941739de20201971a6088d318624a8c11da1c20137
3
+ size 8597707
checkpoint-1000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2313b5e548f982e25c687da66bb10e0ae5ca8a0ea67a71916cc1bb521b5b2fb
3
+ size 16786816
checkpoint-1000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a18b5161a6d6944c269fa1aea436a45f824536cca9274fb143995f47f88fa63b
3
+ size 14757
checkpoint-1000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5ca5fd1f3d50dfbd88c5f854e399c1c22a842d2231d41415da16bf924479e76
3
+ size 1401
checkpoint-500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d74f1ca028954cea47bd7260a483c937bf3dde42e061b99b02063967ba24099
3
+ size 8597707
checkpoint-500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:244a08e3d024e6136eea44c69a0f8e5a491ab01669cccab2a6ff43b2a0311432
3
+ size 16786816
checkpoint-500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64611be5220d7c2fa7124836fcaec65a82637df14aa59605a5ad621af52fbddc
3
+ size 14757
checkpoint-500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8baa45cc00e6da1eefbbbc2d50fb568432ef1e20241f0a3571b49dcb8d62f7f2
3
+ size 1401
image_0.png ADDED

Git LFS Details

  • SHA256: 8da932fea4dddcef310f3eb848951aa2c684445521d86ec8be624be862bc7e69
  • Pointer size: 132 Bytes
  • Size of remote file: 1.47 MB
image_1.png ADDED

Git LFS Details

  • SHA256: 6ededcde1b9771596c33c9c90a9e53f8db8572f93c1b311a87e5e46bb5c33bed
  • Pointer size: 132 Bytes
  • Size of remote file: 1.51 MB
image_2.png ADDED

Git LFS Details

  • SHA256: 46dff2044a19ba8f20e15ec2026d449b56e5d17d9008af93c6fe4bc56646788e
  • Pointer size: 132 Bytes
  • Size of remote file: 1.32 MB
image_3.png ADDED

Git LFS Details

  • SHA256: 436588aa3cb4540af2843193ba2facab611fa0ab1ca5714a6f9f326f420e3431
  • Pointer size: 132 Bytes
  • Size of remote file: 1.52 MB
logs/dreambooth-flux2-image2img-lora/1769679228.1513677/events.out.tfevents.1769679228.209-20-158-47.1224629.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c309ab77a2baec61a82441cbca71b36ab2d2a25f5693c550f1485dd3ec1d73e8
3
+ size 4144
logs/dreambooth-flux2-image2img-lora/1769679228.1548688/hparams.yml ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ aspect_ratio_buckets: null
8
+ bnb_quantization_config_path: null
9
+ cache_dir: null
10
+ cache_latents: true
11
+ caption_column: prompt
12
+ center_crop: false
13
+ checkpointing_steps: 500
14
+ checkpoints_total_limit: null
15
+ class_data_dir: null
16
+ cond_image_column: input_image
17
+ dataloader_num_workers: 0
18
+ dataset_config_name: null
19
+ dataset_name: linoyts/flux-delight-dataset
20
+ do_fp8_training: true
21
+ enable_npu_flash_attention: false
22
+ final_validation_prompt: null
23
+ fsdp_text_encoder: false
24
+ gradient_accumulation_steps: 1
25
+ gradient_checkpointing: true
26
+ guidance_scale: 3.5
27
+ hub_model_id: null
28
+ hub_token: null
29
+ image_column: output_image
30
+ instance_data_dir: null
31
+ instance_prompt: null
32
+ learning_rate: 0.0001
33
+ local_rank: -1
34
+ logging_dir: logs
35
+ logit_mean: 0.0
36
+ logit_std: 1.0
37
+ lora_alpha: 4
38
+ lora_dropout: 0.0
39
+ lora_layers: null
40
+ lr_num_cycles: 1
41
+ lr_power: 1.0
42
+ lr_scheduler: constant_with_warmup
43
+ lr_warmup_steps: 200
44
+ max_grad_norm: 1.0
45
+ max_sequence_length: 512
46
+ max_train_steps: 1000
47
+ mixed_precision: null
48
+ mode_scale: 1.29
49
+ num_train_epochs: 8
50
+ num_validation_images: 4
51
+ offload: false
52
+ optimizer: adamw
53
+ output_dir: Flux2-Klein-Delight-LoRA
54
+ pretrained_model_name_or_path: black-forest-labs/FLUX.2-klein-base-9B
55
+ prodigy_beta3: null
56
+ prodigy_decouple: true
57
+ prodigy_safeguard_warmup: true
58
+ prodigy_use_bias_correction: true
59
+ push_to_hub: true
60
+ random_flip: false
61
+ rank: 16
62
+ repeats: 1
63
+ report_to: tensorboard
64
+ resolution: 1024
65
+ resume_from_checkpoint: null
66
+ revision: null
67
+ sample_batch_size: 4
68
+ scale_lr: false
69
+ seed: 0
70
+ skip_final_inference: false
71
+ train_batch_size: 1
72
+ upcast_before_saving: false
73
+ use_8bit_adam: true
74
+ validation_epochs: 50
75
+ validation_image: wednesday.jpg
76
+ validation_prompt: "Relight the image to remove all existing lighting conditions and\
77
+ \ replace them with neutral, uniform illumination. Apply soft, evenly distributed\
78
+ \ lighting with no directional shadows, no harsh highlights, and no dramatic contrast.\
79
+ \ Maintain the original identity of all subjects exactly\u2014preserve facial structure,\
80
+ \ skin tone, proportions, expressions, hair, clothing, and textures. Do not alter\
81
+ \ pose, camera angle, background geometry, or image composition. Lighting should\
82
+ \ appear balanced, and studio-neutral, similar to diffuse overcast or a soft lightbox\
83
+ \ setup. Ensure consistent exposure across the entire image with realistic depth\
84
+ \ and subtle shading only where necessary for form."
85
+ variant: null
86
+ weighting_scheme: none
logs/dreambooth-flux2-image2img-lora/events.out.tfevents.1769679228.209-20-158-47.1224629.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c47b947f3d28cb2470cc60a0989d6c55ce5392e7d34e329fda9f7d4e510661d
3
+ size 5090
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2313b5e548f982e25c687da66bb10e0ae5ca8a0ea67a71916cc1bb521b5b2fb
3
+ size 16786816