End of training

README.md

@@ -0,0 +1,85 @@
+---
+base_model: black-forest-labs/FLUX.1-dev
+library_name: diffusers
+license: other
+instance_prompt: photo of <s0><s1><s2> plush bird
+widget: []
+tags:
+- text-to-image
+- diffusers-training
+- diffusers
+- lora
+- flux
+- flux-diffusers
+- template:sd-lora
+---
+
+<!-- This model card has been generated automatically according to the information the training script had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+
+# Flux DreamBooth LoRA - cwhuh/ponix-generator
+
+<Gallery />
+
+## Model description
+
+These are cwhuh/ponix-generator DreamBooth LoRA weights for black-forest-labs/FLUX.1-dev.
+
+The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux.md).
+
+Was LoRA for the text encoder enabled? False.
+
+Pivotal tuning was enabled: True.
+
+## Trigger words
+
+To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
+
+    to trigger concept `ponix` → use `<s0><s1><s2>` in your prompt 
+
+    
+
+## Download model
+
+[Download the *.safetensors LoRA](cwhuh/ponix-generator/tree/main) in the Files & versions tab.
+
+## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
+
+```py
+from diffusers import AutoPipelineForText2Image
+import torch
+from huggingface_hub import hf_hub_download
+    from safetensors.torch import load_file
+            
+pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16).to('cuda')
+pipeline.load_lora_weights('cwhuh/ponix-generator', weight_name='pytorch_lora_weights.safetensors')
+embedding_path = hf_hub_download(repo_id='cwhuh/ponix-generator', filename='./ckpt/ponix-generator_emb.safetensors', repo_type="model")
+    state_dict = load_file(embedding_path)
+    pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>", "<s2>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
+            
+image = pipeline('photo of <s0><s1><s2> plush bird').images[0]
+```
+
+For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
+
+## License
+
+Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md).
+
+
+## Intended uses & limitations
+
+#### How to use
+
+```python
+# TODO: add an example code snippet for running this diffusion pipeline
+```
+
+#### Limitations and bias
+
+[TODO: provide examples of latent issues and potential remediations]
+
+## Training details
+
+[TODO: describe the data used to train the model]

checkpoint-1000/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db73caca3bde8a887dfe8895a96a6d2847b708f7c2b832bc7eb694b48fd87b4a
+size 738345542

checkpoint-1000/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28ad9b6259056741062d7028961ed51e3b38d3219ee57d1bac6a0e69e0ec5e7b
+size 37406344

checkpoint-1000/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72e9b59f7e4a25a129507b5f30e794f0886f951de75d2d0b458c3da4b05dda10
+size 14344

checkpoint-1000/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02c1875712672363efa2b38e5618a6dbdca576b421269b59a3333e86755f0b21
+size 1064

checkpoint-500/optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0782097cab3b139ae47912ce045cdc195f3281f6db662791bf5e5655675e0e35
+size 738345542

checkpoint-500/pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95223199beb2c9dee65a0c689a37414d61756c607794d27e6b7995110d89f2b4
+size 37406344

checkpoint-500/random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dea532c610bb4140a9180711c9460713ecf79280654b432370b69c793ce83567
+size 14344

checkpoint-500/scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72ef7361eb3ca738d82f6b0ce999ee77ee2bbe2c79a64c85a993f2a2eea063c5
+size 1064

logs/dreambooth-flux-dev-lora-advanced/1741496211.6550972/events.out.tfevents.1741496211.81a08c12101c.5433.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91de5de452dd9abfb460bc59d4e4abc25871089195b172091f1653be7b2f64d7
+size 3805

logs/dreambooth-flux-dev-lora-advanced/1741496211.667142/hparams.yml

@@ -0,0 +1,80 @@
+adam_beta1: 0.9
+adam_beta2: 0.999
+adam_epsilon: 1.0e-08
+adam_weight_decay: 0.0001
+adam_weight_decay_text_encoder: 0.001
+allow_tf32: false
+cache_dir: /workspace/ponix-generator/model
+cache_latents: false
+caption_column: null
+center_crop: false
+checkpointing_steps: 500
+checkpoints_total_limit: null
+class_data_dir: null
+class_prompt: null
+dataloader_num_workers: 0
+dataset_config_name: null
+dataset_name: null
+enable_t5_ti: false
+gradient_accumulation_steps: 1
+gradient_checkpointing: true
+guidance_scale: 1.0
+hub_model_id: null
+hub_token: null
+image_column: image
+initializer_concept: red plush bird
+instance_data_dir: ./data/instance
+instance_prompt: photo of <s0><s1><s2> plush bird
+learning_rate: 1.0
+local_rank: -1
+logging_dir: logs
+logit_mean: 0.0
+logit_std: 1.0
+lora_layers: attn.to_k,attn.to_q,attn.to_v,attn.to_out.0
+lr_num_cycles: 1
+lr_power: 1.0
+lr_scheduler: constant
+lr_warmup_steps: 500
+max_grad_norm: 1.0
+max_sequence_length: 512
+max_train_steps: 1000
+mixed_precision: bf16
+mode_scale: 1.29
+num_class_images: 1000
+num_new_tokens_per_abstraction: null
+num_train_epochs: 167
+num_validation_images: 4
+optimizer: prodigy
+output_dir: ./ckpt/ponix-generator
+pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
+prior_generation_precision: null
+prior_loss_weight: 1.0
+prodigy_beta3: null
+prodigy_decouple: true
+prodigy_safeguard_warmup: true
+prodigy_use_bias_correction: true
+push_to_hub: true
+random_flip: false
+rank: 16
+repeats: 1
+report_to: tensorboard
+resolution: 768
+resume_from_checkpoint: latest
+revision: null
+sample_batch_size: 4
+scale_lr: false
+seed: null
+text_encoder_lr: 5.0e-06
+token_abstraction: ponix
+train_batch_size: 1
+train_text_encoder: false
+train_text_encoder_frac: 1.0
+train_text_encoder_ti: true
+train_text_encoder_ti_frac: 0.25
+train_transformer_frac: 1.0
+use_8bit_adam: false
+validation_epochs: 50
+validation_prompt: null
+variant: null
+weighting_scheme: none
+with_prior_preservation: false

logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1741496211.81a08c12101c.5433.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dad0cc3b9e736720212ad2026c1ef163040ce6333085b93ddacdc80f368fcafa
+size 83834

ponix-generator_emb.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0c2de2afb51ea627ab311a1cb0702279f8da73dc9658b723cf37dca828754a8
+size 9296

pytorch_lora_weights.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28ad9b6259056741062d7028961ed51e3b38d3219ee57d1bac6a0e69e0ec5e7b
+size 37406344