domipapp commited on
Commit
88e3619
·
verified ·
1 Parent(s): a1037e4

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,20 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ image-0.png filter=lfs diff=lfs merge=lfs -text
37
+ image-1.png filter=lfs diff=lfs merge=lfs -text
38
+ image-10.png filter=lfs diff=lfs merge=lfs -text
39
+ image-11.png filter=lfs diff=lfs merge=lfs -text
40
+ image-12.png filter=lfs diff=lfs merge=lfs -text
41
+ image-13.png filter=lfs diff=lfs merge=lfs -text
42
+ image-14.png filter=lfs diff=lfs merge=lfs -text
43
+ image-15.png filter=lfs diff=lfs merge=lfs -text
44
+ image-16.png filter=lfs diff=lfs merge=lfs -text
45
+ image-2.png filter=lfs diff=lfs merge=lfs -text
46
+ image-3.png filter=lfs diff=lfs merge=lfs -text
47
+ image-4.png filter=lfs diff=lfs merge=lfs -text
48
+ image-5.png filter=lfs diff=lfs merge=lfs -text
49
+ image-6.png filter=lfs diff=lfs merge=lfs -text
50
+ image-7.png filter=lfs diff=lfs merge=lfs -text
51
+ image-8.png filter=lfs diff=lfs merge=lfs -text
52
+ image-9.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - stable-diffusion-xl
4
+ - stable-diffusion-xl-diffusers
5
+ - text-to-image
6
+ - diffusers
7
+ - lora
8
+ - template:sd-lora
9
+ widget:
10
+ - text: An image of a 28 year old man <s0><s1>
11
+ output:
12
+ url: image-0.png
13
+ - text: An image of a 28 year old man <s0><s1>
14
+ output:
15
+ url: image-1.png
16
+ - text: An image of a 28 year old man <s0><s1>
17
+ output:
18
+ url: image-2.png
19
+ - text: An image of a 28 year old man with a goofy face expression <s0><s1>
20
+ output:
21
+ url: image-3.png
22
+ - text: An image of a 28 year old man with a sad face expression <s0><s1>
23
+ output:
24
+ url: image-4.png
25
+ - text: An sitting portrait image of a 28 year old man <s0><s1>
26
+ output:
27
+ url: image-5.png
28
+ - text: An image of a 28 year old man with a smile <s0><s1>
29
+ output:
30
+ url: image-6.png
31
+ - text: An image of a 28 year old man with a serious face expression <s0><s1>
32
+ output:
33
+ url: image-7.png
34
+ - text: An image of a 28 year old man with a serious face expression <s0><s1>
35
+ output:
36
+ url: image-8.png
37
+ - text: An image of a 28 year old man with a happy face expression holding a cat <s0><s1>
38
+ output:
39
+ url: image-9.png
40
+ - text: An image of a 28 year old man with an angry face expression <s0><s1>
41
+ output:
42
+ url: image-10.png
43
+ - text: An image of a 28 year old man <s0><s1>
44
+ output:
45
+ url: image-11.png
46
+ - text: An image of a 28 year old man in the mountains <s0><s1>
47
+ output:
48
+ url: image-12.png
49
+ - text: An image of a 28 year old man outdoors <s0><s1>
50
+ output:
51
+ url: image-13.png
52
+ - text: A close-up image of a 28 year old man with a serious face expression <s0><s1>
53
+ output:
54
+ url: image-14.png
55
+ - text: A close-up image of a 28 year old man with a goofy face expression <s0><s1>
56
+ output:
57
+ url: image-15.png
58
+ - text: Eddie Redmayne man <s0><s1>
59
+ output:
60
+ url: image-16.png
61
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
62
+ instance_prompt: Eddie Redmayne man <s0><s1>
63
+ license: openrail++
64
+ ---
65
+
66
+ # SDXL LoRA DreamBooth - domipapp/domiai2-0
67
+
68
+ <Gallery />
69
+
70
+ ## Model description
71
+
72
+ ### These are domipapp/domiai2-0 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
73
+
74
+ ## Download model
75
+
76
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
77
+
78
+ - **LoRA**: download **[`domiai2-0.safetensors` here 💾](/domipapp/domiai2-0/blob/main/domiai2-0.safetensors)**.
79
+ - Place it on your `models/Lora` folder.
80
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:domiai2-0:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
81
+ - *Embeddings*: download **[`domiai2-0_emb.safetensors` here 💾](/domipapp/domiai2-0/blob/main/domiai2-0_emb.safetensors)**.
82
+ - Place it on it on your `embeddings` folder
83
+ - Use it by adding `domiai2-0_emb` to your prompt. For example, `Eddie Redmayne man domiai2-0_emb`
84
+ (you need both the LoRA and the embeddings as they were trained together for this LoRA)
85
+
86
+
87
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
88
+
89
+ ```py
90
+ from diffusers import AutoPipelineForText2Image
91
+ import torch
92
+ from huggingface_hub import hf_hub_download
93
+ from safetensors.torch import load_file
94
+
95
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
96
+ pipeline.load_lora_weights('domipapp/domiai2-0', weight_name='pytorch_lora_weights.safetensors')
97
+ embedding_path = hf_hub_download(repo_id='domipapp/domiai2-0', filename='domiai2-0_emb.safetensors' repo_type="model")
98
+ state_dict = load_file(embedding_path)
99
+ pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
100
+ pipeline.load_textual_inversion(state_dict["clip_g"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
101
+
102
+ image = pipeline('Eddie Redmayne man <s0><s1>').images[0]
103
+ ```
104
+
105
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
106
+
107
+ ## Trigger words
108
+
109
+ To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
110
+
111
+ to trigger concept `TOK` → use `<s0><s1>` in your prompt
112
+
113
+
114
+
115
+ ## Details
116
+ All [Files & versions](/domipapp/domiai2-0/tree/main).
117
+
118
+ The weights were trained using [🧨 diffusers Advanced Dreambooth Training Script](https://github.com/huggingface/diffusers/blob/main/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py).
119
+
120
+ LoRA for the text encoder was enabled. False.
121
+
122
+ Pivotal tuning was enabled: True.
123
+
124
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
125
+
domiai2-0.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ba9103df0163cf22498292a18ade542c446dad99b48df97966090a1b0226a8b
3
+ size 186046568
domiai2-0_emb.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8949985a6edfa2743980fadb386f11cd860f1a19a61718074868218fda681e50
3
+ size 16536
image-0.png ADDED

Git LFS Details

  • SHA256: 5a0df64e9c31610855ebb1697809672f5cba9c61d54fafbbdded0a972898734a
  • Pointer size: 132 Bytes
  • Size of remote file: 1.31 MB
image-1.png ADDED

Git LFS Details

  • SHA256: d330b27e64f988d2bb20bb3797efaa90659414101424af1886f384faa4e6a2d0
  • Pointer size: 132 Bytes
  • Size of remote file: 1.46 MB
image-10.png ADDED

Git LFS Details

  • SHA256: 581f3c34428e42f286d6efe6c3b1e17b5e7a78d56cdb9619d6244f62d043438c
  • Pointer size: 132 Bytes
  • Size of remote file: 1.34 MB
image-11.png ADDED

Git LFS Details

  • SHA256: 05544922933973fcf57b53597ff7aecb1987fbba70efd54fd5117928c271e6f1
  • Pointer size: 132 Bytes
  • Size of remote file: 1.26 MB
image-12.png ADDED

Git LFS Details

  • SHA256: e811a05828889977f2814feb0a7685781faf751cbe0c4fcd6dbf87bc7d274e79
  • Pointer size: 132 Bytes
  • Size of remote file: 1.7 MB
image-13.png ADDED

Git LFS Details

  • SHA256: b50e282e62678e033bf5f0f209b0dc0d07680763b2efd1c9213841be78d89984
  • Pointer size: 132 Bytes
  • Size of remote file: 1.42 MB
image-14.png ADDED

Git LFS Details

  • SHA256: 4c3d893544bc230a7b6d511b9f88abe573e0bfd434a80f4d8762ca42a0815166
  • Pointer size: 132 Bytes
  • Size of remote file: 1.36 MB
image-15.png ADDED

Git LFS Details

  • SHA256: d3ae8420d39e38ac780077c9ad126fd3f4782c65a68fb6562fe0d9f26c45b7b9
  • Pointer size: 132 Bytes
  • Size of remote file: 1.45 MB
image-16.png ADDED

Git LFS Details

  • SHA256: ba4a27115746feb6c5d1c0141dcacac859c78385471e1f68dd3a2f6b307208a7
  • Pointer size: 132 Bytes
  • Size of remote file: 1.52 MB
image-2.png ADDED

Git LFS Details

  • SHA256: 150aca37c6646a4c1659f8323c5ed9de0388e0a3ac4bb6f17fb4f1116530d9c9
  • Pointer size: 132 Bytes
  • Size of remote file: 1.81 MB
image-3.png ADDED

Git LFS Details

  • SHA256: 103a020c9c6ba08d2eab9c61102d3387742c7509c8d5b7f817fc1a73e7b77d17
  • Pointer size: 132 Bytes
  • Size of remote file: 1.47 MB
image-4.png ADDED

Git LFS Details

  • SHA256: b69098c913b0e81bb5838b794e8a048714322958c6e1ac236025b06c8dcabb43
  • Pointer size: 132 Bytes
  • Size of remote file: 1.27 MB
image-5.png ADDED

Git LFS Details

  • SHA256: 0e7188c5167051338ab5615935cb0f98ce0208470ee0399dcb6d13afd72d6b5a
  • Pointer size: 132 Bytes
  • Size of remote file: 1.64 MB
image-6.png ADDED

Git LFS Details

  • SHA256: 95a7ff303aac8432f07bd3b1267bae8d27bacc9faf7c17fc0af2a5d7be5c0b42
  • Pointer size: 132 Bytes
  • Size of remote file: 1.33 MB
image-7.png ADDED

Git LFS Details

  • SHA256: ee426d17f1f826c2d86083cdb5b7fcd979a9e4785350f76f13ca57e45f1acfcd
  • Pointer size: 132 Bytes
  • Size of remote file: 1.28 MB
image-8.png ADDED

Git LFS Details

  • SHA256: 89763aa59d4f4694184130c9bd8e0364cf1bbdc8bc1648ee7eeb9f5365799793
  • Pointer size: 132 Bytes
  • Size of remote file: 1.28 MB
image-9.png ADDED

Git LFS Details

  • SHA256: c33239697110a1e40154d74bf5dc0af764c10d0db8fe6e978451803d68b4acf7
  • Pointer size: 132 Bytes
  • Size of remote file: 1.85 MB
logs/dreambooth-lora-sd-xl/1726339981.0736861/events.out.tfevents.1726339981.r-domipapp-autotrain-domiai2-0-0tlz6u40-f5262-ogcf8.224.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7369521830c155b980f56be3f8113b7b82d76e567bfa5a5ebc7a1a8701ed96a0
3
+ size 3710
logs/dreambooth-lora-sd-xl/1726339981.0748594/hparams.yml ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: null
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: true
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 100000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: e2275c52-e8a7-45b9-a8f4-545f469916b4
14
+ class_prompt: a photo of a person
15
+ crops_coords_top_left_h: 0
16
+ crops_coords_top_left_w: 0
17
+ dataloader_num_workers: 0
18
+ dataset_config_name: null
19
+ dataset_name: ./6e109a42-aa52-46a4-98d1-b4dedf9e1965
20
+ enable_xformers_memory_efficient_attention: false
21
+ gradient_accumulation_steps: 1
22
+ gradient_checkpointing: true
23
+ hub_model_id: null
24
+ hub_token: null
25
+ image_column: image
26
+ instance_data_dir: null
27
+ instance_prompt: Eddie Redmayne man <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: -1
30
+ logging_dir: logs
31
+ lr_num_cycles: 1
32
+ lr_power: 1.0
33
+ lr_scheduler: constant
34
+ lr_warmup_steps: 0
35
+ max_grad_norm: 1.0
36
+ max_train_steps: 1275
37
+ mixed_precision: bf16
38
+ noise_offset: 0
39
+ num_class_images: 150
40
+ num_new_tokens_per_abstraction: 2
41
+ num_train_epochs: 17
42
+ num_validation_images: 4
43
+ optimizer: prodigy
44
+ output_dir: domiai2-0
45
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
46
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
47
+ prior_generation_precision: null
48
+ prior_loss_weight: 1.0
49
+ prodigy_beta3: null
50
+ prodigy_decouple: true
51
+ prodigy_safeguard_warmup: true
52
+ prodigy_use_bias_correction: true
53
+ push_to_hub: false
54
+ rank: 32
55
+ repeats: 2
56
+ report_to: tensorboard
57
+ resolution: 1024
58
+ resume_from_checkpoint: null
59
+ revision: null
60
+ sample_batch_size: 4
61
+ scale_lr: false
62
+ seed: 42
63
+ snr_gamma: null
64
+ text_encoder_lr: 1.0
65
+ token_abstraction: TOK
66
+ train_batch_size: 2
67
+ train_text_encoder: false
68
+ train_text_encoder_frac: 1.0
69
+ train_text_encoder_ti: true
70
+ train_text_encoder_ti_frac: 0.5
71
+ use_8bit_adam: false
72
+ validation_epochs: 50
73
+ validation_prompt: null
74
+ variant: null
75
+ with_prior_preservation: true
logs/dreambooth-lora-sd-xl/events.out.tfevents.1726339981.r-domipapp-autotrain-domiai2-0-0tlz6u40-f5262-ogcf8.224.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c43ab0e61562a35af52c62759a8f55fc21a4d0288e495bbbf07efd1096ad876c
3
+ size 106934
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:873f17afdddb5bfb03a5a2e509c65b9c42674388ff93e7324a715cad9780643f
3
+ size 185963768