linoyts HF Staff commited on
Commit
24b9dec
·
verified ·
1 Parent(s): cf73a22

End of training

Browse files
README.md ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/FLUX.1-dev
3
+ library_name: diffusers
4
+ license: other
5
+ tags:
6
+ - text-to-image
7
+ - diffusers-training
8
+ - diffusers
9
+ - lora
10
+ - flux
11
+ - flux-diffusers
12
+ - template:sd-lora
13
+ instance_prompt: <s0>
14
+ widget: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+
21
+ # Flux DreamBooth LoRA - linoyts/linoy_flux_v21
22
+
23
+ <Gallery />
24
+
25
+ ## Model description
26
+
27
+ These are linoyts/linoy_flux_v21 DreamBooth LoRA weights for black-forest-labs/FLUX.1-dev.
28
+
29
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux.md).
30
+
31
+ Was LoRA for the text encoder enabled? False.
32
+
33
+ Pivotal tuning was enabled: True.
34
+
35
+ ## Trigger words
36
+
37
+ To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
38
+
39
+ to trigger concept `TOK` → use `<s0>` in your prompt
40
+
41
+
42
+
43
+ ## Download model
44
+
45
+ [Download the *.safetensors LoRA](linoyts/linoy_flux_v21/tree/main) in the Files & versions tab.
46
+
47
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
48
+
49
+ ```py
50
+ from diffusers import AutoPipelineForText2Image
51
+ import torch
52
+ from huggingface_hub import hf_hub_download
53
+ from safetensors.torch import load_file
54
+
55
+ pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16).to('cuda')
56
+ pipeline.load_lora_weights('linoyts/linoy_flux_v21', weight_name='pytorch_lora_weights.safetensors')
57
+ embedding_path = hf_hub_download(repo_id='linoyts/linoy_flux_v21', filename='linoy_flux_v21_emb.safetensors', repo_type="model")
58
+ state_dict = load_file(embedding_path)
59
+ pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
60
+ pipeline.load_textual_inversion(state_dict["t5"], token=["<s0>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
61
+
62
+ image = pipeline('<s0>').images[0]
63
+ ```
64
+
65
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
66
+
67
+ ## License
68
+
69
+ Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md).
70
+
71
+
72
+ ## Intended uses & limitations
73
+
74
+ #### How to use
75
+
76
+ ```python
77
+ # TODO: add an example code snippet for running this diffusion pipeline
78
+ ```
79
+
80
+ #### Limitations and bias
81
+
82
+ [TODO: provide examples of latent issues and potential remediations]
83
+
84
+ ## Training details
85
+
86
+ [TODO: describe the data used to train the model]
linoy_flux_v21_emb.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a013b08fa8f86432025888ea1df0c234d4516f30022a93807698c961fc6dbde8
3
+ size 11408
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae71abbc7a9c641ffac435b69a57abdce2d7f075aa4d1e8f2eeb79f18db61a4e
3
+ size 37406344