Image-to-Image
Diffusers
flux
flux-diffusers
lora
bertjiazheng commited on
Commit
f90c01e
·
1 Parent(s): 671eb58

Init Commit

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/output1.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/output2.png filter=lfs diff=lfs merge=lfs -text
38
+ assets/output3.png filter=lfs diff=lfs merge=lfs -text
39
+ assets/output4.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -3,4 +3,60 @@ license: other
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: >-
5
  https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev
 
 
 
 
 
 
 
 
 
 
6
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: >-
5
  https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev
6
+ base_model:
7
+ - black-forest-labs/FLUX.1-dev
8
+ tags:
9
+ - flux
10
+ - flux-diffusers
11
+ - image-to-image
12
+ - diffusers
13
+ - lora
14
+ pipeline_tag: image-to-image
15
+ library_name: diffusers
16
  ---
17
+
18
+ ## FLUX.1-Wireframe-dev-lora
19
+
20
+ `FLUX.1 Wireframe [dev] LoRA` is a LoRA for [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev), capable of generating an image based on a text description while following the structure of given wireframe image.
21
+
22
+ ## Showcase
23
+
24
+ | Prompt | Control image | Generated image |
25
+ | :---: | :---: | :---: |
26
+ | <details>A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space.</details> | ![Control image](assets/input1.png) | ![Generated Image](assets/output1.png) |
27
+ | <details>A contemporary bedroom features a large, plush bed with a white and gray upholstered headboard and matching bedding. The bed is positioned centrally, flanked by two nightstands with modern, metallic lamps. The walls are finished in light gray paneling, creating a clean and minimalist backdrop. A large window on the left side of the room allows natural light to flood in, with sheer curtains partially drawn to diffuse the sunlight. The flooring is a smooth, light gray tile that reflects the ambient light, enhancing the room's bright and airy feel. The artwork above the bed is a modern abstract piece, featuring a circular design with a mix of dark and light tones, adding a touch of sophistication to the space.</details> | ![Control image](assets/input2.png) | ![Generated Image](assets/output2.png) |
28
+ | <details>A contemporary bedroom features a large bed positioned centrally, with a soft, light gray upholstered headboard. The bed is dressed in crisp white linens, accented by a beige throw blanket with a textured pattern. Flanking the bed are two gray pillows, adding a subtle contrast. Above the bed, a minimalist abstract painting with gold and gray tones hangs on the white wall. The room is bathed in natural light streaming through a large window with sheer white curtains, which are drawn back to reveal a black-framed view outside. The light wooden flooring complements the serene and modern aesthetic of the space.</details> | ![Control image](assets/input3.png) | ![Generated Image](assets/output3.png) |
29
+ | <details>A modern dining area features a sleek, dark wood dining table with a minimalist design, flanked by six matching chairs with light brown upholstery. The table is positioned in the foreground, with a large window on the left side allowing natural light to flood the space. The midground showcases a built-in storage unit with glass and wood paneling, housing various decorative items and wine glasses. The background reveals a polished tile floor that extends throughout the room, with a light gray and white color scheme that enhances the contemporary aesthetic. The ceiling is adorned with recessed lighting, casting a soft glow over the dining area, while the large window on the left provides ample daylight, creating a bright and airy atmosphere.</details> | ![Control image](assets/input4.png) | ![Generated Image](assets/output4.png) |
30
+
31
+ ## Diffusers
32
+
33
+ ```python
34
+ import torch
35
+ from diffusers.pipelines.flux.pipeline_flux_control import FluxControlPipeline
36
+ from diffusers.utils import load_image
37
+
38
+ pipe = FluxControlPipeline.from_pretrained(
39
+ "black-forest-labs/FLUX.1-dev/",
40
+ torch_dtype=torch.bfloat16,
41
+ )
42
+ pipe.load_lora_weights("manycore-research/FLUX.1-Wireframe-dev-lora")
43
+ pipe.to("cuda")
44
+
45
+ control_image = load_image("https://huggingface.co/manycore-research/FLUX.1-Wireframe-dev-lora/blob/main/assets/input1.png")
46
+ prompt = "A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space."
47
+
48
+ image = pipe(
49
+ prompt=prompt,
50
+ control_image=control_image,
51
+ num_inference_steps=20,
52
+ generator=torch.Generator(device="cpu").manual_seed(42),
53
+ height=512,
54
+ width=512,
55
+ guidance_scale=10.0,
56
+ ).images[0]
57
+ image.save("output.png")
58
+ ```
59
+
60
+ ## LICENSE
61
+
62
+ FLUX.1-Wireframe-dev-lora is licensed under the [FLUX.1-dev Non-Commercial License](https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev).
assets/input1.png ADDED
assets/input2.png ADDED
assets/input3.png ADDED
assets/input4.png ADDED
assets/output1.png ADDED

Git LFS Details

  • SHA256: c559683a7f6558a27120a30cac2ea0aa26914eb07f62c40792b1cac852b14174
  • Pointer size: 131 Bytes
  • Size of remote file: 265 kB
assets/output2.png ADDED

Git LFS Details

  • SHA256: beccf74fb0687a4cc99157b629b45a7259fa7a4e71eff2db3960793cf90f7876
  • Pointer size: 131 Bytes
  • Size of remote file: 308 kB
assets/output3.png ADDED

Git LFS Details

  • SHA256: 34b11880165358b87942af43a4b95f8b0837f5cf0b7e0055a246d307e2fe8ca6
  • Pointer size: 131 Bytes
  • Size of remote file: 299 kB
assets/output4.png ADDED

Git LFS Details

  • SHA256: 1dac904d77724d373d2bb86717bdfead20d45702dc2a2a8685e27ae8edddf70a
  • Pointer size: 131 Bytes
  • Size of remote file: 339 kB
lora.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46a2884893fd7661c29bab06b68eb21f87eb240dc7145b314e9fa73c54a933c7
3
+ size 1047692320