manycore-research
/

FLUX.1-Wireframe-dev-lora

@@ -1,62 +1,64 @@
----
-license: other
-license_name: flux-1-dev-non-commercial-license
-license_link: >-
-  https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev
-base_model:
-- black-forest-labs/FLUX.1-dev
-tags:
-  - flux
-  - flux-diffusers
-  - image-to-image
-  - diffusers
-  - lora
-pipeline_tag: image-to-image
-library_name: diffusers
----
-## FLUX.1-Wireframe-dev-lora
-`FLUX.1 Wireframe [dev] LoRA` is a LoRA for [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev), capable of generating an image based on a text description while following the structure of given wireframe image.
-## Showcase
-| Prompt | Control image | Generated image |
-| :---: | :---: | :---: |
-| <details>A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space.</details> | ![Control image](assets/input1.png) | ![Generated Image](assets/output1.png) |
-| <details>A contemporary bedroom features a large, plush bed with a white and gray upholstered headboard and matching bedding. The bed is positioned centrally, flanked by two nightstands with modern, metallic lamps. The walls are finished in light gray paneling, creating a clean and minimalist backdrop. A large window on the left side of the room allows natural light to flood in, with sheer curtains partially drawn to diffuse the sunlight. The flooring is a smooth, light gray tile that reflects the ambient light, enhancing the room's bright and airy feel. The artwork above the bed is a modern abstract piece, featuring a circular design with a mix of dark and light tones, adding a touch of sophistication to the space.</details> | ![Control image](assets/input2.png) | ![Generated Image](assets/output2.png) |
-| <details>A contemporary bedroom features a large bed positioned centrally, with a soft, light gray upholstered headboard. The bed is dressed in crisp white linens, accented by a beige throw blanket with a textured pattern. Flanking the bed are two gray pillows, adding a subtle contrast. Above the bed, a minimalist abstract painting with gold and gray tones hangs on the white wall. The room is bathed in natural light streaming through a large window with sheer white curtains, which are drawn back to reveal a black-framed view outside. The light wooden flooring complements the serene and modern aesthetic of the space.</details> | ![Control image](assets/input3.png) | ![Generated Image](assets/output3.png) |
-| <details>A modern dining area features a sleek, dark wood dining table with a minimalist design, flanked by six matching chairs with light brown upholstery. The table is positioned in the foreground, with a large window on the left side allowing natural light to flood the space. The midground showcases a built-in storage unit with glass and wood paneling, housing various decorative items and wine glasses. The background reveals a polished tile floor that extends throughout the room, with a light gray and white color scheme that enhances the contemporary aesthetic. The ceiling is adorned with recessed lighting, casting a soft glow over the dining area, while the large window on the left provides ample daylight, creating a bright and airy atmosphere.</details> | ![Control image](assets/input4.png) | ![Generated Image](assets/output4.png) |
-## Diffusers
-```python
-import torch
-from diffusers.pipelines.flux.pipeline_flux_control import FluxControlPipeline
-from diffusers.utils import load_image
-pipe = FluxControlPipeline.from_pretrained(
-  "black-forest-labs/FLUX.1-dev/",
-  torch_dtype=torch.bfloat16,
-)
-pipe.load_lora_weights("manycore-research/FLUX.1-Wireframe-dev-lora")
-pipe.to("cuda")
-control_image = load_image("https://huggingface.co/manycore-research/FLUX.1-Wireframe-dev-lora/blob/main/assets/input1.png")
-prompt = "A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space."
-image = pipe(
-    prompt=prompt,
-    control_image=control_image,
-    num_inference_steps=20,
-    generator=torch.Generator(device="cpu").manual_seed(42),
-    height=512,
-    width=512,
-    guidance_scale=10.0,
-).images[0]
-image.save("output.png")
-```
-## LICENSE
 FLUX.1-Wireframe-dev-lora is licensed under the [FLUX.1-dev Non-Commercial License](https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev).

+---
+license: other
+license_name: flux-1-dev-non-commercial-license
+license_link: >-
+  https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev
+base_model:
+- black-forest-labs/FLUX.1-dev
+tags:
+  - flux
+  - flux-diffusers
+  - image-to-image
+  - diffusers
+  - lora
+pipeline_tag: image-to-image
+library_name: diffusers
+---
+## FLUX.1-Wireframe-dev-lora
+`FLUX.1 Wireframe [dev] LoRA` is a LoRA for [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev), capable of generating an image based on a text description while following the structure of given wireframe image.
+## Showcase
+| Prompt | Control image | Generated image |
+| :---: | :---: | :---: |
+| <details>A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space.</details> | ![Control image](assets/input1.png) | ![Generated Image](assets/output1.png) |
+| <details>A contemporary bedroom features a large, plush bed with a white and gray upholstered headboard and matching bedding. The bed is positioned centrally, flanked by two nightstands with modern, metallic lamps. The walls are finished in light gray paneling, creating a clean and minimalist backdrop. A large window on the left side of the room allows natural light to flood in, with sheer curtains partially drawn to diffuse the sunlight. The flooring is a smooth, light gray tile that reflects the ambient light, enhancing the room's bright and airy feel. The artwork above the bed is a modern abstract piece, featuring a circular design with a mix of dark and light tones, adding a touch of sophistication to the space.</details> | ![Control image](assets/input2.png) | ![Generated Image](assets/output2.png) |
+| <details>A contemporary bedroom features a large bed positioned centrally, with a soft, light gray upholstered headboard. The bed is dressed in crisp white linens, accented by a beige throw blanket with a textured pattern. Flanking the bed are two gray pillows, adding a subtle contrast. Above the bed, a minimalist abstract painting with gold and gray tones hangs on the white wall. The room is bathed in natural light streaming through a large window with sheer white curtains, which are drawn back to reveal a black-framed view outside. The light wooden flooring complements the serene and modern aesthetic of the space.</details> | ![Control image](assets/input3.png) | ![Generated Image](assets/output3.png) |
+| <details>A modern dining area features a sleek, dark wood dining table with a minimalist design, flanked by six matching chairs with light brown upholstery. The table is positioned in the foreground, with a large window on the left side allowing natural light to flood the space. The midground showcases a built-in storage unit with glass and wood paneling, housing various decorative items and wine glasses. The background reveals a polished tile floor that extends throughout the room, with a light gray and white color scheme that enhances the contemporary aesthetic. The ceiling is adorned with recessed lighting, casting a soft glow over the dining area, while the large window on the left provides ample daylight, creating a bright and airy atmosphere.</details> | ![Control image](assets/input4.png) | ![Generated Image](assets/output4.png) |
+## Diffusers
+```python
+import torch
+from diffusers.pipelines.flux.pipeline_flux_control import FluxControlPipeline
+from diffusers.utils import load_image
+pipe = FluxControlPipeline.from_pretrained(
+    "black-forest-labs/FLUX.1-dev",
+    torch_dtype=torch.bfloat16,
+)
+pipe.load_lora_weights("manycore-research/FLUX.1-Wireframe-dev-lora")
+pipe = pipe.to("cuda")
+control_image = load_image(
+    "https://huggingface.co/manycore-research/FLUX.1-Wireframe-dev-lora/resolve/main/assets/input1.png"
+)
+prompt = "A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space."
+image = pipe(
+    prompt=prompt,
+    control_image=control_image,
+    num_inference_steps=20,
+    generator=torch.Generator(device="cpu").manual_seed(42),
+    height=512,
+    width=512,
+    guidance_scale=10.0,
+).images[0]
+image.save("output.png")
+```
+## LICENSE
 FLUX.1-Wireframe-dev-lora is licensed under the [FLUX.1-dev Non-Commercial License](https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev).