FLUX.1-Wireframe-dev-lora for SpatialGen

FLUX.1 Wireframe [dev] LoRA is an improved version of FLUX.1-Layout-ControlNet, which serves as a key component of the SpatialGen. FLUX.1 Wireframe [dev] LoRA is a LoRA for FLUX.1 [dev], capable of generating an image based on a text description while following the structure of the given wireframe image.

📖 Paper: SPATIALGEN: Layout-guided 3D Indoor Scene Generation
🌐 Project Page
💻 Code Repository

Prompt

A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space.

Prompt

A contemporary bedroom features a large, plush bed with a white and gray upholstered headboard and matching bedding. The bed is positioned centrally, flanked by two nightstands with modern, metallic lamps. The walls are finished in light gray paneling, creating a clean and minimalist backdrop. A large window on the left side of the room allows natural light to flood in, with sheer curtains partially drawn to diffuse the sunlight. The flooring is a smooth, light gray tile that reflects the ambient light, enhancing the room's bright and airy feel. The artwork above the bed is a modern abstract piece, featuring a circular design with a mix of dark and light tones, adding a touch of sophistication to the space.

Prompt

A contemporary bedroom features a large bed positioned centrally, with a soft, light gray upholstered headboard. The bed is dressed in crisp white linens, accented by a beige throw blanket with a textured pattern. Flanking the bed are two gray pillows, adding a subtle contrast. Above the bed, a minimalist abstract painting with gold and gray tones hangs on the white wall. The room is bathed in natural light streaming through a large window with sheer white curtains, which are drawn back to reveal a black-framed view outside. The light wooden flooring complements the serene and modern aesthetic of the space.

Prompt

A modern dining area features a sleek, dark wood dining table with a minimalist design, flanked by six matching chairs with light brown upholstery. The table is positioned in the foreground, with a large window on the left side allowing natural light to flood the space. The midground showcases a built-in storage unit with glass and wood paneling, housing various decorative items and wine glasses. The background reveals a polished tile floor that extends throughout the room, with a light gray and white color scheme that enhances the contemporary aesthetic. The ceiling is adorned with recessed lighting, casting a soft glow over the dining area, while the large window on the left provides ample daylight, creating a bright and airy atmosphere.

Diffusers

import torch
from diffusers.pipelines.flux.pipeline_flux_control import FluxControlPipeline
from diffusers.utils import load_image

pipe = FluxControlPipeline.from_pretrained(
    "black-forest-labs/FLUX.1-dev",
    torch_dtype=torch.bfloat16,
)
pipe.load_lora_weights("manycore-research/FLUX.1-Wireframe-dev-lora")
pipe = pipe.to("cuda")

control_image = load_image(
    "https://huggingface.co/manycore-research/FLUX.1-Wireframe-dev-lora/resolve/main/assets/input1.png"
)
prompt = "A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space."

image = pipe(
    prompt=prompt,
    control_image=control_image,
    num_inference_steps=20,
    generator=torch.Generator(device="cpu").manual_seed(42),
    height=512,
    width=512,
    guidance_scale=10.0,
).images[0]
image.save("output.png")