sirineddd/pinterest-multimodal-text-to-image
Viewer • Updated • 72 • 16
How to use sirineddd/pinterest-stable-diffusion-v1-4 with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("CompVis/stable-diffusion-v1-4", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("sirineddd/pinterest-stable-diffusion-v1-4")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]Fine-tuned on a curated dataset of aesthetic Pinterest flatlays, focusing on skincare products, soft lighting, and pastel backgrounds.
from diffusers import StableDiffusionPipeline
import torch
pipe = StableDiffusionPipeline.from_pretrained("CompVis/stable-diffusion-v1-4", torch_dtype=torch.float16)
pipe.load_lora_weights("sirineddd/pinterest-stable-diffusion-v1-4")
prompt = "Aesthetic Pinterest-style flatlay of skincare products, pastel background, soft lighting"
image = pipe(prompt, num_inference_steps=30, guidance_scale=7.5).images[0]
image.show()
Base model
CompVis/stable-diffusion-v1-4