irodkin/celeba_with_llava_shorter_captions
Viewer • Updated • 40.3k • 51 • 4
How to use irodkin/controlnet_celeba_with_llava_captions_ft with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("irodkin/controlnet_celeba_with_llava_captions_ft", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]For this model the only one available contol input is the conditioning_image from dataset irodkin/celeba_with_llava_shorter_captions
And this image the model actually ignores. Its just experimental text2image