How to use h94/IP-Adapter with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("h94/IP-Adapter", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0]
Do you have plans to train the model full-face (faces with white background) for sdxl? This would be more useful, because plus have a problem with background (the square of the surrounding background around the head affects the final image)
· Sign up or log in to comment