Diffusers How to use peterwilli/control_instruct_pix2pix_beta_1 with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline
controlnet = ControlNetModel.from_pretrained("peterwilli/control_instruct_pix2pix_beta_1")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
"fill-in-base-model", controlnet=controlnet
) 
