from diffusers import ControlNetModel, StableDiffusionControlNetPipeline
controlnet = ControlNetModel.from_pretrained("kmaksatk/controlnet_80k_data_blip_2")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
"runwayml/stable-diffusion-v1-5", controlnet=controlnet
)controlnet-kmaksatk/controlnet_80k_data_blip_2
These are controlnet weights trained on runwayml/stable-diffusion-v1-5 with new type of conditioning.
You can find some example images below.
prompt: Man doing a cartwheel in blue suit
prompt: Man doing a cartwheel in blue suit
prompt: Man doing a cartwheel in blue suit

- Downloads last month
- 1
Model tree for kmaksatk/controlnet_80k_data_blip_2
Base model
runwayml/stable-diffusion-v1-5