How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline

controlnet = ControlNetModel.from_pretrained("kmaksatk/controlnet_80k_data_blip_2")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
	"runwayml/stable-diffusion-v1-5", controlnet=controlnet
)

controlnet-kmaksatk/controlnet_80k_data_blip_2

These are controlnet weights trained on runwayml/stable-diffusion-v1-5 with new type of conditioning. You can find some example images below. prompt: Man doing a cartwheel in blue suit images_0) prompt: Man doing a cartwheel in blue suit images_1) prompt: Man doing a cartwheel in blue suit images_2)

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kmaksatk/controlnet_80k_data_blip_2

Adapter
(2725)
this model