How to use InstantX/FLUX.1-dev-Controlnet-Union with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("InstantX/FLUX.1-dev-Controlnet-Union", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0]
Hi! I use Diffusers with PRBut get this error:TypeError: FluxTransformer2DModel.forward() got an unexpected keyword argument 'controlnet_block_samples'
TypeError: FluxTransformer2DModel.forward() got an unexpected keyword argument 'controlnet_block_samples'
you can use not latest diffusers version's transformer_flux.py but this url code
https://github.com/instantX-research/diffusers_flux/blob/main/src/diffusers/models/transformers/transformer_flux.py
https://github.com/instantX-research/diffusers_flux
Thank you, now it works
Β· Sign up or log in to comment