why flux1-dev produce noisy image with canny controlnet
flux can produce a pretty image if cut off the controlnet module, but a noisy image produced if connected with controlnet module.
Please take a look,
flux:flux1-dev.safetensors
lora: furry_lora.safetensors
controlnent: flux-controlnet-canny
you can move this png file into comfyui
sadly the results I get are vastly inconsistent but often they look like this. 90% of the time the end result is unusable, then randomly i will get a good gen. Been researching for about 7 hours today, haven't found a consistent solve.
I spent 70 hours since it came out, and come to same conclusion
Hi,
Currently, ControlNet is not working as expected in ComfyUI, because we use different implementation of sampling and other features in our code. We are working on integrating our implementation into ComfyUI directly, but it is not functional at the moment. Thank you for your understanding.
I have used Canny Controlnet in ComfyUI with the "Apply Controlnet (Advanced)" node. I'm getting good results by setting end_percent very low, like 0.01-0.05 to do just 1 or 2 steps. That points the image in the direction I want and then leaves Flux free to do what it wants. With end_percent too high the image quality degrades badly.