Instructions to use hirol/Any-inpainting with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use hirol/Any-inpainting with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("hirol/Any-inpainting", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
inpaint model based anything
origin url: https://huggingface.co/spaces/hirol/controlnetOverMask
hirol/Any-inpainting
ControlnetWithBackground
Controlnet
Inpainting
Stable diffusion
Use controlnet to generate sketches and characters, and keep the background unchanged.
Usually when we generate a very perfect background image, we want to add image elements, but using controlnet directly will affect the original background. This project aims to add elements to the page while keeping the background unchanged, and can directly operate on the original background.
Support skeletal character generation and sketch generation.
Optimize an inpaint model for the general domain against the stablediffusion-inpaint model.
Two modes, openpose control and manuscript control
openpose control
Add character skeletons to a forest scene generated by SD, and keep the background unchanged to generate controllable characters
manuscript control
Added manuscript houses to an SD generated forest scene
Added manuscript chairs to an SD generated snow scene

- Downloads last month
- 2