Instructions to use TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
how to compitable with diffusers sdxl controlnet pipeline?
how to compitable with diffusers sdxl controlnet pipeline?
thank you!!!
i mean how to load this file like this format
[-rw-r--r-- 1 xxx 1274 Feb 21 03:19 config.json
-rw-r--r-- 1 xxx 5004438321 Aug 12 2023 diffusion_pytorch_model.bin]
(https://huggingface.co/lllyasviel/sd-controlnet-depth/tree/main)
I have uploaded the config.json for you
Is there a .bin versions as well?
I have uploaded the config.json for you
model = ControlNetModel.from_single_file(
'./TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors',
config_file='./config.json',
)
"cond_stage_config" in original_config["model"]["params"]
KeyError: 'model'
@nived2
Rename TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.fp16.safetensors and put it in a folder with the config file, then use:
model = ControlNetModel.from_pretrained(folder_name)
sorry, I did not uploade the config for v2, I will update
@nived2
Rename TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.fp16.safetensors and put it in a folder with the config file, then use:
model = ControlNetModel.from_pretrained(folder_name)
Thanks a lot! It works for me.
But renaming TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.safetensors is right.
I still meet the error
TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic does not appear to have a file named diffusion_pytorch_model.bin.
Could you share the diffusers code of how to run this model? thx a lot.
WARNING:Unable to determine version for ControlNet model 'TTPLANET_Controlnet_Tile_realistic_v2_fp16