Instructions to use common-canvas/CommonCanvas-XL-C with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use common-canvas/CommonCanvas-XL-C with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("common-canvas/CommonCanvas-XL-C", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
From scratch, or not?
I cant seem to find a clear answer in the huggingface model cards, etc:
Are these models created from scratch, just using the sdxl architecture?
Or are they trained on top of sdxl base?
I'm thinking from scratch, but I need an explicit statement of that please?
I know it's been a while, but here's the paper it's based on. Yes, in terms of any actual visual information used, no in terms of derived technologies like machine vision for the purposes of captioning. https://arxiv.org/pdf/2310.16825
thanks for the reply.... not understanding how the words match up to my question.
wading through the paper, they say that they use "the sdxl unet".
it is unclear whether that means "they used just the ARCHITECTURE, but trained the model from scratch", or that they used
https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/resolve/main/unet/diffusion_pytorch_model.safetensors
The unet models weights are trained from scratch.