How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("llmrobot/qwen-image-layered-int8-sdnq", dtype=torch.bfloat16, device_map="cuda")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

8 bit (int8 with SVD rank 128) quantization of Qwen/Qwen-Image-Layered using SDNQ.

Downloads last month
6
Safetensors
Model size
22B params
Tensor type
BF16
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for llmrobot/qwen-image-layered-int8-sdnq

Base model

Qwen/Qwen-Image
Quantized
(8)
this model