Instructions to use stabilityai/stable-diffusion-3.5-medium-amdnpu with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use stabilityai/stable-diffusion-3.5-medium-amdnpu with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-3.5-medium-amdnpu", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
| DynamicDispatch Offload - not offloaded | |
| +-------------------+-------+------------------------+------------------------+ | |
| | Op Type | Count | Inputs | Outputs | | |
| +===================+=======+========================+========================+ | |
| | CastAvx | 1 | [1,'height','width',1� | [1,'height','width',1� | | |
| | | | - FLOAT16 | - BFLOAT16 | | |
| | CastAvx | 1 | [1,'floor(2.0*floor(2� | [1,'floor(2.0*floor(2� | | |
| | | | - BFLOAT16 | - FLOAT16 | | |
| | DynamicPad | 1 | [1,16,'height','width� | [1] - FLOAT16 | | |
| | | | - FLOAT16 | | | |
| | Gather | 2 | [1] - INT64 | [1] - INT64 | | |
| | | | [1] - INT64 | | | |
| | Mul | 2 | [1] - INT64 | [1] - INT64 | | |
| | | | [1] - INT64 | | | |
| | Shape | 1 | [1,16,'height','width� | [1] - INT64 | | |
| | | | - FLOAT16 | | | |
| | Slice | 1 | [1] - FLOAT16 | [1] - FLOAT16 | | |
| | | | [1] - INT64 | | | |
| | | | [1] - INT64 | | | |
| | | | [1] - INT64 | | | |
| | Slice | 1 | [1] - FLOAT16 | [1,3,'floor(2.0*floor� | | |
| | | | [1] - INT64 | - FLOAT16 | | |
| | | | [1] - INT64 | | | |
| | | | [1] - INT64 | | | |
| | Transpose | 1 | [1] - FLOAT16 | [1,'height','width',1� | | |
| | | | | - FLOAT16 | | |
| | Transpose | 1 | [1,'floor(2.0*floor(2� | [1] - FLOAT16 | | |
| | | | - FLOAT16 | | | |
| +-------------------+-------+------------------------+------------------------+ | |
| | Not offloaded sum | 12 | | | | |
| +-------------------+-------+------------------------+------------------------+ | |
| DynamicDispatch Offload - offloaded | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Op Type | Count | Inputs | Outputs | | |
| +====================+=============+=====================+====================+ | |
| | DynamicDispatch | 1 | [1,'height','width� | [1,'floor(2.0*flo� | | |
| | | | - BFLOAT16 | - BFLOAT16 | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded sum | 1 | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded Op Types | SDGroupNorm | | | | |
| | | SDConv | | | | |
| | | SDResize | | | | |
| | | SDGemm | | | | |
| | | SDAdd | | | | |
| | | SDMHA_VAE | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded sum (dd | 88 | | | | |
| | fusion) | | | | | |
| | Offload Ratio (dd | 88.0% | | | | |
| | fusion) | | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |