import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("sayakpaul/flux.1-dev-int8-aot-compiled", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]This repository provides the int8 quantized AoT compiled binary of Flux.1-Dev.
Follow this gist for details on how it was obtained and how to perform inference.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for sayakpaul/flux.1-dev-int8-aot-compiled
Base model
black-forest-labs/FLUX.1-dev