Sync from GitHub
Browse files
app.py
CHANGED
|
@@ -100,6 +100,11 @@ with gr.Blocks(theme=gr.themes.Soft()) as demo:
|
|
| 100 |
- Try to be as specific as possible about your local machine.
|
| 101 |
- As a rule of thumb, GPUs from RTX 4090 and later, are generally good for using `torch.compile()`.
|
| 102 |
- To leverage FP8, the GPU needs to have a compute capability of at least 8.9.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
"""
|
| 104 |
)
|
| 105 |
|
|
|
|
| 100 |
- Try to be as specific as possible about your local machine.
|
| 101 |
- As a rule of thumb, GPUs from RTX 4090 and later, are generally good for using `torch.compile()`.
|
| 102 |
- To leverage FP8, the GPU needs to have a compute capability of at least 8.9.
|
| 103 |
+
- Check out the following docs for optimization in Diffusers:
|
| 104 |
+
* [Memory](https://huggingface.co/docs/diffusers/main/en/optimization/memory)
|
| 105 |
+
* [Caching](https://huggingface.co/docs/diffusers/main/en/optimization/cache)
|
| 106 |
+
* [Inference acceleration](https://huggingface.co/docs/diffusers/main/en/optimization/fp16)
|
| 107 |
+
* [PyTorch blog](https://pytorch.org/blog/presenting-flux-fast-making-flux-go-brrr-on-h100s/)
|
| 108 |
"""
|
| 109 |
)
|
| 110 |
|