Instructions to use aaa-ceku7/GFT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use aaa-ceku7/GFT with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("aaa-ceku7/GFT", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
Add model card for GFT: Visual Generation Without Guidance with pipeline and library tags
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,30 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
--
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: text-to-image
|
| 4 |
+
library_name: diffusers
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
# Guidance-Free Training (GFT): Visual Generation Without Guidance
|
| 8 |
+
|
| 9 |
+
This repository hosts models related to the paper [Visual Generation Without Guidance](https://huggingface.co/papers/2501.15420).
|
| 10 |
+
|
| 11 |
+
GFT is a novel approach that enables visual generative models to operate without Classifier-Free Guidance (CFG), effectively halving the computational cost of sampling while maintaining comparable performance. This method is universal, applicable to diffusion, autoregressive, and masked-prediction models, and can be trained directly from scratch or fine-tuned with minimal modifications to existing codebases.
|
| 12 |
+
|
| 13 |
+
<p align="center">
|
| 14 |
+
<img src="https://github.com/thu-ml/GFT/raw/main/GFT.png" alt="logo" style="width:80%;">
|
| 15 |
+
</p>
|
| 16 |
+
<p align="center">
|
| 17 |
+
<b>Qualitative T2I comparison between vanilla conditional generation, GFT, and CFG on Stable Diffusion 1.5 with the prompt "Elegant crystal vase holding pink peonies, soft raindrops tracing paths down the window behind it".</b>
|
| 18 |
+
</p>
|
| 19 |
+
|
| 20 |
+
For more details, including training code and example usage for different base models (like Stable Diffusion 1.5 and DiT), please refer to the official [GitHub repository](https://github.com/thu-ml/GFT).
|
| 21 |
+
|
| 22 |
+
If you find this work helpful, please consider citing the original paper:
|
| 23 |
+
```
|
| 24 |
+
@article{chen2025visual,
|
| 25 |
+
title={Visual Generation Without Guidance},
|
| 26 |
+
author={Chen, Huayu and Jiang, Kai and Zheng, Kaiwen and Chen, Jianfei and Su, Hang and Zhu, Jun},
|
| 27 |
+
journal={arXiv preprint arXiv:2501.15420},
|
| 28 |
+
year={2025}
|
| 29 |
+
}
|
| 30 |
+
```
|