Instructions to use doohickey/neopian-diffusion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use doohickey/neopian-diffusion with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("doohickey/neopian-diffusion", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -18,8 +18,9 @@ Example chosen frame of GIF from CLIP
|
|
| 18 |
|
| 19 |
## Training Details
|
| 20 |
|
| 21 |
-
Stage 1 (0-
|
| 22 |
|
|
|
|
| 23 |
|
| 24 |
## How to use with `diffusers` library (section from [openjourney](https://huggingface.co/openjourney/openjourney))
|
| 25 |
|
|
|
|
| 18 |
|
| 19 |
## Training Details
|
| 20 |
|
| 21 |
+
Stage 1 (0-8k steps) The text encoder was trained along with the UNet at half precision for 15% of the total 8,000 steps (1,200 steps), and then the UNet was trained alone for the rest. I used a polynomial learning rate decay starting at 2e-6 (the default in fast-DreamBooth). "low quality" concatenated onto 1/3 of the prompts.
|
| 22 |
|
| 23 |
+
Stage 2 (8k-) Text encoder trained 50% of steps, random choice "low quality" "lowres" "jpeg" concatenated onto 10% of prompts, starting at 1e-6
|
| 24 |
|
| 25 |
## How to use with `diffusers` library (section from [openjourney](https://huggingface.co/openjourney/openjourney))
|
| 26 |
|