wiki/Prompt-Tips.md

## Params

TL;DR: Tweak **steps**, **cfg scale** and **sampler** as results will vary depending on combination of all three  

- **Encoder**  
  Which text tokenizer to use, SD typically uses `CLiP`, but others can be substituted (`BERT`, `GPTx`, etc)  
- **Batch Size**  
  How many images to generate in parallel, limited by your VRAM  
- **Batch Count**  
  How many batches to run sequentially  
  So total number of images generated is batch size x batch count  
- **Seed**  
  Initializer for noise generator  
  Use same seed to have repeatable results, otherwise use random (-1)  
- **CFG Scale** (Classifer-Free-Guidance)  
  How close should diffusers follow prompt, 0 means none and 30 means exact  
  Best results are between 7 (creative) to 13 (realistic), but optimal value depends on your model, prompt, and parameters  
- **Width & Height**  
  SD 1.x was trained on 512x512, SD 2.x on 768x768, SDXL on 1024x1024, derivative fine-tunes may have different resolutions  
  So typically don't stray too far from those and instead use upscalers if high resolution is needed  
  However, changing aspect ratio can change composition of image (e.g. portrait vs landscape results in close-up vs more wide angle results)  
- **Steps**  
  Directly impacts performance  
  How many iterative denoising steps to run, low number can lead to non-converged results (denoising is not complete)  
  Sweet-spot depends on chosen sampler and settings, can be as low as 10 and as high as 100  
  Higher number of steps tends to increase output quality, except for non-converging (ancestral) samplers like "Euler a" which just keep modifying the picture to no end  
  At high step counts, many samplers converge to the same image as other samplers  

## Prompt Engineering

Know your model: different models were trained on different datasets, some may understand terms other models don't  

**Main groups**

- **Mediums**: best starting a prompt with it after specifying artist  
  Examples: *painting, photograph, drawing, sketch*
- **Flavors**: best left as separate token at the end of the prompt  
  Examples: *ray tracing, fine art, black and white, pixiv, artstation*
- **Movements**: best added to prompt with as keyword  
  Examples: *pop art, photorealism*  
- **Artists**: best starting a prompt with it  
  Examples: *greg rutkowski, artgerm, dc comics, picasso*  

**Modifiers**

- **Feel**: best near the end  
  Examples: *beautiful, sharp focus, 4k, hdr, high detailed, canon 5d*
- **Composition**: best at front, but only use if results don't fit  
  Examples: *1man, 1woman*

**Negative Prompt**

- Any keyword can be specified in a negative prompt as well
  Examples: *watermark*

**Advanced Prompt Modifiers**  

- Availability depends on implementation  
- Specify importance of specific words: E.g. using `(word:1.2)` makes the influence of `word` stronger, `(word:0.8)` makes it weaker  

**Advanced Prompt Modifiers**  

For original backend only:
- Alternate between words: `[word1|word2]` will alternate between `word1` and `word2` in every denoising step, blending the two concepts  
- Switch words during denoising: `[word1:word2:0.3]` will use `word1` for the first 30% of steps, then change it to `word2`  
- Force include multiple objects "AND"  

**Hints**

- Use either artists or movements  
  Using both may result in one overpowering the other, or in unexpected outcome  
- Select medium that fits artist  
  It helps model a lot to know which medium to use when styling  
- Add action after subject  
  Examples: portrait, standing, sitting
- Moving things to the front of prompt may increase its emphasis  
  Example: *cartoon drawing of a woman as pixar* vs *pixar drawing of a woman*
- Use both subject and scene keywords
  Example: *woman on a beach*

**Example**

> (composition) (artist) (medium) (subject) (action) (scene) (movement) (flavor) (feel)  
> 1woman greg rutkowski painting of a woman happy front portrait on a beach as photorealism, sharp focus, artstation