card: consolidate img2img into a single table
Browse files
README.md
CHANGED
|
@@ -40,84 +40,56 @@ Full single-file SDXL checkpoints, ready to load as-is.
|
|
| 40 |
|
| 41 |
|
| 42 |
|
|
|
|
| 43 |
---
|
| 44 |
|
| 45 |
## img2img
|
| 46 |
|
| 47 |
-
Both checkpoints do `img2img` as well as `txt2img`.
|
| 48 |
|
| 49 |
<table>
|
| 50 |
-
<tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-source.png" width="250" alt="
|
| 51 |
-
<tr><td><sub>**source prompt:** `a red apple on a rustic wooden table beside a window, soft daylight, visible wood grain, studio photograph, sharp focus` β 1024Γ1024, seed 7
|
|
|
|
|
|
|
| 52 |
</table>
|
| 53 |
|
| 54 |
### Describe the image you want. Do not give an instruction.
|
| 55 |
|
| 56 |
-
This is the single thing most likely to waste your afternoon, so it is first.
|
| 57 |
-
|
| 58 |
SDXL has no instruction-following training. The prompt is a **description of the
|
| 59 |
-
image to produce**, not a command
|
| 60 |
-
picture looks like:
|
| 61 |
-
|
| 62 |
-
> β
`a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokesβ¦`
|
| 63 |
-
|
| 64 |
-
not
|
| 65 |
|
| 66 |
-
>
|
|
|
|
|
|
|
| 67 |
|
| 68 |
-
The instruction form is taken literally
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
settings β only the prompt. The samples above use the descriptive form at the
|
| 73 |
-
same `strength 0.75` that produced the broken results with an instruction.
|
| 74 |
|
| 75 |
### The two checkpoints
|
| 76 |
|
| 77 |
-
Both keep the subject at 0.75 β same apple,
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
- **Juggernaut XL v9** β heavier impasto, warmer, more overtly painted. The
|
| 81 |
-
photographic checkpoint, and the one to reach for on photographic sources.
|
| 82 |
-
- **Illustrious Anime v4** β cleaner and brighter (it retains ~93% of the source's
|
| 83 |
-
luminance against Juggernaut's ~85%), rendered more as illustration than as oil
|
| 84 |
-
on canvas. Being an anime checkpoint, it leans that way even when asked for a
|
| 85 |
-
painting.
|
| 86 |
-
|
| 87 |
-
### On `strength`
|
| 88 |
-
|
| 89 |
-
It is the fraction of the image the sampler may rewrite, trading style against
|
| 90 |
-
fidelity. Swept from 15 to 40 steps and guidance 5.0 to 12.5 at `strength 0.75`,
|
| 91 |
-
output was stable across the whole range β so with a descriptive prompt these
|
| 92 |
-
settings are forgiving. Below ~0.3 you get little more than a gloss pass; above
|
| 93 |
-
~0.85 the source becomes a loose suggestion.
|
| 94 |
|
|
|
|
| 95 |
|
|
|
|
|
|
|
|
|
|
| 96 |
|
|
|
|
| 97 |
|
| 98 |
-
|
| 99 |
-
|
| 100 |
-
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
| 105 |
-
|
| 106 |
-
|
| 107 |
-
Measured against the source: Juggernaut 1.00Γ luminance, Illustrious 1.03Γ.
|
| 108 |
-
Juggernaut applies vertical brushwork across the gradient; Illustrious leaves it
|
| 109 |
-
close to the source. In both, the flat circle is reproduced flat β a uniform
|
| 110 |
-
region carries no detail for the sampler to work from at `strength 0.75`, while
|
| 111 |
-
the graduated area does.
|
| 112 |
-
|
| 113 |
-
Two properties of this source affect how it should be used in testing:
|
| 114 |
-
|
| 115 |
-
- With no subject present, subject loss cannot be observed. `strength 0.90` passes
|
| 116 |
-
against this fixture and does not preserve the subject of a photograph.
|
| 117 |
-
- `histogram_correlation` measures 0.001 and β0.017 here, against 0.73β0.78 for
|
| 118 |
-
the same runs on a photograph, because a near-uniform histogram has little to
|
| 119 |
-
correlate against. `TEST_PLAN.md` treats a negative value as a VAE scaling
|
| 120 |
-
symptom.
|
| 121 |
|
| 122 |
## Recommended settings
|
| 123 |
|
|
|
|
| 40 |
|
| 41 |
|
| 42 |
|
| 43 |
+
|
| 44 |
---
|
| 45 |
|
| 46 |
## img2img
|
| 47 |
|
| 48 |
+
Both checkpoints do `img2img` as well as `txt2img`. Two sources, each through both checkpoints.
|
| 49 |
|
| 50 |
<table>
|
| 51 |
+
<tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-source.png" width="250" alt="photographic source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-juggernaut.png" width="250" alt="Juggernaut XL v9 on the photographic source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-illustrious.png" width="250" alt="Illustrious Anime v4 on the photographic source"></td></tr>
|
| 52 |
+
<tr><td><sub>**source prompt:** `a red apple on a rustic wooden table beside a window, soft daylight, visible wood grain, studio photograph, sharp focus` β 1024Γ1024, seed 7</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β **Juggernaut XL v9**, 1024Γ1024, **30 steps**, **strength 0.75**, seed 7 β about 170 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β **Illustrious Anime v4**, 1024Γ1024, **30 steps**, **strength 0.75**, seed 7 β about 170 s on an A100 80GB</sub></td></tr>
|
| 53 |
+
<tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="tests/sdxl/test_06_source.png, a synthetic gradient"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut on the test_06 fixture"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious on the test_06 fixture"></td></tr>
|
| 54 |
+
<tr><td><sub>**source** β `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β **Juggernaut XL v9**, 1024Γ1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β about 174 s</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β **Illustrious Anime v4**, 1024Γ1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β about 174 s</sub></td></tr>
|
| 55 |
</table>
|
| 56 |
|
| 57 |
### Describe the image you want. Do not give an instruction.
|
| 58 |
|
|
|
|
|
|
|
| 59 |
SDXL has no instruction-following training. The prompt is a **description of the
|
| 60 |
+
image to produce**, not a command applied to the source:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
|
| 62 |
+
> β
`a still life oil painting of a red apple on a rustic wooden table beside a sunlit windowβ¦`
|
| 63 |
+
>
|
| 64 |
+
> β `the same scene rendered as a vivid oil paintingβ¦`
|
| 65 |
|
| 66 |
+
The instruction form is taken literally. Asking for "the same scene rendered as an
|
| 67 |
+
oil painting" returned an apple coated in dripping paint with a paintbrush in frame,
|
| 68 |
+
and at higher strength a different scene altogether β at the same `strength 0.75`
|
| 69 |
+
that produced the top row here.
|
|
|
|
|
|
|
| 70 |
|
| 71 |
### The two checkpoints
|
| 72 |
|
| 73 |
+
Both keep the subject at 0.75 β same apple, position, scale and light. Juggernaut
|
| 74 |
+
is heavier impasto and warmer; Illustrious is cleaner and brighter (retaining ~93%
|
| 75 |
+
of source luminance against Juggernaut's ~85%), rendering more as illustration.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
|
| 77 |
+
### `strength` and the swept range
|
| 78 |
|
| 79 |
+
Swept 15β40 steps and guidance 5.0β12.5 at `strength 0.75`, output was stable
|
| 80 |
+
throughout. Below ~0.3 gives little more than a gloss pass; above ~0.85 the source
|
| 81 |
+
becomes a loose suggestion.
|
| 82 |
|
| 83 |
+
### On the synthetic source
|
| 84 |
|
| 85 |
+
Bottom row: Juggernaut 1.00Γ source luminance, Illustrious 1.03Γ. Juggernaut
|
| 86 |
+
applies vertical brushwork to the gradient; Illustrious leaves it close to the
|
| 87 |
+
source. In both, the flat circle is reproduced flat β a uniform region carries no
|
| 88 |
+
detail for the sampler at `strength 0.75`, while the graduated area does. Two
|
| 89 |
+
consequences for testing: subject loss cannot be observed against a subjectless
|
| 90 |
+
source (`strength 0.90` passes here and does not preserve a photograph's subject),
|
| 91 |
+
and `histogram_correlation` measures 0.001/β0.017 here against 0.73β0.78 for the
|
| 92 |
+
same runs on a photograph.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
## Recommended settings
|
| 95 |
|