ChrisColeTech commited on
Commit
f84ec9d
Β·
verified Β·
1 Parent(s): fb1f27f

card: consolidate img2img into a single table

Browse files
Files changed (1) hide show
  1. README.md +30 -58
README.md CHANGED
@@ -40,84 +40,56 @@ Full single-file SDXL checkpoints, ready to load as-is.
40
 
41
 
42
 
 
43
  ---
44
 
45
  ## img2img
46
 
47
- Both checkpoints do `img2img` as well as `txt2img`. Same input, same prompt, same seed, through each.
48
 
49
  <table>
50
- <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-source.png" width="250" alt="source prompt: a red apple on a rustic wooden table beside a window, soft daylight, visible wood grain, studio photograph, sharp focus β€” 1024Γ—1024, seed 7 β€” generated separately as the img2img input"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-juggernaut.png" width="250" alt="img2img prompt: a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail β€” Juggernaut XL v9, 1024Γ—1024, 25 steps, guidance 7.5, strength 0.75, seed 42 β€” about 174 s on an A100 80GB"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-illustrious.png" width="250" alt="img2img prompt: a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail β€” Illustrious Anime v4, 1024Γ—1024, 25 steps, guidance 7.5, strength 0.75, seed 42 β€” about 174 s on an A100 80GB"></td></tr>
51
- <tr><td><sub>**source prompt:** `a red apple on a rustic wooden table beside a window, soft daylight, visible wood grain, studio photograph, sharp focus` β€” 1024Γ—1024, seed 7 β€” generated separately as the img2img input</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td></tr>
 
 
52
  </table>
53
 
54
  ### Describe the image you want. Do not give an instruction.
55
 
56
- This is the single thing most likely to waste your afternoon, so it is first.
57
-
58
  SDXL has no instruction-following training. The prompt is a **description of the
59
- image to produce**, not a command to apply to the source. Write what the finished
60
- picture looks like:
61
-
62
- > βœ… `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes…`
63
-
64
- not
65
 
66
- > ❌ `the same scene rendered as a vivid oil painting, thick visible brushstrokes…`
 
 
67
 
68
- The instruction form is taken literally and produces exactly what it says. Asking
69
- for "the same scene rendered as an oil painting" returned an apple **coated in
70
- dripping paint** with a paintbrush in frame, and at higher strength a different
71
- scene altogether. Nothing was wrong with the model, the checkpoint or the
72
- settings β€” only the prompt. The samples above use the descriptive form at the
73
- same `strength 0.75` that produced the broken results with an instruction.
74
 
75
  ### The two checkpoints
76
 
77
- Both keep the subject at 0.75 β€” same apple, same position, same scale, same light.
78
- They differ in treatment:
79
-
80
- - **Juggernaut XL v9** β€” heavier impasto, warmer, more overtly painted. The
81
- photographic checkpoint, and the one to reach for on photographic sources.
82
- - **Illustrious Anime v4** β€” cleaner and brighter (it retains ~93% of the source's
83
- luminance against Juggernaut's ~85%), rendered more as illustration than as oil
84
- on canvas. Being an anime checkpoint, it leans that way even when asked for a
85
- painting.
86
-
87
- ### On `strength`
88
-
89
- It is the fraction of the image the sampler may rewrite, trading style against
90
- fidelity. Swept from 15 to 40 steps and guidance 5.0 to 12.5 at `strength 0.75`,
91
- output was stable across the whole range β€” so with a descriptive prompt these
92
- settings are forgiving. Below ~0.3 you get little more than a gloss pass; above
93
- ~0.85 the source becomes a loose suggestion.
94
 
 
95
 
 
 
 
96
 
 
97
 
98
- ### Test fixture
99
-
100
- `tests/sdxl/test_06_source.png` through both checkpoints.
101
-
102
- <table>
103
- <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="test_06 fixture source, a synthetic gradient with a flat circle"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut XL v9 on the test_06 fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious Anime v4 on the test_06 fixture source"></td></tr>
104
- <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td></tr>
105
- </table>
106
-
107
- Measured against the source: Juggernaut 1.00Γ— luminance, Illustrious 1.03Γ—.
108
- Juggernaut applies vertical brushwork across the gradient; Illustrious leaves it
109
- close to the source. In both, the flat circle is reproduced flat β€” a uniform
110
- region carries no detail for the sampler to work from at `strength 0.75`, while
111
- the graduated area does.
112
-
113
- Two properties of this source affect how it should be used in testing:
114
-
115
- - With no subject present, subject loss cannot be observed. `strength 0.90` passes
116
- against this fixture and does not preserve the subject of a photograph.
117
- - `histogram_correlation` measures 0.001 and βˆ’0.017 here, against 0.73–0.78 for
118
- the same runs on a photograph, because a near-uniform histogram has little to
119
- correlate against. `TEST_PLAN.md` treats a negative value as a VAE scaling
120
- symptom.
121
 
122
  ## Recommended settings
123
 
 
40
 
41
 
42
 
43
+
44
  ---
45
 
46
  ## img2img
47
 
48
+ Both checkpoints do `img2img` as well as `txt2img`. Two sources, each through both checkpoints.
49
 
50
  <table>
51
+ <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-source.png" width="250" alt="photographic source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-juggernaut.png" width="250" alt="Juggernaut XL v9 on the photographic source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/img2img-illustrious.png" width="250" alt="Illustrious Anime v4 on the photographic source"></td></tr>
52
+ <tr><td><sub>**source prompt:** `a red apple on a rustic wooden table beside a window, soft daylight, visible wood grain, studio photograph, sharp focus` β€” 1024Γ—1024, seed 7</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β€” **Juggernaut XL v9**, 1024Γ—1024, **30 steps**, **strength 0.75**, seed 7 β€” about 170 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window, thick visible oil paint brushstrokes, warm daylight, painterly canvas texture, high detail` β€” **Illustrious Anime v4**, 1024Γ—1024, **30 steps**, **strength 0.75**, seed 7 β€” about 170 s on an A100 80GB</sub></td></tr>
53
+ <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="tests/sdxl/test_06_source.png, a synthetic gradient"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut on the test_06 fixture"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious on the test_06 fixture"></td></tr>
54
+ <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s</sub></td></tr>
55
  </table>
56
 
57
  ### Describe the image you want. Do not give an instruction.
58
 
 
 
59
  SDXL has no instruction-following training. The prompt is a **description of the
60
+ image to produce**, not a command applied to the source:
 
 
 
 
 
61
 
62
+ > βœ… `a still life oil painting of a red apple on a rustic wooden table beside a sunlit window…`
63
+ >
64
+ > ❌ `the same scene rendered as a vivid oil painting…`
65
 
66
+ The instruction form is taken literally. Asking for "the same scene rendered as an
67
+ oil painting" returned an apple coated in dripping paint with a paintbrush in frame,
68
+ and at higher strength a different scene altogether β€” at the same `strength 0.75`
69
+ that produced the top row here.
 
 
70
 
71
  ### The two checkpoints
72
 
73
+ Both keep the subject at 0.75 β€” same apple, position, scale and light. Juggernaut
74
+ is heavier impasto and warmer; Illustrious is cleaner and brighter (retaining ~93%
75
+ of source luminance against Juggernaut's ~85%), rendering more as illustration.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
 
77
+ ### `strength` and the swept range
78
 
79
+ Swept 15–40 steps and guidance 5.0–12.5 at `strength 0.75`, output was stable
80
+ throughout. Below ~0.3 gives little more than a gloss pass; above ~0.85 the source
81
+ becomes a loose suggestion.
82
 
83
+ ### On the synthetic source
84
 
85
+ Bottom row: Juggernaut 1.00Γ— source luminance, Illustrious 1.03Γ—. Juggernaut
86
+ applies vertical brushwork to the gradient; Illustrious leaves it close to the
87
+ source. In both, the flat circle is reproduced flat β€” a uniform region carries no
88
+ detail for the sampler at `strength 0.75`, while the graduated area does. Two
89
+ consequences for testing: subject loss cannot be observed against a subjectless
90
+ source (`strength 0.90` passes here and does not preserve a photograph's subject),
91
+ and `histogram_correlation` measures 0.001/βˆ’0.017 here against 0.73–0.78 for the
92
+ same runs on a photograph.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
93
 
94
  ## Recommended settings
95