ChrisColeTech commited on
Commit
8e937bd
Β·
verified Β·
1 Parent(s): 8c24f68

card: fixture prompt matched to the source; state plainly why it is a weak demo

Browse files
Files changed (1) hide show
  1. README.md +27 -14
README.md CHANGED
@@ -93,25 +93,38 @@ settings are forgiving. Below ~0.3 you get little more than a gloss pass; above
93
  ~0.85 the source becomes a loose suggestion.
94
 
95
 
96
- ### The repo's own test fixture
97
 
98
- `tests/sdxl/test_06_source.png` with the test plan's `DEFAULT_PROMPT`, through both checkpoints.
 
 
 
99
 
100
  <table>
101
- <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="test_06 fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut on the fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious on the fixture source"></td></tr>
102
- <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient</sub></td><td><sub>**img2img prompt:** `a colorful vibrant landscape painting, mountains lake sunset clouds, thick oil paint brushstrokes, high detail, 4k ultra detailed` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42</sub></td><td><sub>**img2img prompt:** `a colorful vibrant landscape painting, mountains lake sunset clouds, thick oil paint brushstrokes, high detail, 4k ultra detailed` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42</sub></td></tr>
103
  </table>
104
 
105
- **A caveat about this fixture, not the model.** The source is a synthetic gradient
106
- with a flat circle. The result gains real vertical brushwork and holds luminance
107
- (1.00Γ— and 1.03Γ— of source), but the prompt's *content* β€” mountains, lake, sunset β€”
108
- never appears, because at `strength 0.75` the source's geometry dominates and there
109
- is no semantic content to reinterpret.
110
-
111
- That also makes this fixture unable to detect the failure that matters: with no
112
- subject in the source, subject loss is invisible. It is why `strength 0.90` passes
113
- here and discards the subject on a photograph. **Validate img2img against a real
114
- photograph as well.**
 
 
 
 
 
 
 
 
 
 
 
115
 
116
  ## Recommended settings
117
 
 
93
  ~0.85 the source becomes a loose suggestion.
94
 
95
 
 
96
 
97
+ ### The repo's own test fixture β€” and why it is a poor demo
98
+
99
+ `tests/sdxl/test_06_source.png` through both checkpoints, with a prompt describing
100
+ what is actually in the source.
101
 
102
  <table>
103
+ <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="test_06 fixture source, a synthetic gradient with a flat circle"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut on the fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious on the fixture source"></td></tr>
104
+ <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td></tr>
105
  </table>
106
 
107
+ **Neither result is a good advertisement, and the source is why.** Juggernaut gives
108
+ the gradient real vertical brushwork; Illustrious barely changes it at all. In both,
109
+ the circle stays **perfectly flat** β€” no impasto β€” even though the prompt explicitly
110
+ asks for ridges catching the light on it.
111
+
112
+ That is not a model or a settings problem. A large region of uniform colour gives
113
+ the denoiser nothing to work with at `strength 0.75`: flat reconstructs to flat.
114
+ The gradient varies, so it takes texture. Use the apple comparison above to judge
115
+ these checkpoints; this fixture is included because the test suite uses it, not
116
+ because it shows the model at its best.
117
+
118
+ Two consequences worth carrying into any testing you do:
119
+
120
+ - **A synthetic source cannot detect subject loss.** With no subject present, the
121
+ failure that matters is invisible β€” which is how `strength 0.90` passes here and
122
+ discards the subject entirely on a photograph.
123
+ - **`histogram_correlation` is meaningless on this source.** Measured against it,
124
+ the metric comes out 0.001 and βˆ’0.017, because a near-uniform histogram cannot
125
+ correlate with anything. On a real photograph the same runs score 0.73–0.78. The
126
+ test plan reads a negative value as "colors unrelated β€” check VAE scaling", so
127
+ run against its own fixture the suite would send you hunting a bug that is not there.
128
 
129
  ## Recommended settings
130