ChrisColeTech commited on
Commit
fb1f27f
Β·
verified Β·
1 Parent(s): 8e937bd

card: state fixture results factually, drop editorial framing

Browse files
Files changed (1) hide show
  1. README.md +18 -25
README.md CHANGED
@@ -94,37 +94,30 @@ settings are forgiving. Below ~0.3 you get little more than a gloss pass; above
94
 
95
 
96
 
97
- ### The repo's own test fixture β€” and why it is a poor demo
98
 
99
- `tests/sdxl/test_06_source.png` through both checkpoints, with a prompt describing
100
- what is actually in the source.
 
101
 
102
  <table>
103
- <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="test_06 fixture source, a synthetic gradient with a flat circle"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut on the fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious on the fixture source"></td></tr>
104
  <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td></tr>
105
  </table>
106
 
107
- **Neither result is a good advertisement, and the source is why.** Juggernaut gives
108
- the gradient real vertical brushwork; Illustrious barely changes it at all. In both,
109
- the circle stays **perfectly flat** β€” no impasto β€” even though the prompt explicitly
110
- asks for ridges catching the light on it.
111
-
112
- That is not a model or a settings problem. A large region of uniform colour gives
113
- the denoiser nothing to work with at `strength 0.75`: flat reconstructs to flat.
114
- The gradient varies, so it takes texture. Use the apple comparison above to judge
115
- these checkpoints; this fixture is included because the test suite uses it, not
116
- because it shows the model at its best.
117
-
118
- Two consequences worth carrying into any testing you do:
119
-
120
- - **A synthetic source cannot detect subject loss.** With no subject present, the
121
- failure that matters is invisible β€” which is how `strength 0.90` passes here and
122
- discards the subject entirely on a photograph.
123
- - **`histogram_correlation` is meaningless on this source.** Measured against it,
124
- the metric comes out 0.001 and βˆ’0.017, because a near-uniform histogram cannot
125
- correlate with anything. On a real photograph the same runs score 0.73–0.78. The
126
- test plan reads a negative value as "colors unrelated β€” check VAE scaling", so
127
- run against its own fixture the suite would send you hunting a bug that is not there.
128
 
129
  ## Recommended settings
130
 
 
94
 
95
 
96
 
 
97
 
98
+ ### Test fixture
99
+
100
+ `tests/sdxl/test_06_source.png` through both checkpoints.
101
 
102
  <table>
103
+ <tr><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-source.png" width="250" alt="test_06 fixture source, a synthetic gradient with a flat circle"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-juggernaut.png" width="250" alt="Juggernaut XL v9 on the test_06 fixture source"></td><td><img src="https://huggingface.co/ChrisColeTech/sdxl/resolve/main/samples/fixture-illustrious.png" width="250" alt="Illustrious Anime v4 on the test_06 fixture source"></td></tr>
104
  <tr><td><sub>**source** β€” `tests/sdxl/test_06_source.png`, a synthetic gradient with a flat circle</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Juggernaut XL v9**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td><td><sub>**img2img prompt:** `an oil painting of an abstract composition with a large glowing golden circle at the centre over a flowing rainbow gradient, thick visible brushstrokes, impasto ridges catching the light, visible canvas texture` β€” **Illustrious Anime v4**, 1024Γ—1024, **25 steps**, **guidance 7.5**, **strength 0.75**, seed 42 β€” about 174 s on an A100 80GB</sub></td></tr>
105
  </table>
106
 
107
+ Measured against the source: Juggernaut 1.00Γ— luminance, Illustrious 1.03Γ—.
108
+ Juggernaut applies vertical brushwork across the gradient; Illustrious leaves it
109
+ close to the source. In both, the flat circle is reproduced flat β€” a uniform
110
+ region carries no detail for the sampler to work from at `strength 0.75`, while
111
+ the graduated area does.
112
+
113
+ Two properties of this source affect how it should be used in testing:
114
+
115
+ - With no subject present, subject loss cannot be observed. `strength 0.90` passes
116
+ against this fixture and does not preserve the subject of a photograph.
117
+ - `histogram_correlation` measures 0.001 and βˆ’0.017 here, against 0.73–0.78 for
118
+ the same runs on a photograph, because a near-uniform histogram has little to
119
+ correlate against. `TEST_PLAN.md` treats a negative value as a VAE scaling
120
+ symptom.
 
 
 
 
 
 
 
121
 
122
  ## Recommended settings
123