AbstractPhil's picture
exp010b amendment: roles ckpt image-space signature identical to uniform - frequency reweighting confirmed inert on both instruments
5ecf2a9 verified
|
Raw
History Blame Contribute Delete
3.1 kB
# exp010_controller β€” THE STEP-GATED DIFFUSION CONTROLLER + generation-side
# band-lesion battery (CANDIDATE, 1-seed battery)
**The artifact.** `StepGatedSampler` β€” DDIM sampling where EVERY denoising
step sets the band crossfade windows from the current timestep, activating
the trained band experts coarse-to-fine across the trajectory. The stage's
controller, shipped as a usable module.
**The question.** exp009 showed per-step eps-MSE is nearly blind to band
behavior (0.05–0.2% moves). What do the bands do IN IMAGE SPACE? Battery:
exp008's 2-seed-confirmed mb3 stack; arms all_on / lesion each band / frozen;
paired seeds; judged by round-trip grounding, lesion-vs-all_on LP/HP
decomposition, and within-prompt diversity (6 prompts Γ— 4 seeds).
**Results** (`results.json`):
| arm | grounding gap | diversity | LP-change vs all_on | HP-change |
|---|---|---|---|---|
| **all_on** | **+0.2135** | 0.196 | β€” | β€” |
| lesion band0 (LOW noise) | +0.1979 | 0.208 | 0.0036 | 0.0031 |
| lesion band1 (MID) | +0.1821 | 0.217 | 0.0184 | 0.0039 |
| lesion band2 (HIGH noise) | +0.1782 | 0.297 | **0.0727** | 0.0051 |
| frozen | +0.1247 | 0.332 | 0.0804 | 0.0052 |
**Findings.**
1. **The controller lifts grounding +0.089 over frozen** (+0.1247 β†’ +0.2135)
and every band lesion cuts it monotonically β€” all three bands carry
generation-relevant signal that eps-MSE could not see. The image-space
instrument was the right upgrade.
2. **Coarse-to-fine confirmed by lesion signature ratios**: the HIGH-band
lesion is 14Γ— LP-dominated (0.0727 LP vs 0.0051 HP β€” structure/layout),
the LOW-band lesion is ~1:1 detail-leaning (0.0036/0.0031), MID
intermediate. (Raw prereg G2b "LOW moves HP most in absolute terms"
missed β€” layout shift mechanically drags detail with it; the per-lesion
ratio is the honest read, disclosed.)
3. **Diversity interpretation flip (G3 miss, informative):** the eps-trained
HIGH band CONCENTRATES generations toward the conditioning (its lesion
raises diversity 0.196 β†’ 0.297; frozen is most "diverse" because least
grounded). A diversity-CARRYING high-noise expert remains a training-
objective goal (nothing here trained for diversity), not a refuted
property β€” the docket's diversity/blob supervision is the open path.
**Caveats.** 1-seed battery (one noise-seed bank, n=24 + 6Γ—4 diversity
probe); one checkpoint (uniform-trained mb3_s0; the roles checkpoint runs
the same battery as an amendment); CLIP-L gauges. Cost β‰ˆ 0.2 GPU-h.
---
## AMENDMENT: the ROLES checkpoint through the same battery (`results_roles_s0.json`)
Image-space lesion signatures are IDENTICAL to the uniform checkpoint's
(band2 LP-change 0.0724 vs 0.0727; all bands within a few %), and role
training slightly COST grounding (all_on +0.1996 vs uniform +0.2135).
Frequency-reweighted role pressure is now confirmed inert on BOTH
instruments (per-step gauges, exp009; generation-side battery, here).
The role thesis's open path is qualitatively different supervision
(segmentation blobbing / diversity pressure β€” the stage's exp011+).