Isaacwang commited on
Commit
c4f3424
Β·
verified Β·
1 Parent(s): 01441da

Upload zimg-fdloss/RECIPE.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. zimg-fdloss/RECIPE.md +33 -19
zimg-fdloss/RECIPE.md CHANGED
@@ -1,4 +1,12 @@
1
- # Flow Matching Mid/Post-training β€” Final Recipe Card (frozen 2026-08-04)
 
 
 
 
 
 
 
 
2
 
3
  Model: Z-Image 6B S3-DiT @1024Β². Reference data: BLIP3o-60k (GPT-4o set),
4
  holdout = sorted-enumeration idx % 12 == 0.
@@ -18,12 +26,15 @@ holdout = sorted-enumeration idx % 12 == 0.
18
  standalone cross-covariance term on a factor-probe basis; conditional
19
  coupling via top-32 diag-whitened CCA text coordinates (K=32 optimal;
20
  K=64 does not transfer); EMA population moments (Ξ²=0.999). **Global
21
- batch 64 (4-node) if available** β€” the sole surviving upgrade.
22
- 3. **Optional TFC finishing dial** β€” short (250–500 step) pass tying the
23
- 1-jump endpoint's SigLIP2 features to sg(own multi-step endpoint):
24
- redistributes quality between NFE operating points along a measured
25
- exchange curve (~1.9 pts gained @1 per pt lost @8, pooled over 5 runs).
26
- Not net creation. **Mechanism caveat (measured)**: the dial as shipped
 
 
 
27
  uses the standard stats root, whose warm-start moments come from the
28
  iMF-stage model β€” a stale anchor relative to the checkpoint being
29
  finished. Rebuilding the warm-start from the finished model's own
@@ -32,18 +43,20 @@ holdout = sorted-enumeration idx % 12 == 0.
32
  champion): part of the dial's @1 gain is stale-anchor replay, not TFC
33
  alone. Keep the standard (stale) stats root when using the dial.
34
 
35
- ## Headline numbers (GenEval macro, 553Γ—2 VLM-judged; FDr held-out judge mean)
36
 
37
- | model | GenEval@8 | GenEval@1 | FDr@8 | FDr@1 |
38
- |---|---|---|---|---|
39
- | Z-Image-Turbo (distilled baseline) | 0.811 | 0.719 | 2.174 | 1.700 |
40
- | **champion (this recipe, b16)** | **0.900** | **0.842** | 1.612 | 1.519 |
41
- | champion @ batch 64 | 0.910 | 0.846 | 1.621 | 1.447 |
42
- | 1-NFE specialist (TFC full-run) | 0.843 | 0.879 | 1.909 | 1.596 |
 
43
 
44
- McNemar vs turbo: z=+7.0/+8.2 (Holm-robust). No teacher, no discriminator,
45
- no fake-score network, no CFG at train or inference; ~4.5 h on one 8Γ—H200
46
- node (b16).
 
47
 
48
  ## The three laws (measured)
49
 
@@ -65,8 +78,9 @@ node (b16).
65
 
66
  ## Checkpoints in this folder
67
 
68
- - `champion-D1c-clean/` β€” the b16 champion (FD ckpt + iMF init)
69
- - `champion-D1c-b64/` β€” batch-64 variant (best both-points nominal)
 
70
  - `T1-1nfe-record/` β€” best pure-1-NFE model (0.879@1)
71
  - `T3-balanced-finisher/`, `T4a-near-pareto-finisher/` β€” TFC dial points
72
  - `V1g0-clean-rerun-g0c/`, `champion-V1g0/` β€” recipe-ancestor reference
 
1
+ # Flow Matching Mid/Post-training β€” Final Recipe Card (rev 2026-08-05)
2
+
3
+ > **2026-08-05 champion promotion (pre-registered 4-seed test)**: the b64 +
4
+ > 250-step-finishing stack ("I1combo") beat the frozen b16 champion at BOTH
5
+ > operating points on 4 seeds (553Γ—4 = 2212 paired items): GenEval @8
6
+ > z=+2.91, @1 z=+2.42 (rule: zβ‰₯+2 at one endpoint AND z>0 at the other;
7
+ > per-seed @1 deltas all positive). 4-seed macro: **0.910 @8 / 0.858 @1**
8
+ > (old champion 0.899/0.842). Decomposition: b64 stage +2.82 @8 / +1.94 @1;
9
+ > finishing stage +0.14 @8 / +0.87 @1. The recipe below reflects this.
10
 
11
  Model: Z-Image 6B S3-DiT @1024Β². Reference data: BLIP3o-60k (GPT-4o set),
12
  holdout = sorted-enumeration idx % 12 == 0.
 
26
  standalone cross-covariance term on a factor-probe basis; conditional
27
  coupling via top-32 diag-whitened CCA text coordinates (K=32 optimal;
28
  K=64 does not transfer); EMA population moments (Ξ²=0.999). **Global
29
+ batch 64 (4-node): promoted component β€” on 4 seeds this stage alone is
30
+ z=+2.82 @8 / +1.94 @1 over b16.**
31
+ 3. **TFC finishing pass (promoted @ b64, 250 steps, lr 3e-6)** β€” ties the
32
+ 1-jump endpoint's SigLIP2 features to sg(own multi-step endpoint). On
33
+ the b64 base it adds @1 without measurable @8 cost (4-seed +0.14 @8 /
34
+ +0.87 @1); on b16 bases it acts as a redistribution dial along a
35
+ measured exchange curve (~1.9 pts gained @1 per pt lost @8, pooled
36
+ over 5 runs β€” not net creation). **Mechanism caveat (measured)**: the
37
+ pass as shipped
38
  uses the standard stats root, whose warm-start moments come from the
39
  iMF-stage model β€” a stale anchor relative to the checkpoint being
40
  finished. Rebuilding the warm-start from the finished model's own
 
43
  champion): part of the dial's @1 gain is stale-anchor replay, not TFC
44
  alone. Keep the standard (stale) stats root when using the dial.
45
 
46
+ ## Headline numbers (GenEval macro; FDr held-out judge mean)
47
 
48
+ | model | seeds | GenEval@8 | GenEval@1 | FDr@8 | FDr@1 |
49
+ |---|---|---|---|---|---|
50
+ | Z-Image-Turbo (distilled baseline) | 2 | 0.811 | 0.719 | 2.174 | 1.700 |
51
+ | b16 recipe (old champion) | 4 | 0.899 | 0.842 | 1.612 | 1.519 |
52
+ | + batch 64 | 4 | 0.910 | 0.853 | 1.621 | 1.447 |
53
+ | **+ 250-step finishing (CHAMPION)** | **4** | **0.910** | **0.858** | β€” | β€” |
54
+ | 1-NFE specialist (TFC full-run, b16) | 2 | 0.843 | 0.879 | 1.909 | 1.596 |
55
 
56
+ McNemar: champion vs b16 recipe +2.91 @8 / +2.42 @1 (4 seeds, pre-registered
57
+ promotion rule); b16 recipe vs turbo z=+7.0/+8.2 (Holm-robust). No teacher,
58
+ no discriminator, no fake-score network, no CFG at train or inference;
59
+ ~4.5 h on one 8Γ—H200 node (b16) / ~1.5 h wall on 4 nodes (b64 + finishing).
60
 
61
  ## The three laws (measured)
62
 
 
78
 
79
  ## Checkpoints in this folder
80
 
81
+ - `champion-I1combo/` β€” **the promoted champion** (b64 FD + 250s finishing)
82
+ - `champion-D1c-clean/` β€” the b16 recipe (FD ckpt + iMF init)
83
+ - `champion-D1c-b64/` β€” batch-64 stage (the promoted champion's base)
84
  - `T1-1nfe-record/` β€” best pure-1-NFE model (0.879@1)
85
  - `T3-balanced-finisher/`, `T4a-near-pareto-finisher/` β€” TFC dial points
86
  - `V1g0-clean-rerun-g0c/`, `champion-V1g0/` β€” recipe-ancestor reference