Upload zimg-fdloss/RECIPE.md with huggingface_hub
Browse files- zimg-fdloss/RECIPE.md +33 -19
zimg-fdloss/RECIPE.md
CHANGED
|
@@ -1,4 +1,12 @@
|
|
| 1 |
-
# Flow Matching Mid/Post-training β Final Recipe Card (
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
Model: Z-Image 6B S3-DiT @1024Β². Reference data: BLIP3o-60k (GPT-4o set),
|
| 4 |
holdout = sorted-enumeration idx % 12 == 0.
|
|
@@ -18,12 +26,15 @@ holdout = sorted-enumeration idx % 12 == 0.
|
|
| 18 |
standalone cross-covariance term on a factor-probe basis; conditional
|
| 19 |
coupling via top-32 diag-whitened CCA text coordinates (K=32 optimal;
|
| 20 |
K=64 does not transfer); EMA population moments (Ξ²=0.999). **Global
|
| 21 |
-
batch 64 (4-node)
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
|
|
|
|
|
|
|
|
|
| 27 |
uses the standard stats root, whose warm-start moments come from the
|
| 28 |
iMF-stage model β a stale anchor relative to the checkpoint being
|
| 29 |
finished. Rebuilding the warm-start from the finished model's own
|
|
@@ -32,18 +43,20 @@ holdout = sorted-enumeration idx % 12 == 0.
|
|
| 32 |
champion): part of the dial's @1 gain is stale-anchor replay, not TFC
|
| 33 |
alone. Keep the standard (stale) stats root when using the dial.
|
| 34 |
|
| 35 |
-
## Headline numbers (GenEval macro
|
| 36 |
|
| 37 |
-
| model | GenEval@8 | GenEval@1 | FDr@8 | FDr@1 |
|
| 38 |
-
|---|---|---|---|---|
|
| 39 |
-
| Z-Image-Turbo (distilled baseline) | 0.811 | 0.719 | 2.174 | 1.700 |
|
| 40 |
-
|
|
| 41 |
-
|
|
| 42 |
-
|
|
|
|
|
| 43 |
|
| 44 |
-
McNemar vs
|
| 45 |
-
|
| 46 |
-
|
|
|
|
| 47 |
|
| 48 |
## The three laws (measured)
|
| 49 |
|
|
@@ -65,8 +78,9 @@ node (b16).
|
|
| 65 |
|
| 66 |
## Checkpoints in this folder
|
| 67 |
|
| 68 |
-
- `champion-
|
| 69 |
-
- `champion-D1c-
|
|
|
|
| 70 |
- `T1-1nfe-record/` β best pure-1-NFE model (0.879@1)
|
| 71 |
- `T3-balanced-finisher/`, `T4a-near-pareto-finisher/` β TFC dial points
|
| 72 |
- `V1g0-clean-rerun-g0c/`, `champion-V1g0/` β recipe-ancestor reference
|
|
|
|
| 1 |
+
# Flow Matching Mid/Post-training β Final Recipe Card (rev 2026-08-05)
|
| 2 |
+
|
| 3 |
+
> **2026-08-05 champion promotion (pre-registered 4-seed test)**: the b64 +
|
| 4 |
+
> 250-step-finishing stack ("I1combo") beat the frozen b16 champion at BOTH
|
| 5 |
+
> operating points on 4 seeds (553Γ4 = 2212 paired items): GenEval @8
|
| 6 |
+
> z=+2.91, @1 z=+2.42 (rule: zβ₯+2 at one endpoint AND z>0 at the other;
|
| 7 |
+
> per-seed @1 deltas all positive). 4-seed macro: **0.910 @8 / 0.858 @1**
|
| 8 |
+
> (old champion 0.899/0.842). Decomposition: b64 stage +2.82 @8 / +1.94 @1;
|
| 9 |
+
> finishing stage +0.14 @8 / +0.87 @1. The recipe below reflects this.
|
| 10 |
|
| 11 |
Model: Z-Image 6B S3-DiT @1024Β². Reference data: BLIP3o-60k (GPT-4o set),
|
| 12 |
holdout = sorted-enumeration idx % 12 == 0.
|
|
|
|
| 26 |
standalone cross-covariance term on a factor-probe basis; conditional
|
| 27 |
coupling via top-32 diag-whitened CCA text coordinates (K=32 optimal;
|
| 28 |
K=64 does not transfer); EMA population moments (Ξ²=0.999). **Global
|
| 29 |
+
batch 64 (4-node): promoted component β on 4 seeds this stage alone is
|
| 30 |
+
z=+2.82 @8 / +1.94 @1 over b16.**
|
| 31 |
+
3. **TFC finishing pass (promoted @ b64, 250 steps, lr 3e-6)** β ties the
|
| 32 |
+
1-jump endpoint's SigLIP2 features to sg(own multi-step endpoint). On
|
| 33 |
+
the b64 base it adds @1 without measurable @8 cost (4-seed +0.14 @8 /
|
| 34 |
+
+0.87 @1); on b16 bases it acts as a redistribution dial along a
|
| 35 |
+
measured exchange curve (~1.9 pts gained @1 per pt lost @8, pooled
|
| 36 |
+
over 5 runs β not net creation). **Mechanism caveat (measured)**: the
|
| 37 |
+
pass as shipped
|
| 38 |
uses the standard stats root, whose warm-start moments come from the
|
| 39 |
iMF-stage model β a stale anchor relative to the checkpoint being
|
| 40 |
finished. Rebuilding the warm-start from the finished model's own
|
|
|
|
| 43 |
champion): part of the dial's @1 gain is stale-anchor replay, not TFC
|
| 44 |
alone. Keep the standard (stale) stats root when using the dial.
|
| 45 |
|
| 46 |
+
## Headline numbers (GenEval macro; FDr held-out judge mean)
|
| 47 |
|
| 48 |
+
| model | seeds | GenEval@8 | GenEval@1 | FDr@8 | FDr@1 |
|
| 49 |
+
|---|---|---|---|---|---|
|
| 50 |
+
| Z-Image-Turbo (distilled baseline) | 2 | 0.811 | 0.719 | 2.174 | 1.700 |
|
| 51 |
+
| b16 recipe (old champion) | 4 | 0.899 | 0.842 | 1.612 | 1.519 |
|
| 52 |
+
| + batch 64 | 4 | 0.910 | 0.853 | 1.621 | 1.447 |
|
| 53 |
+
| **+ 250-step finishing (CHAMPION)** | **4** | **0.910** | **0.858** | β | β |
|
| 54 |
+
| 1-NFE specialist (TFC full-run, b16) | 2 | 0.843 | 0.879 | 1.909 | 1.596 |
|
| 55 |
|
| 56 |
+
McNemar: champion vs b16 recipe +2.91 @8 / +2.42 @1 (4 seeds, pre-registered
|
| 57 |
+
promotion rule); b16 recipe vs turbo z=+7.0/+8.2 (Holm-robust). No teacher,
|
| 58 |
+
no discriminator, no fake-score network, no CFG at train or inference;
|
| 59 |
+
~4.5 h on one 8ΓH200 node (b16) / ~1.5 h wall on 4 nodes (b64 + finishing).
|
| 60 |
|
| 61 |
## The three laws (measured)
|
| 62 |
|
|
|
|
| 78 |
|
| 79 |
## Checkpoints in this folder
|
| 80 |
|
| 81 |
+
- `champion-I1combo/` β **the promoted champion** (b64 FD + 250s finishing)
|
| 82 |
+
- `champion-D1c-clean/` β the b16 recipe (FD ckpt + iMF init)
|
| 83 |
+
- `champion-D1c-b64/` β batch-64 stage (the promoted champion's base)
|
| 84 |
- `T1-1nfe-record/` β best pure-1-NFE model (0.879@1)
|
| 85 |
- `T3-balanced-finisher/`, `T4a-near-pareto-finisher/` β TFC dial points
|
| 86 |
- `V1g0-clean-rerun-g0c/`, `champion-V1g0/` β recipe-ancestor reference
|