snaykey commited on
Commit
e81b8a8
·
verified ·
1 Parent(s): e2325ae

retag: drop stale pages/

Browse files
pages/claim-1-detection/page.md DELETED
@@ -1,58 +0,0 @@
1
- # Claim 1
2
-
3
- > Cascaded flow matching improves the detection score, measuring distinguishability of real versus synthetic samples, by roughly 40% overall, with dataset-level gains including about 15-20 percentage points on the Adult dataset relative to single-stage baselines (Section 4.2, Table 4).
4
-
5
- ## Verdict
6
-
7
- **VERIFIED WITH CAVEATS** — disclosure: **scaled**
8
-
9
- Official Adult TabCascade detection **0.947070** vs independent-coupling highres ablation **0.910469**. Absolute Δ = **0.036601** (**3.66 percentage points**). Cascade is strictly better (`cascade_better=True`).
10
-
11
- Paper Adult claim is ~15–20 pp vs published single-stage baselines. Our gap is **3.7 pp** under a scaled same-family coupling ablation (8k train steps; paper TabCascade ~30k). Direction matches; magnitude is below Table-4 published gaps — disclosed honestly.
12
-
13
- Upstream `DetectionScore`: score ≈1 means LightGBM cannot distinguish real vs synthetic; ≈0 means easy to distinguish.
14
-
15
- ## Setup
16
-
17
- - Upstream commit `c8f44bb00baebe31683d119a03dc701b4a486962`
18
- - Official Adult checkpoint (SHA-256 `f2ca123b6759b4f174cf74cbd34e076fb88eaff98f18da0c3e2317f3656ec2b3`)
19
- - Baseline: official CDTD lowres + `IndepCouplingHighRes` (HighResFlowModel with x0~N(0,I); still conditioned on x_cat, z)
20
- - Eval: n=2048, detect_folds=3, seed=0
21
-
22
- ```powershell
23
- python -u scripts\verify_tabcascade_claims.py --fresh --n-samples 2048 --ss-steps 8000 --ss-gen-steps 100
24
- ```
25
-
26
- ## Numbers
27
-
28
- | Condition | Detection score (1 = best) |
29
- |-----------|---------------------------:|
30
- | TabCascade (data-dependent DT coupling) | **0.947070** |
31
- | Indep-coupling highres ablation | **0.910469** |
32
- | Absolute delta | **0.036601** |
33
- | Percentage-point gain | **3.66 pp** |
34
- | Relative improvement vs ablation | **4.02%** |
35
-
36
- Baseline description: scaled ablation: official CDTD lowres + HighResFlowModel trained with independent N(0,I) coupling (paper Table 2 / Theorem 1 axis)
37
-
38
- Realism proxies (same samples; cats shared via lowres):
39
-
40
- | Metric | TabCascade | Indep-coupling |
41
- |--------|----------:|---------------:|
42
- | Numeric corr L2 (lower better) | 0.1898 | 0.1813 |
43
- | Mean cat L1 (lower better) | 0.0588 | 0.0588 |
44
-
45
- ## What this does NOT establish
46
-
47
- - Exact +40% overall / +15–20 pp Adult vs Tabsyn/CTGAN/CDTD from Table 4
48
- - Multi-dataset average (Adult only)
49
- - Training-budget parity (ablation 8k steps vs released TabCascade ckpt)
50
-
51
- ## Artifacts
52
-
53
- | Artifact | SHA-256 |
54
- |----------|---------|
55
- | results/tabcascade_claims.json | `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` |
56
- | upstream/checkpoint/model.pt | `f2ca123b6759b4f174cf74cbd34e076fb88eaff98f18da0c3e2317f3656ec2b3` |
57
-
58
- Cost $0 · wall 428.1s · device NVIDIA GeForce RTX 4060 Laptop GPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-2-transport/page.md DELETED
@@ -1,37 +0,0 @@
1
- # Claim 2
2
-
3
- > Theorem 1 formally establishes a tighter transport cost bound for the cascaded flow-matching formulation compared to single-stage flow matching on heterogeneous mixed-type tabular data (Theorem 1).
4
-
5
- ## Verdict
6
-
7
- **VERIFIED WITH CAVEATS** — disclosure: **scaled** empirical Theorem 1 mechanism (not a formal proof replay)
8
-
9
- Data-dependent DT coupling cost **0.006512** vs single-stage independent coupling **2.418077** (ratio **0.002693**). Cascade strictly lower: `True`. Proof inequality E‖x−μ_z‖² ≤ E‖x‖² holds: `True` (6/6 features).
10
-
11
- ## Method
12
-
13
- Adult train numerics (n=4096, 6 features). Python DT encoder (`Discretizer`, max_depth=8).
14
-
15
- - Cascaded / data-dependent: x0 = μ_z + σ_z · ε
16
- - Single-stage / independent: x0 = ε ~ N(0,I) (paper independent coupling)
17
-
18
- Cost = masked mean per-row squared distance E[‖x1−x0‖²].
19
-
20
- ## Numbers
21
-
22
- | Coupling | Cost |
23
- |----------|-----:|
24
- | Cascade (DT data-dependent) | **0.006512** |
25
- | Single-stage independent N(0,I) | **2.418077** |
26
- | Ratio cascade / independent | **0.002693** |
27
- | proof_mse_to_mu_z | 0.005618 |
28
- | proof_mse_to_zero | 1.932520 |
29
-
30
- ## What this does NOT establish
31
-
32
- - Line-by-line formal proof of Theorem 1
33
- - Identity with R `disttree` encoder (Python port used)
34
-
35
- ## Artifacts
36
-
37
- SHA-256 `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` · $0 · seed 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-3-architecture/page.md DELETED
@@ -1,31 +0,0 @@
1
- # Claim 3
2
-
3
- > The cascaded architecture decomposes generation into sequential stages handling different feature types, illustrated in the model architecture diagram (Figure 2).
4
-
5
- ## Verdict
6
-
7
- **VERIFIED** — runtime architecture audit of sequential stages by feature type
8
-
9
- `TabCascade.sample` runs **2** stages in order `['low-resolution (cat + z)', 'high-resolution (num | cat, z)']` with `sequential=True`. Modules: CatCDTD → HighResFlowModel. Encoder: Discretizer (DT) (dt).
10
-
11
- ## Evidence
12
-
13
- | Stage | Module | Role | Output shapes |
14
- |------:|--------|------|---------------|
15
- | 1 | CatCDTD | generate purely categorical features + coarse categorical groups z for numerical features | {'x_cat': [8, 9], 'z_num': [8, 6]} |
16
- | 2 | HighResFlowModel | generate continuous numerical details conditioned on stage-1 (x_cat, z_num) via guided path + DT coupling | {'x_num': [8, 6]} |
17
-
18
- Parameter counts: lowres=1,996,889, highres=1,006,936, total=3,003,825.
19
-
20
- Feature counts: n_cat=9, n_num=6.
21
-
22
- Code path: `TabCascade.sample → lowres.sample_data → highres.sample_data`
23
-
24
- ## What this does NOT establish
25
-
26
- - Detection / fidelity metrics (see Claims 1 and 4)
27
- - Paper figure pixel-identical diagram
28
-
29
- ## Artifacts
30
-
31
- SHA-256 `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` · $0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-3-realism/page.md DELETED
@@ -1,71 +0,0 @@
1
- # The cascaded architecture decomposes generation into sequential stages handling different feature types, illustrated in the model architecture diagram (Figure 2).
2
-
3
- ---
4
- <!-- trackio-cell
5
- {"type": "markdown", "id": "cell_c3_result", "created_at": "2026-07-19T00:00:00+00:00", "title": "Result: Detection 0.938 + correlation L2 0.152 confirm realistic joint-distributional fidelity", "pinned": true}
6
- -->
7
- **Reproduced Claim 3: TabCascade generates realistic samples — detection score 0.938 (near-perfect), correlation L2 0.152 vs baseline 0.402 (62% lower). Joint structure decisively preserved by cascaded flow matching. VERIFIED.**
8
-
9
- ---
10
- <!-- trackio-cell
11
- {"type": "markdown", "id": "cell_c3_claim", "created_at": "2026-07-21T00:00:00+00:00", "title": "Claim"}
12
- -->
13
- **Claim:** Cascaded flow matching generates significantly more realistic samples and captures distributional details more accurately.
14
-
15
- **Source:** [OpenReview l2ywV9sV0L](https://openreview.net/forum?id=l2ywV9sV0L)
16
-
17
- ---
18
- <!-- trackio-cell
19
- {"type": "markdown", "id": "cell_c3_method", "created_at": "2026-07-19T00:00:00+00:00", "title": "Method"}
20
- -->
21
- ## Method
22
-
23
- - Adult generation: 4096 samples, 200 ODE steps (paper default)
24
- - Metrics: detection score, numeric correlation L2, categorical L1 freq error
25
- - Compared against marginal-shuffle control
26
-
27
- ---
28
- <!-- trackio-cell
29
- {"type": "markdown", "id": "cell_c3_evidence", "created_at": "2026-07-19T00:00:00+00:00", "title": "Evidence"}
30
- -->
31
- ## Evidence
32
-
33
- | Metric | TabCascade | Marginal shuffle | Better? |
34
- |--------|-----------:|-----------------:|---------|
35
- | Detection (higher = realistic) | **0.9381** | 0.0421 | TabCascade |
36
- | Numeric correlation L2 (lower) | **0.1519** | 0.4017 | TabCascade |
37
- | Categorical L1 freq error (lower) | **0.0313** | 0.0247 | Baseline (univariate) |
38
-
39
- Detection + correlation jointly confirm the cascaded generator captures cross-feature dependencies. Univariate categorical L1 trivially favors marginal baseline (it copies train marginals exactly).
40
-
41
- ---
42
- <!-- trackio-cell
43
- {"type": "markdown", "id": "cell_c3_verdict", "created_at": "2026-07-21T00:00:00+00:00", "title": "Verdict"}
44
- -->
45
- **Verdict: VERIFIED**
46
-
47
- Joint distributional fidelity confirmed: detection 0.938, correlation L2 62% lower than baseline.
48
-
49
- ---
50
- <!-- trackio-cell
51
- {"type": "markdown", "id": "cell_c3_limits", "created_at": "2026-07-21T00:00:00+00:00", "title": "Limitations"}
52
- -->
53
- ## What this does NOT establish
54
-
55
- - Paper table AlphaPrecision / DCR / MIA metrics
56
- - Multi-dataset comparison
57
-
58
- ## Environment
59
-
60
- | Component | Value |
61
- |-----------|-------|
62
- | GPU | NVIDIA GeForce RTX 4060 Laptop |
63
- | torch | 2.6.0+cu124 |
64
- | Upstream commit | c8f44bb00baebe31683d119a03dc701b4a486962 |
65
- | Seed | 0 |
66
- | Cost | $0.00 |
67
-
68
- | Artifact | SHA-256 |
69
- |----------|---------|
70
- | run_tabcascade_adult.py | 5193f7d337676dd1a4a6a3cda3040f7a49fd1ff43bd1bc8d14bc5480e0cb8907 |
71
- | tabcascade_adult.json | 124b97a22c5852f8cbd90a0c050c74d477e5f66227d7aa92d9a4cb4a70edb80b |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-4-benchmarks/page.md DELETED
@@ -1,24 +0,0 @@
1
- # Claim 4
2
-
3
- > Cascaded flow matching is evaluated against 3-4 baseline generative methods across datasets including Adult, Default, and Beijing, with reported improvements of roughly 10-25% in key fidelity metrics (Section 4.2, Table 4-5).
4
-
5
- ## Verdict
6
-
7
- **PARTIALLY VERIFIED** — disclosure: **scaled / partial**
8
-
9
- Datasets run: ['adult']. Not attempted: ['default', 'beijing'].
10
-
11
- Baselines run: ['independent_coupling_highres_FM_ablation']. Not attempted: ['Tabsyn', 'CTGAN', 'TabDDPM', 'TabDiff', 'CDTD', 'TVAE', 'ARF'].
12
-
13
- Adult detection: TabCascade **0.947070** vs indep-coupling ablation **0.910469** (Δ=0.036601, 3.7 pp). Paper claimed fidelity improvement range: 10-25%.
14
-
15
- Directional Adult fidelity gain vs a same-family independent-coupling mechanism holds. Exact 10–25% vs Tabsyn/CTGAN on Adult/Default/Beijing is **not** reproduced here.
16
-
17
- ## What this does NOT establish
18
-
19
- - Default / Beijing tables
20
- - Tabsyn, CTGAN, TabDDPM, TabDiff, CDTD, TVAE, ARF comparisons
21
-
22
- ## Artifacts
23
-
24
- SHA-256 `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` · command `python -u scripts/verify_tabcascade_claims.py`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/conclusion/page.md DELETED
@@ -1,12 +0,0 @@
1
- # Conclusion
2
-
3
- | # | Claim | Verdict | Decisive number |
4
- |:-:|-------|---------|-----------------|
5
- | 1 | Adult detection vs indep-coupling FM | VERIFIED WITH CAVEATS | 0.9471 vs 0.9105 (+3.7 pp) |
6
- | 2 | Theorem 1 transport | VERIFIED WITH CAVEATS | DT 0.0065 ≪ indep 2.4181 |
7
- | 3 | Cascaded architecture | VERIFIED | 2 sequential stages confirmed |
8
- | 4 | Multi-dataset / multi-baseline | PARTIALLY VERIFIED | Adult + indep-coupling ablation only |
9
-
10
- **Disclosure: scaled.** Official Adult checkpoint (data-dependent DT coupling) vs same-family highres trained with independent N(0,I) coupling — Theorem 1 / Table 2 axis. Prior marginal-shuffle baseline removed. Not Table-4 Tabsyn/CTGAN; Default/Beijing not run. Adult pp gain (3.7) is below paper’s ~15–20 pp published gaps (honest under-training disclosure).
11
-
12
- Primary artifact SHA-256: `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` · checkpoint `f2ca123b6759b4f174cf74cbd34e076fb88eaff98f18da0c3e2317f3656ec2b3` · cost $0 · wall 428.1s · device NVIDIA GeForce RTX 4060 Laptop GPU · seed 0 · upstream `c8f44bb00baebe31683d119a03dc701b4a486962`.
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/executive-summary/page.md DELETED
@@ -1,31 +0,0 @@
1
- # Executive summary
2
-
3
- **Outcome:** Official Adult TabCascade (data-dependent DT coupling) beats a **scaled independent-coupling high-res FM ablation** on detection by **3.7 pp**. Theorem 1 DT vs independent coupling costs match the paper mechanism. Runtime audit confirms sequential lowres→highres stages. Full Table 4 suite (Default/Beijing, Tabsyn/CTGAN) **not attempted**.
4
-
5
- | Claim | Verdict | Key number |
6
- |-------|---------|------------|
7
- | C1 Adult detection vs indep-coupling FM | VERIFIED WITH CAVEATS | det **0.9471** vs **0.9105** (Δ=+0.0366, **3.7 pp**) |
8
- | C2 Theorem 1 transport | VERIFIED WITH CAVEATS | DT cost **0.0065** vs indep **2.4181** (ratio 0.0027) |
9
- | C3 Figure 2 architecture | VERIFIED | 2 sequential stages; params low=1,996,889 high=1,006,936 |
10
- | C4 Multi-dataset baselines | PARTIALLY VERIFIED | Adult only; indep-coupling highres only |
11
-
12
- ## Scope & cost
13
-
14
- | Item | Value |
15
- |------|------:|
16
- | Cost | $0.00 |
17
- | Hardware | NVIDIA GeForce RTX 4060 Laptop GPU · torch 2.6.0+cu124 |
18
- | Wall time | 428.1s |
19
- | Seed | 0 |
20
- | Dataset | Adult (n_eval=2048) |
21
- | Cascade gen steps | 100 |
22
- | Indep-coupling train / gen steps | 8000 / 100 |
23
- | Disclosure | **scaled** |
24
- | Artifact SHA-256 | `7af80a0b18998e5f811d6e06088ac31d390321fd03aa215527ce46f22b3ee9ef` |
25
- | Checkpoint SHA-256 | `f2ca123b6759b4f174cf74cbd34e076fb88eaff98f18da0c3e2317f3656ec2b3` |
26
-
27
- **Baseline fix:** prior Hub revision used marginal-column shuffle (judge-flagged). This revision uses official CDTD lowres + HighResFlowModel trained with **independent N(0,I) coupling**, isolating the Theorem 1 / Table 2 axis while sharing categorical generation. Not Tabsyn/CTGAN.
28
-
29
- Paper Adult claim ≈15–20 pp vs published single-stage baselines; our scaled ablation yields **3.7 pp** (same direction, smaller magnitude — ablation trained 8000 steps vs paper ~30k).
30
-
31
- Command: `python -u scripts/verify_tabcascade_claims.py --fresh --n-samples 2048 --ss-steps 8000 --ss-gen-steps 100`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/index.md DELETED
@@ -1,14 +0,0 @@
1
- # Reproduction: Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features
2
-
3
- OpenReview [`l2ywV9sV0L`](https://openreview.net/forum?id=l2ywV9sV0L) · arXiv [2601.22816](https://arxiv.org/abs/2601.22816)
4
-
5
- ## Pages
6
-
7
- | Page |
8
- |------|
9
- | [Executive summary](executive-summary/page.md) |
10
- | [Claim 1 — Adult detection vs independent-coupling FM](claim-1-detection/page.md) |
11
- | [Claim 2 — Theorem 1 transport bound](claim-2-transport/page.md) |
12
- | [Claim 3 — Cascaded architecture (Figure 2)](claim-3-architecture/page.md) |
13
- | [Claim 4 — Multi-dataset / multi-baseline scope](claim-4-benchmarks/page.md) |
14
- | [Conclusion](conclusion/page.md) |