Efradeca commited on
Commit
6c9249b
·
verified ·
1 Parent(s): 0d2b2e4

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -18
README.md CHANGED
@@ -40,9 +40,9 @@ per-geometry finite-element (FEM) solve for fast design-space exploration.
40
  Verified node-by-node against FEM: pooled **R² = 0.99986**, test relative-L2 **0.00597** on the shipped
41
  checkpoint. **Interactive demo:** https://huggingface.co/spaces/Efradeca/elastic-stress-surrogate
42
 
43
- > **Honesty note.** This card reports the model's limitations as prominently as its strengths. The
44
- > deployed value is *accuracy + speed*. The equilibrium regularizer is a well-characterized **trade-off**
45
- > (a prior-art idea in a new meshfree instantiation), not a free win — see *Evaluation* and *Findings*.
46
 
47
  ## Model Details
48
 
@@ -66,7 +66,7 @@ connectivity.
66
  attention block is reused verbatim) and an independent, from-equations reimplementation of the
67
  **LinearNO** attention block (Hu et al., AAAI 2026).
68
 
69
- ### What is and isn't novel (read this)
70
 
71
  The soft equilibrium-residual penalty `λ‖∇·σ‖²` on a predicted stress field is **established prior art**
72
  (PI-UNet 2022; PiFNO 2024; and especially **P-DivGNN 2025**, which uses essentially the same
@@ -75,7 +75,7 @@ periodic micro-RVE). We do **not** claim the idea. This
75
  repository's actual contribution is (1) a specific, previously-unattested **instantiation** — the penalty
76
  on a *transformer* operator with a *meshfree, connectivity-free* MLS divergence (exact on affine fields by
77
  the degree-1 GMLS reproduction property), distinct from the FE / FFT / finite-difference operators of all
78
- prior work — and (2) a **cross-operator honesty analysis** of when that penalty actually helps.
79
 
80
  ### Model Sources
81
 
@@ -192,21 +192,21 @@ committed per-seed distributions are in the repository (`docs/RESULTS.md`, `resu
192
  | LinearNO, M=256 (this work) | 0.00635 | 0.00622 ± 0.00071 | 3 | 765,313 |
193
  | **+ equilibrium regularizer (this model)** | 0.00653 | 0.00668 ± 0.00065 | 3 | 582,275 |
194
 
195
- **Comparable, not "beats."** In this sample LinearNO's median (0.00606) is lower than our reproduced
196
- baseline's (0.00766) at fewer parameters, and it reaches the published ~0.0050 level on good seeds. But
197
- both models have **high run-to-run variance** (`torch.compile` non-determinism on 1000 samples), and the
198
- baseline's higher mean is driven by 2 outlier seeds. We do **not** claim LinearNO beats or is more robust
199
- than the baseline; an attempted mechanistic explanation (slice-attention instability) was **empirically
200
- tested and refuted**. Honest reading: LinearNO is **comparable** to the baseline at ≤ its parameters, both
201
- reproducing ~0.0064 on good seeds. As a cross-check, we re-evaluated the authors' released official
202
- checkpoint on our data with their code and reproduced **0.005007** confirming the dataset, split, and
203
- metric are identical, so the table is mutually comparable.
204
 
205
  **Verification against FEM ground truth** (200 test meshes; shipped checkpoint = best of 3 eqreg seeds):
206
  per-sample relative-L2 mean **0.00597** (median 0.00533), pooled Pearson **r = 0.99993**, **R² = 0.99986**,
207
  peak-stress relative error **0.27%** — reproducible via `scripts/verify_model.py` → `results/verify_model.json`.
208
 
209
- ### Findings (the honest part)
210
 
211
  **1. The meshfree MLS operator is rigorously grounded.** It is a degree-1 GMLS derivative: *exact on
212
  affine fields* (~1e-14 in float64) and *O(h)-convergent* on smooth fields (fitted slope 1.01), validated
@@ -219,7 +219,7 @@ same-architecture, epoch-matched ablation the regularizer cuts the residual **~3
219
  model's own (MLS) operator**, but an **independent FE operator** sees only **~6–53×** — at a **measured
220
  accuracy cost** (test rel-L2 0.00479 → 0.00621, +30%). A model-free control on exactly-divergence-free
221
  analytic fields confirms the FE operator is *comparable* to MLS off the void-rim slivers (the large raw
222
- gap is a sliver artifact), so the honest operator-agnostic reduction (~53×) still sits **an order of
223
  magnitude below** the trained-operator 325×. The gaming reproduces on the *literal* official LinearNO
224
  block (gap ~25×), so it is a property of the soft-penalty objective, not our implementation.
225
 
@@ -237,8 +237,8 @@ equilibrium residual low OOD (+7%), but on an orthogonal field-smoothness proxy
237
  from the unregularized models.
238
 
239
  **Takeaway:** the soft equilibrium penalty looks most impressive exactly where it is least physical (an
240
- unsupervised latent tensor). We report this rather than paper over it. The deployed model's value is its
241
- accuracy (R² = 0.99986) and millisecond CPU speed.
242
 
243
  ## Technical Specifications
244
 
 
40
  Verified node-by-node against FEM: pooled **R² = 0.99986**, test relative-L2 **0.00597** on the shipped
41
  checkpoint. **Interactive demo:** https://huggingface.co/spaces/Efradeca/elastic-stress-surrogate
42
 
43
+ > **At a glance.** The deployed value is *accuracy + speed*: **R² = 0.99986** vs FEM, milliseconds on CPU.
44
+ > The equilibrium regularizer is a physical-consistency component with a well-characterized
45
+ > accuracy/consistency **trade-off** (see *Evaluation*).
46
 
47
  ## Model Details
48
 
 
66
  attention block is reused verbatim) and an independent, from-equations reimplementation of the
67
  **LinearNO** attention block (Hu et al., AAAI 2026).
68
 
69
+ ### Novelty and prior work
70
 
71
  The soft equilibrium-residual penalty `λ‖∇·σ‖²` on a predicted stress field is **established prior art**
72
  (PI-UNet 2022; PiFNO 2024; and especially **P-DivGNN 2025**, which uses essentially the same
 
75
  repository's actual contribution is (1) a specific, previously-unattested **instantiation** — the penalty
76
  on a *transformer* operator with a *meshfree, connectivity-free* MLS divergence (exact on affine fields by
77
  the degree-1 GMLS reproduction property), distinct from the FE / FFT / finite-difference operators of all
78
+ prior work — and (2) a **cross-operator analysis** that quantifies when that penalty actually helps.
79
 
80
  ### Model Sources
81
 
 
192
  | LinearNO, M=256 (this work) | 0.00635 | 0.00622 ± 0.00071 | 3 | 765,313 |
193
  | **+ equilibrium regularizer (this model)** | 0.00653 | 0.00668 ± 0.00065 | 3 | 582,275 |
194
 
195
+ **Accuracy: comparable to the baseline.** In this sample LinearNO's median (0.00606) is lower than our
196
+ reproduced baseline's (0.00766) at fewer parameters, and it reaches the published ~0.0050 level on good
197
+ seeds. Both models show **high run-to-run variance** (`torch.compile` non-determinism on 1000 samples),
198
+ with the baseline's higher mean driven by 2 outlier seeds; an attempted mechanistic explanation
199
+ (slice-attention instability) was tested and **not supported** by the evidence. LinearNO is therefore best
200
+ read as **statistically comparable** to the baseline at ≤ its parameters, both reaching ~0.0064 on good
201
+ seeds, without claiming an accuracy improvement. As a cross-check, we re-evaluated the authors' released
202
+ official checkpoint on our data with their code and reproduced **0.005007**, confirming the dataset, split,
203
+ and metric are identical, so the table is mutually comparable.
204
 
205
  **Verification against FEM ground truth** (200 test meshes; shipped checkpoint = best of 3 eqreg seeds):
206
  per-sample relative-L2 mean **0.00597** (median 0.00533), pooled Pearson **r = 0.99993**, **R² = 0.99986**,
207
  peak-stress relative error **0.27%** — reproducible via `scripts/verify_model.py` → `results/verify_model.json`.
208
 
209
+ ### Research findings
210
 
211
  **1. The meshfree MLS operator is rigorously grounded.** It is a degree-1 GMLS derivative: *exact on
212
  affine fields* (~1e-14 in float64) and *O(h)-convergent* on smooth fields (fitted slope 1.01), validated
 
219
  model's own (MLS) operator**, but an **independent FE operator** sees only **~6–53×** — at a **measured
220
  accuracy cost** (test rel-L2 0.00479 → 0.00621, +30%). A model-free control on exactly-divergence-free
221
  analytic fields confirms the FE operator is *comparable* to MLS off the void-rim slivers (the large raw
222
+ gap is a sliver artifact), so the operator-agnostic reduction (~53×) still sits **an order of
223
  magnitude below** the trained-operator 325×. The gaming reproduces on the *literal* official LinearNO
224
  block (gap ~25×), so it is a property of the soft-penalty objective, not our implementation.
225
 
 
237
  from the unregularized models.
238
 
239
  **Takeaway:** the soft equilibrium penalty looks most impressive exactly where it is least physical (an
240
+ unsupervised latent tensor), and its benefit largely disappears under direct tensor supervision. The
241
+ deployed model's value is its accuracy (R² = 0.99986) and millisecond CPU speed.
242
 
243
  ## Technical Specifications
244