resoajoe commited on
Commit
ecfd257
·
verified ·
1 Parent(s): 9c1acea

state the scalar baseline explicitly: 10 statistics, in-sample vs transferred

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -140,3 +140,27 @@ sess = ort.InferenceSession("quality_gate.onnx", sess_options=so, providers=["CP
140
  Measured effect on the same workload: idle CPU **192% → 16.5%** of one core, active **231% → 88%**,
141
  thread count 45 → 22, throughput unchanged. On edge hardware this is the difference between
142
  "runs alongside everything else" and "saturates the machine".
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
140
  Measured effect on the same workload: idle CPU **192% → 16.5%** of one core, active **231% → 88%**,
141
  thread count 45 → 22, throughput unchanged. On edge hardware this is the difference between
142
  "runs alongside everything else" and "saturates the machine".
143
+
144
+ ## What "scalar baseline" means on this card
145
+
146
+ Every margin quoted here is against a **stated baseline**, because a margin without one is not a
147
+ measurement. The baseline is the best single-threshold classifier over **ten cheap statistics**,
148
+ fitted optimistically:
149
+
150
+ `mean` · `std` · `lapvar` · `hf` (high-frequency energy ratio) · `grad` (Sobel magnitude) ·
151
+ `entropy` · `centre_edge` · `radial_slope` · `row_fft_peak` · `col_fft_peak`
152
+
153
+ The last four are **spatially aware**, added after an earlier six-statistic baseline — all global
154
+ aggregates — was found to systematically overstate model value on spatially structured tasks. A
155
+ baseline that cannot see *where* anything is loses to a CNN by default. On one test task that flaw
156
+ inflated an apparent margin from **+0.060 to +0.261**.
157
+
158
+ Two questions are asked with it, and they disagree:
159
+
160
+ - **in-sample** — threshold fitted on the data it is scored on. Deliberately generous. Answers
161
+ *is there structure beyond a low-order statistic?*
162
+ - **transferred** — threshold fitted on the training corpus, applied unchanged to the target.
163
+ Answers *what should I ship?* On one task the in-sample figure was 0.954 and the transferred
164
+ figure **0.565**.
165
+
166
+ Where this card quotes a single scalar figure without qualification, it is the in-sample one.