state the scalar baseline explicitly: 10 statistics, in-sample vs transferred
Browse files
README.md
CHANGED
|
@@ -140,3 +140,27 @@ sess = ort.InferenceSession("quality_gate.onnx", sess_options=so, providers=["CP
|
|
| 140 |
Measured effect on the same workload: idle CPU **192% → 16.5%** of one core, active **231% → 88%**,
|
| 141 |
thread count 45 → 22, throughput unchanged. On edge hardware this is the difference between
|
| 142 |
"runs alongside everything else" and "saturates the machine".
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 140 |
Measured effect on the same workload: idle CPU **192% → 16.5%** of one core, active **231% → 88%**,
|
| 141 |
thread count 45 → 22, throughput unchanged. On edge hardware this is the difference between
|
| 142 |
"runs alongside everything else" and "saturates the machine".
|
| 143 |
+
|
| 144 |
+
## What "scalar baseline" means on this card
|
| 145 |
+
|
| 146 |
+
Every margin quoted here is against a **stated baseline**, because a margin without one is not a
|
| 147 |
+
measurement. The baseline is the best single-threshold classifier over **ten cheap statistics**,
|
| 148 |
+
fitted optimistically:
|
| 149 |
+
|
| 150 |
+
`mean` · `std` · `lapvar` · `hf` (high-frequency energy ratio) · `grad` (Sobel magnitude) ·
|
| 151 |
+
`entropy` · `centre_edge` · `radial_slope` · `row_fft_peak` · `col_fft_peak`
|
| 152 |
+
|
| 153 |
+
The last four are **spatially aware**, added after an earlier six-statistic baseline — all global
|
| 154 |
+
aggregates — was found to systematically overstate model value on spatially structured tasks. A
|
| 155 |
+
baseline that cannot see *where* anything is loses to a CNN by default. On one test task that flaw
|
| 156 |
+
inflated an apparent margin from **+0.060 to +0.261**.
|
| 157 |
+
|
| 158 |
+
Two questions are asked with it, and they disagree:
|
| 159 |
+
|
| 160 |
+
- **in-sample** — threshold fitted on the data it is scored on. Deliberately generous. Answers
|
| 161 |
+
*is there structure beyond a low-order statistic?*
|
| 162 |
+
- **transferred** — threshold fitted on the training corpus, applied unchanged to the target.
|
| 163 |
+
Answers *what should I ship?* On one task the in-sample figure was 0.954 and the transferred
|
| 164 |
+
figure **0.565**.
|
| 165 |
+
|
| 166 |
+
Where this card quotes a single scalar figure without qualification, it is the in-sample one.
|