yungisimon commited on
Commit
26eb45a
·
verified ·
1 Parent(s): e713490

corrected proxy-gate numbers (crosswalk fix) + reproduced q4 baseline

Browse files
Files changed (1) hide show
  1. README.md +10 -8
README.md CHANGED
@@ -137,14 +137,16 @@ _⚠ in OUR backbone's pretraining — contaminated for us; reference only_
137
 
138
  ## ShieldFlow proxy-traffic product gate (native ShieldFlow taxonomy, partial)
139
 
140
- Held-out 10% of the v7 proxy corpus (enterprise pastes); trained on the same 90% the
141
- incumbent did, evaluated on the identical untouched holdout.
 
142
 
143
- | dataset | ours (v4) P / R / F1 | q4 incumbent |
144
  |---|---|---|
145
- | proxy_traffic_holdout | 0.749 / 0.683 / **0.714** | F1 0.878 / R 0.982 |
146
- | proxy_traffic_holdout_xlong | 0.688 / 0.753 / **0.719** | F1 0.884 / R 0.940 |
147
 
148
- v4 adds the v7 train split + 3 native ShieldFlow types (`developer.login_credentials`,
149
- `developer.device_id`, `healthcare.health_plan_id`). Recall gap to the in-distribution
150
- incumbent remains; tuning the v7 mix weight is the lever.
 
 
137
 
138
  ## ShieldFlow proxy-traffic product gate (native ShieldFlow taxonomy, partial)
139
 
140
+ Held-out 10% of the v7 proxy corpus; we train on the same 90% the incumbent did and
141
+ evaluate on the identical untouched holdout (seed-42 split). q4 baseline reproduced
142
+ exactly in this harness (validates the scoring path).
143
 
144
+ | dataset | **ours (v4)** P / R / F1 | q4 incumbent (reproduced) |
145
  |---|---|---|
146
+ | proxy_traffic_holdout | 0.872 / 0.715 / **0.786** | 0.794 / 0.982 / 0.878 |
147
+ | proxy_traffic_holdout_xlong | 0.793 / 0.767 / **0.780** | 0.834 / 0.940 / 0.884 |
148
 
149
+ v4 has **higher precision** than the incumbent; the F1 gap is **recall** (q4 is tuned for
150
+ near-total recall on this workload). Scored in native ShieldFlow space with these new
151
+ types: `developer.login_credentials` (combo span), `developer.device_id`,
152
+ `healthcare.health_plan_id`.