Upload eval_val/report.md with huggingface_hub
Browse files- eval_val/report.md +49 -0
eval_val/report.md
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Bedding × Dinomaly ALL6 (VIS+SWIR) — eval report (val)
|
| 2 |
+
|
| 3 |
+
- Pipeline: `dinomaly_bedding_all6.yaml`
|
| 4 |
+
- Frames evaluated: **59**
|
| 5 |
+
- Splits CSV: `bedding_splits_npz.csv`
|
| 6 |
+
|
| 7 |
+
## Headline metrics vs EAD baseline
|
| 8 |
+
|
| 9 |
+
| Metric | Dinomaly RGB | EAD baseline | Δ |
|
| 10 |
+
|-----------------------|-------------:|-------------:|---------:|
|
| 11 |
+
| Pixel AUROC | **0.976** | 0.910 | +0.066 |
|
| 12 |
+
| Image AUROC (p99.9) | **0.870** | 0.846 | +0.024 |
|
| 13 |
+
| Optimal-F1 Dice (raw) | **0.615** | 0.679 | -0.064 |
|
| 14 |
+
| Dice threshold (raw) | 0.1819 | — | — |
|
| 15 |
+
| Dice — per-frame-norm (legacy) | 0.418 | — | -0.261 |
|
| 16 |
+
|
| 17 |
+
## Per-class pixel AUROC (one-vs-background)
|
| 18 |
+
|
| 19 |
+
| Class | Pixel AUROC |
|
| 20 |
+
|-------|------------:|
|
| 21 |
+
| PLA_black_16mm | 0.998 |
|
| 22 |
+
| PLA_blue_16mm | 0.998 |
|
| 23 |
+
| PLA_blue_8mm | 0.996 |
|
| 24 |
+
| POMC | 0.995 |
|
| 25 |
+
| PLA_black_8mm | 0.995 |
|
| 26 |
+
| transparent_plastic | 0.994 |
|
| 27 |
+
| PLA_white_8mm | 0.994 |
|
| 28 |
+
| leaf | 0.992 |
|
| 29 |
+
| water | 0.992 |
|
| 30 |
+
| PLA_white_16mm | 0.992 |
|
| 31 |
+
| PET | 0.990 |
|
| 32 |
+
| alcohol | 0.990 |
|
| 33 |
+
| PLA_blue_4mm | 0.987 |
|
| 34 |
+
| fake_leaf | 0.983 |
|
| 35 |
+
| PLA_blacK_4mm | 0.982 |
|
| 36 |
+
| PLA_black_1mm | 0.978 |
|
| 37 |
+
| water&alcohol-tray | 0.978 |
|
| 38 |
+
| PLA_blue_1mm | 0.972 |
|
| 39 |
+
| PLA_black_2mm | 0.965 |
|
| 40 |
+
| PLA_white_1mm | 0.941 |
|
| 41 |
+
| PLA_white_4mm | 0.925 |
|
| 42 |
+
| PLA_blue_2mm | 0.923 |
|
| 43 |
+
| PLA_white_2mm | 0.840 |
|
| 44 |
+
|
| 45 |
+
## Files
|
| 46 |
+
- `roc_pixel.png` — pixel-level ROC curve
|
| 47 |
+
- `roc_per_class.png` — per-class AUROC bar chart
|
| 48 |
+
- `per_frame/<frame_id>.png` — 3-col per-frame layout
|
| 49 |
+
- `raw/<frame_id>.npz` — raw score + GT for re-analysis
|