update readme
Browse files
README.md
CHANGED
|
@@ -104,21 +104,6 @@ Youden's J is reported as a secondary reference. The threshold (**0.7113**) was
|
|
| 104 |
|
| 105 |
- Validation @ locked threshold: sensitivity **0.952**, specificity **0.896**.
|
| 106 |
|
| 107 |
-
## Test performance (locked model + locked threshold, n=1000)
|
| 108 |
-
|
| 109 |
-
CI method: stratified bootstrap, 2000 resamples, seed=42. Probabilities calibrated.
|
| 110 |
-
|
| 111 |
-
| Metric | Point estimate | 95% CI |
|
| 112 |
-
|--------|---------------:|:------:|
|
| 113 |
-
| AUROC | **0.9371** | [0.9202, 0.9528] |
|
| 114 |
-
| Sensitivity | 0.9042 | [0.8824, 0.9248] |
|
| 115 |
-
| Specificity | 0.7955 | [0.7435, 0.8439] |
|
| 116 |
-
| PPV | 0.9232 | [0.9054, 0.9401] |
|
| 117 |
-
| NPV | 0.7535 | [0.7123, 0.7979] |
|
| 118 |
-
| Accuracy | 0.8750 | [0.8540, 0.8950] |
|
| 119 |
-
| F1 | 0.9136 | [0.8991, 0.9278] |
|
| 120 |
-
| Brier | 0.0823 | — |
|
| 121 |
-
| ECE | 0.0314 | — |
|
| 122 |
|
| 123 |
## Calibration results
|
| 124 |
|
|
@@ -127,14 +112,6 @@ Temperature scaling (T=0.5646) on validation reduced **validation ECE from 0.083
|
|
| 127 |
the test set, calibrated ECE is **0.0314** (well calibrated). Reliability diagrams:
|
| 128 |
`results/figures/valid_calibration.png`, `results/figures/test_calibration.png`.
|
| 129 |
|
| 130 |
-
## Confusion matrix (Test)
|
| 131 |
-
|
| 132 |
-
TN = 214 · FP = 55 · FN = 70 · TP = 661
|
| 133 |
-
|
| 134 |
-

|
| 135 |
-
|
| 136 |
-
Additional figures: `results/figures/test_roc.png`,
|
| 137 |
-
`results/figures/test_pr.png`, `results/figures/test_confusion_normalized.png`.
|
| 138 |
|
| 139 |
## Files in this repo
|
| 140 |
|
|
|
|
| 104 |
|
| 105 |
- Validation @ locked threshold: sensitivity **0.952**, specificity **0.896**.
|
| 106 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
|
| 108 |
## Calibration results
|
| 109 |
|
|
|
|
| 112 |
the test set, calibrated ECE is **0.0314** (well calibrated). Reliability diagrams:
|
| 113 |
`results/figures/valid_calibration.png`, `results/figures/test_calibration.png`.
|
| 114 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 115 |
|
| 116 |
## Files in this repo
|
| 117 |
|