Johnyquest7 commited on
Commit
e3fb751
·
verified ·
1 Parent(s): 7a26115

update readme

Browse files

Add information about external validation

Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -14,9 +14,9 @@ pipeline_tag: image-classification
14
  # Agentic Thyroid ResNet-18 — Ultrasound Nodule Malignancy Classifier
15
 
16
  > ⚠️ **RESEARCH USE ONLY — NOT FOR CLINICAL USE.** This model is a research
17
- > artifact trained on a single retrospective dataset. It has **not** been
18
- > externally validated and **must not** be used for diagnosis, screening, or any
19
- > clinical decision-making. External, prospective validation is required before
20
  > any clinical consideration.
21
 
22
  A ResNet-18 binary classifier that predicts the probability that a cropped
@@ -155,7 +155,7 @@ python evaluate_external.py \
155
 
156
  ## Limitations, bias, and leakage concerns
157
 
158
- - **Single-source dataset; no external validation.** Performance on data from
159
  other scanners, institutions, or populations is unknown and likely lower.
160
  - **Cropped-ROI inputs.** The model expects nodule-cropped images like TN5000;
161
  whole-frame ultrasound will be out of distribution.
@@ -169,9 +169,11 @@ python evaluate_external.py \
169
  - **Leakage checks were exhaustive within the available signal** (exact pixel
170
  hashing + filename-ID overlap, all zero) but cannot rule out near-duplicate or
171
  same-patient-different-image leakage if such structure exists in the source.
 
172
 
173
  ## ⚠️ External validation required before clinical use
174
 
 
175
  This model **requires independent, ideally prospective, multi-site external
176
  validation** before any clinical consideration. It is released for research
177
  reproducibility only.
 
14
  # Agentic Thyroid ResNet-18 — Ultrasound Nodule Malignancy Classifier
15
 
16
  > ⚠️ **RESEARCH USE ONLY — NOT FOR CLINICAL USE.** This model is a research
17
+ > artifact trained on a single retrospective dataset and is validated only one external dataset. It
18
+ > **must not** be used for diagnosis, screening, or any
19
+ > clinical decision-making. Multiple external, prospective validation is required before
20
  > any clinical consideration.
21
 
22
  A ResNet-18 binary classifier that predicts the probability that a cropped
 
155
 
156
  ## Limitations, bias, and leakage concerns
157
 
158
+ - **Single-source dataset** Performance on data from
159
  other scanners, institutions, or populations is unknown and likely lower.
160
  - **Cropped-ROI inputs.** The model expects nodule-cropped images like TN5000;
161
  whole-frame ultrasound will be out of distribution.
 
169
  - **Leakage checks were exhaustive within the available signal** (exact pixel
170
  hashing + filename-ID overlap, all zero) but cannot rule out near-duplicate or
171
  same-patient-different-image leakage if such structure exists in the source.
172
+ But the original article describing the dataset states that "Only one representative image among the images of the same perspective of the patient is reserved, to prevent the risk of data leakage and ensure the dataset can be partitioned at the patient level;"
173
 
174
  ## ⚠️ External validation required before clinical use
175
 
176
+ At present this model has only one external validation.
177
  This model **requires independent, ideally prospective, multi-site external
178
  validation** before any clinical consideration. It is released for research
179
  reproducibility only.