Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,82 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
colorFrom: pink
|
| 5 |
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
-
pinned:
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: gradeeye
|
| 3 |
+
emoji: π
|
| 4 |
colorFrom: pink
|
| 5 |
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
+
pinned: true
|
| 8 |
+
thumbnail: >-
|
| 9 |
+
https://cdn-uploads.huggingface.co/production/uploads/68cef9e7195e8b94d3557b81/CAfWeW32yUYWygr9dMb4Y.png
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# GradEye
|
| 13 |
+
|
| 14 |
+
Model checkpoints and code supporting our study on **per-threshold calibration
|
| 15 |
+
under domain shift** in diabetic retinopathy (DR) grading. We use a CORN
|
| 16 |
+
ordinal regression head across a leave-one-domain-out (LODO) protocol on four
|
| 17 |
+
public fundus photograph datasets, and show that calibration β not just
|
| 18 |
+
accuracy β degrades non-uniformly across ordinal thresholds under domain shift.
|
| 19 |
+
|
| 20 |
+
π Paper: coming soon
|
| 21 |
+
π Code: [github.com/yourname/gradeeye](https://github.com/yourname/gradeeye)
|
| 22 |
+
π License: see below (per-repo, not MIT β derived from restricted-use source data)
|
| 23 |
+
|
| 24 |
+
## What we publish
|
| 25 |
+
|
| 26 |
+
Pretrained CNN/ViT backbones (ConvNeXt-Tiny, DeiT-3 Small/384, MaxViT-Tiny/384)
|
| 27 |
+
with a CORN ordinal regression head, trained under a strict LODO protocol
|
| 28 |
+
across four DR fundus photograph domains, plus auxiliary-channel variants
|
| 29 |
+
(learned segmentation masks, Sobel edge maps) and the U-Net segmentation
|
| 30 |
+
models used to generate them.
|
| 31 |
+
|
| 32 |
+
## Data sources (LODO folds)
|
| 33 |
+
|
| 34 |
+
| Domain | Role |
|
| 35 |
+
|:--|:--|
|
| 36 |
+
| EyePACS | held-out fold / training source |
|
| 37 |
+
| APTOS | held-out fold / training source |
|
| 38 |
+
| Messidor-2 | held-out fold / training source |
|
| 39 |
+
| DDR | held-out fold / training source |
|
| 40 |
+
|
| 41 |
+
Each model is trained on 3 of the 4 domains and evaluated on the 4th,
|
| 42 |
+
held-out domain β the model never sees that domain during training or
|
| 43 |
+
model selection.
|
| 44 |
+
|
| 45 |
+
## Key findings
|
| 46 |
+
|
| 47 |
+
| # | Finding | Headline number |
|
| 48 |
+
|--:|:--|:--|
|
| 49 |
+
| 1 | Per-threshold calibration diverges structurally under domain shift | ECE range 0.05β0.29 across thresholds (6Γ spread on Messidor-2) |
|
| 50 |
+
| 2 | Post-hoc temperature scaling fails under shift β and fails the *opposite* way expected | T saturates at upper bound (5.0); model is under-confident, not overconfident |
|
| 51 |
+
| 3 | Class balancing hurts cross-domain accuracy in this LODO setup | unbalanced beats balanced by +3.93% mean QWK |
|
| 52 |
+
| 4 | Mild NPDR (grade 1) is the dominant cross-study failure mode | F1 < 0.13 on every fold, every variant |
|
| 53 |
+
| 5 | Best cross-domain backbone (of 3 tested) | ConvNeXt-Tiny, mean QWK 0.686 Β± 0.156 |
|
| 54 |
+
|
| 55 |
+
Full per-fold, per-variant tables are in the paper and in each repo's model card.
|
| 56 |
+
|
| 57 |
+
## Repository structure
|
| 58 |
+
|
| 59 |
+
One repo per training configuration (backbone Γ channel variant Γ loss).
|
| 60 |
+
See the [Collection] *(link once live)* for the full index. Each repo's
|
| 61 |
+
model card documents architecture, LODO fold, training hyperparameters,
|
| 62 |
+
and metrics for that specific checkpoint set.
|
| 63 |
+
|
| 64 |
+
## License
|
| 65 |
+
|
| 66 |
+
Model weights are derived from datasets with **non-commercial,
|
| 67 |
+
research/academic-use restrictions** (EyePACS and APTOS Kaggle competition
|
| 68 |
+
terms prohibit redistribution and commercial use). Accordingly, all
|
| 69 |
+
checkpoints in this org are released under **`cc-by-nc-4.0`**, research use
|
| 70 |
+
only. See each repo's card for source-dataset attribution. Raw source
|
| 71 |
+
images are not redistributed β only trained model weights.
|
| 72 |
+
|
| 73 |
+
## Status
|
| 74 |
+
|
| 75 |
+
This is an active research project; some tables in the paper are still
|
| 76 |
+
being finalized (confidence intervals, seed sensitivity, full ablation
|
| 77 |
+
matrix). Findings above are from completed runs and are stable; exact
|
| 78 |
+
numbers may be refined before camera-ready.
|
| 79 |
+
|
| 80 |
+
## Author
|
| 81 |
+
|
| 82 |
+
[Your Name] Β· [GitHub](https://github.com/yourname) Β· [contact/socials]
|