ahmed-farhanur-rashid commited on
Commit
7d982e1
Β·
verified Β·
1 Parent(s): f4ce534

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +76 -4
README.md CHANGED
@@ -1,10 +1,82 @@
1
  ---
2
- title: README
3
- emoji: 🐨
4
  colorFrom: pink
5
  colorTo: green
6
  sdk: static
7
- pinned: false
 
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: gradeeye
3
+ emoji: πŸ“š
4
  colorFrom: pink
5
  colorTo: green
6
  sdk: static
7
+ pinned: true
8
+ thumbnail: >-
9
+ https://cdn-uploads.huggingface.co/production/uploads/68cef9e7195e8b94d3557b81/CAfWeW32yUYWygr9dMb4Y.png
10
  ---
11
 
12
+ # GradEye
13
+
14
+ Model checkpoints and code supporting our study on **per-threshold calibration
15
+ under domain shift** in diabetic retinopathy (DR) grading. We use a CORN
16
+ ordinal regression head across a leave-one-domain-out (LODO) protocol on four
17
+ public fundus photograph datasets, and show that calibration β€” not just
18
+ accuracy β€” degrades non-uniformly across ordinal thresholds under domain shift.
19
+
20
+ πŸ”— Paper: coming soon
21
+ πŸ”— Code: [github.com/yourname/gradeeye](https://github.com/yourname/gradeeye)
22
+ πŸ“„ License: see below (per-repo, not MIT β€” derived from restricted-use source data)
23
+
24
+ ## What we publish
25
+
26
+ Pretrained CNN/ViT backbones (ConvNeXt-Tiny, DeiT-3 Small/384, MaxViT-Tiny/384)
27
+ with a CORN ordinal regression head, trained under a strict LODO protocol
28
+ across four DR fundus photograph domains, plus auxiliary-channel variants
29
+ (learned segmentation masks, Sobel edge maps) and the U-Net segmentation
30
+ models used to generate them.
31
+
32
+ ## Data sources (LODO folds)
33
+
34
+ | Domain | Role |
35
+ |:--|:--|
36
+ | EyePACS | held-out fold / training source |
37
+ | APTOS | held-out fold / training source |
38
+ | Messidor-2 | held-out fold / training source |
39
+ | DDR | held-out fold / training source |
40
+
41
+ Each model is trained on 3 of the 4 domains and evaluated on the 4th,
42
+ held-out domain β€” the model never sees that domain during training or
43
+ model selection.
44
+
45
+ ## Key findings
46
+
47
+ | # | Finding | Headline number |
48
+ |--:|:--|:--|
49
+ | 1 | Per-threshold calibration diverges structurally under domain shift | ECE range 0.05–0.29 across thresholds (6Γ— spread on Messidor-2) |
50
+ | 2 | Post-hoc temperature scaling fails under shift β€” and fails the *opposite* way expected | T saturates at upper bound (5.0); model is under-confident, not overconfident |
51
+ | 3 | Class balancing hurts cross-domain accuracy in this LODO setup | unbalanced beats balanced by +3.93% mean QWK |
52
+ | 4 | Mild NPDR (grade 1) is the dominant cross-study failure mode | F1 < 0.13 on every fold, every variant |
53
+ | 5 | Best cross-domain backbone (of 3 tested) | ConvNeXt-Tiny, mean QWK 0.686 Β± 0.156 |
54
+
55
+ Full per-fold, per-variant tables are in the paper and in each repo's model card.
56
+
57
+ ## Repository structure
58
+
59
+ One repo per training configuration (backbone Γ— channel variant Γ— loss).
60
+ See the [Collection] *(link once live)* for the full index. Each repo's
61
+ model card documents architecture, LODO fold, training hyperparameters,
62
+ and metrics for that specific checkpoint set.
63
+
64
+ ## License
65
+
66
+ Model weights are derived from datasets with **non-commercial,
67
+ research/academic-use restrictions** (EyePACS and APTOS Kaggle competition
68
+ terms prohibit redistribution and commercial use). Accordingly, all
69
+ checkpoints in this org are released under **`cc-by-nc-4.0`**, research use
70
+ only. See each repo's card for source-dataset attribution. Raw source
71
+ images are not redistributed β€” only trained model weights.
72
+
73
+ ## Status
74
+
75
+ This is an active research project; some tables in the paper are still
76
+ being finalized (confidence intervals, seed sensitivity, full ablation
77
+ matrix). Findings above are from completed runs and are stable; exact
78
+ numbers may be refined before camera-ready.
79
+
80
+ ## Author
81
+
82
+ [Your Name] Β· [GitHub](https://github.com/yourname) Β· [contact/socials]