Add Grad-CAM saliency maps for 6 CNN-class models
Browse files- .gitattributes +6 -0
- gradcam/README.md +20 -0
- gradcam/gradcam_clip_openai.png +3 -0
- gradcam/gradcam_densenet121.png +3 -0
- gradcam/gradcam_inception_v3.png +3 -0
- gradcam/gradcam_resnet101.png +3 -0
- gradcam/gradcam_resnet50.png +3 -0
- gradcam/gradcam_vgg19.png +3 -0
.gitattributes
CHANGED
|
@@ -53,3 +53,9 @@ analysis/roc_curves/roc_resnet50.png filter=lfs diff=lfs merge=lfs -text
|
|
| 53 |
analysis/roc_curves/roc_retfound.png filter=lfs diff=lfs merge=lfs -text
|
| 54 |
analysis/roc_curves/roc_swin_b.png filter=lfs diff=lfs merge=lfs -text
|
| 55 |
analysis/roc_curves/roc_vgg19.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
analysis/roc_curves/roc_retfound.png filter=lfs diff=lfs merge=lfs -text
|
| 54 |
analysis/roc_curves/roc_swin_b.png filter=lfs diff=lfs merge=lfs -text
|
| 55 |
analysis/roc_curves/roc_vgg19.png filter=lfs diff=lfs merge=lfs -text
|
| 56 |
+
gradcam/gradcam_clip_openai.png filter=lfs diff=lfs merge=lfs -text
|
| 57 |
+
gradcam/gradcam_densenet121.png filter=lfs diff=lfs merge=lfs -text
|
| 58 |
+
gradcam/gradcam_inception_v3.png filter=lfs diff=lfs merge=lfs -text
|
| 59 |
+
gradcam/gradcam_resnet101.png filter=lfs diff=lfs merge=lfs -text
|
| 60 |
+
gradcam/gradcam_resnet50.png filter=lfs diff=lfs merge=lfs -text
|
| 61 |
+
gradcam/gradcam_vgg19.png filter=lfs diff=lfs merge=lfs -text
|
gradcam/README.md
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Grad-CAM Saliency Maps
|
| 2 |
+
|
| 3 |
+
Per-class Grad-CAM visualisations for the 6 CNN-class models. For each model the figure
|
| 4 |
+
shows the 10 disease classes (rows) with the original fundus image (left) and the
|
| 5 |
+
Grad-CAM heatmap overlay (right).
|
| 6 |
+
|
| 7 |
+
## Generation
|
| 8 |
+
- Library: `pytorch-grad-cam`
|
| 9 |
+
- Target layer: last convolutional block of each backbone
|
| 10 |
+
- CLIP uses input-gradient saliency (no convolutional layer at the same semantic level)
|
| 11 |
+
- Foundation transformer models (DINOv2-L, RETFound, Swin-B) require a different attention
|
| 12 |
+
rollout / hookable layer and are not included in this v1 Grad-CAM batch.
|
| 13 |
+
|
| 14 |
+
## Files
|
| 15 |
+
- `gradcam_vgg19.png`
|
| 16 |
+
- `gradcam_resnet50.png`
|
| 17 |
+
- `gradcam_resnet101.png`
|
| 18 |
+
- `gradcam_densenet121.png`
|
| 19 |
+
- `gradcam_inception_v3.png`
|
| 20 |
+
- `gradcam_clip_openai.png`
|
gradcam/gradcam_clip_openai.png
ADDED
|
Git LFS Details
|
gradcam/gradcam_densenet121.png
ADDED
|
Git LFS Details
|
gradcam/gradcam_inception_v3.png
ADDED
|
Git LFS Details
|
gradcam/gradcam_resnet101.png
ADDED
|
Git LFS Details
|
gradcam/gradcam_resnet50.png
ADDED
|
Git LFS Details
|
gradcam/gradcam_vgg19.png
ADDED
|
Git LFS Details
|