Update README.md
Browse files
README.md
CHANGED
|
@@ -103,6 +103,42 @@ The stored epoch is zero-indexed, so `epoch = 99` corresponds to the completion
|
|
| 103 |
|
| 104 |
The checkpoint includes training state such as optimizer and scheduler information in addition to model parameters.
|
| 105 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
## Intended Use
|
| 107 |
|
| 108 |
This checkpoint is provided for research and downstream applications involving self-supervised visual representations, including:
|
|
|
|
| 103 |
|
| 104 |
The checkpoint includes training state such as optimizer and scheduler information in addition to model parameters.
|
| 105 |
|
| 106 |
+
### Comparative Evaluation Results
|
| 107 |
+
|
| 108 |
+
The table below reproduces the summary metrics reported in the associated paper across all VEDB-trained conditions and **reference models**. **Rows corresponding to this repository's ImageNet-1K checkpoint are bolded.**
|
| 109 |
+
|
| 110 |
+
| Task | Condition | Val Loss | Top-1 (%) | Top-5 (%) | Best Macro-F1 (%) |
|
| 111 |
+
| --- | --- | ---: | ---: | ---: | ---: |
|
| 112 |
+
| SimCLR | Baseline | 0.4331 | 87.60 | β | β |
|
| 113 |
+
| SimCLR | Fovea-Gaze | 0.3749 | 90.43 | β | β |
|
| 114 |
+
| SimCLR | Periph-NF | 0.4548 | 90.04 | β | β |
|
| 115 |
+
| SimCLR | Periph | 0.4545 | 89.26 | β | β |
|
| 116 |
+
| In-Domain | Baseline | 0.9811 | β | β | 42.17 |
|
| 117 |
+
| In-Domain | Fovea-Gaze | 1.2031 | β | β | 43.64 |
|
| 118 |
+
| In-Domain | Periph-NF | 1.3090 | β | β | 30.93 |
|
| 119 |
+
| In-Domain | Periph | 1.0623 | β | β | 36.56 |
|
| 120 |
+
| In-Domain | STL-10 | 1.6666 | β | β | 25.41 |
|
| 121 |
+
| In-Domain | ImageNet-100 | 1.2342 | β | β | 41.23 |
|
| 122 |
+
| **In-Domain** | **ImageNet-1K** | **0.9713** | **β** | **β** | **43.33** |
|
| 123 |
+
| VGGFace2 | Baseline | 7.8101 | 5.21 | 11.73 | 3.26 |
|
| 124 |
+
| VGGFace2 | Fovea-Gaze | 7.9104 | 4.58 | 10.76 | 2.70 |
|
| 125 |
+
| VGGFace2 | Periph-NF | 8.0232 | 3.39 | 8.17 | 1.90 |
|
| 126 |
+
| VGGFace2 | Periph | 8.1681 | 2.54 | 6.39 | 1.35 |
|
| 127 |
+
| VGGFace2 | STL-10 | 6.9973 | 9.55 | 18.96 | 7.43 |
|
| 128 |
+
| VGGFace2 | ImageNet-100 | 6.7985 | 10.77 | 21.07 | 8.71 |
|
| 129 |
+
| **VGGFace2** | **ImageNet-1K** | **6.7964** | **10.74** | **21.08** | **8.77** |
|
| 130 |
+
| Places365 | Baseline | 3.9690 | 25.63 | 51.90 | 23.16 |
|
| 131 |
+
| Places365 | Fovea-Gaze | 4.2347 | 21.86 | 46.21 | 19.14 |
|
| 132 |
+
| Places365 | Periph-NF | 4.2621 | 20.51 | 44.58 | 17.86 |
|
| 133 |
+
| Places365 | Periph | 4.2671 | 20.26 | 44.10 | 17.65 |
|
| 134 |
+
| Places365 | STL-10 | 3.8281 | 26.57 | 53.47 | 24.82 |
|
| 135 |
+
| Places365 | ImageNet-100 | 3.9207 | 24.99 | 51.21 | 23.32 |
|
| 136 |
+
| **Places365** | **ImageNet-1K** | **3.6264** | **30.17** | **58.46** | **28.36** |
|
| 137 |
+
|
| 138 |
+
**Note:** SimCLR Top-1 is computed from the self-supervised contrastive objective and is not directly comparable to downstream supervised classification accuracy. For downstream tasks, the pretrained ResNet-18 backbone was **frozen** and only a linear classifier was trained; the backbone weights were **not fine-tuned**. Classifier checkpoints were selected by best validation Macro-F1. In-domain Top-1 accuracy is omitted because label imbalance across frames can make accuracy misleading; Macro-F1 is reported as the primary class-balanced metric. STL-10, ImageNet-100, and ImageNet-1K are treated as out-of-domain baselines because they were not pretrained on VEDB.
|
| 139 |
+
|
| 140 |
+
For in-domain classification, Macro-F1 was used as the primary class-balanced metric because of label imbalance across VEDB frame categories.
|
| 141 |
+
|
| 142 |
## Intended Use
|
| 143 |
|
| 144 |
This checkpoint is provided for research and downstream applications involving self-supervised visual representations, including:
|