DM-Diaz commited on
Commit
a0eafea
Β·
verified Β·
1 Parent(s): 5d15d82

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -29,6 +29,42 @@ The model was pretrained using **SimCLR with a ResNet-18 backbone** and served a
29
 
30
  Training was implemented using the [**Lightly** self-supervised learning framework](https://docs.lightly.ai/self-supervised-learning/index.html). The training images were obtained from the [`clane9/imagenet-100`](https://huggingface.co/datasets/clane9/imagenet-100) dataset on Hugging Face.
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## Related Models
33
 
34
  This repository is associated with the **[Eccentricity-Constrained SimCLR Models (VEDB)](https://hf.co/collections/DM-Diaz/eccentricity-constrained-simclr-models-vedb)** collection.
 
29
 
30
  Training was implemented using the [**Lightly** self-supervised learning framework](https://docs.lightly.ai/self-supervised-learning/index.html). The training images were obtained from the [`clane9/imagenet-100`](https://huggingface.co/datasets/clane9/imagenet-100) dataset on Hugging Face.
31
 
32
+ ### Comparative Evaluation Results
33
+
34
+ The table below reproduces the summary metrics reported in the associated paper across all VEDB-trained conditions and **reference models**. **Rows corresponding to this repository's ImageNet-100 checkpoint are bolded.**
35
+
36
+ | Task | Condition | Val Loss | Top-1 (%) | Top-5 (%) | Best Macro-F1 (%) |
37
+ | --- | --- | ---: | ---: | ---: | ---: |
38
+ | SimCLR | Baseline | 0.4331 | 87.60 | β€” | β€” |
39
+ | SimCLR | Fovea-Gaze | 0.3749 | 90.43 | β€” | β€” |
40
+ | SimCLR | Periph-NF | 0.4548 | 90.04 | β€” | β€” |
41
+ | SimCLR | Periph | 0.4545 | 89.26 | β€” | β€” |
42
+ | In-Domain | Baseline | 0.9811 | β€” | β€” | 42.17 |
43
+ | In-Domain | Fovea-Gaze | 1.2031 | β€” | β€” | 43.64 |
44
+ | In-Domain | Periph-NF | 1.3090 | β€” | β€” | 30.93 |
45
+ | In-Domain | Periph | 1.0623 | β€” | β€” | 36.56 |
46
+ | In-Domain | STL-10 | 1.6666 | β€” | β€” | 25.41 |
47
+ | **In-Domain** | **ImageNet-100** | **1.2342** | **β€”** | **β€”** | **41.23** |
48
+ | In-Domain | ImageNet-1K | 0.9713 | β€” | β€” | 43.33 |
49
+ | VGGFace2 | Baseline | 7.8101 | 5.21 | 11.73 | 3.26 |
50
+ | VGGFace2 | Fovea-Gaze | 7.9104 | 4.58 | 10.76 | 2.70 |
51
+ | VGGFace2 | Periph-NF | 8.0232 | 3.39 | 8.17 | 1.90 |
52
+ | VGGFace2 | Periph | 8.1681 | 2.54 | 6.39 | 1.35 |
53
+ | VGGFace2 | STL-10 | 6.9973 | 9.55 | 18.96 | 7.43 |
54
+ | **VGGFace2** | **ImageNet-100** | **6.7985** | **10.77** | **21.07** | **8.71** |
55
+ | VGGFace2 | ImageNet-1K | 6.7964 | 10.74 | 21.08 | 8.77 |
56
+ | Places365 | Baseline | 3.9690 | 25.63 | 51.90 | 23.16 |
57
+ | Places365 | Fovea-Gaze | 4.2347 | 21.86 | 46.21 | 19.14 |
58
+ | Places365 | Periph-NF | 4.2621 | 20.51 | 44.58 | 17.86 |
59
+ | Places365 | Periph | 4.2671 | 20.26 | 44.10 | 17.65 |
60
+ | Places365 | STL-10 | 3.8281 | 26.57 | 53.47 | 24.82 |
61
+ | **Places365** | **ImageNet-100** | **3.9207** | **24.99** | **51.21** | **23.32** |
62
+ | Places365 | ImageNet-1K | 3.6264 | 30.17 | 58.46 | 28.36 |
63
+
64
+ **Note:** SimCLR Top-1 is computed from the self-supervised contrastive objective and is not directly comparable to downstream supervised classification accuracy. For downstream tasks, the pretrained ResNet-18 backbone was **frozen** and only a linear classifier was trained; the backbone weights were **not fine-tuned**. Classifier checkpoints were selected by best validation Macro-F1. In-domain Top-1 accuracy is omitted because label imbalance across frames can make accuracy misleading; Macro-F1 is reported as the primary class-balanced metric. STL-10, ImageNet-100, and ImageNet-1K are treated as out-of-domain baselines because they were not pretrained on VEDB.
65
+
66
+ For in-domain classification, Macro-F1 was used as the primary class-balanced metric because of label imbalance across VEDB frame categories.
67
+
68
  ## Related Models
69
 
70
  This repository is associated with the **[Eccentricity-Constrained SimCLR Models (VEDB)](https://hf.co/collections/DM-Diaz/eccentricity-constrained-simclr-models-vedb)** collection.