DM-Diaz commited on
Commit
3e0f73c
Β·
verified Β·
1 Parent(s): 78cdf34

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +107 -6
README.md CHANGED
@@ -21,17 +21,104 @@ This repository contains the **ImageNet-1K SimCLR ResNet-18 checkpoint** trained
21
 
22
  **Diaz, D. M., & Henderson, M. M. (2026). _Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field._ Proceedings of the 9th Conference on Cognitive Computational Neuroscience.**
23
 
24
- **DOI:** `10.32470/0416gfsq`<br>
25
- **arXiv:** `2607.19316`<br>
26
  **Contributed Talk:** [CCN 2026 presentation on YouTube](https://www.youtube.com/watch?v=Lb4S3FWqd2M&t=2545s)
27
 
28
- The model was pretrained using **SimCLR with a ResNet-18 backbone** and served as one of the non-egocentric reference models in the associated study. It was used alongside models pretrained on ImageNet-100 and STL-10 to provide comparison points for evaluating representations learned from naturalistic egocentric visual experience.
29
 
30
- Training was implemented using the [**Lightly** self-supervised learning framework](https://docs.lightly.ai/self-supervised-learning/index.html). The training images were obtained from the [`evanarlian/imagenet_1k_resized_256`](https://huggingface.co/datasets/evanarlian/imagenet_1k_resized_256) dataset on Hugging Face.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ## Related Models
33
 
34
- This repository is associated with the **[Eccentricity-Constrained SimCLR Models (VEDB)](https://hf.co/collections/DM-Diaz/eccentricity-constrained-simclr-models-vedb)** collection.
35
 
36
  - [VEDB SimCLR ResNet-18 β€” Baseline](https://huggingface.co/DM-Diaz/VEDB-SimCLR-ResNet18-Baseline)
37
  - [VEDB SimCLR ResNet-18 β€” Fovea-Gaze](https://huggingface.co/DM-Diaz/VEDB-SimCLR-ResNet18-Fovea-Gaze)
@@ -40,4 +127,18 @@ This repository is associated with the **[Eccentricity-Constrained SimCLR Models
40
  - [VEDB NSD ResNet-18 β€” Encoding Models](https://huggingface.co/DM-Diaz/VEDB-NSD-ResNet18-Encoding-Models)
41
  - [SimCLR ResNet-18 β€” ImageNet-1K](https://huggingface.co/DM-Diaz/SimCLR-ResNet18-ImageNet1K)
42
  - [SimCLR ResNet-18 β€” ImageNet-100](https://huggingface.co/DM-Diaz/SimCLR-ResNet18-ImageNet100)
43
- - [SimCLR ResNet-18 β€” STL-10](https://github.com/Spijkervet/SimCLR) *(external pretrained reference model; checkpoint provided by Spijkervet/SimCLR and not redistributed by this project)*
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  **Diaz, D. M., & Henderson, M. M. (2026). _Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field._ Proceedings of the 9th Conference on Cognitive Computational Neuroscience.**
23
 
24
+ **DOI:** [10.32470/0416gfsq](https://doi.org/10.32470/0416gfsq)<br>
25
+ **arXiv:** [2607.19316](https://arxiv.org/abs/2607.19316)<br>
26
  **Contributed Talk:** [CCN 2026 presentation on YouTube](https://www.youtube.com/watch?v=Lb4S3FWqd2M&t=2545s)
27
 
28
+ The model was pretrained using **SimCLR with a ResNet-18 backbone** and served as one of the non-egocentric reference models in the associated study. It was evaluated alongside models pretrained on ImageNet-100 and STL-10 as comparison models for representations learned from naturalistic egocentric visual experience.
29
 
30
+ Training was implemented using the [Lightly self-supervised learning framework](https://docs.lightly.ai/self-supervised-learning/index.html). The training images were obtained from the [`evanarlian/imagenet_1k_resized_256`](https://huggingface.co/datasets/evanarlian/imagenet_1k_resized_256) dataset on Hugging Face.
31
+
32
+ ## Model Architecture
33
+
34
+ The model uses a standard **ResNet-18** encoder with the classification head removed.
35
+
36
+ | Component | Configuration |
37
+ | --- | --- |
38
+ | Backbone | ResNet-18 |
39
+ | Backbone representation | 512 dimensions |
40
+ | Projection head | Lightly `SimCLRProjectionHead` |
41
+ | Projection dimensions | `512 β†’ 512 β†’ 128` |
42
+ | Projection output | 128 dimensions |
43
+ | SSL objective | NT-Xent |
44
+ | Temperature | `0.1` |
45
+
46
+ The released checkpoint contains both the ResNet-18 backbone and SimCLR projection head. For downstream representation extraction, the 512-dimensional backbone representation can be used independently of the projection head.
47
+
48
+ ## Training Configuration
49
+
50
+ | Parameter | Value |
51
+ | --- | --- |
52
+ | Dataset | ImageNet-1K |
53
+ | Dataset source | `evanarlian/imagenet_1k_resized_256` |
54
+ | Number of classes | 1,000 |
55
+ | Epochs | 100 |
56
+ | Batch size | 32 |
57
+ | Input resolution | `224 Γ— 224` |
58
+ | Optimizer | LARS |
59
+ | Initial learning rate | `0.0375` |
60
+ | Momentum | `0.9` |
61
+ | Weight decay | `1e-6` |
62
+ | LR schedule | Cosine warmup |
63
+ | Warmup | 10 epochs |
64
+ | Precision | 16-bit mixed precision |
65
+ | Distributed training | No |
66
+
67
+ The learning rate was linearly scaled from a base learning rate of `0.3` according to batch size:
68
+
69
+ `0.3 Γ— (32 / 256) = 0.0375`
70
+
71
+ The training script specifies 100 epochs, 1,000 classes, and 224-pixel inputs. The checkpoint was saved at the completion of this run.
72
+
73
+ ## Training Data
74
+
75
+ Training data were obtained from the Hugging Face dataset:
76
+
77
+ [`evanarlian/imagenet_1k_resized_256`](https://huggingface.co/datasets/evanarlian/imagenet_1k_resized_256)
78
+
79
+ The locally downloaded dataset was loaded from Hugging Face parquet shards. The training split was used for self-supervised representation learning.
80
+
81
+ The dataset itself is **not redistributed through this repository** and remains subject to its original access conditions and terms.
82
+
83
+ ## Checkpoint
84
+
85
+ **File:** `checkpoint_100-resnet18-simclr-imagenet1k.ckpt`
86
+
87
+ The released file is a **full PyTorch Lightning checkpoint**, rather than a backbone-only state dictionary.
88
+
89
+ Checkpoint inspection confirmed:
90
+
91
+ | Property | Value |
92
+ | --- | --- |
93
+ | PyTorch Lightning version recorded | `2.6.1` |
94
+ | Stored epoch | `99` |
95
+ | Training epochs completed | 100 |
96
+ | Global step | `4,003,600` |
97
+ | State-dict entries | 132 |
98
+ | Backbone output | 512 dimensions |
99
+ | Projection output | 128 dimensions |
100
+ | Strict architecture loading | Successful |
101
+
102
+ The stored epoch is zero-indexed, so `epoch = 99` corresponds to the completion of epoch 100.
103
+
104
+ The checkpoint includes training state such as optimizer and scheduler information in addition to model parameters.
105
+
106
+ ## Intended Use
107
+
108
+ This checkpoint is provided for research and downstream applications involving self-supervised visual representations, including:
109
+
110
+ - reproducing the reference-model analyses reported in Diaz and Henderson (2026),
111
+ - extracting ResNet-18 representations for comparison with the VEDB-pretrained models,
112
+ - reproducing the associated NSD voxelwise encoding analyses,
113
+ - linear-probe or fine-tuned image classification,
114
+ - transfer learning to other visual recognition tasks, and
115
+ - representation-learning and visual-neuroscience research.
116
+
117
+ The released checkpoint contains a self-supervised ResNet-18 encoder and SimCLR projection head rather than a trained classification head. For image classification, users can attach and train an appropriate classifier on the learned backbone representations or fine-tune the encoder for the target task.
118
 
119
  ## Related Models
120
 
121
+ This model was used as a non-egocentric reference model in the study associated with the **[Eccentricity-Constrained SimCLR Models (VEDB)](https://hf.co/collections/DM-Diaz/eccentricity-constrained-simclr-models-vedb)** collection.
122
 
123
  - [VEDB SimCLR ResNet-18 β€” Baseline](https://huggingface.co/DM-Diaz/VEDB-SimCLR-ResNet18-Baseline)
124
  - [VEDB SimCLR ResNet-18 β€” Fovea-Gaze](https://huggingface.co/DM-Diaz/VEDB-SimCLR-ResNet18-Fovea-Gaze)
 
127
  - [VEDB NSD ResNet-18 β€” Encoding Models](https://huggingface.co/DM-Diaz/VEDB-NSD-ResNet18-Encoding-Models)
128
  - [SimCLR ResNet-18 β€” ImageNet-1K](https://huggingface.co/DM-Diaz/SimCLR-ResNet18-ImageNet1K)
129
  - [SimCLR ResNet-18 β€” ImageNet-100](https://huggingface.co/DM-Diaz/SimCLR-ResNet18-ImageNet100)
130
+ - [SimCLR ResNet-18 β€” STL-10](https://github.com/Spijkervet/SimCLR) *(external pretrained reference model; checkpoint provided by Spijkervet/SimCLR and not redistributed by this project)*
131
+
132
+ ## Citation
133
+
134
+ If you use this checkpoint or representations derived from it in academic work, please cite the associated study:
135
+
136
+ ```bibtex
137
+ @inproceedings{diaz2026eccentricity,
138
+ author = {Diaz, Dylan M. and Henderson, Margaret M.},
139
+ title = {Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field},
140
+ booktitle = {Proceedings of the 9th Conference on Cognitive Computational Neuroscience},
141
+ address = {New York, NY, USA},
142
+ year = {2026},
143
+ doi = {10.32470/0416gfsq}
144
+ }