DM-Diaz commited on
Commit
a326cc9
Β·
verified Β·
1 Parent(s): b03a6dd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -14
README.md CHANGED
@@ -13,31 +13,92 @@ tags:
13
  - arxiv:2607.19316
14
  ---
15
 
16
- # VEDB SimCLR ResNet-18 β€” Fovea-Gaze
17
 
18
- This repository contains the **Fovea-Gaze SimCLR ResNet-18 checkpoint** associated with:
19
 
20
- **Diaz, D. M., & Henderson, M. M. (2026). _Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field._ Proceedings of the 9th Conference on Cognitive Computational Neuroscience.**
21
 
22
- **DOI:** `10.32470/0416gfsq`
23
  **arXiv:** `2607.19316`
24
 
25
- This model is part of the **[Eccentricity-Constrained SimCLR Models (VEDB)](https://hf.co/collections/DM-Diaz/eccentricity-constrained-simclr-models-vedb)** collection.
26
 
27
- ## Model
 
 
 
28
 
29
- - **Architecture:** ResNet-18
30
- - **Training:** SimCLR self-supervised pretraining
31
- - **Dataset:** Visual Experience Dataset (VEDB)
32
- - **Condition:** Fovea-Gaze
33
- - **Epoch:** 120
34
- - **Checkpoint:** `simclr_resnet18_fovea-gaze_epoch120.pth.tar`
35
 
36
- The **Fovea-Gaze** condition was pretrained using gaze-centered central visual information derived from VEDB frames.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
 
38
  ## Release Status
39
 
40
- The pretrained checkpoint is available now. A complete model card, training documentation, and evaluation code will be added shortly.
41
 
42
  ## Citation
43
 
 
13
  - arxiv:2607.19316
14
  ---
15
 
16
+ # VEDB SimCLR ResNet-18 β€” NSD Voxelwise Encoding Models
17
 
18
+ This repository contains **subject-specific voxelwise encoding-model fits** from:
19
 
20
+ **Diaz, D. M., & Henderson, M. M. (2026). *Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field.* Proceedings of the 9th Conference on Cognitive Computational Neuroscience.**
21
 
22
+ **DOI:** `10.32470/0416gfsq`
23
  **arXiv:** `2607.19316`
24
 
25
+ The encoding models were fit to fMRI responses from the **Natural Scenes Dataset (NSD)** using representations extracted from four VEDB-pretrained SimCLR ResNet-18 models:
26
 
27
+ * **Baseline**
28
+ * **Fovea-Gaze**
29
+ * **Periph**
30
+ * **Periph-NF**
31
 
32
+ ## Repository Structure
 
 
 
 
 
33
 
34
+ ```text
35
+ baseline/
36
+ fovea-gaze/
37
+ periph/
38
+ periph-nf/
39
+ ```
40
+
41
+ Each folder contains voxelwise encoding-model fits for **NSD subjects S1–S8**.
42
+
43
+ Example:
44
+
45
+ ```text
46
+ fovea-gaze/
47
+ β”œβ”€β”€ NSD_S1_resnet18-Fovea-Gaze_concat.npy
48
+ β”œβ”€β”€ NSD_S2_resnet18-Fovea-Gaze_concat.npy
49
+ β”œβ”€β”€ ...
50
+ └── NSD_S8_resnet18-Fovea-Gaze_concat.npy
51
+ ```
52
+
53
+ ## Encoding Models
54
+
55
+ For each subject and visual-field condition, features were extracted from:
56
+
57
+ ```text
58
+ conv1
59
+ layer1.1
60
+ layer2.1
61
+ layer3.1
62
+ layer4.1
63
+ avgpool
64
+ ```
65
+
66
+ Layer features were dimensionally reduced with PCA, concatenated, and used to fit **voxelwise L2-regularized linear regression (ridge) encoding models**.
67
+
68
+ Each `.npy` file contains a saved Python dictionary including:
69
+
70
+ * fitted voxelwise `weights`
71
+ * held-out `r2`
72
+ * held-out `corr`
73
+ * candidate `lambdas`
74
+ * `best_lambda_inds`
75
+ * voxel mask and index information
76
+ * voxel noise ceilings
77
+ * subject and model metadata
78
+
79
+ ## Loading a Fit
80
+
81
+ ```python
82
+ import numpy as np
83
+
84
+ fit = np.load(
85
+ "baseline/NSD_S1_resnet18-Baseline_concat.npy",
86
+ allow_pickle=True
87
+ ).item()
88
+
89
+ weights = fit["weights"]
90
+ r2 = fit["r2"]
91
+ corr = fit["corr"]
92
+ best_lambda_inds = fit["best_lambda_inds"]
93
+ ```
94
+
95
+ ## Related Models
96
+
97
+ The pretrained SimCLR checkpoints used to generate these representations are available in the **Eccentricity-Constrained SimCLR Models (VEDB)** Hugging Face collection.
98
 
99
  ## Release Status
100
 
101
+ Encoding-model fits are available now. Additional documentation and analysis code are forthcoming.
102
 
103
  ## Citation
104