Update README.md
Browse files
README.md
CHANGED
|
@@ -13,31 +13,92 @@ tags:
|
|
| 13 |
- arxiv:2607.19316
|
| 14 |
---
|
| 15 |
|
| 16 |
-
# VEDB SimCLR ResNet-18 β
|
| 17 |
|
| 18 |
-
This repository contains
|
| 19 |
|
| 20 |
-
**Diaz, D. M., & Henderson, M. M. (2026).
|
| 21 |
|
| 22 |
-
**DOI:** `10.32470/0416gfsq`
|
| 23 |
**arXiv:** `2607.19316`
|
| 24 |
|
| 25 |
-
|
| 26 |
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
-
|
| 30 |
-
- **Training:** SimCLR self-supervised pretraining
|
| 31 |
-
- **Dataset:** Visual Experience Dataset (VEDB)
|
| 32 |
-
- **Condition:** Fovea-Gaze
|
| 33 |
-
- **Epoch:** 120
|
| 34 |
-
- **Checkpoint:** `simclr_resnet18_fovea-gaze_epoch120.pth.tar`
|
| 35 |
|
| 36 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Release Status
|
| 39 |
|
| 40 |
-
|
| 41 |
|
| 42 |
## Citation
|
| 43 |
|
|
|
|
| 13 |
- arxiv:2607.19316
|
| 14 |
---
|
| 15 |
|
| 16 |
+
# VEDB SimCLR ResNet-18 β NSD Voxelwise Encoding Models
|
| 17 |
|
| 18 |
+
This repository contains **subject-specific voxelwise encoding-model fits** from:
|
| 19 |
|
| 20 |
+
**Diaz, D. M., & Henderson, M. M. (2026). *Eccentricity-Constrained CNN Training Reveals Adaptive Information Coding Around the Visual Field.* Proceedings of the 9th Conference on Cognitive Computational Neuroscience.**
|
| 21 |
|
| 22 |
+
**DOI:** `10.32470/0416gfsq`
|
| 23 |
**arXiv:** `2607.19316`
|
| 24 |
|
| 25 |
+
The encoding models were fit to fMRI responses from the **Natural Scenes Dataset (NSD)** using representations extracted from four VEDB-pretrained SimCLR ResNet-18 models:
|
| 26 |
|
| 27 |
+
* **Baseline**
|
| 28 |
+
* **Fovea-Gaze**
|
| 29 |
+
* **Periph**
|
| 30 |
+
* **Periph-NF**
|
| 31 |
|
| 32 |
+
## Repository Structure
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
+
```text
|
| 35 |
+
baseline/
|
| 36 |
+
fovea-gaze/
|
| 37 |
+
periph/
|
| 38 |
+
periph-nf/
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
Each folder contains voxelwise encoding-model fits for **NSD subjects S1βS8**.
|
| 42 |
+
|
| 43 |
+
Example:
|
| 44 |
+
|
| 45 |
+
```text
|
| 46 |
+
fovea-gaze/
|
| 47 |
+
βββ NSD_S1_resnet18-Fovea-Gaze_concat.npy
|
| 48 |
+
βββ NSD_S2_resnet18-Fovea-Gaze_concat.npy
|
| 49 |
+
βββ ...
|
| 50 |
+
βββ NSD_S8_resnet18-Fovea-Gaze_concat.npy
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
## Encoding Models
|
| 54 |
+
|
| 55 |
+
For each subject and visual-field condition, features were extracted from:
|
| 56 |
+
|
| 57 |
+
```text
|
| 58 |
+
conv1
|
| 59 |
+
layer1.1
|
| 60 |
+
layer2.1
|
| 61 |
+
layer3.1
|
| 62 |
+
layer4.1
|
| 63 |
+
avgpool
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
Layer features were dimensionally reduced with PCA, concatenated, and used to fit **voxelwise L2-regularized linear regression (ridge) encoding models**.
|
| 67 |
+
|
| 68 |
+
Each `.npy` file contains a saved Python dictionary including:
|
| 69 |
+
|
| 70 |
+
* fitted voxelwise `weights`
|
| 71 |
+
* held-out `r2`
|
| 72 |
+
* held-out `corr`
|
| 73 |
+
* candidate `lambdas`
|
| 74 |
+
* `best_lambda_inds`
|
| 75 |
+
* voxel mask and index information
|
| 76 |
+
* voxel noise ceilings
|
| 77 |
+
* subject and model metadata
|
| 78 |
+
|
| 79 |
+
## Loading a Fit
|
| 80 |
+
|
| 81 |
+
```python
|
| 82 |
+
import numpy as np
|
| 83 |
+
|
| 84 |
+
fit = np.load(
|
| 85 |
+
"baseline/NSD_S1_resnet18-Baseline_concat.npy",
|
| 86 |
+
allow_pickle=True
|
| 87 |
+
).item()
|
| 88 |
+
|
| 89 |
+
weights = fit["weights"]
|
| 90 |
+
r2 = fit["r2"]
|
| 91 |
+
corr = fit["corr"]
|
| 92 |
+
best_lambda_inds = fit["best_lambda_inds"]
|
| 93 |
+
```
|
| 94 |
+
|
| 95 |
+
## Related Models
|
| 96 |
+
|
| 97 |
+
The pretrained SimCLR checkpoints used to generate these representations are available in the **Eccentricity-Constrained SimCLR Models (VEDB)** Hugging Face collection.
|
| 98 |
|
| 99 |
## Release Status
|
| 100 |
|
| 101 |
+
Encoding-model fits are available now. Additional documentation and analysis code are forthcoming.
|
| 102 |
|
| 103 |
## Citation
|
| 104 |
|