PPWangyc commited on
Commit
349ac71
·
1 Parent(s): 17ad685
Files changed (1) hide show
  1. README.md +46 -0
README.md CHANGED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ task_categories:
5
+ - other
6
+ tags:
7
+ - fMRI Decoding Models
8
+ - Generative Models
9
+ - Neural Decoding
10
+ license: mit
11
+ ---
12
+
13
+ # WAVE-models
14
+
15
+ ## Description
16
+ WAVE models are generative models designed to decode natural images from fMRI data. We utilize contrastive learning and diffusion models, trained using the PyTorch library. This suite includes both universal models trained across all subjects and subject-specific models, particularly for the CSI1 subject within the BOLD5000 dataset. Pre-trained models and additional resources are also available.
17
+
18
+ ## Model Structure
19
+ ### Universal Model
20
+ - **All**: A universal model trained on data from all subjects.
21
+
22
+ ### Subject-Specific Model
23
+ - **CSI1**: A model specifically trained on the CSI1 subject.
24
+
25
+ ### Model Folder Structure
26
+ - `contrastive/`: Contains the contrastive learning models.
27
+ - `decode/`: Contains the diffusion models.
28
+
29
+ ### Model Files
30
+ - `*/contrastive/model_last_prompt.bin`: A model integrating contrastive learning with prompt.
31
+ - `*/contrastive/model_last_vis-mask.bin`: A model integrating contrastive learning with prompt and visual network masking.
32
+ - `*/decode/model_last_prompt_vd.bin`: Versatile diffusion model fine-tuned on the contrastive prompt learning model.
33
+ - `*/decode/model_last_prompt_vis-mask_vd.bin`: Versatile diffusion model fine-tuned on the contrastive prompt and visual network masking model.
34
+
35
+ ## Pre-trained fMRI Model
36
+ Available at:
37
+ - `upstream/GPT/pytorch_model.bin` (1.2 GB): Pre-trained GPT model for fMRI data from this [GitHub repository](https://github.com/athms/learning-from-brains).
38
+
39
+ ## Additional Resources
40
+ ### DiFuMo Atlas
41
+ - `labels_1024_dictionary.csv`: Contains labels for the DiFuMo atlas.
42
+
43
+ ### Yeo 7 Atlas
44
+ - `index_yeo7.json`: Labels for DiFuMo atlas indices associated with visual networks.
45
+
46
+ For further details on the models and applications, refer to the [GitHub repository](https://github.com/PPWangyc/WAVE).