Hugging Face's logo

eegdino
/
EEG-DINO

Model card Files
xet
Community
eegdino commited on
Commit
5d8ae13
·
verified ·
1 Parent(s): 4ca0df4

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +74 -1
README.md CHANGED
@@ -31,4 +31,77 @@ and change the default settings in /path/to/run_finetuning.py:
31
  parser.add_argument('--num_layers', default=12, type=int)
32
  parser.add_argument('--dim_feedforward', default=512, type=int)
33
  ```
34
- 512/16/1024 for medium and 1024/24/2048 for large.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  parser.add_argument('--num_layers', default=12, type=int)
32
  parser.add_argument('--dim_feedforward', default=512, type=int)
33
  ```
34
+ 512/16/1024 for medium and 1024/24/2048 for large.
35
+
36
+ ## Evaluation Results
37
+
38
+ We evaluate the performance of EEG-DINO on multiple downstream tasks, including TUEV, SEED-V and TUAB. The results consistently demonstrate the effectiveness of our model.
39
+
40
+ ### TUEV
41
+ Linear Probing:
42
+
43
+ | Model | Params | Banlanced Acc. | Cohen's Kappa | Weighted F1 |
44
+ |:----------------|-------:|---------------:|--------------:|------------:|
45
+ | BIOT | 3.2M | 0.3327 | 0.3835 | 0.6792 |
46
+ | LaBraM-Base | 5.8M | 0.3461 | 0.3968 | 0.6974 |
47
+ | CBraMod | 4.0M | 0.3246 | 0.3884 | 0.6889 |
48
+ | EEG-DINO-Small | 4.6M | 0.5482 | 0.5673 | 0.7861 |
49
+ | EEG-DINO-Medium | 33M | 0.5880 | 0.6180 | 0.8111 |
50
+ | EEG-DINO-Large | 201M | **0.6054** | **0.6419** | **0.8214** |
51
+
52
+ Full-parameter fine-tuning:
53
+
54
+ | Model | Params | Banlanced Acc. | Cohen's Kappa | Weighted F1 |
55
+ |:----------------|-------:|---------------:|--------------:|------------:|
56
+ | BIOT | 3.2M | 0.5281 | 0.5273 | 0.7492 |
57
+ | LaBraM-Base | 5.8M | 0.6409 | 0.6637 | 0.8312 |
58
+ | CBraMod | 4.0M | 0.5942 | 0.5818 | 0.7817 |
59
+ | EEG-DINO-Small | 4.6M | 0.6516 | 0.6654 | 0.8356 |
60
+ | EEG-DINO-Medium | 33M | 0.6611 | 0.6739 | 0.8357 |
61
+ | EEG-DINO-Large | 201M | **0.6679** | **0.6809** | **0.8398** |
62
+
63
+ ### SEED-V
64
+ Linear Probing:
65
+
66
+ | Model | Params | Balanced Acc. | Cohen's Kappa | Weighted F1 |
67
+ |:----------------|-------:|--------------:|--------------:|------------:|
68
+ | BIOT | 3.2M | 0.2461 | 0.0798 | 0.2489 |
69
+ | LaBraM-Base | 5.8M | 0.2521 | 0.0854 | 0.2543 |
70
+ | CBraMod | 4.0M | 0.2536 | 0.0842 | 0.2568 |
71
+ | EEG-DINO-Small | 4.6M | 0.2981 | 0.1273 | 0.3035 |
72
+ | EEG-DINO-Medium | 33M | 0.3365 | 0.1707 | 0.3426 |
73
+ | EEG-DINO-Large | 201M | **0.3579** | **0.1984** | **0.3652** |
74
+
75
+ Full-parameter fine-tuning:
76
+
77
+ | Model | Params | Banlanced Acc. | Cohen's Kappa | Weighted F1 |
78
+ |:----------------|-------:|---------------:|--------------:|------------:|
79
+ | BIOT | 3.2M | 0.3837 | 0.2261 | 0.3856 |
80
+ | LaBraM-Base | 5.8M | 0.3976 | 0.2386 | 0.3974 |
81
+ | CBraMod | 4.0M | 0.3899 | 0.2414 | 0.3977 |
82
+ | EEG-DINO-Small | 4.6M | 0.4063 | 0.2564 | 0.4092 |
83
+ | EEG-DINO-Medium | 33M | 0.4138 | 0.2727 | 0.4234 |
84
+ | EEG-DINO-Large | 201M | **0.4177** | **0.2801** | **0.4315** |
85
+
86
+ ### TUAB
87
+ Linear Probing:
88
+
89
+ | Model | Params | Balanced Acc. | AUC-PR | AUROC |
90
+ |:----------------|-------:|--------------:|-------:|------:|
91
+ | BIOT | 3.2M | 0.7308 | 0.7849 | 0.8013 |
92
+ | LaBraM-Base | 5.8M | 0.7457 | 0.8081 | 0.8115 |
93
+ | CBraMod | 4.0M | 0.6785 | 0.7721 | 0.7826 |
94
+ | EEG-DINO-Small | 4.6M | 0.7841 | 0.8666 | 0.8706 |
95
+ | EEG-DINO-Medium | 33M | 0.7915 | 0.8680 | 0.8763 |
96
+ | EEG-DINO-Large | 201M | **0.7963** | **0.8701** | **0.8814** |
97
+
98
+ Full-parameter fine-tuning:
99
+
100
+ | Model | Params | Balanced Acc. | AUC-PR | AUROC |
101
+ |:----------------|-------:|--------------:|-------:|------:|
102
+ | BIOT | 3.2M | 0.7959 | 0.8792 | 0.8815 |
103
+ | LaBraM-Base | 5.8M | 0.8140 | 0.8965 | 0.9022 |
104
+ | CBraMod | 4.0M | 0.8091 | 0.8906 | 0.8831 |
105
+ | EEG-DINO-Small | 4.6M | 0.8137 | 0.8906 | 0.8981 |
106
+ | EEG-DINO-Medium | 33M | 0.8155 | 0.8963 | 0.9018 |
107
+ | EEG-DINO-Large | 201M | **0.8207** | **0.9012** | **0.9100** |