caobin commited on
Commit
bf86f80
·
verified ·
1 Parent(s): 4771e57

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -3
README.md CHANGED
@@ -1,7 +1,41 @@
 
 
1
  ---
2
- license: apache-2.0
 
3
  ---
4
 
5
- [github](https://github.com/WPEM/CPICANN)
6
- The repo contains the pretrained models of CIPCANN
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
 
 
1
+ Sure, here's a revised version of your document:
2
+
3
  ---
4
+ License: Apache-2.0
5
+
6
  ---
7
 
8
+ ## CPICANN Pretrained Models Repository
9
+
10
+ This repository contains the pretrained models of the method described in the CPICANN paper, available at [GitHub](https://github.com/WPEM/CPICANN).
11
+
12
+ ### Ablation Study on Self-Attention Configuration
13
+
14
+ In Table 1 below, we present the results of an ablation study on self-attention configuration:
15
+
16
+ | No. | Model Configuration | Trainable Parameters | Accuracy on Validation Set (%) |
17
+ |-----|----------------------------|----------------------|--------------------------------|
18
+ | 1 | ED: 128, HN: 8, SL: 4 | 13,725,793 | 86.16 |
19
+ | 2 | ED: 128, HN: 8, SL: 6 (CPICANN) | 14,385,505 | 87.50 |
20
+ | 3 | ED: 128, HN: 8, SL: 8 | 15,045,217 | 86.94 |
21
+ | 4 | ED: 256, HN: 8, SL: 6 | 17,243,873 | 85.51 |
22
+ | 5 | ED: 384, HN: 8, SL: 6 | 20,872,161 | 86.14 |
23
+ | 6 | ED: 128, HN: 4, SL: 6 | 14,385,505 | 86.43 |
24
+ | 7 | ED: 384, HN: 6, SL: 6 | 20,872,161 | 85.78 |
25
+
26
+ Based on the validation set accuracy, the self-attention module is optimized within the following ranges: self-attention layers of 4, 6, or 8; embedding dimensions of 128, 256, or 384; and head numbers of 4, 6, or 8. The results are detailed in Table S1, with the notations of ED for embedding dimensions, HN for head number, and SL for the number of self-attention layers. The ablation study identifies the optimal configuration of CPICANN as ED: 128, HN: 8, SL: 6.
27
+
28
+ ### CNNonly and ATTENTIONonly Models
29
+
30
+ Two additional models, CNNonly and ATTENTIONonly, isolate the CNN and attention parts of CPICANN, respectively.
31
+
32
+ ### Datasets Tested
33
+
34
+ CPICANN is evaluated on four distinguished datasets, denoted as D1, D2, D3, and D4, with the following characteristics:
35
+
36
+ - **D1**: 0% background ratio and Gaussian noise (σ=0.25) (v chosen in paper)
37
+ - **D2**: 3% background ratio and Gaussian noise (σ=0.25)
38
+ - **D3**: 0% background ratio and Gaussian noise (σ=1)
39
+ - **D4**: 0% background ratio and Gaussian noise (σ=3)
40
 
41
+ Feel free to let me know if there are any further modifications you'd like!