cynthiachan commited on
Commit
772f6d4
·
1 Parent(s): dd0f20b

Upload 11 files

Browse files
README.md ADDED
@@ -0,0 +1,201 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - cynthiachan/FeedRef2022
7
+ model-index:
8
+ - name: training
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # training
16
+
17
+ This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the cynthiachan/FeedRef2022 dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.0514
20
+ - Attackid Precision: 0.8889
21
+ - Attackid Recall: 0.9231
22
+ - Attackid F1: 0.9057
23
+ - Attackid Number: 52
24
+ - Bitcoinaddr Precision: 0.875
25
+ - Bitcoinaddr Recall: 1.0
26
+ - Bitcoinaddr F1: 0.9333
27
+ - Bitcoinaddr Number: 7
28
+ - Cve Precision: 0.8378
29
+ - Cve Recall: 0.9538
30
+ - Cve F1: 0.8921
31
+ - Cve Number: 65
32
+ - Defenderthreat Precision: 0.875
33
+ - Defenderthreat Recall: 1.0
34
+ - Defenderthreat F1: 0.9333
35
+ - Defenderthreat Number: 7
36
+ - Domain Precision: 0.9279
37
+ - Domain Recall: 0.9369
38
+ - Domain F1: 0.9324
39
+ - Domain Number: 206
40
+ - Email Precision: 0.8333
41
+ - Email Recall: 0.9302
42
+ - Email F1: 0.8791
43
+ - Email Number: 43
44
+ - Filepath Precision: 0.8857
45
+ - Filepath Recall: 0.9195
46
+ - Filepath F1: 0.9023
47
+ - Filepath Number: 1652
48
+ - Fingerprint Precision: 0.0
49
+ - Fingerprint Recall: 0.0
50
+ - Fingerprint F1: 0.0
51
+ - Fingerprint Number: 2
52
+ - Hostname Precision: 0.8910
53
+ - Hostname Recall: 0.9653
54
+ - Hostname F1: 0.9267
55
+ - Hostname Number: 144
56
+ - Ipv4 Precision: 0.9767
57
+ - Ipv4 Recall: 0.9825
58
+ - Ipv4 F1: 0.9796
59
+ - Ipv4 Number: 171
60
+ - Ipv6 Precision: 0.3333
61
+ - Ipv6 Recall: 1.0
62
+ - Ipv6 F1: 0.5
63
+ - Ipv6 Number: 3
64
+ - Md5 Precision: 0.9141
65
+ - Md5 Recall: 0.9857
66
+ - Md5 F1: 0.9486
67
+ - Md5 Number: 421
68
+ - Sha1 Precision: 0.8545
69
+ - Sha1 Recall: 0.9592
70
+ - Sha1 F1: 0.9038
71
+ - Sha1 Number: 49
72
+ - Sha256 Precision: 0.9120
73
+ - Sha256 Recall: 0.9919
74
+ - Sha256 F1: 0.9502
75
+ - Sha256 Number: 491
76
+ - Uri Precision: 0.3333
77
+ - Uri Recall: 0.4545
78
+ - Uri F1: 0.3846
79
+ - Uri Number: 11
80
+ - Overall Precision: 0.8946
81
+ - Overall Recall: 0.9446
82
+ - Overall F1: 0.9189
83
+ - Overall Accuracy: 0.9886
84
+
85
+ ## Model description
86
+
87
+ More information needed
88
+
89
+ ## Intended uses & limitations
90
+
91
+ More information needed
92
+
93
+ ## Training and evaluation data
94
+
95
+ More information needed
96
+
97
+ ## Training procedure
98
+
99
+ ### Training hyperparameters
100
+
101
+ The following hyperparameters were used during training:
102
+ - learning_rate: 5e-05
103
+ - train_batch_size: 8
104
+ - eval_batch_size: 8
105
+ - seed: 42
106
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
107
+ - lr_scheduler_type: linear
108
+ - num_epochs: 3.0
109
+
110
+ ### Training results
111
+
112
+ | Training Loss | Epoch | Step | Validation Loss | Attackid Precision | Attackid Recall | Attackid F1 | Attackid Number | Bitcoinaddr Precision | Bitcoinaddr Recall | Bitcoinaddr F1 | Bitcoinaddr Number | Cve Precision | Cve Recall | Cve F1 | Cve Number | Defenderthreat Precision | Defenderthreat Recall | Defenderthreat F1 | Defenderthreat Number | Domain Precision | Domain Recall | Domain F1 | Domain Number | Email Precision | Email Recall | Email F1 | Email Number | Filepath Precision | Filepath Recall | Filepath F1 | Filepath Number | Fingerprint Precision | Fingerprint Recall | Fingerprint F1 | Fingerprint Number | Hostname Precision | Hostname Recall | Hostname F1 | Hostname Number | Ipv4 Precision | Ipv4 Recall | Ipv4 F1 | Ipv4 Number | Ipv6 Precision | Ipv6 Recall | Ipv6 F1 | Ipv6 Number | Md5 Precision | Md5 Recall | Md5 F1 | Md5 Number | Sha1 Precision | Sha1 Recall | Sha1 F1 | Sha1 Number | Sha256 Precision | Sha256 Recall | Sha256 F1 | Sha256 Number | Uri Precision | Uri Recall | Uri F1 | Uri Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
113
+ |:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------:|:----------:|:------:|:----------:|:------------------------:|:---------------------:|:-----------------:|:---------------------:|:----------------:|:-------------:|:---------:|:-------------:|:---------------:|:------------:|:--------:|:------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:--------------:|:-----------:|:-------:|:-----------:|:-------------:|:----------:|:------:|:----------:|:--------------:|:-----------:|:-------:|:-----------:|:----------------:|:-------------:|:---------:|:-------------:|:-------------:|:----------:|:------:|:----------:|:-----------------:|:--------------:|:----------:|:----------------:|
114
+ | 0.3691 | 0.04 | 500 | 0.3054 | 0.0 | 0.0 | 0.0 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.0 | 0.0 | 0.0 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.0 | 0.0 | 0.0 | 206 | 0.0 | 0.0 | 0.0 | 43 | 0.1917 | 0.5975 | 0.2903 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.0 | 0.0 | 0.0 | 144 | 0.5747 | 0.5848 | 0.5797 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.4160 | 0.7648 | 0.5389 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.5131 | 0.9145 | 0.6574 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.2665 | 0.5590 | 0.3610 | 0.9297 |
115
+ | 0.2388 | 0.07 | 1000 | 0.2124 | 0.0 | 0.0 | 0.0 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7467 | 0.8615 | 0.8 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.0 | 0.0 | 0.0 | 206 | 0.0 | 0.0 | 0.0 | 43 | 0.3846 | 0.4661 | 0.4215 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.3534 | 0.6528 | 0.4585 | 144 | 0.6667 | 0.5614 | 0.6095 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.5275 | 0.9097 | 0.6678 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.8787 | 0.9002 | 0.8893 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.4932 | 0.5539 | 0.5218 | 0.9491 |
116
+ | 0.1817 | 0.11 | 1500 | 0.2025 | 0.4433 | 0.8269 | 0.5772 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7941 | 0.8308 | 0.8120 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.2241 | 0.6602 | 0.3346 | 206 | 0.1538 | 0.2326 | 0.1852 | 43 | 0.4561 | 0.6816 | 0.5465 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.0042 | 0.0069 | 0.0052 | 144 | 0.6522 | 0.7018 | 0.6761 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.5671 | 0.8527 | 0.6812 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.7623 | 0.9470 | 0.8447 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.4654 | 0.6961 | 0.5579 | 0.9563 |
117
+ | 0.1552 | 0.15 | 2000 | 0.1581 | 0.6119 | 0.7885 | 0.6891 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.8235 | 0.8615 | 0.8421 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.4979 | 0.5680 | 0.5306 | 206 | 0.4795 | 0.8140 | 0.6034 | 43 | 0.4876 | 0.7960 | 0.6047 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.5682 | 0.6944 | 0.625 | 144 | 0.4692 | 0.8012 | 0.5918 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.5321 | 0.9240 | 0.6753 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.7951 | 0.9328 | 0.8585 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.5345 | 0.7966 | 0.6398 | 0.9622 |
118
+ | 0.1567 | 0.19 | 2500 | 0.1619 | 0.6032 | 0.7308 | 0.6609 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.8133 | 0.9385 | 0.8714 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6257 | 0.5680 | 0.5954 | 206 | 0.1379 | 0.1860 | 0.1584 | 43 | 0.5788 | 0.7512 | 0.6538 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.4981 | 0.9097 | 0.6437 | 144 | 0.7233 | 0.8713 | 0.7905 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7723 | 0.9264 | 0.8423 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.7523 | 0.9837 | 0.8526 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6308 | 0.7876 | 0.7006 | 0.9628 |
119
+ | 0.1588 | 0.22 | 3000 | 0.1409 | 0.4050 | 0.9423 | 0.5665 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.5962 | 0.9538 | 0.7337 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6805 | 0.7961 | 0.7338 | 206 | 0.5821 | 0.9070 | 0.7091 | 43 | 0.6291 | 0.7712 | 0.6930 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6902 | 0.8819 | 0.7744 | 144 | 0.5737 | 0.8421 | 0.6825 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.5678 | 0.9454 | 0.7094 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.8582 | 0.9735 | 0.9122 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6300 | 0.8228 | 0.7136 | 0.9664 |
120
+ | 0.1257 | 0.26 | 3500 | 0.1417 | 0.5541 | 0.7885 | 0.6508 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6854 | 0.9385 | 0.7922 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6828 | 0.7524 | 0.7159 | 206 | 0.5217 | 0.8372 | 0.6429 | 43 | 0.6314 | 0.7155 | 0.6708 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.5261 | 0.9097 | 0.6667 | 144 | 0.7562 | 0.8889 | 0.8172 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7435 | 0.9501 | 0.8342 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.7325 | 0.9817 | 0.8390 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6627 | 0.7942 | 0.7225 | 0.9658 |
121
+ | 0.1229 | 0.3 | 4000 | 0.1455 | 0.6567 | 0.8462 | 0.7395 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7391 | 0.7846 | 0.7612 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6858 | 0.7524 | 0.7176 | 206 | 0.4321 | 0.8140 | 0.5645 | 43 | 0.6740 | 0.7809 | 0.7235 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6452 | 0.8333 | 0.7273 | 144 | 0.5455 | 0.5614 | 0.5533 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7697 | 0.8575 | 0.8112 | 421 | 0.3645 | 0.7959 | 0.5 | 49 | 0.6948 | 0.9735 | 0.8109 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6684 | 0.8029 | 0.7295 | 0.9667 |
122
+ | 0.1323 | 0.34 | 4500 | 0.1323 | 0.6719 | 0.8269 | 0.7414 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7910 | 0.8154 | 0.8030 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6064 | 0.7330 | 0.6637 | 206 | 0.74 | 0.8605 | 0.7957 | 43 | 0.6802 | 0.7391 | 0.7084 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.5935 | 0.5069 | 0.5468 | 144 | 0.7826 | 0.7368 | 0.7590 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7783 | 0.8171 | 0.7972 | 421 | 0.3810 | 0.8163 | 0.5195 | 49 | 0.8368 | 0.9715 | 0.8992 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7049 | 0.7717 | 0.7368 | 0.9680 |
123
+ | 0.1379 | 0.37 | 5000 | 0.1088 | 0.5930 | 0.9808 | 0.7391 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.725 | 0.8923 | 0.8 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7619 | 0.6990 | 0.7291 | 206 | 0.5556 | 0.9302 | 0.6957 | 43 | 0.6551 | 0.8360 | 0.7346 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7127 | 0.8958 | 0.7938 | 144 | 0.7989 | 0.8596 | 0.8282 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7665 | 0.9359 | 0.8428 | 421 | 0.3729 | 0.4490 | 0.4074 | 49 | 0.7278 | 0.9695 | 0.8314 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6886 | 0.8550 | 0.7629 | 0.9738 |
124
+ | 0.1162 | 0.41 | 5500 | 0.1205 | 0.5765 | 0.9423 | 0.7153 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.8026 | 0.9385 | 0.8652 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7960 | 0.7767 | 0.7862 | 206 | 0.6032 | 0.8837 | 0.7170 | 43 | 0.6724 | 0.8099 | 0.7348 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6791 | 0.8819 | 0.7674 | 144 | 0.8041 | 0.9123 | 0.8548 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7188 | 0.9287 | 0.8104 | 421 | 0.5714 | 0.8163 | 0.6723 | 49 | 0.8088 | 0.9735 | 0.8835 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7033 | 0.8538 | 0.7713 | 0.9711 |
125
+ | 0.1128 | 0.45 | 6000 | 0.1165 | 0.6575 | 0.9231 | 0.768 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7143 | 0.9231 | 0.8054 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7703 | 0.7816 | 0.7759 | 206 | 0.6724 | 0.9070 | 0.7723 | 43 | 0.6634 | 0.7706 | 0.7130 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6580 | 0.8819 | 0.7537 | 144 | 0.8434 | 0.8187 | 0.8309 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8032 | 0.9596 | 0.8745 | 421 | 0.6066 | 0.7551 | 0.6727 | 49 | 0.8554 | 0.9756 | 0.9115 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7201 | 0.8327 | 0.7723 | 0.9736 |
126
+ | 0.11 | 0.49 | 6500 | 0.1374 | 0.7167 | 0.8269 | 0.7679 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7273 | 0.8615 | 0.7887 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7592 | 0.7039 | 0.7305 | 206 | 0.725 | 0.6744 | 0.6988 | 43 | 0.6129 | 0.7524 | 0.6755 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7151 | 0.8542 | 0.7785 | 144 | 0.7919 | 0.8012 | 0.7965 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7821 | 0.9549 | 0.8599 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.6880 | 0.9837 | 0.8097 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.6710 | 0.8005 | 0.7300 | 0.9680 |
127
+ | 0.1152 | 0.52 | 7000 | 0.1152 | 0.6933 | 1.0 | 0.8189 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6374 | 0.8923 | 0.7436 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6103 | 0.6311 | 0.6205 | 206 | 0.6739 | 0.7209 | 0.6966 | 43 | 0.6969 | 0.7960 | 0.7431 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7721 | 0.7292 | 0.75 | 144 | 0.8526 | 0.7778 | 0.8135 | 171 | 0.0192 | 0.3333 | 0.0364 | 3 | 0.8549 | 0.9097 | 0.8815 | 421 | 0.4706 | 0.8163 | 0.5970 | 49 | 0.8625 | 0.9837 | 0.9191 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7271 | 0.8216 | 0.7715 | 0.9722 |
128
+ | 0.1084 | 0.56 | 7500 | 0.1073 | 0.75 | 0.8077 | 0.7778 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6484 | 0.9077 | 0.7564 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7313 | 0.8058 | 0.7667 | 206 | 0.6452 | 0.9302 | 0.7619 | 43 | 0.6933 | 0.8196 | 0.7512 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6818 | 0.9375 | 0.7895 | 144 | 0.6872 | 0.9123 | 0.7839 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8789 | 0.9477 | 0.9120 | 421 | 0.7451 | 0.7755 | 0.76 | 49 | 0.8374 | 0.9857 | 0.9055 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7277 | 0.8643 | 0.7902 | 0.9741 |
129
+ | 0.0789 | 0.6 | 8000 | 0.0958 | 0.7719 | 0.8462 | 0.8073 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7403 | 0.8769 | 0.8028 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7731 | 0.8107 | 0.7915 | 206 | 0.74 | 0.8605 | 0.7957 | 43 | 0.7408 | 0.7924 | 0.7657 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6749 | 0.9514 | 0.7896 | 144 | 0.8011 | 0.8480 | 0.8239 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8299 | 0.9620 | 0.8911 | 421 | 0.5686 | 0.5918 | 0.58 | 49 | 0.8770 | 0.9878 | 0.9291 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7700 | 0.8469 | 0.8066 | 0.9760 |
130
+ | 0.1149 | 0.64 | 8500 | 0.1334 | 1.0 | 0.7692 | 0.8696 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6795 | 0.8154 | 0.7413 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7336 | 0.7621 | 0.7476 | 206 | 0.3824 | 0.6047 | 0.4685 | 43 | 0.6318 | 0.5454 | 0.5854 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8227 | 0.8056 | 0.8140 | 144 | 0.7707 | 0.7076 | 0.7378 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8776 | 0.9026 | 0.8899 | 421 | 0.6129 | 0.7755 | 0.6847 | 49 | 0.8339 | 0.9817 | 0.9018 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7231 | 0.6961 | 0.7094 | 0.9673 |
131
+ | 0.1155 | 0.67 | 9000 | 0.1052 | 0.6267 | 0.9038 | 0.7402 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7294 | 0.9538 | 0.8267 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7232 | 0.7864 | 0.7535 | 206 | 0.7391 | 0.7907 | 0.7640 | 43 | 0.7494 | 0.7312 | 0.7402 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7531 | 0.8472 | 0.7974 | 144 | 0.8708 | 0.9064 | 0.8883 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8340 | 0.9667 | 0.8955 | 421 | 0.5714 | 0.5714 | 0.5714 | 49 | 0.8709 | 0.9756 | 0.9203 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7664 | 0.8135 | 0.7893 | 0.9742 |
132
+ | 0.0926 | 0.71 | 9500 | 0.1048 | 0.6438 | 0.9038 | 0.752 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6610 | 0.6 | 0.6290 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7541 | 0.6699 | 0.7095 | 206 | 0.7308 | 0.8837 | 0.8 | 43 | 0.6768 | 0.8456 | 0.7519 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7119 | 0.875 | 0.7850 | 144 | 0.8343 | 0.8830 | 0.8580 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8712 | 0.9477 | 0.9078 | 421 | 0.7193 | 0.8367 | 0.7736 | 49 | 0.8476 | 0.9857 | 0.9115 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7322 | 0.8604 | 0.7911 | 0.9760 |
133
+ | 0.0982 | 0.75 | 10000 | 0.0985 | 0.6533 | 0.9423 | 0.7717 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7027 | 0.8 | 0.7482 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7671 | 0.8155 | 0.7906 | 206 | 0.7143 | 0.9302 | 0.8081 | 43 | 0.7465 | 0.8039 | 0.7741 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6507 | 0.9444 | 0.7705 | 144 | 0.9106 | 0.9532 | 0.9314 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8008 | 0.9264 | 0.8590 | 421 | 0.5641 | 0.8980 | 0.6929 | 49 | 0.8460 | 0.9735 | 0.9053 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7633 | 0.8568 | 0.8074 | 0.9769 |
134
+ | 0.085 | 0.79 | 10500 | 0.0972 | 0.6184 | 0.9038 | 0.7344 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.8154 | 0.8154 | 0.8154 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7236 | 0.8641 | 0.7876 | 206 | 0.7755 | 0.8837 | 0.8261 | 43 | 0.7544 | 0.8105 | 0.7814 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7081 | 0.9097 | 0.7964 | 144 | 0.8778 | 0.9240 | 0.9003 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8976 | 0.9572 | 0.9264 | 421 | 0.8039 | 0.8367 | 0.8200 | 49 | 0.8432 | 0.9857 | 0.9089 | 491 | 0.1111 | 0.0909 | 0.1000 | 11 | 0.7852 | 0.8643 | 0.8229 | 0.9779 |
135
+ | 0.0981 | 0.82 | 11000 | 0.1092 | 0.6944 | 0.9615 | 0.8065 | 52 | 0.2 | 0.1429 | 0.1667 | 7 | 0.7262 | 0.9385 | 0.8188 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6842 | 0.8835 | 0.7712 | 206 | 0.6667 | 0.7907 | 0.7234 | 43 | 0.7117 | 0.8251 | 0.7642 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7159 | 0.875 | 0.7875 | 144 | 0.9337 | 0.9064 | 0.9199 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7175 | 0.9715 | 0.8254 | 421 | 0.0 | 0.0 | 0.0 | 49 | 0.8620 | 0.9796 | 0.9171 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7399 | 0.8610 | 0.7959 | 0.9737 |
136
+ | 0.0892 | 0.86 | 11500 | 0.0969 | 0.6049 | 0.9423 | 0.7368 | 52 | 0.4545 | 0.7143 | 0.5556 | 7 | 0.0 | 0.0 | 0.0 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.8 | 0.8155 | 0.8077 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.6975 | 0.8571 | 0.7691 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7397 | 0.75 | 0.7448 | 144 | 0.8841 | 0.8480 | 0.8657 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8821 | 0.9596 | 0.9192 | 421 | 0.9474 | 0.7347 | 0.8276 | 49 | 0.8251 | 0.9511 | 0.8836 | 491 | 0.25 | 0.1818 | 0.2105 | 11 | 0.7557 | 0.8544 | 0.8020 | 0.9759 |
137
+ | 0.0924 | 0.9 | 12000 | 0.0971 | 0.7059 | 0.9231 | 0.8000 | 52 | 0.4615 | 0.8571 | 0.6 | 7 | 0.8108 | 0.9231 | 0.8633 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7331 | 0.8932 | 0.8053 | 206 | 0.8 | 0.9302 | 0.8602 | 43 | 0.7544 | 0.8535 | 0.8009 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7697 | 0.8819 | 0.8220 | 144 | 0.8947 | 0.8947 | 0.8947 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7758 | 0.9454 | 0.8522 | 421 | 0.4516 | 0.8571 | 0.5915 | 49 | 0.8618 | 0.9776 | 0.9160 | 491 | 0.08 | 0.1818 | 0.1111 | 11 | 0.7664 | 0.8875 | 0.8225 | 0.9782 |
138
+ | 0.0784 | 0.94 | 12500 | 0.1113 | 0.6623 | 0.9808 | 0.7907 | 52 | 0.6667 | 0.8571 | 0.75 | 7 | 0.8406 | 0.8923 | 0.8657 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.6865 | 0.8398 | 0.7555 | 206 | 0.7547 | 0.9302 | 0.8333 | 43 | 0.7858 | 0.7863 | 0.7861 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8026 | 0.8472 | 0.8243 | 144 | 0.8629 | 0.8830 | 0.8728 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8462 | 0.9406 | 0.8909 | 421 | 0.56 | 0.8571 | 0.6774 | 49 | 0.9119 | 0.9695 | 0.9398 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.8022 | 0.8466 | 0.8238 | 0.9774 |
139
+ | 0.1063 | 0.97 | 13000 | 0.0932 | 0.6538 | 0.9808 | 0.7846 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7838 | 0.8923 | 0.8345 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7738 | 0.8301 | 0.8009 | 206 | 0.75 | 0.8372 | 0.7912 | 43 | 0.6979 | 0.8529 | 0.7676 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7086 | 0.8611 | 0.7774 | 144 | 0.8703 | 0.9415 | 0.9045 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.6184 | 0.8931 | 0.7308 | 421 | 0.2424 | 0.1633 | 0.1951 | 49 | 0.8511 | 0.9776 | 0.9100 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7176 | 0.8646 | 0.7843 | 0.9760 |
140
+ | 0.0765 | 1.01 | 13500 | 0.0892 | 0.6806 | 0.9423 | 0.7903 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6714 | 0.7231 | 0.6963 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.8416 | 0.8252 | 0.8333 | 206 | 0.7917 | 0.8837 | 0.8352 | 43 | 0.7330 | 0.8559 | 0.7897 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7105 | 0.9375 | 0.8084 | 144 | 0.8757 | 0.9474 | 0.9101 | 171 | 0.125 | 1.0 | 0.2222 | 3 | 0.8769 | 0.9810 | 0.9260 | 421 | 0.5970 | 0.8163 | 0.6897 | 49 | 0.8761 | 0.9796 | 0.925 | 491 | 0.0 | 0.0 | 0.0 | 11 | 0.7696 | 0.8881 | 0.8246 | 0.9790 |
141
+ | 0.0677 | 1.05 | 14000 | 0.0804 | 0.6667 | 0.9231 | 0.7742 | 52 | 0.3333 | 0.7143 | 0.4545 | 7 | 0.7941 | 0.8308 | 0.8120 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.8112 | 0.7718 | 0.7910 | 206 | 0.7234 | 0.7907 | 0.7556 | 43 | 0.7725 | 0.8487 | 0.8088 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7949 | 0.8611 | 0.8267 | 144 | 0.9401 | 0.9181 | 0.9290 | 171 | 0.1765 | 1.0 | 0.3 | 3 | 0.8613 | 0.9739 | 0.9142 | 421 | 0.4868 | 0.7551 | 0.592 | 49 | 0.8881 | 0.9857 | 0.9344 | 491 | 0.2222 | 0.1818 | 0.2000 | 11 | 0.7978 | 0.8782 | 0.8360 | 0.9805 |
142
+ | 0.0544 | 1.09 | 14500 | 0.0924 | 0.9216 | 0.9038 | 0.9126 | 52 | 0.1875 | 0.4286 | 0.2609 | 7 | 0.7973 | 0.9077 | 0.8489 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.7511 | 0.8641 | 0.8036 | 206 | 0.78 | 0.9070 | 0.8387 | 43 | 0.7361 | 0.8747 | 0.7994 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.6569 | 0.9306 | 0.7701 | 144 | 0.9253 | 0.9415 | 0.9333 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.9146 | 0.9667 | 0.9400 | 421 | 0.6308 | 0.8367 | 0.7193 | 49 | 0.8121 | 0.9857 | 0.8905 | 491 | 0.0833 | 0.1818 | 0.1143 | 11 | 0.7679 | 0.9025 | 0.8298 | 0.9793 |
143
+ | 0.0797 | 1.12 | 15000 | 0.0851 | 0.9057 | 0.9231 | 0.9143 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7294 | 0.9538 | 0.8267 | 65 | 0.5 | 0.5714 | 0.5333 | 7 | 0.7909 | 0.8447 | 0.8169 | 206 | 0.8125 | 0.9070 | 0.8571 | 43 | 0.8104 | 0.8432 | 0.8265 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7 | 0.8264 | 0.7580 | 144 | 0.8804 | 0.9474 | 0.9127 | 171 | 0.2222 | 0.6667 | 0.3333 | 3 | 0.8834 | 0.9359 | 0.9089 | 421 | 0.5056 | 0.9184 | 0.6522 | 49 | 0.8436 | 0.9776 | 0.9057 | 491 | 0.0625 | 0.0909 | 0.0741 | 11 | 0.8077 | 0.8794 | 0.8420 | 0.9793 |
144
+ | 0.0544 | 1.16 | 15500 | 0.0905 | 0.7 | 0.9423 | 0.8033 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6421 | 0.9385 | 0.7625 | 65 | 0.25 | 0.2857 | 0.2667 | 7 | 0.8018 | 0.8447 | 0.8227 | 206 | 0.7273 | 0.9302 | 0.8163 | 43 | 0.7642 | 0.8571 | 0.8080 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8098 | 0.9167 | 0.8599 | 144 | 0.9261 | 0.9532 | 0.9395 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.6976 | 0.9810 | 0.8154 | 421 | 0.6066 | 0.7551 | 0.6727 | 49 | 0.8948 | 0.9878 | 0.9390 | 491 | 0.3636 | 0.3636 | 0.3636 | 11 | 0.7664 | 0.8953 | 0.8259 | 0.9793 |
145
+ | 0.0815 | 1.2 | 16000 | 0.0799 | 0.9804 | 0.9615 | 0.9709 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.6593 | 0.9231 | 0.7692 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.825 | 0.8010 | 0.8128 | 206 | 0.6667 | 0.9302 | 0.7767 | 43 | 0.7140 | 0.8523 | 0.7770 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7016 | 0.9306 | 0.8000 | 144 | 0.9096 | 0.9415 | 0.9253 | 171 | 0.3 | 1.0 | 0.4615 | 3 | 0.7203 | 0.9359 | 0.8140 | 421 | 0.3193 | 0.7755 | 0.4524 | 49 | 0.8548 | 0.9470 | 0.8986 | 491 | 0.5 | 0.4545 | 0.4762 | 11 | 0.7339 | 0.8794 | 0.8001 | 0.9780 |
146
+ | 0.0647 | 1.24 | 16500 | 0.0739 | 0.8889 | 0.9231 | 0.9057 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7692 | 0.9231 | 0.8392 | 65 | 0.0 | 0.0 | 0.0 | 7 | 0.8077 | 0.8155 | 0.8116 | 206 | 0.8 | 0.9302 | 0.8602 | 43 | 0.7750 | 0.8717 | 0.8205 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8467 | 0.8819 | 0.8639 | 144 | 0.92 | 0.9415 | 0.9306 | 171 | 0.0682 | 1.0 | 0.1277 | 3 | 0.8515 | 0.9810 | 0.9117 | 421 | 0.9318 | 0.8367 | 0.8817 | 49 | 0.9120 | 0.9919 | 0.9502 | 491 | 0.1875 | 0.2727 | 0.2222 | 11 | 0.8066 | 0.8998 | 0.8507 | 0.9820 |
147
+ | 0.0532 | 1.27 | 17000 | 0.0870 | 0.8491 | 0.8654 | 0.8571 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.8657 | 0.8923 | 0.8788 | 65 | 0.5714 | 0.5714 | 0.5714 | 7 | 0.7404 | 0.8447 | 0.7891 | 206 | 0.8163 | 0.9302 | 0.8696 | 43 | 0.8296 | 0.8547 | 0.8420 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8217 | 0.8958 | 0.8571 | 144 | 0.8931 | 0.8304 | 0.8606 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8369 | 0.9382 | 0.8847 | 421 | 0.9574 | 0.9184 | 0.9375 | 49 | 0.9026 | 0.9817 | 0.9405 | 491 | 0.5714 | 0.3636 | 0.4444 | 11 | 0.8367 | 0.8815 | 0.8585 | 0.9810 |
148
+ | 0.0673 | 1.31 | 17500 | 0.0851 | 0.8929 | 0.9615 | 0.9259 | 52 | 0.5714 | 0.5714 | 0.5714 | 7 | 0.7024 | 0.9077 | 0.7919 | 65 | 0.4 | 0.2857 | 0.3333 | 7 | 0.7817 | 0.8689 | 0.8230 | 206 | 0.7959 | 0.9070 | 0.8478 | 43 | 0.8198 | 0.8511 | 0.8352 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7738 | 0.9028 | 0.8333 | 144 | 0.9162 | 0.9591 | 0.9371 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8655 | 0.9786 | 0.9186 | 421 | 0.775 | 0.6327 | 0.6966 | 49 | 0.8377 | 0.9776 | 0.9023 | 491 | 0.2143 | 0.2727 | 0.2400 | 11 | 0.8231 | 0.8902 | 0.8553 | 0.9816 |
149
+ | 0.0715 | 1.35 | 18000 | 0.0821 | 0.8868 | 0.9038 | 0.8952 | 52 | 0.1 | 1.0 | 0.1818 | 7 | 0.6778 | 0.9385 | 0.7871 | 65 | 0.8 | 0.5714 | 0.6667 | 7 | 0.7653 | 0.7913 | 0.7780 | 206 | 0.78 | 0.9070 | 0.8387 | 43 | 0.7410 | 0.8989 | 0.8124 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7458 | 0.9167 | 0.8224 | 144 | 0.8713 | 0.8713 | 0.8713 | 171 | 0.2727 | 1.0 | 0.4286 | 3 | 0.8008 | 0.9644 | 0.875 | 421 | 0.4333 | 0.7959 | 0.5612 | 49 | 0.8920 | 0.9756 | 0.9319 | 491 | 0.8333 | 0.4545 | 0.5882 | 11 | 0.7578 | 0.9082 | 0.8262 | 0.9793 |
150
+ | 0.0778 | 1.39 | 18500 | 0.0661 | 0.9074 | 0.9423 | 0.9245 | 52 | 0.0714 | 0.1429 | 0.0952 | 7 | 0.8 | 0.9231 | 0.8571 | 65 | 1.0 | 0.2857 | 0.4444 | 7 | 0.8757 | 0.7864 | 0.8286 | 206 | 0.7547 | 0.9302 | 0.8333 | 43 | 0.7831 | 0.8674 | 0.8231 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8323 | 0.9306 | 0.8787 | 144 | 0.8859 | 0.9532 | 0.9183 | 171 | 0.1875 | 1.0 | 0.3158 | 3 | 0.9138 | 0.9572 | 0.9350 | 421 | 0.7963 | 0.8776 | 0.8350 | 49 | 0.8544 | 0.9919 | 0.9180 | 491 | 0.2 | 0.1818 | 0.1905 | 11 | 0.8172 | 0.8971 | 0.8553 | 0.9829 |
151
+ | 0.0672 | 1.42 | 19000 | 0.0841 | 0.6538 | 0.9808 | 0.7846 | 52 | 0.2593 | 1.0 | 0.4118 | 7 | 0.6703 | 0.9385 | 0.7821 | 65 | 0.4 | 0.2857 | 0.3333 | 7 | 0.8162 | 0.7330 | 0.7724 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.7510 | 0.8747 | 0.8082 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7432 | 0.9444 | 0.8318 | 144 | 0.8477 | 0.9766 | 0.9076 | 171 | 0.1579 | 1.0 | 0.2727 | 3 | 0.8103 | 0.9739 | 0.8846 | 421 | 0.6327 | 0.6327 | 0.6327 | 49 | 0.7970 | 0.9674 | 0.8740 | 491 | 0.1190 | 0.4545 | 0.1887 | 11 | 0.7558 | 0.8977 | 0.8207 | 0.9787 |
152
+ | 0.0802 | 1.46 | 19500 | 0.0682 | 0.8276 | 0.9231 | 0.8727 | 52 | 0.4615 | 0.8571 | 0.6 | 7 | 0.7468 | 0.9077 | 0.8194 | 65 | 0.3333 | 0.2857 | 0.3077 | 7 | 0.7621 | 0.8398 | 0.7991 | 206 | 0.9091 | 0.9302 | 0.9195 | 43 | 0.7958 | 0.8801 | 0.8359 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7735 | 0.9722 | 0.8615 | 144 | 0.9357 | 0.9357 | 0.9357 | 171 | 0.3333 | 1.0 | 0.5 | 3 | 0.8385 | 0.9620 | 0.8960 | 421 | 0.5556 | 0.9184 | 0.6923 | 49 | 0.8845 | 0.9674 | 0.9241 | 491 | 0.2778 | 0.4545 | 0.3448 | 11 | 0.8074 | 0.9070 | 0.8543 | 0.9819 |
153
+ | 0.0886 | 1.5 | 20000 | 0.0633 | 0.9259 | 0.9615 | 0.9434 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.7568 | 0.8615 | 0.8058 | 65 | 0.5714 | 0.5714 | 0.5714 | 7 | 0.8980 | 0.8544 | 0.8756 | 206 | 0.9302 | 0.9302 | 0.9302 | 43 | 0.8470 | 0.8916 | 0.8688 | 1652 | 0.25 | 1.0 | 0.4 | 2 | 0.8373 | 0.9653 | 0.8968 | 144 | 0.9032 | 0.9825 | 0.9412 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.9044 | 0.9667 | 0.9346 | 421 | 0.7931 | 0.9388 | 0.8598 | 49 | 0.8342 | 0.9939 | 0.9071 | 491 | 0.1053 | 0.3636 | 0.1633 | 11 | 0.8471 | 0.9185 | 0.8814 | 0.9833 |
154
+ | 0.0525 | 1.54 | 20500 | 0.0632 | 0.8197 | 0.9615 | 0.8850 | 52 | 0.7 | 1.0 | 0.8235 | 7 | 0.6742 | 0.9231 | 0.7792 | 65 | 0.4444 | 0.5714 | 0.5 | 7 | 0.7819 | 0.9223 | 0.8463 | 206 | 0.6721 | 0.9535 | 0.7885 | 43 | 0.8220 | 0.8723 | 0.8464 | 1652 | 0.0909 | 0.5 | 0.1538 | 2 | 0.7812 | 0.8681 | 0.8224 | 144 | 0.9180 | 0.9825 | 0.9492 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8838 | 0.9572 | 0.9190 | 421 | 0.5 | 0.9592 | 0.6573 | 49 | 0.8173 | 0.9837 | 0.8928 | 491 | 0.25 | 0.3636 | 0.2963 | 11 | 0.8092 | 0.9097 | 0.8565 | 0.9828 |
155
+ | 0.0664 | 1.57 | 21000 | 0.0671 | 0.8197 | 0.9615 | 0.8850 | 52 | 0.5385 | 1.0 | 0.7000 | 7 | 0.6778 | 0.9385 | 0.7871 | 65 | 0.375 | 0.4286 | 0.4000 | 7 | 0.7932 | 0.9126 | 0.8488 | 206 | 0.72 | 0.8372 | 0.7742 | 43 | 0.7546 | 0.8935 | 0.8182 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7571 | 0.9306 | 0.8349 | 144 | 0.8777 | 0.9649 | 0.9192 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8867 | 0.9667 | 0.9250 | 421 | 0.8846 | 0.9388 | 0.9109 | 49 | 0.8199 | 0.9919 | 0.8977 | 491 | 0.3333 | 0.4545 | 0.3846 | 11 | 0.7829 | 0.9221 | 0.8468 | 0.9830 |
156
+ | 0.0524 | 1.61 | 21500 | 0.0674 | 0.8305 | 0.9423 | 0.8829 | 52 | 0.5833 | 1.0 | 0.7368 | 7 | 0.7763 | 0.9077 | 0.8369 | 65 | 0.375 | 0.4286 | 0.4000 | 7 | 0.8889 | 0.8544 | 0.8713 | 206 | 0.7692 | 0.9302 | 0.8421 | 43 | 0.8235 | 0.8838 | 0.8526 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9041 | 0.9167 | 0.9103 | 144 | 0.9527 | 0.9415 | 0.9471 | 171 | 0.4286 | 1.0 | 0.6 | 3 | 0.9470 | 0.9762 | 0.9614 | 421 | 0.7857 | 0.8980 | 0.8381 | 49 | 0.8857 | 0.9939 | 0.9367 | 491 | 0.5 | 0.4545 | 0.4762 | 11 | 0.8555 | 0.9140 | 0.8838 | 0.9844 |
157
+ | 0.0603 | 1.65 | 22000 | 0.0735 | 0.7812 | 0.9615 | 0.8621 | 52 | 0.0 | 0.0 | 0.0 | 7 | 0.9206 | 0.8923 | 0.9062 | 65 | 0.8 | 0.5714 | 0.6667 | 7 | 0.8062 | 0.8883 | 0.8453 | 206 | 0.6721 | 0.9535 | 0.7885 | 43 | 0.8402 | 0.8051 | 0.8223 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8036 | 0.9375 | 0.8654 | 144 | 0.9167 | 0.9649 | 0.9402 | 171 | 0.3 | 1.0 | 0.4615 | 3 | 0.9249 | 0.9359 | 0.9303 | 421 | 0.7077 | 0.9388 | 0.8070 | 49 | 0.9198 | 0.9817 | 0.9498 | 491 | 0.6667 | 0.5455 | 0.6 | 11 | 0.8558 | 0.8715 | 0.8636 | 0.9822 |
158
+ | 0.0674 | 1.69 | 22500 | 0.0639 | 0.8103 | 0.9038 | 0.8545 | 52 | 0.2 | 0.2857 | 0.2353 | 7 | 0.7838 | 0.8923 | 0.8345 | 65 | 1.0 | 0.5714 | 0.7273 | 7 | 0.8852 | 0.8981 | 0.8916 | 206 | 0.8163 | 0.9302 | 0.8696 | 43 | 0.8393 | 0.8759 | 0.8572 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8618 | 0.9097 | 0.8851 | 144 | 0.8771 | 0.9181 | 0.8971 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.9400 | 0.9667 | 0.9532 | 421 | 0.9388 | 0.9388 | 0.9388 | 49 | 0.9030 | 0.9857 | 0.9426 | 491 | 0.3846 | 0.4545 | 0.4167 | 11 | 0.8633 | 0.9064 | 0.8844 | 0.9843 |
159
+ | 0.0693 | 1.72 | 23000 | 0.0773 | 0.7143 | 0.9615 | 0.8197 | 52 | 0.8571 | 0.8571 | 0.8571 | 7 | 0.8356 | 0.9385 | 0.8841 | 65 | 0.625 | 0.7143 | 0.6667 | 7 | 0.8009 | 0.8786 | 0.8380 | 206 | 0.7119 | 0.9767 | 0.8235 | 43 | 0.7847 | 0.9001 | 0.8385 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7640 | 0.9444 | 0.8447 | 144 | 0.8836 | 0.9766 | 0.9278 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7143 | 0.9501 | 0.8155 | 421 | 0.3780 | 0.9796 | 0.5455 | 49 | 0.8134 | 0.9674 | 0.8837 | 491 | 0.5714 | 0.3636 | 0.4444 | 11 | 0.7688 | 0.9212 | 0.8381 | 0.9808 |
160
+ | 0.0383 | 1.76 | 23500 | 0.0667 | 0.6410 | 0.9615 | 0.7692 | 52 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.7692 | 0.9231 | 0.8392 | 65 | 0.8333 | 0.7143 | 0.7692 | 7 | 0.8326 | 0.8689 | 0.8504 | 206 | 0.7636 | 0.9767 | 0.8571 | 43 | 0.8580 | 0.8777 | 0.8677 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8571 | 0.9167 | 0.8859 | 144 | 0.9405 | 0.9240 | 0.9322 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8901 | 0.9810 | 0.9333 | 421 | 0.88 | 0.8980 | 0.8889 | 49 | 0.9112 | 0.9817 | 0.9451 | 491 | 0.3636 | 0.3636 | 0.3636 | 11 | 0.8628 | 0.9097 | 0.8856 | 0.9845 |
161
+ | 0.0496 | 1.8 | 24000 | 0.0712 | 0.8 | 0.9231 | 0.8571 | 52 | 0.8571 | 0.8571 | 0.8571 | 7 | 0.7262 | 0.9385 | 0.8188 | 65 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.8390 | 0.8350 | 0.8370 | 206 | 0.8889 | 0.9302 | 0.9091 | 43 | 0.8522 | 0.8692 | 0.8607 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8867 | 0.9236 | 0.9048 | 144 | 0.9598 | 0.9766 | 0.9681 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8963 | 0.9857 | 0.9389 | 421 | 0.7015 | 0.9592 | 0.8103 | 49 | 0.9412 | 0.9776 | 0.9590 | 491 | 0.25 | 0.5455 | 0.3429 | 11 | 0.8659 | 0.9073 | 0.8861 | 0.9848 |
162
+ | 0.0465 | 1.84 | 24500 | 0.0612 | 0.6667 | 0.9615 | 0.7874 | 52 | 0.75 | 0.8571 | 0.8000 | 7 | 0.7625 | 0.9385 | 0.8414 | 65 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.8287 | 0.8689 | 0.8483 | 206 | 0.7407 | 0.9302 | 0.8247 | 43 | 0.8236 | 0.8904 | 0.8557 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.7919 | 0.9514 | 0.8644 | 144 | 0.9326 | 0.9708 | 0.9513 | 171 | 0.0513 | 0.6667 | 0.0952 | 3 | 0.9079 | 0.9834 | 0.9441 | 421 | 0.8958 | 0.8776 | 0.8866 | 49 | 0.9186 | 0.9878 | 0.9519 | 491 | 0.1765 | 0.2727 | 0.2143 | 11 | 0.8355 | 0.9212 | 0.8762 | 0.9853 |
163
+ | 0.0446 | 1.87 | 25000 | 0.0662 | 0.6410 | 0.9615 | 0.7692 | 52 | 0.6364 | 1.0 | 0.7778 | 7 | 0.8732 | 0.9538 | 0.9118 | 65 | 0.8333 | 0.7143 | 0.7692 | 7 | 0.9378 | 0.8786 | 0.9073 | 206 | 0.8333 | 0.9302 | 0.8791 | 43 | 0.8362 | 0.8747 | 0.8550 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8447 | 0.9444 | 0.8918 | 144 | 0.9598 | 0.9766 | 0.9681 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.92 | 0.9834 | 0.9506 | 421 | 0.9070 | 0.7959 | 0.8478 | 49 | 0.9186 | 0.9878 | 0.9519 | 491 | 0.3636 | 0.3636 | 0.3636 | 11 | 0.8659 | 0.9131 | 0.8889 | 0.9851 |
164
+ | 0.0496 | 1.91 | 25500 | 0.0653 | 0.7612 | 0.9808 | 0.8571 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8472 | 0.9385 | 0.8905 | 65 | 0.5 | 0.5714 | 0.5333 | 7 | 0.9158 | 0.8981 | 0.9069 | 206 | 0.8367 | 0.9535 | 0.8913 | 43 | 0.8487 | 0.8729 | 0.8606 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8889 | 0.9444 | 0.9158 | 144 | 0.9586 | 0.9474 | 0.9529 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.9077 | 0.9810 | 0.9429 | 421 | 0.7895 | 0.9184 | 0.8491 | 49 | 0.9120 | 0.9919 | 0.9502 | 491 | 0.5 | 0.2727 | 0.3529 | 11 | 0.8714 | 0.9137 | 0.8921 | 0.9854 |
165
+ | 0.0689 | 1.95 | 26000 | 0.0689 | 0.8596 | 0.9423 | 0.8991 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.7887 | 0.8615 | 0.8235 | 65 | 0.5714 | 0.5714 | 0.5714 | 7 | 0.9064 | 0.8932 | 0.8998 | 206 | 0.8367 | 0.9535 | 0.8913 | 43 | 0.8217 | 0.9122 | 0.8646 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8232 | 0.9375 | 0.8766 | 144 | 0.9222 | 0.9708 | 0.9459 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.8827 | 0.9834 | 0.9303 | 421 | 0.9744 | 0.7755 | 0.8636 | 49 | 0.8574 | 0.9919 | 0.9197 | 491 | 0.4286 | 0.2727 | 0.3333 | 11 | 0.8441 | 0.9299 | 0.8849 | 0.9842 |
166
+ | 0.0465 | 1.99 | 26500 | 0.1060 | 0.8136 | 0.9231 | 0.8649 | 52 | 0.5 | 1.0 | 0.6667 | 7 | 0.7778 | 0.8615 | 0.8175 | 65 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.8552 | 0.9175 | 0.8852 | 206 | 0.82 | 0.9535 | 0.8817 | 43 | 0.8698 | 0.8977 | 0.8835 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8904 | 0.9028 | 0.8966 | 144 | 0.9643 | 0.9474 | 0.9558 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.7361 | 0.9739 | 0.8384 | 421 | 0.25 | 0.0612 | 0.0984 | 49 | 0.8832 | 0.9552 | 0.9178 | 491 | 0.1 | 0.1818 | 0.1290 | 11 | 0.8384 | 0.9040 | 0.8700 | 0.9796 |
167
+ | 0.0448 | 2.02 | 27000 | 0.0686 | 0.7385 | 0.9231 | 0.8205 | 52 | 0.625 | 0.7143 | 0.6667 | 7 | 0.8714 | 0.9385 | 0.9037 | 65 | 0.625 | 0.7143 | 0.6667 | 7 | 0.8545 | 0.9126 | 0.8826 | 206 | 0.6727 | 0.8605 | 0.7551 | 43 | 0.8778 | 0.8959 | 0.8868 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9116 | 0.9306 | 0.9210 | 144 | 0.9538 | 0.9649 | 0.9593 | 171 | 0.0 | 0.0 | 0.0 | 3 | 0.9157 | 0.9549 | 0.9349 | 421 | 0.875 | 0.8571 | 0.8660 | 49 | 0.8855 | 0.9919 | 0.9356 | 491 | 0.4 | 0.3636 | 0.3810 | 11 | 0.8790 | 0.9200 | 0.8990 | 0.9854 |
168
+ | 0.0379 | 2.06 | 27500 | 0.0633 | 0.8421 | 0.9231 | 0.8807 | 52 | 0.2308 | 0.4286 | 0.3 | 7 | 0.8824 | 0.9231 | 0.9023 | 65 | 0.4545 | 0.7143 | 0.5556 | 7 | 0.8451 | 0.9272 | 0.8843 | 206 | 0.7037 | 0.8837 | 0.7835 | 43 | 0.8901 | 0.8674 | 0.8786 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8303 | 0.9514 | 0.8867 | 144 | 0.9706 | 0.9649 | 0.9677 | 171 | 0.3333 | 1.0 | 0.5 | 3 | 0.9300 | 0.9786 | 0.9537 | 421 | 0.9149 | 0.8776 | 0.8958 | 49 | 0.8385 | 0.9939 | 0.9096 | 491 | 0.2 | 0.3636 | 0.2581 | 11 | 0.8719 | 0.9116 | 0.8913 | 0.9859 |
169
+ | 0.0352 | 2.1 | 28000 | 0.0653 | 0.8772 | 0.9615 | 0.9174 | 52 | 0.5556 | 0.7143 | 0.6250 | 7 | 0.8158 | 0.9538 | 0.8794 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.8733 | 0.9369 | 0.9040 | 206 | 0.8913 | 0.9535 | 0.9213 | 43 | 0.8272 | 0.9128 | 0.8679 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8824 | 0.9375 | 0.9091 | 144 | 0.9706 | 0.9649 | 0.9677 | 171 | 0.375 | 1.0 | 0.5455 | 3 | 0.8790 | 0.9834 | 0.9283 | 421 | 0.9 | 0.9184 | 0.9091 | 49 | 0.8692 | 0.9878 | 0.9247 | 491 | 0.25 | 0.4545 | 0.3226 | 11 | 0.8493 | 0.9377 | 0.8913 | 0.9844 |
170
+ | 0.0328 | 2.14 | 28500 | 0.0599 | 0.8772 | 0.9615 | 0.9174 | 52 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.8806 | 0.9077 | 0.8939 | 65 | 0.5556 | 0.7143 | 0.6250 | 7 | 0.8804 | 0.8932 | 0.8867 | 206 | 0.8542 | 0.9535 | 0.9011 | 43 | 0.8680 | 0.9074 | 0.8872 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.85 | 0.9444 | 0.8947 | 144 | 0.9701 | 0.9474 | 0.9586 | 171 | 0.2727 | 1.0 | 0.4286 | 3 | 0.9452 | 0.9834 | 0.9639 | 421 | 0.6714 | 0.9592 | 0.7899 | 49 | 0.8937 | 0.9756 | 0.9328 | 491 | 0.5 | 0.4545 | 0.4762 | 11 | 0.8786 | 0.9293 | 0.9032 | 0.9867 |
171
+ | 0.0473 | 2.17 | 29000 | 0.0595 | 0.7692 | 0.9615 | 0.8547 | 52 | 0.2222 | 0.2857 | 0.25 | 7 | 0.8493 | 0.9538 | 0.8986 | 65 | 0.6667 | 0.5714 | 0.6154 | 7 | 0.8889 | 0.9320 | 0.9100 | 206 | 0.8367 | 0.9535 | 0.8913 | 43 | 0.8341 | 0.9189 | 0.8744 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8466 | 0.9583 | 0.8990 | 144 | 0.9711 | 0.9825 | 0.9767 | 171 | 0.2143 | 1.0 | 0.3529 | 3 | 0.9234 | 0.9739 | 0.9480 | 421 | 0.75 | 0.9184 | 0.8257 | 49 | 0.8844 | 0.9817 | 0.9305 | 491 | 0.5556 | 0.4545 | 0.5 | 11 | 0.8557 | 0.9386 | 0.8953 | 0.9855 |
172
+ | 0.0511 | 2.21 | 29500 | 0.0668 | 0.6849 | 0.9615 | 0.8000 | 52 | 0.1522 | 1.0 | 0.2642 | 7 | 0.7561 | 0.9538 | 0.8435 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.8761 | 0.9272 | 0.9009 | 206 | 0.8039 | 0.9535 | 0.8723 | 43 | 0.8154 | 0.9195 | 0.8643 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8491 | 0.9375 | 0.8911 | 144 | 0.9709 | 0.9766 | 0.9738 | 171 | 0.2727 | 1.0 | 0.4286 | 3 | 0.8939 | 0.9810 | 0.9354 | 421 | 0.5789 | 0.8980 | 0.704 | 49 | 0.8403 | 0.9857 | 0.9072 | 491 | 0.5 | 0.4545 | 0.4762 | 11 | 0.8214 | 0.9407 | 0.8770 | 0.9845 |
173
+ | 0.0369 | 2.25 | 30000 | 0.0695 | 0.6579 | 0.9615 | 0.7812 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8732 | 0.9538 | 0.9118 | 65 | 0.625 | 0.7143 | 0.6667 | 7 | 0.9154 | 0.8932 | 0.9042 | 206 | 0.9535 | 0.9535 | 0.9535 | 43 | 0.8883 | 0.9001 | 0.8942 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9013 | 0.9514 | 0.9257 | 144 | 0.9527 | 0.9415 | 0.9471 | 171 | 0.375 | 1.0 | 0.5455 | 3 | 0.9126 | 0.9430 | 0.9276 | 421 | 0.5104 | 1.0 | 0.6759 | 49 | 0.9286 | 0.9796 | 0.9534 | 491 | 0.3571 | 0.4545 | 0.4 | 11 | 0.8837 | 0.9233 | 0.9030 | 0.9854 |
174
+ | 0.041 | 2.29 | 30500 | 0.0623 | 0.9091 | 0.9615 | 0.9346 | 52 | 0.4375 | 1.0 | 0.6087 | 7 | 0.8378 | 0.9538 | 0.8921 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.9061 | 0.9369 | 0.9212 | 206 | 0.8723 | 0.9535 | 0.9111 | 43 | 0.8486 | 0.9225 | 0.8840 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8940 | 0.9375 | 0.9153 | 144 | 0.9708 | 0.9708 | 0.9708 | 171 | 1.0 | 1.0 | 1.0 | 3 | 0.9556 | 0.9715 | 0.9635 | 421 | 0.7705 | 0.9592 | 0.8545 | 49 | 0.9310 | 0.9898 | 0.9595 | 491 | 0.3333 | 0.4545 | 0.3846 | 11 | 0.8803 | 0.9428 | 0.9105 | 0.9853 |
175
+ | 0.0385 | 2.32 | 31000 | 0.0632 | 0.9091 | 0.9615 | 0.9346 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.7848 | 0.9538 | 0.8611 | 65 | 0.5556 | 0.7143 | 0.6250 | 7 | 0.8915 | 0.9175 | 0.9043 | 206 | 0.9111 | 0.9535 | 0.9318 | 43 | 0.8486 | 0.9092 | 0.8778 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8961 | 0.9583 | 0.9262 | 144 | 0.9709 | 0.9766 | 0.9738 | 171 | 1.0 | 1.0 | 1.0 | 3 | 0.9180 | 0.9834 | 0.9495 | 421 | 0.8478 | 0.7959 | 0.8211 | 49 | 0.8959 | 0.9817 | 0.9368 | 491 | 0.3125 | 0.4545 | 0.3704 | 11 | 0.8724 | 0.9338 | 0.9021 | 0.9849 |
176
+ | 0.0415 | 2.36 | 31500 | 0.0647 | 0.8929 | 0.9615 | 0.9259 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8493 | 0.9538 | 0.8986 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.9363 | 0.9272 | 0.9317 | 206 | 0.875 | 0.9767 | 0.9231 | 43 | 0.8679 | 0.9025 | 0.8849 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8726 | 0.9514 | 0.9103 | 144 | 0.9429 | 0.9649 | 0.9538 | 171 | 0.3 | 1.0 | 0.4615 | 3 | 0.9154 | 0.9762 | 0.9448 | 421 | 0.7719 | 0.8980 | 0.8302 | 49 | 0.9067 | 0.9898 | 0.9464 | 491 | 0.1579 | 0.5455 | 0.2449 | 11 | 0.8767 | 0.9329 | 0.9039 | 0.9847 |
177
+ | 0.0454 | 2.4 | 32000 | 0.0606 | 0.9091 | 0.9615 | 0.9346 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8971 | 0.9385 | 0.9173 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9139 | 0.9272 | 0.9205 | 206 | 0.8542 | 0.9535 | 0.9011 | 43 | 0.8652 | 0.9056 | 0.8849 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9122 | 0.9375 | 0.9247 | 144 | 0.9483 | 0.9649 | 0.9565 | 171 | 0.3 | 1.0 | 0.4615 | 3 | 0.9321 | 0.9786 | 0.9548 | 421 | 0.8136 | 0.9796 | 0.8889 | 49 | 0.9455 | 0.9898 | 0.9672 | 491 | 0.2143 | 0.5455 | 0.3077 | 11 | 0.888 | 0.9350 | 0.9109 | 0.9869 |
178
+ | 0.0334 | 2.44 | 32500 | 0.0610 | 0.8929 | 0.9615 | 0.9259 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8714 | 0.9385 | 0.9037 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.8977 | 0.9369 | 0.9169 | 206 | 0.9130 | 0.9767 | 0.9438 | 43 | 0.8463 | 0.9068 | 0.8755 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9007 | 0.9444 | 0.9220 | 144 | 0.9532 | 0.9532 | 0.9532 | 171 | 0.375 | 1.0 | 0.5455 | 3 | 0.9536 | 0.9762 | 0.9648 | 421 | 0.8545 | 0.9592 | 0.9038 | 49 | 0.9419 | 0.9898 | 0.9652 | 491 | 0.25 | 0.5455 | 0.3429 | 11 | 0.8813 | 0.9356 | 0.9076 | 0.9867 |
179
+ | 0.0453 | 2.47 | 33000 | 0.0610 | 0.8929 | 0.9615 | 0.9259 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8732 | 0.9538 | 0.9118 | 65 | 0.5556 | 0.7143 | 0.6250 | 7 | 0.9057 | 0.9320 | 0.9187 | 206 | 0.9302 | 0.9302 | 0.9302 | 43 | 0.8668 | 0.9098 | 0.8878 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8882 | 0.9375 | 0.9122 | 144 | 0.9588 | 0.9532 | 0.9560 | 171 | 0.375 | 1.0 | 0.5455 | 3 | 0.9303 | 0.9834 | 0.9561 | 421 | 1.0 | 0.8980 | 0.9462 | 49 | 0.9455 | 0.9898 | 0.9672 | 491 | 0.7143 | 0.4545 | 0.5556 | 11 | 0.8952 | 0.9353 | 0.9148 | 0.9875 |
180
+ | 0.0225 | 2.51 | 33500 | 0.0607 | 0.9259 | 0.9615 | 0.9434 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.7949 | 0.9538 | 0.8671 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.8733 | 0.9369 | 0.9040 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.8641 | 0.9007 | 0.8820 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8616 | 0.9514 | 0.9043 | 144 | 0.9412 | 0.9357 | 0.9384 | 171 | 0.3333 | 1.0 | 0.5 | 3 | 0.9281 | 0.9810 | 0.9538 | 421 | 0.8868 | 0.9592 | 0.9216 | 49 | 0.9365 | 0.9919 | 0.9634 | 491 | 0.4545 | 0.4545 | 0.4545 | 11 | 0.8844 | 0.9323 | 0.9077 | 0.9876 |
181
+ | 0.0276 | 2.55 | 34000 | 0.0603 | 0.8909 | 0.9423 | 0.9159 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.775 | 0.9538 | 0.8552 | 65 | 0.6667 | 0.8571 | 0.75 | 7 | 0.8894 | 0.9369 | 0.9125 | 206 | 0.9111 | 0.9535 | 0.9318 | 43 | 0.8661 | 0.9201 | 0.8923 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8688 | 0.9653 | 0.9145 | 144 | 0.9649 | 0.9649 | 0.9649 | 171 | 0.1667 | 1.0 | 0.2857 | 3 | 0.9649 | 0.9786 | 0.9717 | 421 | 0.9020 | 0.9388 | 0.92 | 49 | 0.9222 | 0.9898 | 0.9548 | 491 | 0.4545 | 0.4545 | 0.4545 | 11 | 0.8868 | 0.9428 | 0.9140 | 0.9877 |
182
+ | 0.0291 | 2.59 | 34500 | 0.0605 | 0.9074 | 0.9423 | 0.9245 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8378 | 0.9538 | 0.8921 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.9091 | 0.9223 | 0.9157 | 206 | 0.9524 | 0.9302 | 0.9412 | 43 | 0.8707 | 0.9213 | 0.8953 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8947 | 0.9444 | 0.9189 | 144 | 0.9758 | 0.9415 | 0.9583 | 171 | 0.25 | 1.0 | 0.4 | 3 | 0.9448 | 0.9762 | 0.9603 | 421 | 0.9787 | 0.9388 | 0.9583 | 49 | 0.8952 | 0.9919 | 0.9411 | 491 | 0.2632 | 0.4545 | 0.3333 | 11 | 0.8885 | 0.9401 | 0.9136 | 0.9881 |
183
+ | 0.0264 | 2.62 | 35000 | 0.0616 | 0.9074 | 0.9423 | 0.9245 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8493 | 0.9538 | 0.8986 | 65 | 0.75 | 0.8571 | 0.8000 | 7 | 0.9019 | 0.9369 | 0.9190 | 206 | 0.8913 | 0.9535 | 0.9213 | 43 | 0.8694 | 0.9310 | 0.8992 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8782 | 0.9514 | 0.9133 | 144 | 0.9422 | 0.9532 | 0.9477 | 171 | 0.25 | 1.0 | 0.4 | 3 | 0.9258 | 0.9786 | 0.9515 | 421 | 0.8679 | 0.9388 | 0.9020 | 49 | 0.9272 | 0.9857 | 0.9556 | 491 | 0.1852 | 0.4545 | 0.2632 | 11 | 0.8837 | 0.9465 | 0.9140 | 0.9875 |
184
+ | 0.0343 | 2.66 | 35500 | 0.0595 | 0.7083 | 0.9808 | 0.8226 | 52 | 0.6667 | 0.8571 | 0.75 | 7 | 0.7949 | 0.9538 | 0.8671 | 65 | 0.7143 | 0.7143 | 0.7143 | 7 | 0.8858 | 0.9417 | 0.9129 | 206 | 0.9091 | 0.9302 | 0.9195 | 43 | 0.8556 | 0.9110 | 0.8824 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8616 | 0.9514 | 0.9043 | 144 | 0.9270 | 0.9649 | 0.9456 | 171 | 1.0 | 1.0 | 1.0 | 3 | 0.9388 | 0.9834 | 0.9606 | 421 | 0.8868 | 0.9592 | 0.9216 | 49 | 0.8919 | 0.9919 | 0.9392 | 491 | 0.625 | 0.4545 | 0.5263 | 11 | 0.8728 | 0.9389 | 0.9046 | 0.9871 |
185
+ | 0.0284 | 2.7 | 36000 | 0.0569 | 0.9074 | 0.9423 | 0.9245 | 52 | 0.5385 | 1.0 | 0.7000 | 7 | 0.8052 | 0.9538 | 0.8732 | 65 | 0.5556 | 0.7143 | 0.6250 | 7 | 0.9143 | 0.9320 | 0.9231 | 206 | 0.9070 | 0.9070 | 0.9070 | 43 | 0.8724 | 0.9189 | 0.8950 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9145 | 0.9653 | 0.9392 | 144 | 0.9540 | 0.9708 | 0.9623 | 171 | 0.15 | 1.0 | 0.2609 | 3 | 0.9605 | 0.9810 | 0.9706 | 421 | 0.8364 | 0.9388 | 0.8846 | 49 | 0.8907 | 0.9959 | 0.9404 | 491 | 0.625 | 0.4545 | 0.5263 | 11 | 0.8865 | 0.9425 | 0.9137 | 0.9878 |
186
+ | 0.0377 | 2.74 | 36500 | 0.0554 | 0.7083 | 0.9808 | 0.8226 | 52 | 0.5833 | 1.0 | 0.7368 | 7 | 0.7654 | 0.9538 | 0.8493 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.8981 | 0.9417 | 0.9194 | 206 | 0.9091 | 0.9302 | 0.9195 | 43 | 0.8700 | 0.9237 | 0.8961 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9205 | 0.9653 | 0.9424 | 144 | 0.9540 | 0.9708 | 0.9623 | 171 | 0.25 | 1.0 | 0.4 | 3 | 0.9063 | 0.9881 | 0.9455 | 421 | 0.9020 | 0.9388 | 0.92 | 49 | 0.8825 | 0.9939 | 0.9349 | 491 | 0.4545 | 0.4545 | 0.4545 | 11 | 0.8755 | 0.9477 | 0.9101 | 0.9883 |
187
+ | 0.0316 | 2.77 | 37000 | 0.0562 | 0.6711 | 0.9808 | 0.7969 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8052 | 0.9538 | 0.8732 | 65 | 0.6667 | 0.8571 | 0.75 | 7 | 0.9143 | 0.9320 | 0.9231 | 206 | 0.9524 | 0.9302 | 0.9412 | 43 | 0.8721 | 0.9243 | 0.8974 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.9026 | 0.9653 | 0.9329 | 144 | 0.9653 | 0.9766 | 0.9709 | 171 | 0.2143 | 1.0 | 0.3529 | 3 | 0.9202 | 0.9857 | 0.9518 | 421 | 0.8070 | 0.9388 | 0.8679 | 49 | 0.8954 | 0.9939 | 0.9421 | 491 | 0.5 | 0.4545 | 0.4762 | 11 | 0.8801 | 0.9471 | 0.9123 | 0.9885 |
188
+ | 0.0454 | 2.81 | 37500 | 0.0555 | 0.8333 | 0.9615 | 0.8929 | 52 | 0.5 | 1.0 | 0.6667 | 7 | 0.8052 | 0.9538 | 0.8732 | 65 | 0.6667 | 0.8571 | 0.75 | 7 | 0.9023 | 0.9417 | 0.9216 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.8782 | 0.9249 | 0.9009 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8642 | 0.9722 | 0.9150 | 144 | 0.9337 | 0.9883 | 0.9602 | 171 | 0.2143 | 1.0 | 0.3529 | 3 | 0.9498 | 0.9881 | 0.9686 | 421 | 0.94 | 0.9592 | 0.9495 | 49 | 0.8954 | 0.9939 | 0.9421 | 491 | 0.3125 | 0.4545 | 0.3704 | 11 | 0.8845 | 0.9492 | 0.9157 | 0.9881 |
189
+ | 0.0445 | 2.85 | 38000 | 0.0521 | 0.8889 | 0.9231 | 0.9057 | 52 | 0.5385 | 1.0 | 0.7000 | 7 | 0.8493 | 0.9538 | 0.8986 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9019 | 0.9369 | 0.9190 | 206 | 0.8511 | 0.9302 | 0.8889 | 43 | 0.8769 | 0.9183 | 0.8971 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8797 | 0.9653 | 0.9205 | 144 | 0.9767 | 0.9825 | 0.9796 | 171 | 0.25 | 1.0 | 0.4 | 3 | 0.9243 | 0.9857 | 0.9540 | 421 | 0.8103 | 0.9592 | 0.8785 | 49 | 0.8954 | 0.9939 | 0.9421 | 491 | 0.3125 | 0.4545 | 0.3704 | 11 | 0.8845 | 0.9443 | 0.9134 | 0.9884 |
190
+ | 0.0379 | 2.89 | 38500 | 0.0524 | 0.8727 | 0.9231 | 0.8972 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8611 | 0.9538 | 0.9051 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9147 | 0.9369 | 0.9257 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.8903 | 0.9183 | 0.9041 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8742 | 0.9653 | 0.9175 | 144 | 0.9711 | 0.9825 | 0.9767 | 171 | 0.2308 | 1.0 | 0.375 | 3 | 0.9101 | 0.9857 | 0.9464 | 421 | 0.8214 | 0.9388 | 0.8762 | 49 | 0.9067 | 0.9898 | 0.9464 | 491 | 0.3571 | 0.4545 | 0.4 | 11 | 0.8932 | 0.9434 | 0.9176 | 0.9885 |
191
+ | 0.0372 | 2.92 | 39000 | 0.0514 | 0.8889 | 0.9231 | 0.9057 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8378 | 0.9538 | 0.8921 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9279 | 0.9369 | 0.9324 | 206 | 0.8333 | 0.9302 | 0.8791 | 43 | 0.8857 | 0.9195 | 0.9023 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8910 | 0.9653 | 0.9267 | 144 | 0.9767 | 0.9825 | 0.9796 | 171 | 0.3333 | 1.0 | 0.5 | 3 | 0.9141 | 0.9857 | 0.9486 | 421 | 0.8545 | 0.9592 | 0.9038 | 49 | 0.9120 | 0.9919 | 0.9502 | 491 | 0.3333 | 0.4545 | 0.3846 | 11 | 0.8946 | 0.9446 | 0.9189 | 0.9886 |
192
+ | 0.0263 | 2.96 | 39500 | 0.0515 | 0.8889 | 0.9231 | 0.9057 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8378 | 0.9538 | 0.8921 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9190 | 0.9369 | 0.9279 | 206 | 0.8511 | 0.9302 | 0.8889 | 43 | 0.8868 | 0.9201 | 0.9031 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8910 | 0.9653 | 0.9267 | 144 | 0.9825 | 0.9825 | 0.9825 | 171 | 0.3 | 1.0 | 0.4615 | 3 | 0.9326 | 0.9857 | 0.9584 | 421 | 0.8868 | 0.9592 | 0.9216 | 49 | 0.9137 | 0.9919 | 0.9512 | 491 | 0.3571 | 0.4545 | 0.4 | 11 | 0.8982 | 0.9449 | 0.9210 | 0.9885 |
193
+ | 0.0242 | 3.0 | 40000 | 0.0518 | 0.8889 | 0.9231 | 0.9057 | 52 | 0.875 | 1.0 | 0.9333 | 7 | 0.8267 | 0.9538 | 0.8857 | 65 | 0.875 | 1.0 | 0.9333 | 7 | 0.9190 | 0.9369 | 0.9279 | 206 | 0.8696 | 0.9302 | 0.8989 | 43 | 0.8827 | 0.9201 | 0.9010 | 1652 | 0.0 | 0.0 | 0.0 | 2 | 0.8688 | 0.9653 | 0.9145 | 144 | 0.9825 | 0.9825 | 0.9825 | 171 | 0.2727 | 1.0 | 0.4286 | 3 | 0.9220 | 0.9834 | 0.9517 | 421 | 0.9038 | 0.9592 | 0.9307 | 49 | 0.9086 | 0.9919 | 0.9484 | 491 | 0.3846 | 0.4545 | 0.4167 | 11 | 0.8933 | 0.9446 | 0.9183 | 0.9885 |
194
+
195
+
196
+ ### Framework versions
197
+
198
+ - Transformers 4.24.0
199
+ - Pytorch 1.12.1+cu113
200
+ - Datasets 2.6.1
201
+ - Tokenizers 0.13.1
all_results.json ADDED
@@ -0,0 +1,141 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_attackID_f1": 0.9056603773584906,
4
+ "eval_attackID_number": 52,
5
+ "eval_attackID_precision": 0.8888888888888888,
6
+ "eval_attackID_recall": 0.9230769230769231,
7
+ "eval_bitcoinAddr_f1": 0.9333333333333333,
8
+ "eval_bitcoinAddr_number": 7,
9
+ "eval_bitcoinAddr_precision": 0.875,
10
+ "eval_bitcoinAddr_recall": 1.0,
11
+ "eval_cve_f1": 0.8920863309352518,
12
+ "eval_cve_number": 65,
13
+ "eval_cve_precision": 0.8378378378378378,
14
+ "eval_cve_recall": 0.9538461538461539,
15
+ "eval_defenderThreat_f1": 0.9333333333333333,
16
+ "eval_defenderThreat_number": 7,
17
+ "eval_defenderThreat_precision": 0.875,
18
+ "eval_defenderThreat_recall": 1.0,
19
+ "eval_domain_f1": 0.9323671497584541,
20
+ "eval_domain_number": 206,
21
+ "eval_domain_precision": 0.9278846153846154,
22
+ "eval_domain_recall": 0.9368932038834952,
23
+ "eval_email_f1": 0.8791208791208791,
24
+ "eval_email_number": 43,
25
+ "eval_email_precision": 0.8333333333333334,
26
+ "eval_email_recall": 0.9302325581395349,
27
+ "eval_filepath_f1": 0.9022869022869023,
28
+ "eval_filepath_number": 1652,
29
+ "eval_filepath_precision": 0.8857142857142857,
30
+ "eval_filepath_recall": 0.9194915254237288,
31
+ "eval_fingerprint_f1": 0.0,
32
+ "eval_fingerprint_number": 2,
33
+ "eval_fingerprint_precision": 0.0,
34
+ "eval_fingerprint_recall": 0.0,
35
+ "eval_hostname_f1": 0.9266666666666667,
36
+ "eval_hostname_number": 144,
37
+ "eval_hostname_precision": 0.8910256410256411,
38
+ "eval_hostname_recall": 0.9652777777777778,
39
+ "eval_ipv4_f1": 0.9795918367346939,
40
+ "eval_ipv4_number": 171,
41
+ "eval_ipv4_precision": 0.9767441860465116,
42
+ "eval_ipv4_recall": 0.9824561403508771,
43
+ "eval_ipv6_f1": 0.5,
44
+ "eval_ipv6_number": 3,
45
+ "eval_ipv6_precision": 0.3333333333333333,
46
+ "eval_ipv6_recall": 1.0,
47
+ "eval_loss": 0.05140919238328934,
48
+ "eval_md5_f1": 0.9485714285714285,
49
+ "eval_md5_number": 421,
50
+ "eval_md5_precision": 0.9140969162995595,
51
+ "eval_md5_recall": 0.9857482185273159,
52
+ "eval_overall_accuracy": 0.988635339423983,
53
+ "eval_overall_f1": 0.9189347380743343,
54
+ "eval_overall_precision": 0.8945868945868946,
55
+ "eval_overall_recall": 0.9446450060168472,
56
+ "eval_runtime": 103.3004,
57
+ "eval_samples": 13340,
58
+ "eval_samples_per_second": 129.138,
59
+ "eval_sha1_f1": 0.9038461538461537,
60
+ "eval_sha1_number": 49,
61
+ "eval_sha1_precision": 0.8545454545454545,
62
+ "eval_sha1_recall": 0.9591836734693877,
63
+ "eval_sha256_f1": 0.9502439024390243,
64
+ "eval_sha256_number": 491,
65
+ "eval_sha256_precision": 0.9119850187265918,
66
+ "eval_sha256_recall": 0.9918533604887984,
67
+ "eval_steps_per_second": 16.147,
68
+ "eval_uri_f1": 0.3846153846153846,
69
+ "eval_uri_number": 11,
70
+ "eval_uri_precision": 0.3333333333333333,
71
+ "eval_uri_recall": 0.45454545454545453,
72
+ "predict_attackID_f1": 1.0,
73
+ "predict_attackID_number": 54,
74
+ "predict_attackID_precision": 1.0,
75
+ "predict_attackID_recall": 1.0,
76
+ "predict_bitcoinAddr_f1": 0.8888888888888888,
77
+ "predict_bitcoinAddr_number": 9,
78
+ "predict_bitcoinAddr_precision": 0.8888888888888888,
79
+ "predict_bitcoinAddr_recall": 0.8888888888888888,
80
+ "predict_cve_f1": 0.9500000000000001,
81
+ "predict_cve_number": 76,
82
+ "predict_cve_precision": 0.9047619047619048,
83
+ "predict_cve_recall": 1.0,
84
+ "predict_defenderThreat_f1": 0.0,
85
+ "predict_defenderThreat_number": 0,
86
+ "predict_defenderThreat_precision": 0.0,
87
+ "predict_defenderThreat_recall": 0.0,
88
+ "predict_domain_f1": 0.9333333333333332,
89
+ "predict_domain_number": 183,
90
+ "predict_domain_precision": 0.9114583333333334,
91
+ "predict_domain_recall": 0.9562841530054644,
92
+ "predict_email_f1": 0.9879518072289156,
93
+ "predict_email_number": 42,
94
+ "predict_email_precision": 1.0,
95
+ "predict_email_recall": 0.9761904761904762,
96
+ "predict_filepath_f1": 0.8969771745835905,
97
+ "predict_filepath_number": 1601,
98
+ "predict_filepath_precision": 0.8860450944546009,
99
+ "predict_filepath_recall": 0.9081823860087446,
100
+ "predict_hostname_f1": 0.9686411149825783,
101
+ "predict_hostname_number": 145,
102
+ "predict_hostname_precision": 0.9788732394366197,
103
+ "predict_hostname_recall": 0.9586206896551724,
104
+ "predict_ipv4_f1": 0.9570200573065903,
105
+ "predict_ipv4_number": 173,
106
+ "predict_ipv4_precision": 0.9488636363636364,
107
+ "predict_ipv4_recall": 0.9653179190751445,
108
+ "predict_ipv6_f1": 0.5714285714285714,
109
+ "predict_ipv6_number": 7,
110
+ "predict_ipv6_precision": 0.5714285714285714,
111
+ "predict_ipv6_recall": 0.5714285714285714,
112
+ "predict_loss": 0.04564148560166359,
113
+ "predict_md5_f1": 0.9634551495016611,
114
+ "predict_md5_number": 445,
115
+ "predict_md5_precision": 0.9497816593886463,
116
+ "predict_md5_recall": 0.9775280898876404,
117
+ "predict_overall_accuracy": 0.9885820534671927,
118
+ "predict_overall_f1": 0.923447860156721,
119
+ "predict_overall_precision": 0.9086595492289442,
120
+ "predict_overall_recall": 0.9387254901960784,
121
+ "predict_runtime": 105.1484,
122
+ "predict_samples_per_second": 126.868,
123
+ "predict_sha1_f1": 0.9345794392523364,
124
+ "predict_sha1_number": 54,
125
+ "predict_sha1_precision": 0.9433962264150944,
126
+ "predict_sha1_recall": 0.9259259259259259,
127
+ "predict_sha256_f1": 0.9456066945606694,
128
+ "predict_sha256_number": 462,
129
+ "predict_sha256_precision": 0.9149797570850202,
130
+ "predict_sha256_recall": 0.9783549783549783,
131
+ "predict_steps_per_second": 15.863,
132
+ "predict_uri_f1": 0.5999999999999999,
133
+ "predict_uri_number": 13,
134
+ "predict_uri_precision": 0.5294117647058824,
135
+ "predict_uri_recall": 0.6923076923076923,
136
+ "train_loss": 0.07587750652457761,
137
+ "train_runtime": 15652.7262,
138
+ "train_samples": 106717,
139
+ "train_samples_per_second": 20.453,
140
+ "train_steps_per_second": 2.557
141
+ }
config.json ADDED
@@ -0,0 +1,101 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "bert-base-cased",
3
+ "architectures": [
4
+ "BertForTokenClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "finetuning_task": "ner",
9
+ "gradient_checkpointing": false,
10
+ "hidden_act": "gelu",
11
+ "hidden_dropout_prob": 0.1,
12
+ "hidden_size": 768,
13
+ "id2label": {
14
+ "0": "O",
15
+ "1": "B-attackID",
16
+ "2": "I-attackID",
17
+ "3": "B-bitcoinAddr",
18
+ "4": "I-bitcoinAddr",
19
+ "5": "B-cve",
20
+ "6": "I-cve",
21
+ "7": "B-defenderThreat",
22
+ "8": "I-defenderThreat",
23
+ "9": "B-domain",
24
+ "10": "I-domain",
25
+ "11": "B-email",
26
+ "12": "I-email",
27
+ "13": "B-md5",
28
+ "14": "I-md5",
29
+ "15": "B-sha1",
30
+ "16": "I-sha1",
31
+ "17": "B-sha256",
32
+ "18": "I-sha256",
33
+ "19": "B-filepath",
34
+ "20": "I-filepath",
35
+ "21": "B-hostname",
36
+ "22": "I-hostname",
37
+ "23": "B-ipv4",
38
+ "24": "I-ipv4",
39
+ "25": "B-ipv6",
40
+ "26": "I-ipv6",
41
+ "27": "B-fingerprint",
42
+ "28": "I-fingerprint",
43
+ "29": "B-uri",
44
+ "30": "I-uri",
45
+ "31": "B-url",
46
+ "32": "I-url",
47
+ "33": "B-yara",
48
+ "34": "I-yara"
49
+ },
50
+ "initializer_range": 0.02,
51
+ "intermediate_size": 3072,
52
+ "label2id": {
53
+ "B-attackID": 1,
54
+ "B-bitcoinAddr": 3,
55
+ "B-cve": 5,
56
+ "B-defenderThreat": 7,
57
+ "B-domain": 9,
58
+ "B-email": 11,
59
+ "B-filepath": 19,
60
+ "B-fingerprint": 27,
61
+ "B-hostname": 21,
62
+ "B-ipv4": 23,
63
+ "B-ipv6": 25,
64
+ "B-md5": 13,
65
+ "B-sha1": 15,
66
+ "B-sha256": 17,
67
+ "B-uri": 29,
68
+ "B-url": 31,
69
+ "B-yara": 33,
70
+ "I-attackID": 2,
71
+ "I-bitcoinAddr": 4,
72
+ "I-cve": 6,
73
+ "I-defenderThreat": 8,
74
+ "I-domain": 10,
75
+ "I-email": 12,
76
+ "I-filepath": 20,
77
+ "I-fingerprint": 28,
78
+ "I-hostname": 22,
79
+ "I-ipv4": 24,
80
+ "I-ipv6": 26,
81
+ "I-md5": 14,
82
+ "I-sha1": 16,
83
+ "I-sha256": 18,
84
+ "I-uri": 30,
85
+ "I-url": 32,
86
+ "I-yara": 34,
87
+ "O": 0
88
+ },
89
+ "layer_norm_eps": 1e-12,
90
+ "max_position_embeddings": 512,
91
+ "model_type": "bert",
92
+ "num_attention_heads": 12,
93
+ "num_hidden_layers": 12,
94
+ "pad_token_id": 0,
95
+ "position_embedding_type": "absolute",
96
+ "torch_dtype": "float32",
97
+ "transformers_version": "4.24.0",
98
+ "type_vocab_size": 2,
99
+ "use_cache": true,
100
+ "vocab_size": 28996
101
+ }
eval_results.json ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_attackID_f1": 0.9056603773584906,
4
+ "eval_attackID_number": 52,
5
+ "eval_attackID_precision": 0.8888888888888888,
6
+ "eval_attackID_recall": 0.9230769230769231,
7
+ "eval_bitcoinAddr_f1": 0.9333333333333333,
8
+ "eval_bitcoinAddr_number": 7,
9
+ "eval_bitcoinAddr_precision": 0.875,
10
+ "eval_bitcoinAddr_recall": 1.0,
11
+ "eval_cve_f1": 0.8920863309352518,
12
+ "eval_cve_number": 65,
13
+ "eval_cve_precision": 0.8378378378378378,
14
+ "eval_cve_recall": 0.9538461538461539,
15
+ "eval_defenderThreat_f1": 0.9333333333333333,
16
+ "eval_defenderThreat_number": 7,
17
+ "eval_defenderThreat_precision": 0.875,
18
+ "eval_defenderThreat_recall": 1.0,
19
+ "eval_domain_f1": 0.9323671497584541,
20
+ "eval_domain_number": 206,
21
+ "eval_domain_precision": 0.9278846153846154,
22
+ "eval_domain_recall": 0.9368932038834952,
23
+ "eval_email_f1": 0.8791208791208791,
24
+ "eval_email_number": 43,
25
+ "eval_email_precision": 0.8333333333333334,
26
+ "eval_email_recall": 0.9302325581395349,
27
+ "eval_filepath_f1": 0.9022869022869023,
28
+ "eval_filepath_number": 1652,
29
+ "eval_filepath_precision": 0.8857142857142857,
30
+ "eval_filepath_recall": 0.9194915254237288,
31
+ "eval_fingerprint_f1": 0.0,
32
+ "eval_fingerprint_number": 2,
33
+ "eval_fingerprint_precision": 0.0,
34
+ "eval_fingerprint_recall": 0.0,
35
+ "eval_hostname_f1": 0.9266666666666667,
36
+ "eval_hostname_number": 144,
37
+ "eval_hostname_precision": 0.8910256410256411,
38
+ "eval_hostname_recall": 0.9652777777777778,
39
+ "eval_ipv4_f1": 0.9795918367346939,
40
+ "eval_ipv4_number": 171,
41
+ "eval_ipv4_precision": 0.9767441860465116,
42
+ "eval_ipv4_recall": 0.9824561403508771,
43
+ "eval_ipv6_f1": 0.5,
44
+ "eval_ipv6_number": 3,
45
+ "eval_ipv6_precision": 0.3333333333333333,
46
+ "eval_ipv6_recall": 1.0,
47
+ "eval_loss": 0.05140919238328934,
48
+ "eval_md5_f1": 0.9485714285714285,
49
+ "eval_md5_number": 421,
50
+ "eval_md5_precision": 0.9140969162995595,
51
+ "eval_md5_recall": 0.9857482185273159,
52
+ "eval_overall_accuracy": 0.988635339423983,
53
+ "eval_overall_f1": 0.9189347380743343,
54
+ "eval_overall_precision": 0.8945868945868946,
55
+ "eval_overall_recall": 0.9446450060168472,
56
+ "eval_runtime": 103.3004,
57
+ "eval_samples": 13340,
58
+ "eval_samples_per_second": 129.138,
59
+ "eval_sha1_f1": 0.9038461538461537,
60
+ "eval_sha1_number": 49,
61
+ "eval_sha1_precision": 0.8545454545454545,
62
+ "eval_sha1_recall": 0.9591836734693877,
63
+ "eval_sha256_f1": 0.9502439024390243,
64
+ "eval_sha256_number": 491,
65
+ "eval_sha256_precision": 0.9119850187265918,
66
+ "eval_sha256_recall": 0.9918533604887984,
67
+ "eval_steps_per_second": 16.147,
68
+ "eval_uri_f1": 0.3846153846153846,
69
+ "eval_uri_number": 11,
70
+ "eval_uri_precision": 0.3333333333333333,
71
+ "eval_uri_recall": 0.45454545454545453
72
+ }
predict_results.json ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "predict_attackID_f1": 1.0,
3
+ "predict_attackID_number": 54,
4
+ "predict_attackID_precision": 1.0,
5
+ "predict_attackID_recall": 1.0,
6
+ "predict_bitcoinAddr_f1": 0.8888888888888888,
7
+ "predict_bitcoinAddr_number": 9,
8
+ "predict_bitcoinAddr_precision": 0.8888888888888888,
9
+ "predict_bitcoinAddr_recall": 0.8888888888888888,
10
+ "predict_cve_f1": 0.9500000000000001,
11
+ "predict_cve_number": 76,
12
+ "predict_cve_precision": 0.9047619047619048,
13
+ "predict_cve_recall": 1.0,
14
+ "predict_defenderThreat_f1": 0.0,
15
+ "predict_defenderThreat_number": 0,
16
+ "predict_defenderThreat_precision": 0.0,
17
+ "predict_defenderThreat_recall": 0.0,
18
+ "predict_domain_f1": 0.9333333333333332,
19
+ "predict_domain_number": 183,
20
+ "predict_domain_precision": 0.9114583333333334,
21
+ "predict_domain_recall": 0.9562841530054644,
22
+ "predict_email_f1": 0.9879518072289156,
23
+ "predict_email_number": 42,
24
+ "predict_email_precision": 1.0,
25
+ "predict_email_recall": 0.9761904761904762,
26
+ "predict_filepath_f1": 0.8969771745835905,
27
+ "predict_filepath_number": 1601,
28
+ "predict_filepath_precision": 0.8860450944546009,
29
+ "predict_filepath_recall": 0.9081823860087446,
30
+ "predict_hostname_f1": 0.9686411149825783,
31
+ "predict_hostname_number": 145,
32
+ "predict_hostname_precision": 0.9788732394366197,
33
+ "predict_hostname_recall": 0.9586206896551724,
34
+ "predict_ipv4_f1": 0.9570200573065903,
35
+ "predict_ipv4_number": 173,
36
+ "predict_ipv4_precision": 0.9488636363636364,
37
+ "predict_ipv4_recall": 0.9653179190751445,
38
+ "predict_ipv6_f1": 0.5714285714285714,
39
+ "predict_ipv6_number": 7,
40
+ "predict_ipv6_precision": 0.5714285714285714,
41
+ "predict_ipv6_recall": 0.5714285714285714,
42
+ "predict_loss": 0.04564148560166359,
43
+ "predict_md5_f1": 0.9634551495016611,
44
+ "predict_md5_number": 445,
45
+ "predict_md5_precision": 0.9497816593886463,
46
+ "predict_md5_recall": 0.9775280898876404,
47
+ "predict_overall_accuracy": 0.9885820534671927,
48
+ "predict_overall_f1": 0.923447860156721,
49
+ "predict_overall_precision": 0.9086595492289442,
50
+ "predict_overall_recall": 0.9387254901960784,
51
+ "predict_runtime": 105.1484,
52
+ "predict_samples_per_second": 126.868,
53
+ "predict_sha1_f1": 0.9345794392523364,
54
+ "predict_sha1_number": 54,
55
+ "predict_sha1_precision": 0.9433962264150944,
56
+ "predict_sha1_recall": 0.9259259259259259,
57
+ "predict_sha256_f1": 0.9456066945606694,
58
+ "predict_sha256_number": 462,
59
+ "predict_sha256_precision": 0.9149797570850202,
60
+ "predict_sha256_recall": 0.9783549783549783,
61
+ "predict_steps_per_second": 15.863,
62
+ "predict_uri_f1": 0.5999999999999999,
63
+ "predict_uri_number": 13,
64
+ "predict_uri_precision": 0.5294117647058824,
65
+ "predict_uri_recall": 0.6923076923076923
66
+ }
predictions.txt ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "do_lower_case": false,
4
+ "mask_token": "[MASK]",
5
+ "model_max_length": 512,
6
+ "name_or_path": "bert-base-cased",
7
+ "pad_token": "[PAD]",
8
+ "sep_token": "[SEP]",
9
+ "special_tokens_map_file": null,
10
+ "strip_accents": null,
11
+ "tokenize_chinese_chars": true,
12
+ "tokenizer_class": "BertTokenizer",
13
+ "unk_token": "[UNK]"
14
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "train_loss": 0.07587750652457761,
4
+ "train_runtime": 15652.7262,
5
+ "train_samples": 106717,
6
+ "train_samples_per_second": 20.453,
7
+ "train_steps_per_second": 2.557
8
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff