Update README.md
Browse files
README.md
CHANGED
|
@@ -6,28 +6,51 @@ pipeline_tag: text-classification
|
|
| 6 |
datasets:
|
| 7 |
- 19kmunz/iot-23-preprocessed-minimumcolumns
|
| 8 |
---
|
|
|
|
| 9 |
This is an undergraduate course project in computer security.
|
| 10 |
|
| 11 |
The task is to fine tune the large model to achieve malicious network flow data detection.
|
| 12 |
|
| 13 |
-
|
| 14 |
-
|
| 15 |
|
| 16 |
-
|
|
|
|
| 17 |
|
|
|
|
|
|
|
| 18 |
134 icmp OTH 2 96 0
|
| 19 |
37215 tcp S0 2 80 0
|
| 20 |
52869 tcp S0 2 80 0
|
| 21 |
8080 tcp S0 2 80 0
|
| 22 |
80 tcp S0 2 80 0
|
| 23 |
-
|
| 24 |
The above are "malicious", which is "label_1".
|
| 25 |
-
|
| 26 |
67 udp S0 11 3608 0
|
| 27 |
0 icmp OTH 9 844 0
|
| 28 |
136 icmp OTH 3 216 0
|
| 29 |
0 icmp OTH 8 648 0
|
| 30 |
134 icmp OTH 2 96 0
|
| 31 |
-
|
| 32 |
The above are "Benign", which is "label_0".
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
datasets:
|
| 7 |
- 19kmunz/iot-23-preprocessed-minimumcolumns
|
| 8 |
---
|
| 9 |
+
## introduction
|
| 10 |
This is an undergraduate course project in computer security.
|
| 11 |
|
| 12 |
The task is to fine tune the large model to achieve malicious network flow data detection.
|
| 13 |
|
| 14 |
+
## base model
|
| 15 |
+
bert-base-uncased
|
| 16 |
|
| 17 |
+
## dataset:
|
| 18 |
+
19kmunz/iot-23-preprocessed-minimumcolumns
|
| 19 |
|
| 20 |
+
## example prompt:
|
| 21 |
+
```markdown
|
| 22 |
134 icmp OTH 2 96 0
|
| 23 |
37215 tcp S0 2 80 0
|
| 24 |
52869 tcp S0 2 80 0
|
| 25 |
8080 tcp S0 2 80 0
|
| 26 |
80 tcp S0 2 80 0
|
| 27 |
+
```
|
| 28 |
The above are "malicious", which is "label_1".
|
| 29 |
+
```markdown
|
| 30 |
67 udp S0 11 3608 0
|
| 31 |
0 icmp OTH 9 844 0
|
| 32 |
136 icmp OTH 3 216 0
|
| 33 |
0 icmp OTH 8 648 0
|
| 34 |
134 icmp OTH 2 96 0
|
| 35 |
+
```
|
| 36 |
The above are "Benign", which is "label_0".
|
| 37 |
|
| 38 |
+
## accuracy
|
| 39 |
+
```markdown
|
| 40 |
+
Training Loss Valid. Loss Valid. Accur.
|
| 41 |
+
epoch
|
| 42 |
+
1 0.288545 0.190351 0.929988
|
| 43 |
+
2 0.147658 0.154426 0.943510
|
| 44 |
+
3 0.108059 0.173112 0.943510
|
| 45 |
+
4 0.092468 0.161035 0.947416
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
## MCC score: 0.816
|
| 49 |
+
|
| 50 |
+
The "Total MCC" refers to the Matthews Correlation Coefficient (MCC), typically used to assess the quality of predictions in binary classification problems.
|
| 51 |
+
|
| 52 |
+
The MCC value ranges from -1 to 1, where 1 signifies perfect predictions, 0 indicates predictions similar to random chance, and -1 denotes completely opposite predictions.
|
| 53 |
+
|
| 54 |
+
A model with an MCC value of 0.816 can be considered quite good. This value being close to 1 implies that the model has a high predictive capability and can classify samples with considerable accuracy. A higher MCC value closer to 1 indicates stronger predictive ability in the model.
|
| 55 |
+
|
| 56 |
+
In summary, an MCC value of 0.816 indicates that the model demonstrates a high level of accuracy and predictive capability in binary classification tasks.
|