microsoft/codebert-base Script Detector
Summary
| Field | Value |
|---|---|
| Base model | microsoft/codebert-base |
| Phase | phase1 |
| Target repo | HID-APP/script-detector-microsoft-codebert-base |
| Datasets | HID-APP/All-combined |
| Text column | text |
| Epochs | 3.0000 |
| Max length | 512 |
| Train batch size | 4 |
| Eval batch size | 8 |
| Gradient accumulation steps | 4 |
| Learning rate | 0.0000 |
| Precision | fp16 |
| Optimizer | adamw_torch |
| Dataloader workers | 0 |
| Gradient checkpointing | False |
| Group by length | True |
| LoRA enabled | False |
Dataset Sources
| Source | Type | Revision | Fingerprint |
|---|---|---|---|
| HID-APP/All-combined | huggingface | default | 81f16d3fdbb4f97d3574f5c78bce8ada7b15c9ccd625913daa095cae6d545d67 |
Training And Validation History
| Epoch | Step | Train Loss | Eval Loss | Accuracy | Precision | Recall | F1 |
|---|---|---|---|---|---|---|---|
| 1.0000 | 373 | 3.2531 | |||||
| 1.0000 | 373 | 0.5277 | 0.8353 | 0.8144 | 0.9806 | 0.8898 | |
| 2.0000 | 746 | 2.7352 | |||||
| 2.0000 | 746 | 0.5214 | 0.8291 | 0.8015 | 0.9943 | 0.8875 | |
| 3.0000 | 1119 | 2.6190 | |||||
| 3.0000 | 1119 | 0.5194 | 0.8360 | 0.8383 | 0.9396 | 0.8860 |
Final Test Summary
| Split | Accuracy | Malicious Precision | Malicious Recall | Malicious F1 | Loss |
|---|---|---|---|---|---|
| test | 0.7846 | 0.7636 | 0.9598 | 0.8505 | 0.7020 |
Final Test Classification Report
| Class | Precision | Recall | F1 | Support |
|---|---|---|---|---|
| benign | 0.8701 | 0.4753 | 0.6147 | 465.0000 |
| malicious | 0.7636 | 0.9598 | 0.8505 | 821.0000 |
| macro avg | 0.8168 | 0.7175 | 0.7326 | 1286.0000 |
| weighted avg | 0.8021 | 0.7846 | 0.7653 | 1286.0000 |
| accuracy | 0.7846 |
Final Test Confusion Matrix
| Pred benign | Pred malicious | |
|---|---|---|
| Actual benign | 221 | 244 |
| Actual malicious | 33 | 788 |
Final Test Grouped By Original Sample
Chunk rows: 1286; original samples: 1286.
| Pooling | Original Samples | Accuracy | Malicious Precision | Malicious Recall | Malicious F1 |
|---|---|---|---|---|---|
| max_pool | 1286 | 0.7846 | 0.7636 | 0.9598 | 0.8505 |
| mean_pool | 1286 | 0.7846 | 0.7636 | 0.9598 | 0.8505 |