bert-phishing-trainer

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1372
-- Accuracy: 0.9699
-- F1: 0.9693
-- Precision: 0.9695
-- Recall: 0.9699
+- Loss: 0.2090
+- Accuracy: 0.9467
+- F1: 0.9463
+- Precision: 0.9469
+- Recall: 0.9467
 
 ## Model description
 
@@ -49,15 +49,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- num_epochs: 10
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 0.1069        | 1.0   | 2728 | 0.2193          | 0.9558   | 0.9530 | 0.9567    | 0.9558 |
-| 0.232         | 2.0   | 5456 | 0.1591          | 0.9666   | 0.9654 | 0.9665    | 0.9666 |
-| 0.0629        | 3.0   | 8184 | 0.1372          | 0.9699   | 0.9693 | 0.9695    | 0.9699 |
+| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| 0.4561        | 1.0   | 1098  | 0.3688          | 0.8738   | 0.8709 | 0.8760    | 0.8738 |
+| 0.3126        | 2.0   | 2196  | 0.2254          | 0.9339   | 0.9335 | 0.9340    | 0.9339 |
+| 0.3852        | 3.0   | 3294  | 0.3113          | 0.9280   | 0.9274 | 0.9284    | 0.9280 |
+| 0.2341        | 4.0   | 4392  | 0.2376          | 0.9417   | 0.9417 | 0.9418    | 0.9417 |
+| 0.2108        | 5.0   | 5490  | 0.2433          | 0.9408   | 0.9407 | 0.9407    | 0.9408 |
+| 0.0882        | 6.0   | 6588  | 0.2353          | 0.9371   | 0.9364 | 0.9384    | 0.9371 |
+| 0.127         | 7.0   | 7686  | 0.2674          | 0.9276   | 0.9270 | 0.9277    | 0.9276 |
+| 0.1413        | 8.0   | 8784  | 0.2859          | 0.9339   | 0.9341 | 0.9344    | 0.9339 |
+| 0.7061        | 9.0   | 9882  | 0.6121          | 0.6761   | 0.5834 | 0.7861    | 0.6761 |
+| 0.2076        | 10.0  | 10980 | 0.2090          | 0.9467   | 0.9463 | 0.9469    | 0.9467 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:681deecfaa926928484d3d569b20bceea5a2dfb469d4ad667f022a1adba79a41
+oid sha256:b3c07d1210921d23f896fa619bb32053efc6bbe567485672db728f15837830a7
 size 711443456

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d3463e9a3141f421c1bf95b9445eb69b6fd0fb384948dab1fda629675d1f67d9
+oid sha256:5de14c749f2e13fb606cc82bd39b3a2b38dcc1f6fc61a5308c8f27de574be69b
 size 4856