hebashakeel commited on
Commit
18e6108
·
verified ·
1 Parent(s): 8bfd154

End of training

Browse files
README.md CHANGED
@@ -18,21 +18,21 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.0431
22
- - Accuracy: 0.62
23
- - Auc: 0.882
24
- - Precision Class 0: 0.35
25
- - Precision Class 1: 0.76
26
- - Precision Class 2: 0.379
27
- - Precision Class 3: 0.714
28
- - Precision Class 4: 0.803
29
- - Precision Class 5: 0.379
30
  - Recall Class 0: 0.368
31
- - Recall Class 1: 0.826
32
- - Recall Class 2: 0.407
33
- - Recall Class 3: 0.745
34
- - Recall Class 4: 0.766
35
- - Recall Class 5: 0.333
36
 
37
  ## Model description
38
 
@@ -52,8 +52,8 @@ More information needed
52
 
53
  The following hyperparameters were used during training:
54
  - learning_rate: 0.001
55
- - train_batch_size: 8
56
- - eval_batch_size: 8
57
  - seed: 42
58
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
59
  - lr_scheduler_type: linear
@@ -63,16 +63,16 @@ The following hyperparameters were used during training:
63
 
64
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision Class 0 | Precision Class 1 | Precision Class 2 | Precision Class 3 | Precision Class 4 | Precision Class 5 | Recall Class 0 | Recall Class 1 | Recall Class 2 | Recall Class 3 | Recall Class 4 | Recall Class 5 |
65
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|
66
- | 1.5148 | 1.0 | 124 | 1.2488 | 0.505 | 0.847 | 0.318 | 1.0 | 0.233 | 0.964 | 0.653 | 0.235 | 0.56 | 0.2 | 0.318 | 0.643 | 0.701 | 0.222 |
67
- | 1.171 | 2.0 | 248 | 1.0449 | 0.59 | 0.876 | 0.478 | 0.929 | 0.286 | 0.76 | 0.755 | 0.375 | 0.44 | 0.65 | 0.364 | 0.905 | 0.552 | 0.5 |
68
- | 1.0919 | 3.0 | 372 | 1.2051 | 0.571 | 0.863 | 0.381 | 1.0 | 0.262 | 0.872 | 0.741 | 1.0 | 0.64 | 0.45 | 0.727 | 0.81 | 0.642 | 0.083 |
69
- | 0.9998 | 4.0 | 496 | 1.0001 | 0.599 | 0.879 | 0.429 | 0.923 | 0.545 | 0.783 | 0.632 | 0.293 | 0.24 | 0.6 | 0.273 | 0.857 | 0.821 | 0.333 |
70
- | 0.9018 | 5.0 | 620 | 1.0078 | 0.599 | 0.879 | 0.6 | 0.632 | 0.571 | 0.838 | 0.635 | 0.347 | 0.36 | 0.6 | 0.182 | 0.738 | 0.806 | 0.472 |
71
- | 0.8651 | 6.0 | 744 | 0.9984 | 0.623 | 0.881 | 0.4 | 0.778 | 0.556 | 0.872 | 0.644 | 0.333 | 0.56 | 0.7 | 0.227 | 0.81 | 0.866 | 0.194 |
72
- | 0.7965 | 7.0 | 868 | 0.9984 | 0.637 | 0.886 | 0.485 | 0.684 | 0.471 | 0.919 | 0.667 | 0.316 | 0.64 | 0.65 | 0.364 | 0.81 | 0.866 | 0.167 |
73
- | 0.7863 | 8.0 | 992 | 0.9887 | 0.632 | 0.887 | 0.485 | 0.619 | 0.45 | 0.857 | 0.727 | 0.4 | 0.64 | 0.65 | 0.409 | 0.857 | 0.716 | 0.333 |
74
- | 0.7388 | 9.0 | 1116 | 0.9815 | 0.613 | 0.887 | 0.522 | 0.636 | 0.4 | 0.837 | 0.712 | 0.342 | 0.48 | 0.7 | 0.364 | 0.857 | 0.701 | 0.361 |
75
- | 0.7216 | 10.0 | 1240 | 0.9811 | 0.627 | 0.887 | 0.538 | 0.765 | 0.375 | 0.818 | 0.704 | 0.367 | 0.56 | 0.65 | 0.409 | 0.857 | 0.746 | 0.306 |
76
 
77
 
78
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.0524
22
+ - Accuracy: 0.624
23
+ - Auc: 0.879
24
+ - Precision Class 0: 0.389
25
+ - Precision Class 1: 0.778
26
+ - Precision Class 2: 0.467
27
+ - Precision Class 3: 0.767
28
+ - Precision Class 4: 0.722
29
+ - Precision Class 5: 0.342
30
  - Recall Class 0: 0.368
31
+ - Recall Class 1: 0.913
32
+ - Recall Class 2: 0.259
33
+ - Recall Class 3: 0.702
34
+ - Recall Class 4: 0.812
35
+ - Recall Class 5: 0.394
36
 
37
  ## Model description
38
 
 
52
 
53
  The following hyperparameters were used during training:
54
  - learning_rate: 0.001
55
+ - train_batch_size: 16
56
+ - eval_batch_size: 16
57
  - seed: 42
58
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
59
  - lr_scheduler_type: linear
 
63
 
64
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision Class 0 | Precision Class 1 | Precision Class 2 | Precision Class 3 | Precision Class 4 | Precision Class 5 | Recall Class 0 | Recall Class 1 | Recall Class 2 | Recall Class 3 | Recall Class 4 | Recall Class 5 |
65
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|
66
+ | 0.9373 | 1.0 | 62 | 0.9872 | 0.656 | 0.883 | 0.56 | 0.789 | 0.625 | 0.846 | 0.671 | 0.417 | 0.56 | 0.75 | 0.227 | 0.786 | 0.851 | 0.417 |
67
+ | 0.8006 | 2.0 | 124 | 1.0506 | 0.604 | 0.88 | 0.5 | 0.615 | 0.429 | 0.909 | 0.737 | 0.383 | 0.44 | 0.8 | 0.273 | 0.714 | 0.627 | 0.639 |
68
+ | 0.7957 | 3.0 | 186 | 1.0198 | 0.613 | 0.885 | 0.542 | 0.737 | 0.306 | 0.795 | 0.692 | 0.5 | 0.52 | 0.7 | 0.5 | 0.833 | 0.672 | 0.333 |
69
+ | 0.7744 | 4.0 | 248 | 1.0501 | 0.637 | 0.881 | 0.579 | 0.778 | 0.458 | 0.872 | 0.619 | 0.333 | 0.44 | 0.7 | 0.5 | 0.81 | 0.896 | 0.139 |
70
+ | 0.7193 | 5.0 | 310 | 1.0314 | 0.613 | 0.881 | 0.591 | 0.652 | 0.545 | 0.886 | 0.676 | 0.34 | 0.52 | 0.75 | 0.273 | 0.738 | 0.716 | 0.472 |
71
+ | 0.7214 | 6.0 | 372 | 1.0134 | 0.632 | 0.881 | 0.481 | 0.667 | 0.5 | 0.872 | 0.703 | 0.371 | 0.52 | 0.7 | 0.364 | 0.81 | 0.776 | 0.361 |
72
+ | 0.6628 | 7.0 | 434 | 1.0454 | 0.651 | 0.882 | 0.536 | 0.867 | 0.4 | 0.818 | 0.701 | 0.435 | 0.6 | 0.65 | 0.455 | 0.857 | 0.806 | 0.278 |
73
+ | 0.6689 | 8.0 | 496 | 1.0253 | 0.627 | 0.883 | 0.5 | 0.636 | 0.421 | 0.892 | 0.694 | 0.412 | 0.56 | 0.7 | 0.364 | 0.786 | 0.746 | 0.389 |
74
+ | 0.6225 | 9.0 | 558 | 1.0357 | 0.618 | 0.883 | 0.542 | 0.867 | 0.412 | 0.804 | 0.697 | 0.341 | 0.52 | 0.65 | 0.318 | 0.881 | 0.687 | 0.417 |
75
+ | 0.612 | 10.0 | 620 | 1.0199 | 0.637 | 0.883 | 0.5 | 0.765 | 0.391 | 0.804 | 0.708 | 0.429 | 0.52 | 0.65 | 0.409 | 0.881 | 0.761 | 0.333 |
76
 
77
 
78
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fe7b2513bab94d78604edbc6cb23ee3cc95e1036fb6ba64f0f1ae59b237767f
3
  size 437970952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dffe2a92547c732026a5118cdabf16be476b32b90e61cfdefb2e9b6f3147c75
3
  size 437970952
runs/Feb17_08-09-50_d68c514ae1af/events.out.tfevents.1739779790.d68c514ae1af.30.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:570fe4890f8d922b12fba263d4bcbe0438c3056d3062c254b03086cb01b0e648
3
+ size 18700
runs/Feb17_08-09-50_d68c514ae1af/events.out.tfevents.1739779837.d68c514ae1af.30.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d051556163d0455468f97db3df2493e6dcb56d9fd7332466ca3d81a2f1d44b63
3
+ size 1172
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e798020e3c71a47317e78fb28a8c3ec6b02a1238e8b6fe3fbe3a7edb381663a
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8da1afc14e9a52e19cea290c39c72d6ed74d0d0e992f1b04b0b1cbdcdcad618
3
  size 5240