End of training
Browse files
README.md
CHANGED
|
@@ -18,21 +18,21 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
|
| 20 |
It achieves the following results on the evaluation set:
|
| 21 |
-
- Loss: 1.
|
| 22 |
-
- Accuracy: 0.
|
| 23 |
-
- Auc: 0.
|
| 24 |
-
- Precision Class 0: 0.
|
| 25 |
-
- Precision Class 1: 0.
|
| 26 |
-
- Precision Class 2: 0.
|
| 27 |
-
- Precision Class 3: 0.
|
| 28 |
-
- Precision Class 4: 0.
|
| 29 |
-
- Precision Class 5: 0.
|
| 30 |
-
- Recall Class 0: 0.
|
| 31 |
-
- Recall Class 1: 0.
|
| 32 |
- Recall Class 2: 0.444
|
| 33 |
-
- Recall Class 3: 0.
|
| 34 |
-
- Recall Class 4: 0.
|
| 35 |
-
- Recall Class 5: 0.
|
| 36 |
|
| 37 |
## Model description
|
| 38 |
|
|
@@ -51,9 +51,9 @@ More information needed
|
|
| 51 |
### Training hyperparameters
|
| 52 |
|
| 53 |
The following hyperparameters were used during training:
|
| 54 |
-
- learning_rate: 0.
|
| 55 |
-
- train_batch_size:
|
| 56 |
-
- eval_batch_size:
|
| 57 |
- seed: 42
|
| 58 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 59 |
- lr_scheduler_type: linear
|
|
@@ -63,16 +63,16 @@ The following hyperparameters were used during training:
|
|
| 63 |
|
| 64 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision Class 0 | Precision Class 1 | Precision Class 2 | Precision Class 3 | Precision Class 4 | Precision Class 5 | Recall Class 0 | Recall Class 1 | Recall Class 2 | Recall Class 3 | Recall Class 4 | Recall Class 5 |
|
| 65 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|
|
| 66 |
-
|
|
| 67 |
-
|
|
| 68 |
-
|
|
| 69 |
-
|
|
| 70 |
-
|
|
| 71 |
-
|
|
| 72 |
-
|
|
| 73 |
-
|
|
| 74 |
-
|
|
| 75 |
-
|
|
| 76 |
|
| 77 |
|
| 78 |
### Framework versions
|
|
|
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
|
| 20 |
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 1.0555
|
| 22 |
+
- Accuracy: 0.624
|
| 23 |
+
- Auc: 0.867
|
| 24 |
+
- Precision Class 0: 0.4
|
| 25 |
+
- Precision Class 1: 0.762
|
| 26 |
+
- Precision Class 2: 0.429
|
| 27 |
+
- Precision Class 3: 0.72
|
| 28 |
+
- Precision Class 4: 0.7
|
| 29 |
+
- Precision Class 5: 0.5
|
| 30 |
+
- Recall Class 0: 0.421
|
| 31 |
+
- Recall Class 1: 0.696
|
| 32 |
- Recall Class 2: 0.444
|
| 33 |
+
- Recall Class 3: 0.766
|
| 34 |
+
- Recall Class 4: 0.766
|
| 35 |
+
- Recall Class 5: 0.364
|
| 36 |
|
| 37 |
## Model description
|
| 38 |
|
|
|
|
| 51 |
### Training hyperparameters
|
| 52 |
|
| 53 |
The following hyperparameters were used during training:
|
| 54 |
+
- learning_rate: 0.0002
|
| 55 |
+
- train_batch_size: 16
|
| 56 |
+
- eval_batch_size: 16
|
| 57 |
- seed: 42
|
| 58 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 59 |
- lr_scheduler_type: linear
|
|
|
|
| 63 |
|
| 64 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision Class 0 | Precision Class 1 | Precision Class 2 | Precision Class 3 | Precision Class 4 | Precision Class 5 | Recall Class 0 | Recall Class 1 | Recall Class 2 | Recall Class 3 | Recall Class 4 | Recall Class 5 |
|
| 65 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:-----------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|:--------------:|
|
| 66 |
+
| 1.6248 | 1.0 | 62 | 1.4733 | 0.439 | 0.777 | 0.371 | 0.0 | 0.2 | 0.706 | 0.399 | 0.0 | 0.52 | 0.0 | 0.045 | 0.571 | 0.821 | 0.0 |
|
| 67 |
+
| 1.4241 | 2.0 | 124 | 1.3340 | 0.524 | 0.821 | 0.464 | 0.625 | 0.5 | 0.627 | 0.514 | 0.25 | 0.52 | 0.25 | 0.182 | 0.762 | 0.806 | 0.083 |
|
| 68 |
+
| 1.3082 | 3.0 | 186 | 1.2389 | 0.547 | 0.849 | 0.448 | 0.714 | 0.345 | 0.816 | 0.531 | 0.455 | 0.52 | 0.25 | 0.455 | 0.738 | 0.776 | 0.139 |
|
| 69 |
+
| 1.2177 | 4.0 | 248 | 1.1702 | 0.608 | 0.862 | 0.478 | 0.722 | 0.35 | 0.625 | 0.694 | 0.533 | 0.44 | 0.65 | 0.318 | 0.952 | 0.746 | 0.222 |
|
| 70 |
+
| 1.1415 | 5.0 | 310 | 1.1146 | 0.594 | 0.869 | 0.48 | 0.733 | 0.417 | 0.698 | 0.607 | 0.389 | 0.48 | 0.55 | 0.227 | 0.881 | 0.806 | 0.194 |
|
| 71 |
+
| 1.1024 | 6.0 | 372 | 1.0959 | 0.59 | 0.87 | 0.462 | 0.833 | 0.368 | 0.75 | 0.672 | 0.375 | 0.48 | 0.5 | 0.318 | 0.857 | 0.672 | 0.417 |
|
| 72 |
+
| 1.0609 | 7.0 | 434 | 1.0660 | 0.623 | 0.874 | 0.5 | 0.846 | 0.381 | 0.783 | 0.667 | 0.438 | 0.44 | 0.55 | 0.364 | 0.857 | 0.776 | 0.389 |
|
| 73 |
+
| 1.0444 | 8.0 | 496 | 1.0565 | 0.623 | 0.875 | 0.5 | 0.857 | 0.364 | 0.755 | 0.676 | 0.448 | 0.48 | 0.6 | 0.364 | 0.881 | 0.746 | 0.361 |
|
| 74 |
+
| 1.0295 | 9.0 | 558 | 1.0497 | 0.623 | 0.875 | 0.5 | 0.857 | 0.348 | 0.783 | 0.68 | 0.433 | 0.48 | 0.6 | 0.364 | 0.857 | 0.761 | 0.361 |
|
| 75 |
+
| 1.0067 | 10.0 | 620 | 1.0471 | 0.623 | 0.876 | 0.5 | 0.857 | 0.348 | 0.755 | 0.676 | 0.464 | 0.48 | 0.6 | 0.364 | 0.881 | 0.746 | 0.361 |
|
| 76 |
|
| 77 |
|
| 78 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 437970952
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bfb2a69aca819bfd10d61cd76481eb2eb2e25144efc42b6ecee46310fb0dd99a
|
| 3 |
size 437970952
|
runs/Feb17_04-03-41_f7dacc966242/events.out.tfevents.1739765023.f7dacc966242.30.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1e5dd6cb9cf7bc47f1f61c40b984f015aeb5281bd76e81df51b873174b1caab4
|
| 3 |
+
size 18608
|
runs/Feb17_04-03-41_f7dacc966242/events.out.tfevents.1739765144.f7dacc966242.30.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0d8901f17cf5bde20df9c0eb0406a2b51018b56b45275b64ea83f1b74a85a185
|
| 3 |
+
size 1172
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5240
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:162250b0baf0cf4db853cabd5d1d2225e97a4dabbfa9df613bc06e57c604c9fe
|
| 3 |
size 5240
|