End of training

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [medicalai/ClinicalBERT](https://huggingface.co/medicalai/ClinicalBERT) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.0026
-- Accuracy: 0.7527
-- Precision: 0.6542
-- Recall: 0.7527
-- F1: 0.6968
+- Loss: 0.9439
+- Accuracy: 0.7473
+- Precision: 0.6549
+- Recall: 0.7473
+- F1: 0.6918
 
 ## Model description
 
@@ -43,26 +43,24 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 3e-05
+- learning_rate: 5e-05
 - train_batch_size: 4
 - eval_batch_size: 4
 - seed: 42
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 8
+- num_epochs: 6
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
-| No log        | 1.0   | 434  | 1.2511          | 0.6640   | 0.5944    | 0.6640 | 0.6189 |
-| 1.3037        | 2.0   | 868  | 1.2162          | 0.7258   | 0.6261    | 0.7258 | 0.6722 |
-| 1.1839        | 3.0   | 1302 | 1.1236          | 0.7446   | 0.6507    | 0.7446 | 0.6894 |
-| 1.1646        | 4.0   | 1736 | 1.0945          | 0.7473   | 0.6508    | 0.7473 | 0.6920 |
-| 1.1053        | 5.0   | 2170 | 1.0506          | 0.7419   | 0.6499    | 0.7419 | 0.6866 |
-| 1.0518        | 6.0   | 2604 | 1.0332          | 0.7473   | 0.6575    | 0.7473 | 0.6914 |
-| 1.0393        | 7.0   | 3038 | 1.0048          | 0.7527   | 0.6542    | 0.7527 | 0.6968 |
-| 1.0393        | 8.0   | 3472 | 1.0026          | 0.7527   | 0.6542    | 0.7527 | 0.6968 |
+| No log        | 1.0   | 434  | 1.1859          | 0.6909   | 0.6054    | 0.6909 | 0.6422 |
+| 1.2827        | 2.0   | 868  | 1.1446          | 0.7258   | 0.6268    | 0.7258 | 0.6721 |
+| 1.1164        | 3.0   | 1302 | 1.0256          | 0.75     | 0.6546    | 0.75   | 0.6946 |
+| 1.0728        | 4.0   | 1736 | 0.9982          | 0.7473   | 0.6517    | 0.7473 | 0.6921 |
+| 1.0206        | 5.0   | 2170 | 0.9582          | 0.7446   | 0.6530    | 0.7446 | 0.6891 |
+| 0.9745        | 6.0   | 2604 | 0.9439          | 0.7473   | 0.6549    | 0.7473 | 0.6918 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:08203e5a3d1748fd7bb672761a38068cbd1532e0a6dba7599ee874a0646153a9
+oid sha256:2185d0e5a0c3455949ec8fdfddc9fb2746b4388eef9c24970dd6cf94c92bce8c
 size 541323528

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9118762f6db7cbe1568ed12cf7e8a974be2d3051e85e8c2bff5f8ad1c41aac01
+oid sha256:4ed32422372dacf5dc61d875288208c4370c61a996b9802def2cd83dcfe64384
 size 5304