ahmed792002/Finetuning_Bert_ClinicalNotes_Diagnosis_Classification

README.md

@@ -1,12 +1,12 @@
 ---
-base_model: bert-base-uncased
 library_name: transformers
 license: apache-2.0
+base_model: bert-base-uncased
+tags:
+- generated_from_trainer
 metrics:
 - accuracy
 - f1
-tags:
-- generated_from_trainer
 model-index:
 - name: Finetuning_Bert_ClinicalNotes_Diagnosis_Classification
   results: []
@@ -19,7 +19,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0028
+- Loss: 0.0081
 - Accuracy: 1.0
 - F1: 1.0
 
@@ -41,8 +41,8 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 16
+- eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -52,11 +52,11 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1  |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---:|
-| No log        | 1.0   | 438  | 0.0226          | 1.0      | 1.0 |
-| 0.6724        | 2.0   | 876  | 0.0069          | 1.0      | 1.0 |
-| 0.0134        | 3.0   | 1314 | 0.0041          | 1.0      | 1.0 |
-| 0.0062        | 4.0   | 1752 | 0.0031          | 1.0      | 1.0 |
-| 0.0044        | 5.0   | 2190 | 0.0028          | 1.0      | 1.0 |
+| No log        | 1.0   | 219  | 0.1206          | 1.0      | 1.0 |
+| No log        | 2.0   | 438  | 0.0203          | 1.0      | 1.0 |
+| 0.5546        | 3.0   | 657  | 0.0116          | 1.0      | 1.0 |
+| 0.5546        | 4.0   | 876  | 0.0089          | 1.0      | 1.0 |
+| 0.0153        | 5.0   | 1095 | 0.0081          | 1.0      | 1.0 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:761946f78d20632942dd24d0927a6150a76a35f631e5d539dad1780106c66924
+oid sha256:2cbfddbd05d671e8d90ee00fd2c95b18f2a33cb3dc53f020556ff61a88f7e3e1
 size 438014016

runs/Oct14_12-54-18_4e0055edf3ec/events.out.tfevents.1760446460.4e0055edf3ec.40.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3413707b98b660ed9d3a737e743c7c37a5c8431a93a4e6db51624fc79f5987e
+size 8490

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:18052524afe41dcc3f76d9e59f22cc5a36984c4ffa341282905a6180f2d2d0c0
+oid sha256:4b4c01342242806277ca9aac9f4bdc049324cb87b130d2273c914cda4f06cdfb
 size 5304