End of training

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [alex-miller/ODABert](https://huggingface.co/alex-miller/ODABert) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2909
-- Accuracy: 0.88
-- F1: 0.8966
-- Precision: 0.9123
-- Recall: 0.8814
+- Loss: 0.4448
+- Accuracy: 0.91
+- F1: 0.9217
+- Precision: 0.9464
+- Recall: 0.8983
 
 ## Model description
 
@@ -43,7 +43,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
+- learning_rate: 0.0001
 - train_batch_size: 64
 - eval_batch_size: 64
 - seed: 42
@@ -55,16 +55,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 0.6654        | 1.0   | 7    | 0.6058          | 0.75     | 0.7899 | 0.7833    | 0.7966 |
-| 0.5859        | 2.0   | 14   | 0.5028          | 0.8      | 0.8182 | 0.8824    | 0.7627 |
-| 0.4887        | 3.0   | 21   | 0.4160          | 0.81     | 0.8257 | 0.9       | 0.7627 |
-| 0.3762        | 4.0   | 28   | 0.3439          | 0.86     | 0.8772 | 0.9091    | 0.8475 |
-| 0.3176        | 5.0   | 35   | 0.3046          | 0.88     | 0.8947 | 0.9273    | 0.8644 |
-| 0.2659        | 6.0   | 42   | 0.2937          | 0.88     | 0.8947 | 0.9273    | 0.8644 |
-| 0.2592        | 7.0   | 49   | 0.2940          | 0.87     | 0.8889 | 0.8966    | 0.8814 |
-| 0.213         | 8.0   | 56   | 0.2920          | 0.87     | 0.8889 | 0.8966    | 0.8814 |
-| 0.1946        | 9.0   | 63   | 0.2899          | 0.88     | 0.8947 | 0.9273    | 0.8644 |
-| 0.2042        | 10.0  | 70   | 0.2909          | 0.88     | 0.8966 | 0.9123    | 0.8814 |
+| 0.5967        | 1.0   | 7    | 0.3370          | 0.86     | 0.8727 | 0.9412    | 0.8136 |
+| 0.3255        | 2.0   | 14   | 0.3018          | 0.88     | 0.9016 | 0.8730    | 0.9322 |
+| 0.2274        | 3.0   | 21   | 0.3502          | 0.89     | 0.9076 | 0.9       | 0.9153 |
+| 0.0835        | 4.0   | 28   | 0.4278          | 0.88     | 0.8889 | 0.9796    | 0.8136 |
+| 0.0568        | 5.0   | 35   | 0.7164          | 0.82     | 0.8571 | 0.8060    | 0.9153 |
+| 0.0979        | 6.0   | 42   | 0.3929          | 0.88     | 0.8909 | 0.9608    | 0.8305 |
+| 0.0374        | 7.0   | 49   | 0.4090          | 0.9      | 0.9153 | 0.9153    | 0.9153 |
+| 0.0208        | 8.0   | 56   | 0.5139          | 0.9      | 0.9153 | 0.9153    | 0.9153 |
+| 0.0216        | 9.0   | 63   | 0.4479          | 0.91     | 0.9217 | 0.9464    | 0.8983 |
+| 0.0114        | 10.0  | 70   | 0.4448          | 0.91     | 0.9217 | 0.9464    | 0.8983 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:51e4ab5b823d7fa281f9af1439beeafd0961806f6088cfe43cc2697baa488145
+oid sha256:be9b616d87c408a87b5bb0e843549408941719f6a9380e1fb22c6e902405b5a1
 size 672708608

runs/Aug05_16-28-21_49d74c1f1623/events.out.tfevents.1722875302.49d74c1f1623.226.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0871197323ea7f3faad65428b0fbf46e3378fca5096d08b6641ccae76b0eb5f8
+size 12210

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:140e90b51eaa0f352864c1728f09e194c7d52d6f1948007d4a5b613793c3d08c
+oid sha256:ca9c7dab4a2f32f99722937ea39c9998ae24ba2a0f6ab46789a6a265e4d339e3
 size 5112