jon-t/bio-mqa

README.md

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.0528
-- Accuracy: 0.5432
+- Loss: 1.3863
+- Accuracy: 0.2451
 
 ## Model description
 
@@ -44,13 +44,17 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 1
+- num_epochs: 5
 
 ### Training results
 
 | Training Loss | Epoch | Step  | Validation Loss | Accuracy |
 |:-------------:|:-----:|:-----:|:---------------:|:--------:|
-| 1.0855        | 1.0   | 18387 | 1.0528          | 0.5432   |
+| 1.3898        | 1.0   | 18387 | 1.3863          | 0.2508   |
+| 1.3894        | 2.0   | 36774 | 1.3863          | 0.2453   |
+| 1.3907        | 3.0   | 55161 | 1.3863          | 0.2480   |
+| 1.3882        | 4.0   | 73548 | 1.3863          | 0.2487   |
+| 1.3876        | 5.0   | 91935 | 1.3863          | 0.2451   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:32b6d0ac6c9fc4cb863f23b0467a99a19796fadd35b5a203c7ce0e0f3c9c571e
+oid sha256:0b57172430731feddd8f9e0bd11e56123ef704c23faafbdffb9d39b41f22e845
 size 433267692

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:63665d599fdea5ff1d1a586bc175ec59709bfd0213c126e5259fb39721b12b98
+oid sha256:2f6699a79778fcfae1f4441711e310d71911ade3010d9e28ffc7bdfa51a020fd
 size 5240