End of training

README.md

@@ -1,5 +1,6 @@
 ---
-base_model: arnabdhar/tinybert-ner
+license: mit
+base_model: microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext
 tags:
 - generated_from_trainer
 datasets:
@@ -24,16 +25,16 @@ model-index:
     metrics:
     - name: Precision
       type: precision
-      value: 0.4722222222222222
+      value: 0.8456973293768546
     - name: Recall
       type: recall
-      value: 0.40729166666666666
+      value: 0.890625
     - name: F1
       type: f1
-      value: 0.43736017897091717
+      value: 0.8675799086757991
     - name: Accuracy
       type: accuracy
-      value: 0.9466873494713638
+      value: 0.9850593950279626
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -41,13 +42,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 # checkpoint-1000
 
-This model is a fine-tuned version of [arnabdhar/tinybert-ner](https://huggingface.co/arnabdhar/tinybert-ner) on the ncbi_disease dataset.
+This model is a fine-tuned version of [microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext) on the ncbi_disease dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1611
-- Precision: 0.4722
-- Recall: 0.4073
-- F1: 0.4374
-- Accuracy: 0.9467
+- Loss: 0.0543
+- Precision: 0.8457
+- Recall: 0.8906
+- F1: 0.8676
+- Accuracy: 0.9851
 
 ## Model description
 
@@ -78,10 +79,10 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| No log        | 1.0   | 340  | 0.2055          | 0.2744    | 0.1521 | 0.1957 | 0.9318   |
-| 0.2656        | 2.0   | 680  | 0.1761          | 0.4051    | 0.3    | 0.3447 | 0.9417   |
-| 0.1738        | 3.0   | 1020 | 0.1638          | 0.4582    | 0.4    | 0.4271 | 0.9455   |
-| 0.1738        | 4.0   | 1360 | 0.1611          | 0.4722    | 0.4073 | 0.4374 | 0.9467   |
+| No log        | 1.0   | 340  | 0.0596          | 0.7778    | 0.875  | 0.8235 | 0.9795   |
+| 0.0787        | 2.0   | 680  | 0.0416          | 0.8246    | 0.8865 | 0.8544 | 0.9851   |
+| 0.0202        | 3.0   | 1020 | 0.0494          | 0.8385    | 0.8812 | 0.8593 | 0.9846   |
+| 0.0202        | 4.0   | 1360 | 0.0543          | 0.8457    | 0.8906 | 0.8676 | 0.9851   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e1e6e8e2c3f40544d0100e5da2e3458c015d000d4ae91d22ef7e7c77bda74680
+oid sha256:0069d4c5f36b8604096c8fb6e450de23169179a49baa15ca16263b74a479e724
 size 435599164

runs/Nov27_17-15-13_0289733fd6c3/events.out.tfevents.1701105421.0289733fd6c3.579.3

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:828a25d821f59b32ff81ed9547dd2a5fd1bdb508a11fc0c2111ba66be6c067b1
-size 6157
+oid sha256:767f5d1d484fb7e7b69b557fccb276a3b7f766e8847e74d45467c62afad3c506
+size 6983