Hugging Face's logo

elopezlopez
/
Bio_ClinicalBERT_fold_1_binary_v1

Text Classification
Transformers
PyTorch
TensorBoard
bert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
1
elopezlopez commited on
Commit
10d5ef8
·
1 Parent(s): 4b1b06a

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -27
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.7322
20
- - F1: 0.8131
21
 
22
  ## Model description
23
 
@@ -48,31 +48,31 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | F1 |
50
  |:-------------:|:-----:|:----:|:---------------:|:------:|
51
- | No log | 1.0 | 288 | 0.4195 | 0.8033 |
52
- | 0.3947 | 2.0 | 576 | 0.4000 | 0.8193 |
53
- | 0.3947 | 3.0 | 864 | 0.6877 | 0.7952 |
54
- | 0.1822 | 4.0 | 1152 | 0.8430 | 0.8126 |
55
- | 0.1822 | 5.0 | 1440 | 0.9751 | 0.7999 |
56
- | 0.0766 | 6.0 | 1728 | 1.1384 | 0.8130 |
57
- | 0.0279 | 7.0 | 2016 | 1.2097 | 0.8021 |
58
- | 0.0279 | 8.0 | 2304 | 1.5105 | 0.7969 |
59
- | 0.0164 | 9.0 | 2592 | 1.5203 | 0.8010 |
60
- | 0.0164 | 10.0 | 2880 | 1.5394 | 0.7967 |
61
- | 0.0111 | 11.0 | 3168 | 1.6315 | 0.8011 |
62
- | 0.0111 | 12.0 | 3456 | 1.6380 | 0.7996 |
63
- | 0.0071 | 13.0 | 3744 | 1.6066 | 0.8095 |
64
- | 0.0067 | 14.0 | 4032 | 1.6603 | 0.8127 |
65
- | 0.0067 | 15.0 | 4320 | 1.6588 | 0.8088 |
66
- | 0.0053 | 16.0 | 4608 | 1.6856 | 0.8019 |
67
- | 0.0053 | 17.0 | 4896 | 1.7031 | 0.8113 |
68
- | 0.0056 | 18.0 | 5184 | 1.6708 | 0.8019 |
69
- | 0.0056 | 19.0 | 5472 | 1.6937 | 0.8135 |
70
- | 0.0048 | 20.0 | 5760 | 1.6495 | 0.8028 |
71
- | 0.0044 | 21.0 | 6048 | 1.5817 | 0.8108 |
72
- | 0.0044 | 22.0 | 6336 | 1.6462 | 0.8177 |
73
- | 0.0 | 23.0 | 6624 | 1.6896 | 0.8122 |
74
- | 0.0 | 24.0 | 6912 | 1.7274 | 0.8122 |
75
- | 0.0001 | 25.0 | 7200 | 1.7322 | 0.8131 |
76
 
77
 
78
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.7063
20
+ - F1: 0.8114
21
 
22
  ## Model description
23
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | F1 |
50
  |:-------------:|:-----:|:----:|:---------------:|:------:|
51
+ | No log | 1.0 | 288 | 0.4168 | 0.7949 |
52
+ | 0.3981 | 2.0 | 576 | 0.4124 | 0.8137 |
53
+ | 0.3981 | 3.0 | 864 | 0.6691 | 0.8002 |
54
+ | 0.1779 | 4.0 | 1152 | 0.8402 | 0.8122 |
55
+ | 0.1779 | 5.0 | 1440 | 0.9786 | 0.8007 |
56
+ | 0.082 | 6.0 | 1728 | 1.0425 | 0.7981 |
57
+ | 0.0332 | 7.0 | 2016 | 1.2070 | 0.8006 |
58
+ | 0.0332 | 8.0 | 2304 | 1.3305 | 0.8028 |
59
+ | 0.0149 | 9.0 | 2592 | 1.4515 | 0.8009 |
60
+ | 0.0149 | 10.0 | 2880 | 1.3826 | 0.8160 |
61
+ | 0.01 | 11.0 | 3168 | 1.5267 | 0.7963 |
62
+ | 0.01 | 12.0 | 3456 | 1.5158 | 0.8112 |
63
+ | 0.0084 | 13.0 | 3744 | 1.5919 | 0.7998 |
64
+ | 0.0027 | 14.0 | 4032 | 1.6206 | 0.8060 |
65
+ | 0.0027 | 15.0 | 4320 | 1.6861 | 0.8014 |
66
+ | 0.0061 | 16.0 | 4608 | 1.6660 | 0.8001 |
67
+ | 0.0061 | 17.0 | 4896 | 1.5061 | 0.8054 |
68
+ | 0.0133 | 18.0 | 5184 | 1.5813 | 0.8025 |
69
+ | 0.0133 | 19.0 | 5472 | 1.6314 | 0.7968 |
70
+ | 0.0032 | 20.0 | 5760 | 1.6282 | 0.8117 |
71
+ | 0.0007 | 21.0 | 6048 | 1.6378 | 0.8153 |
72
+ | 0.0007 | 22.0 | 6336 | 1.6710 | 0.8033 |
73
+ | 0.0018 | 23.0 | 6624 | 1.6999 | 0.8066 |
74
+ | 0.0018 | 24.0 | 6912 | 1.7045 | 0.8109 |
75
+ | 0.0001 | 25.0 | 7200 | 1.7063 | 0.8114 |
76
 
77
 
78
  ### Framework versions