update model card README.md
Browse files
README.md
CHANGED
|
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
-
- Loss: 0.
|
| 21 |
-
- Accuracy: 0.
|
| 22 |
|
| 23 |
## Model description
|
| 24 |
|
|
@@ -43,163 +43,163 @@ The following hyperparameters were used during training:
|
|
| 43 |
- seed: 42
|
| 44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 45 |
- lr_scheduler_type: linear
|
| 46 |
-
- lr_scheduler_warmup_steps:
|
| 47 |
- num_epochs: 150
|
| 48 |
|
| 49 |
### Training results
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
| 53 |
-
| No log | 1.0 | 1 | 0.
|
| 54 |
-
| No log | 2.0 | 2 | 0.
|
| 55 |
-
| No log | 3.0 | 3 | 0.
|
| 56 |
-
| No log | 4.0 | 4 | 0.
|
| 57 |
-
| No log | 5.0 | 5 | 0.
|
| 58 |
-
| No log | 6.0 | 6 | 0.
|
| 59 |
-
| No log | 7.0 | 7 | 0.
|
| 60 |
-
| No log | 8.0 | 8 | 0.
|
| 61 |
-
| No log | 9.0 | 9 | 0.
|
| 62 |
-
| 0.
|
| 63 |
-
| 0.
|
| 64 |
-
| 0.
|
| 65 |
-
| 0.
|
| 66 |
-
| 0.
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
| 69 |
-
| 0.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
| 72 |
-
| 0.
|
| 73 |
-
| 0.
|
| 74 |
-
| 0.
|
| 75 |
-
| 0.
|
| 76 |
-
| 0.
|
| 77 |
-
| 0.
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
-
| 0.
|
| 82 |
-
| 0.
|
| 83 |
-
| 0.
|
| 84 |
-
| 0.
|
| 85 |
-
| 0.
|
| 86 |
-
| 0.
|
| 87 |
-
| 0.
|
| 88 |
-
| 0.
|
| 89 |
-
| 0.
|
| 90 |
-
| 0.
|
| 91 |
-
| 0.
|
| 92 |
-
| 0.
|
| 93 |
-
| 0.
|
| 94 |
-
| 0.
|
| 95 |
-
| 0.
|
| 96 |
-
| 0.
|
| 97 |
-
| 0.
|
| 98 |
-
| 0.
|
| 99 |
-
| 0.
|
| 100 |
-
| 0.
|
| 101 |
-
| 0.
|
| 102 |
-
| 0.
|
| 103 |
-
| 0.
|
| 104 |
-
| 0.
|
| 105 |
-
| 0.
|
| 106 |
-
| 0.
|
| 107 |
-
| 0.
|
| 108 |
-
| 0.
|
| 109 |
-
| 0.
|
| 110 |
-
| 0.
|
| 111 |
-
| 0.
|
| 112 |
-
| 0.
|
| 113 |
-
| 0.
|
| 114 |
-
| 0.
|
| 115 |
-
| 0.
|
| 116 |
-
| 0.
|
| 117 |
-
| 0.
|
| 118 |
-
| 0.
|
| 119 |
-
| 0.
|
| 120 |
-
| 0.
|
| 121 |
-
| 0.
|
| 122 |
-
| 0.
|
| 123 |
-
| 0.
|
| 124 |
-
| 0.
|
| 125 |
-
| 0.
|
| 126 |
-
| 0.
|
| 127 |
-
| 0.
|
| 128 |
-
| 0.
|
| 129 |
-
| 0.
|
| 130 |
-
| 0.
|
| 131 |
-
| 0.
|
| 132 |
-
| 0.
|
| 133 |
-
| 0.
|
| 134 |
-
| 0.
|
| 135 |
-
| 0.
|
| 136 |
-
| 0.
|
| 137 |
-
| 0.
|
| 138 |
-
| 0.
|
| 139 |
-
| 0.
|
| 140 |
-
| 0.
|
| 141 |
-
| 0.
|
| 142 |
-
| 0.
|
| 143 |
-
| 0.
|
| 144 |
-
| 0.
|
| 145 |
-
| 0.
|
| 146 |
-
| 0.
|
| 147 |
-
| 0.
|
| 148 |
-
| 0.
|
| 149 |
-
| 0.
|
| 150 |
-
| 0.
|
| 151 |
-
| 0.
|
| 152 |
-
| 0.
|
| 153 |
-
| 0.
|
| 154 |
-
| 0.
|
| 155 |
-
| 0.
|
| 156 |
-
| 0.
|
| 157 |
-
| 0.
|
| 158 |
-
| 0.
|
| 159 |
-
| 0.
|
| 160 |
-
| 0.
|
| 161 |
-
| 0.
|
| 162 |
-
| 0.
|
| 163 |
-
| 0.
|
| 164 |
-
| 0.
|
| 165 |
-
| 0.
|
| 166 |
-
| 0.
|
| 167 |
-
| 0.
|
| 168 |
-
| 0.
|
| 169 |
-
| 0.
|
| 170 |
-
| 0.
|
| 171 |
-
| 0.
|
| 172 |
-
| 0.
|
| 173 |
-
| 0.
|
| 174 |
-
| 0.
|
| 175 |
-
| 0.
|
| 176 |
-
| 0.
|
| 177 |
-
| 0.
|
| 178 |
-
| 0.
|
| 179 |
-
| 0.
|
| 180 |
-
| 0.
|
| 181 |
-
| 0.
|
| 182 |
-
| 0.
|
| 183 |
-
| 0.
|
| 184 |
-
| 0.
|
| 185 |
-
| 0.
|
| 186 |
-
| 0.
|
| 187 |
-
| 0.
|
| 188 |
-
| 0.
|
| 189 |
-
| 0.
|
| 190 |
-
| 0.
|
| 191 |
-
| 0.
|
| 192 |
-
| 0.
|
| 193 |
-
| 0.
|
| 194 |
-
| 0.
|
| 195 |
-
| 0.
|
| 196 |
-
| 0.
|
| 197 |
-
| 0.
|
| 198 |
-
| 0.
|
| 199 |
-
| 0.
|
| 200 |
-
| 0.
|
| 201 |
-
| 0.
|
| 202 |
-
| 0.
|
| 203 |
|
| 204 |
|
| 205 |
### Framework versions
|
|
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 0.5049
|
| 21 |
+
- Accuracy: 0.8125
|
| 22 |
|
| 23 |
## Model description
|
| 24 |
|
|
|
|
| 43 |
- seed: 42
|
| 44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 45 |
- lr_scheduler_type: linear
|
| 46 |
+
- lr_scheduler_warmup_steps: 50
|
| 47 |
- num_epochs: 150
|
| 48 |
|
| 49 |
### Training results
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
| 53 |
+
| No log | 1.0 | 1 | 0.7051 | 0.5312 |
|
| 54 |
+
| No log | 2.0 | 2 | 0.7048 | 0.5312 |
|
| 55 |
+
| No log | 3.0 | 3 | 0.7041 | 0.5312 |
|
| 56 |
+
| No log | 4.0 | 4 | 0.7029 | 0.5312 |
|
| 57 |
+
| No log | 5.0 | 5 | 0.7014 | 0.5625 |
|
| 58 |
+
| No log | 6.0 | 6 | 0.6996 | 0.5625 |
|
| 59 |
+
| No log | 7.0 | 7 | 0.6975 | 0.5625 |
|
| 60 |
+
| No log | 8.0 | 8 | 0.6951 | 0.5625 |
|
| 61 |
+
| No log | 9.0 | 9 | 0.6922 | 0.5625 |
|
| 62 |
+
| 0.7427 | 10.0 | 10 | 0.6891 | 0.5625 |
|
| 63 |
+
| 0.7427 | 11.0 | 11 | 0.6857 | 0.5625 |
|
| 64 |
+
| 0.7427 | 12.0 | 12 | 0.6820 | 0.5625 |
|
| 65 |
+
| 0.7427 | 13.0 | 13 | 0.6781 | 0.5625 |
|
| 66 |
+
| 0.7427 | 14.0 | 14 | 0.6740 | 0.5625 |
|
| 67 |
+
| 0.7427 | 15.0 | 15 | 0.6698 | 0.5312 |
|
| 68 |
+
| 0.7427 | 16.0 | 16 | 0.6658 | 0.5938 |
|
| 69 |
+
| 0.7427 | 17.0 | 17 | 0.6621 | 0.5625 |
|
| 70 |
+
| 0.7427 | 18.0 | 18 | 0.6585 | 0.5625 |
|
| 71 |
+
| 0.7427 | 19.0 | 19 | 0.6550 | 0.6562 |
|
| 72 |
+
| 0.6663 | 20.0 | 20 | 0.6516 | 0.6562 |
|
| 73 |
+
| 0.6663 | 21.0 | 21 | 0.6489 | 0.7188 |
|
| 74 |
+
| 0.6663 | 22.0 | 22 | 0.6471 | 0.7188 |
|
| 75 |
+
| 0.6663 | 23.0 | 23 | 0.6465 | 0.75 |
|
| 76 |
+
| 0.6663 | 24.0 | 24 | 0.6465 | 0.75 |
|
| 77 |
+
| 0.6663 | 25.0 | 25 | 0.6461 | 0.7188 |
|
| 78 |
+
| 0.6663 | 26.0 | 26 | 0.6450 | 0.7188 |
|
| 79 |
+
| 0.6663 | 27.0 | 27 | 0.6427 | 0.6875 |
|
| 80 |
+
| 0.6663 | 28.0 | 28 | 0.6394 | 0.6875 |
|
| 81 |
+
| 0.6663 | 29.0 | 29 | 0.6358 | 0.7188 |
|
| 82 |
+
| 0.5394 | 30.0 | 30 | 0.6319 | 0.75 |
|
| 83 |
+
| 0.5394 | 31.0 | 31 | 0.6279 | 0.75 |
|
| 84 |
+
| 0.5394 | 32.0 | 32 | 0.6244 | 0.7812 |
|
| 85 |
+
| 0.5394 | 33.0 | 33 | 0.6207 | 0.7812 |
|
| 86 |
+
| 0.5394 | 34.0 | 34 | 0.6169 | 0.7812 |
|
| 87 |
+
| 0.5394 | 35.0 | 35 | 0.6131 | 0.7812 |
|
| 88 |
+
| 0.5394 | 36.0 | 36 | 0.6096 | 0.7812 |
|
| 89 |
+
| 0.5394 | 37.0 | 37 | 0.6057 | 0.7812 |
|
| 90 |
+
| 0.5394 | 38.0 | 38 | 0.6028 | 0.7812 |
|
| 91 |
+
| 0.5394 | 39.0 | 39 | 0.6010 | 0.75 |
|
| 92 |
+
| 0.3922 | 40.0 | 40 | 0.5975 | 0.75 |
|
| 93 |
+
| 0.3922 | 41.0 | 41 | 0.5941 | 0.75 |
|
| 94 |
+
| 0.3922 | 42.0 | 42 | 0.5902 | 0.75 |
|
| 95 |
+
| 0.3922 | 43.0 | 43 | 0.5854 | 0.75 |
|
| 96 |
+
| 0.3922 | 44.0 | 44 | 0.5800 | 0.75 |
|
| 97 |
+
| 0.3922 | 45.0 | 45 | 0.5768 | 0.7188 |
|
| 98 |
+
| 0.3922 | 46.0 | 46 | 0.5747 | 0.7188 |
|
| 99 |
+
| 0.3922 | 47.0 | 47 | 0.5743 | 0.7188 |
|
| 100 |
+
| 0.3922 | 48.0 | 48 | 0.5765 | 0.7188 |
|
| 101 |
+
| 0.3922 | 49.0 | 49 | 0.5779 | 0.6875 |
|
| 102 |
+
| 0.2715 | 50.0 | 50 | 0.5813 | 0.7188 |
|
| 103 |
+
| 0.2715 | 51.0 | 51 | 0.5839 | 0.6875 |
|
| 104 |
+
| 0.2715 | 52.0 | 52 | 0.5857 | 0.7188 |
|
| 105 |
+
| 0.2715 | 53.0 | 53 | 0.5916 | 0.7188 |
|
| 106 |
+
| 0.2715 | 54.0 | 54 | 0.5986 | 0.75 |
|
| 107 |
+
| 0.2715 | 55.0 | 55 | 0.6033 | 0.75 |
|
| 108 |
+
| 0.2715 | 56.0 | 56 | 0.6016 | 0.75 |
|
| 109 |
+
| 0.2715 | 57.0 | 57 | 0.6004 | 0.75 |
|
| 110 |
+
| 0.2715 | 58.0 | 58 | 0.5928 | 0.75 |
|
| 111 |
+
| 0.2715 | 59.0 | 59 | 0.5860 | 0.7812 |
|
| 112 |
+
| 0.174 | 60.0 | 60 | 0.5795 | 0.75 |
|
| 113 |
+
| 0.174 | 61.0 | 61 | 0.5707 | 0.75 |
|
| 114 |
+
| 0.174 | 62.0 | 62 | 0.5629 | 0.7188 |
|
| 115 |
+
| 0.174 | 63.0 | 63 | 0.5578 | 0.6875 |
|
| 116 |
+
| 0.174 | 64.0 | 64 | 0.5535 | 0.7188 |
|
| 117 |
+
| 0.174 | 65.0 | 65 | 0.5498 | 0.7188 |
|
| 118 |
+
| 0.174 | 66.0 | 66 | 0.5468 | 0.7188 |
|
| 119 |
+
| 0.174 | 67.0 | 67 | 0.5436 | 0.7188 |
|
| 120 |
+
| 0.174 | 68.0 | 68 | 0.5404 | 0.7188 |
|
| 121 |
+
| 0.174 | 69.0 | 69 | 0.5373 | 0.7188 |
|
| 122 |
+
| 0.1107 | 70.0 | 70 | 0.5353 | 0.7188 |
|
| 123 |
+
| 0.1107 | 71.0 | 71 | 0.5327 | 0.7188 |
|
| 124 |
+
| 0.1107 | 72.0 | 72 | 0.5292 | 0.7188 |
|
| 125 |
+
| 0.1107 | 73.0 | 73 | 0.5243 | 0.75 |
|
| 126 |
+
| 0.1107 | 74.0 | 74 | 0.5187 | 0.75 |
|
| 127 |
+
| 0.1107 | 75.0 | 75 | 0.5131 | 0.75 |
|
| 128 |
+
| 0.1107 | 76.0 | 76 | 0.5081 | 0.75 |
|
| 129 |
+
| 0.1107 | 77.0 | 77 | 0.5036 | 0.75 |
|
| 130 |
+
| 0.1107 | 78.0 | 78 | 0.5005 | 0.75 |
|
| 131 |
+
| 0.1107 | 79.0 | 79 | 0.4982 | 0.7812 |
|
| 132 |
+
| 0.0742 | 80.0 | 80 | 0.4970 | 0.8438 |
|
| 133 |
+
| 0.0742 | 81.0 | 81 | 0.4958 | 0.8438 |
|
| 134 |
+
| 0.0742 | 82.0 | 82 | 0.4939 | 0.8438 |
|
| 135 |
+
| 0.0742 | 83.0 | 83 | 0.4908 | 0.8438 |
|
| 136 |
+
| 0.0742 | 84.0 | 84 | 0.4873 | 0.8125 |
|
| 137 |
+
| 0.0742 | 85.0 | 85 | 0.4840 | 0.8125 |
|
| 138 |
+
| 0.0742 | 86.0 | 86 | 0.4814 | 0.8125 |
|
| 139 |
+
| 0.0742 | 87.0 | 87 | 0.4790 | 0.8125 |
|
| 140 |
+
| 0.0742 | 88.0 | 88 | 0.4769 | 0.8125 |
|
| 141 |
+
| 0.0742 | 89.0 | 89 | 0.4750 | 0.8125 |
|
| 142 |
+
| 0.0494 | 90.0 | 90 | 0.4742 | 0.8125 |
|
| 143 |
+
| 0.0494 | 91.0 | 91 | 0.4737 | 0.8125 |
|
| 144 |
+
| 0.0494 | 92.0 | 92 | 0.4731 | 0.8125 |
|
| 145 |
+
| 0.0494 | 93.0 | 93 | 0.4726 | 0.8125 |
|
| 146 |
+
| 0.0494 | 94.0 | 94 | 0.4722 | 0.8125 |
|
| 147 |
+
| 0.0494 | 95.0 | 95 | 0.4720 | 0.8125 |
|
| 148 |
+
| 0.0494 | 96.0 | 96 | 0.4720 | 0.8125 |
|
| 149 |
+
| 0.0494 | 97.0 | 97 | 0.4715 | 0.8125 |
|
| 150 |
+
| 0.0494 | 98.0 | 98 | 0.4712 | 0.8125 |
|
| 151 |
+
| 0.0494 | 99.0 | 99 | 0.4710 | 0.8125 |
|
| 152 |
+
| 0.0331 | 100.0 | 100 | 0.4709 | 0.8125 |
|
| 153 |
+
| 0.0331 | 101.0 | 101 | 0.4711 | 0.8125 |
|
| 154 |
+
| 0.0331 | 102.0 | 102 | 0.4715 | 0.8125 |
|
| 155 |
+
| 0.0331 | 103.0 | 103 | 0.4725 | 0.8125 |
|
| 156 |
+
| 0.0331 | 104.0 | 104 | 0.4734 | 0.8125 |
|
| 157 |
+
| 0.0331 | 105.0 | 105 | 0.4742 | 0.8125 |
|
| 158 |
+
| 0.0331 | 106.0 | 106 | 0.4752 | 0.8125 |
|
| 159 |
+
| 0.0331 | 107.0 | 107 | 0.4761 | 0.8125 |
|
| 160 |
+
| 0.0331 | 108.0 | 108 | 0.4770 | 0.8125 |
|
| 161 |
+
| 0.0331 | 109.0 | 109 | 0.4780 | 0.8125 |
|
| 162 |
+
| 0.0246 | 110.0 | 110 | 0.4789 | 0.8125 |
|
| 163 |
+
| 0.0246 | 111.0 | 111 | 0.4804 | 0.8125 |
|
| 164 |
+
| 0.0246 | 112.0 | 112 | 0.4817 | 0.8125 |
|
| 165 |
+
| 0.0246 | 113.0 | 113 | 0.4829 | 0.8125 |
|
| 166 |
+
| 0.0246 | 114.0 | 114 | 0.4842 | 0.8125 |
|
| 167 |
+
| 0.0246 | 115.0 | 115 | 0.4851 | 0.8125 |
|
| 168 |
+
| 0.0246 | 116.0 | 116 | 0.4863 | 0.8125 |
|
| 169 |
+
| 0.0246 | 117.0 | 117 | 0.4880 | 0.8125 |
|
| 170 |
+
| 0.0246 | 118.0 | 118 | 0.4897 | 0.8125 |
|
| 171 |
+
| 0.0246 | 119.0 | 119 | 0.4913 | 0.8125 |
|
| 172 |
+
| 0.0191 | 120.0 | 120 | 0.4930 | 0.8125 |
|
| 173 |
+
| 0.0191 | 121.0 | 121 | 0.4945 | 0.8125 |
|
| 174 |
+
| 0.0191 | 122.0 | 122 | 0.4959 | 0.8125 |
|
| 175 |
+
| 0.0191 | 123.0 | 123 | 0.4971 | 0.8125 |
|
| 176 |
+
| 0.0191 | 124.0 | 124 | 0.4984 | 0.8125 |
|
| 177 |
+
| 0.0191 | 125.0 | 125 | 0.4995 | 0.8125 |
|
| 178 |
+
| 0.0191 | 126.0 | 126 | 0.5004 | 0.8125 |
|
| 179 |
+
| 0.0191 | 127.0 | 127 | 0.5014 | 0.8125 |
|
| 180 |
+
| 0.0191 | 128.0 | 128 | 0.5021 | 0.8125 |
|
| 181 |
+
| 0.0191 | 129.0 | 129 | 0.5027 | 0.8125 |
|
| 182 |
+
| 0.0163 | 130.0 | 130 | 0.5031 | 0.8125 |
|
| 183 |
+
| 0.0163 | 131.0 | 131 | 0.5031 | 0.8125 |
|
| 184 |
+
| 0.0163 | 132.0 | 132 | 0.5034 | 0.8125 |
|
| 185 |
+
| 0.0163 | 133.0 | 133 | 0.5035 | 0.8125 |
|
| 186 |
+
| 0.0163 | 134.0 | 134 | 0.5036 | 0.8125 |
|
| 187 |
+
| 0.0163 | 135.0 | 135 | 0.5036 | 0.8125 |
|
| 188 |
+
| 0.0163 | 136.0 | 136 | 0.5037 | 0.8125 |
|
| 189 |
+
| 0.0163 | 137.0 | 137 | 0.5038 | 0.8125 |
|
| 190 |
+
| 0.0163 | 138.0 | 138 | 0.5040 | 0.8125 |
|
| 191 |
+
| 0.0163 | 139.0 | 139 | 0.5043 | 0.8125 |
|
| 192 |
+
| 0.0147 | 140.0 | 140 | 0.5044 | 0.8125 |
|
| 193 |
+
| 0.0147 | 141.0 | 141 | 0.5046 | 0.8125 |
|
| 194 |
+
| 0.0147 | 142.0 | 142 | 0.5047 | 0.8125 |
|
| 195 |
+
| 0.0147 | 143.0 | 143 | 0.5049 | 0.8125 |
|
| 196 |
+
| 0.0147 | 144.0 | 144 | 0.5049 | 0.8125 |
|
| 197 |
+
| 0.0147 | 145.0 | 145 | 0.5049 | 0.8125 |
|
| 198 |
+
| 0.0147 | 146.0 | 146 | 0.5049 | 0.8125 |
|
| 199 |
+
| 0.0147 | 147.0 | 147 | 0.5049 | 0.8125 |
|
| 200 |
+
| 0.0147 | 148.0 | 148 | 0.5049 | 0.8125 |
|
| 201 |
+
| 0.0147 | 149.0 | 149 | 0.5049 | 0.8125 |
|
| 202 |
+
| 0.0138 | 150.0 | 150 | 0.5049 | 0.8125 |
|
| 203 |
|
| 204 |
|
| 205 |
### Framework versions
|