| | --- |
| | library_name: transformers |
| | base_model: aubmindlab/bert-base-arabertv02 |
| | tags: |
| | - generated_from_trainer |
| | model-index: |
| | - name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask2_mechanics |
| | results: [] |
| | --- |
| | |
| | <!-- This model card has been generated automatically according to the information the Trainer had access to. You |
| | should probably proofread and complete it, then remove this comment. --> |
| |
|
| | # Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask2_mechanics |
| | |
| | This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset. |
| | It achieves the following results on the evaluation set: |
| | - Loss: 0.5455 |
| | - Qwk: 0.5691 |
| | - Mse: 0.5455 |
| | - Rmse: 0.7386 |
| | |
| | ## Model description |
| | |
| | More information needed |
| | |
| | ## Intended uses & limitations |
| | |
| | More information needed |
| | |
| | ## Training and evaluation data |
| | |
| | More information needed |
| | |
| | ## Training procedure |
| | |
| | ### Training hyperparameters |
| | |
| | The following hyperparameters were used during training: |
| | - learning_rate: 2e-05 |
| | - train_batch_size: 8 |
| | - eval_batch_size: 8 |
| | - seed: 42 |
| | - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
| | - lr_scheduler_type: linear |
| | - num_epochs: 100 |
| | |
| | ### Training results |
| | |
| | | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse | |
| | |:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:| |
| | | No log | 0.0213 | 2 | 3.6715 | 0.0220 | 3.6715 | 1.9161 | |
| | | No log | 0.0426 | 4 | 2.8563 | 0.0503 | 2.8563 | 1.6901 | |
| | | No log | 0.0638 | 6 | 1.2401 | 0.1393 | 1.2401 | 1.1136 | |
| | | No log | 0.0851 | 8 | 0.6320 | 0.3124 | 0.6320 | 0.7950 | |
| | | No log | 0.1064 | 10 | 0.6755 | 0.1823 | 0.6755 | 0.8219 | |
| | | No log | 0.1277 | 12 | 0.6662 | 0.3674 | 0.6662 | 0.8162 | |
| | | No log | 0.1489 | 14 | 0.6873 | 0.4927 | 0.6873 | 0.8290 | |
| | | No log | 0.1702 | 16 | 0.7652 | 0.4506 | 0.7652 | 0.8747 | |
| | | No log | 0.1915 | 18 | 0.6937 | 0.4862 | 0.6937 | 0.8329 | |
| | | No log | 0.2128 | 20 | 0.6393 | 0.5286 | 0.6393 | 0.7995 | |
| | | No log | 0.2340 | 22 | 0.6497 | 0.5065 | 0.6497 | 0.8061 | |
| | | No log | 0.2553 | 24 | 0.5188 | 0.5033 | 0.5188 | 0.7203 | |
| | | No log | 0.2766 | 26 | 0.5712 | 0.4637 | 0.5712 | 0.7558 | |
| | | No log | 0.2979 | 28 | 0.5273 | 0.4938 | 0.5273 | 0.7262 | |
| | | No log | 0.3191 | 30 | 0.5406 | 0.4374 | 0.5406 | 0.7353 | |
| | | No log | 0.3404 | 32 | 0.5355 | 0.4394 | 0.5355 | 0.7318 | |
| | | No log | 0.3617 | 34 | 0.5206 | 0.4111 | 0.5206 | 0.7215 | |
| | | No log | 0.3830 | 36 | 0.5333 | 0.3941 | 0.5333 | 0.7303 | |
| | | No log | 0.4043 | 38 | 0.5406 | 0.4039 | 0.5406 | 0.7353 | |
| | | No log | 0.4255 | 40 | 0.5325 | 0.4156 | 0.5325 | 0.7297 | |
| | | No log | 0.4468 | 42 | 0.5373 | 0.4246 | 0.5373 | 0.7330 | |
| | | No log | 0.4681 | 44 | 0.5923 | 0.2852 | 0.5923 | 0.7696 | |
| | | No log | 0.4894 | 46 | 0.6183 | 0.2807 | 0.6183 | 0.7863 | |
| | | No log | 0.5106 | 48 | 0.6858 | 0.2402 | 0.6858 | 0.8281 | |
| | | No log | 0.5319 | 50 | 0.6494 | 0.3082 | 0.6494 | 0.8058 | |
| | | No log | 0.5532 | 52 | 0.5569 | 0.4049 | 0.5569 | 0.7463 | |
| | | No log | 0.5745 | 54 | 0.4656 | 0.5388 | 0.4656 | 0.6823 | |
| | | No log | 0.5957 | 56 | 0.4648 | 0.5786 | 0.4648 | 0.6818 | |
| | | No log | 0.6170 | 58 | 0.4398 | 0.5717 | 0.4398 | 0.6632 | |
| | | No log | 0.6383 | 60 | 0.4197 | 0.5555 | 0.4197 | 0.6478 | |
| | | No log | 0.6596 | 62 | 0.4172 | 0.5539 | 0.4172 | 0.6459 | |
| | | No log | 0.6809 | 64 | 0.4408 | 0.6286 | 0.4408 | 0.6639 | |
| | | No log | 0.7021 | 66 | 0.5555 | 0.6009 | 0.5555 | 0.7453 | |
| | | No log | 0.7234 | 68 | 0.7550 | 0.5525 | 0.7550 | 0.8689 | |
| | | No log | 0.7447 | 70 | 0.8124 | 0.5613 | 0.8124 | 0.9013 | |
| | | No log | 0.7660 | 72 | 0.6974 | 0.5848 | 0.6974 | 0.8351 | |
| | | No log | 0.7872 | 74 | 0.6234 | 0.6201 | 0.6234 | 0.7895 | |
| | | No log | 0.8085 | 76 | 0.5605 | 0.6280 | 0.5605 | 0.7487 | |
| | | No log | 0.8298 | 78 | 0.4423 | 0.6579 | 0.4423 | 0.6651 | |
| | | No log | 0.8511 | 80 | 0.5967 | 0.5139 | 0.5967 | 0.7724 | |
| | | No log | 0.8723 | 82 | 0.6308 | 0.4865 | 0.6308 | 0.7942 | |
| | | No log | 0.8936 | 84 | 0.4449 | 0.5544 | 0.4449 | 0.6670 | |
| | | No log | 0.9149 | 86 | 0.4097 | 0.5727 | 0.4097 | 0.6401 | |
| | | No log | 0.9362 | 88 | 0.4110 | 0.5767 | 0.4110 | 0.6411 | |
| | | No log | 0.9574 | 90 | 0.5281 | 0.5330 | 0.5281 | 0.7267 | |
| | | No log | 0.9787 | 92 | 0.5240 | 0.5274 | 0.5240 | 0.7239 | |
| | | No log | 1.0 | 94 | 0.4051 | 0.6067 | 0.4051 | 0.6365 | |
| | | No log | 1.0213 | 96 | 0.4063 | 0.6368 | 0.4063 | 0.6374 | |
| | | No log | 1.0426 | 98 | 0.5241 | 0.5896 | 0.5241 | 0.7239 | |
| | | No log | 1.0638 | 100 | 0.5979 | 0.5377 | 0.5979 | 0.7732 | |
| | | No log | 1.0851 | 102 | 0.5571 | 0.5235 | 0.5571 | 0.7464 | |
| | | No log | 1.1064 | 104 | 0.5328 | 0.5192 | 0.5328 | 0.7299 | |
| | | No log | 1.1277 | 106 | 0.5125 | 0.4497 | 0.5125 | 0.7159 | |
| | | No log | 1.1489 | 108 | 0.4651 | 0.4769 | 0.4651 | 0.6820 | |
| | | No log | 1.1702 | 110 | 0.4263 | 0.5330 | 0.4263 | 0.6529 | |
| | | No log | 1.1915 | 112 | 0.4218 | 0.5453 | 0.4218 | 0.6495 | |
| | | No log | 1.2128 | 114 | 0.4469 | 0.4965 | 0.4469 | 0.6685 | |
| | | No log | 1.2340 | 116 | 0.4962 | 0.4085 | 0.4962 | 0.7044 | |
| | | No log | 1.2553 | 118 | 0.5140 | 0.4575 | 0.5140 | 0.7170 | |
| | | No log | 1.2766 | 120 | 0.5814 | 0.5020 | 0.5814 | 0.7625 | |
| | | No log | 1.2979 | 122 | 0.5288 | 0.5370 | 0.5288 | 0.7272 | |
| | | No log | 1.3191 | 124 | 0.5162 | 0.5865 | 0.5162 | 0.7185 | |
| | | No log | 1.3404 | 126 | 0.4904 | 0.6492 | 0.4904 | 0.7003 | |
| | | No log | 1.3617 | 128 | 0.4597 | 0.6086 | 0.4597 | 0.6780 | |
| | | No log | 1.3830 | 130 | 0.4506 | 0.6136 | 0.4506 | 0.6713 | |
| | | No log | 1.4043 | 132 | 0.5070 | 0.5862 | 0.5070 | 0.7120 | |
| | | No log | 1.4255 | 134 | 0.6795 | 0.4488 | 0.6795 | 0.8243 | |
| | | No log | 1.4468 | 136 | 0.6479 | 0.4579 | 0.6479 | 0.8049 | |
| | | No log | 1.4681 | 138 | 0.4713 | 0.5356 | 0.4713 | 0.6865 | |
| | | No log | 1.4894 | 140 | 0.4060 | 0.5929 | 0.4060 | 0.6372 | |
| | | No log | 1.5106 | 142 | 0.4000 | 0.6152 | 0.4000 | 0.6324 | |
| | | No log | 1.5319 | 144 | 0.4305 | 0.5835 | 0.4305 | 0.6561 | |
| | | No log | 1.5532 | 146 | 0.6179 | 0.4605 | 0.6179 | 0.7861 | |
| | | No log | 1.5745 | 148 | 0.7029 | 0.4583 | 0.7029 | 0.8384 | |
| | | No log | 1.5957 | 150 | 0.6621 | 0.4585 | 0.6621 | 0.8137 | |
| | | No log | 1.6170 | 152 | 0.4777 | 0.5244 | 0.4777 | 0.6911 | |
| | | No log | 1.6383 | 154 | 0.3791 | 0.6595 | 0.3791 | 0.6157 | |
| | | No log | 1.6596 | 156 | 0.3820 | 0.6775 | 0.3820 | 0.6180 | |
| | | No log | 1.6809 | 158 | 0.3948 | 0.6775 | 0.3948 | 0.6284 | |
| | | No log | 1.7021 | 160 | 0.4250 | 0.6125 | 0.4250 | 0.6519 | |
| | | No log | 1.7234 | 162 | 0.5020 | 0.5437 | 0.5020 | 0.7085 | |
| | | No log | 1.7447 | 164 | 0.4833 | 0.5835 | 0.4833 | 0.6952 | |
| | | No log | 1.7660 | 166 | 0.4224 | 0.6192 | 0.4224 | 0.6499 | |
| | | No log | 1.7872 | 168 | 0.4125 | 0.6347 | 0.4125 | 0.6423 | |
| | | No log | 1.8085 | 170 | 0.4431 | 0.5998 | 0.4431 | 0.6657 | |
| | | No log | 1.8298 | 172 | 0.4675 | 0.5717 | 0.4675 | 0.6837 | |
| | | No log | 1.8511 | 174 | 0.5781 | 0.4960 | 0.5781 | 0.7603 | |
| | | No log | 1.8723 | 176 | 0.6813 | 0.4511 | 0.6813 | 0.8254 | |
| | | No log | 1.8936 | 178 | 0.6349 | 0.4880 | 0.6349 | 0.7968 | |
| | | No log | 1.9149 | 180 | 0.6006 | 0.5233 | 0.6006 | 0.7750 | |
| | | No log | 1.9362 | 182 | 0.5224 | 0.6040 | 0.5224 | 0.7228 | |
| | | No log | 1.9574 | 184 | 0.5325 | 0.6257 | 0.5325 | 0.7298 | |
| | | No log | 1.9787 | 186 | 0.4619 | 0.6302 | 0.4619 | 0.6796 | |
| | | No log | 2.0 | 188 | 0.4503 | 0.6315 | 0.4503 | 0.6711 | |
| | | No log | 2.0213 | 190 | 0.5117 | 0.6062 | 0.5117 | 0.7154 | |
| | | No log | 2.0426 | 192 | 0.4414 | 0.6206 | 0.4414 | 0.6644 | |
| | | No log | 2.0638 | 194 | 0.3722 | 0.6819 | 0.3722 | 0.6101 | |
| | | No log | 2.0851 | 196 | 0.4930 | 0.5736 | 0.4930 | 0.7022 | |
| | | No log | 2.1064 | 198 | 0.4580 | 0.5794 | 0.4580 | 0.6767 | |
| | | No log | 2.1277 | 200 | 0.3627 | 0.6768 | 0.3627 | 0.6022 | |
| | | No log | 2.1489 | 202 | 0.5227 | 0.5595 | 0.5227 | 0.7230 | |
| | | No log | 2.1702 | 204 | 0.7287 | 0.4812 | 0.7287 | 0.8536 | |
| | | No log | 2.1915 | 206 | 0.7065 | 0.4988 | 0.7065 | 0.8406 | |
| | | No log | 2.2128 | 208 | 0.5782 | 0.5365 | 0.5782 | 0.7604 | |
| | | No log | 2.2340 | 210 | 0.5758 | 0.5643 | 0.5758 | 0.7588 | |
| | | No log | 2.2553 | 212 | 0.5744 | 0.5679 | 0.5744 | 0.7579 | |
| | | No log | 2.2766 | 214 | 0.5348 | 0.5966 | 0.5348 | 0.7313 | |
| | | No log | 2.2979 | 216 | 0.4977 | 0.6742 | 0.4977 | 0.7055 | |
| | | No log | 2.3191 | 218 | 0.4896 | 0.6507 | 0.4896 | 0.6997 | |
| | | No log | 2.3404 | 220 | 0.5154 | 0.6433 | 0.5154 | 0.7179 | |
| | | No log | 2.3617 | 222 | 0.6889 | 0.5556 | 0.6889 | 0.8300 | |
| | | No log | 2.3830 | 224 | 0.8044 | 0.4812 | 0.8044 | 0.8969 | |
| | | No log | 2.4043 | 226 | 0.5725 | 0.5152 | 0.5725 | 0.7566 | |
| | | No log | 2.4255 | 228 | 0.4491 | 0.5950 | 0.4491 | 0.6701 | |
| | | No log | 2.4468 | 230 | 0.4798 | 0.5779 | 0.4798 | 0.6927 | |
| | | No log | 2.4681 | 232 | 0.4933 | 0.5192 | 0.4933 | 0.7024 | |
| | | No log | 2.4894 | 234 | 0.5377 | 0.5041 | 0.5377 | 0.7333 | |
| | | No log | 2.5106 | 236 | 0.6701 | 0.4704 | 0.6701 | 0.8186 | |
| | | No log | 2.5319 | 238 | 0.8833 | 0.4188 | 0.8833 | 0.9399 | |
| | | No log | 2.5532 | 240 | 0.7746 | 0.4705 | 0.7746 | 0.8801 | |
| | | No log | 2.5745 | 242 | 0.4825 | 0.6108 | 0.4825 | 0.6946 | |
| | | No log | 2.5957 | 244 | 0.3994 | 0.6590 | 0.3994 | 0.6320 | |
| | | No log | 2.6170 | 246 | 0.3889 | 0.6424 | 0.3889 | 0.6236 | |
| | | No log | 2.6383 | 248 | 0.4917 | 0.5783 | 0.4917 | 0.7012 | |
| | | No log | 2.6596 | 250 | 0.5771 | 0.5361 | 0.5771 | 0.7597 | |
| | | No log | 2.6809 | 252 | 0.5453 | 0.5533 | 0.5453 | 0.7384 | |
| | | No log | 2.7021 | 254 | 0.4995 | 0.5977 | 0.4995 | 0.7068 | |
| | | No log | 2.7234 | 256 | 0.5162 | 0.6091 | 0.5162 | 0.7184 | |
| | | No log | 2.7447 | 258 | 0.4977 | 0.5981 | 0.4977 | 0.7054 | |
| | | No log | 2.7660 | 260 | 0.4149 | 0.6520 | 0.4149 | 0.6442 | |
| | | No log | 2.7872 | 262 | 0.4129 | 0.6326 | 0.4129 | 0.6426 | |
| | | No log | 2.8085 | 264 | 0.4302 | 0.6060 | 0.4302 | 0.6559 | |
| | | No log | 2.8298 | 266 | 0.6247 | 0.4856 | 0.6247 | 0.7904 | |
| | | No log | 2.8511 | 268 | 0.7140 | 0.4419 | 0.7140 | 0.8450 | |
| | | No log | 2.8723 | 270 | 0.6641 | 0.4579 | 0.6641 | 0.8149 | |
| | | No log | 2.8936 | 272 | 0.5411 | 0.5064 | 0.5411 | 0.7356 | |
| | | No log | 2.9149 | 274 | 0.4313 | 0.5826 | 0.4313 | 0.6567 | |
| | | No log | 2.9362 | 276 | 0.4257 | 0.5996 | 0.4257 | 0.6525 | |
| | | No log | 2.9574 | 278 | 0.4016 | 0.6118 | 0.4016 | 0.6337 | |
| | | No log | 2.9787 | 280 | 0.4714 | 0.5861 | 0.4714 | 0.6866 | |
| | | No log | 3.0 | 282 | 0.6176 | 0.5005 | 0.6176 | 0.7859 | |
| | | No log | 3.0213 | 284 | 0.6416 | 0.4673 | 0.6416 | 0.8010 | |
| | | No log | 3.0426 | 286 | 0.5775 | 0.4966 | 0.5775 | 0.7599 | |
| | | No log | 3.0638 | 288 | 0.5510 | 0.5647 | 0.5510 | 0.7423 | |
| | | No log | 3.0851 | 290 | 0.4327 | 0.6274 | 0.4327 | 0.6578 | |
| | | No log | 3.1064 | 292 | 0.4266 | 0.6463 | 0.4266 | 0.6531 | |
| | | No log | 3.1277 | 294 | 0.4398 | 0.6412 | 0.4398 | 0.6632 | |
| | | No log | 3.1489 | 296 | 0.6065 | 0.5876 | 0.6065 | 0.7788 | |
| | | No log | 3.1702 | 298 | 0.6857 | 0.5333 | 0.6857 | 0.8281 | |
| | | No log | 3.1915 | 300 | 0.5516 | 0.6002 | 0.5516 | 0.7427 | |
| | | No log | 3.2128 | 302 | 0.4414 | 0.6594 | 0.4414 | 0.6644 | |
| | | No log | 3.2340 | 304 | 0.4799 | 0.6004 | 0.4799 | 0.6927 | |
| | | No log | 3.2553 | 306 | 0.4841 | 0.5617 | 0.4841 | 0.6957 | |
| | | No log | 3.2766 | 308 | 0.4373 | 0.5795 | 0.4373 | 0.6613 | |
| | | No log | 3.2979 | 310 | 0.4810 | 0.5586 | 0.4810 | 0.6936 | |
| | | No log | 3.3191 | 312 | 0.4463 | 0.5790 | 0.4463 | 0.6681 | |
| | | No log | 3.3404 | 314 | 0.4365 | 0.5835 | 0.4365 | 0.6607 | |
| | | No log | 3.3617 | 316 | 0.4973 | 0.5784 | 0.4973 | 0.7052 | |
| | | No log | 3.3830 | 318 | 0.4248 | 0.6185 | 0.4248 | 0.6518 | |
| | | No log | 3.4043 | 320 | 0.4480 | 0.6247 | 0.4480 | 0.6694 | |
| | | No log | 3.4255 | 322 | 0.5717 | 0.5872 | 0.5717 | 0.7561 | |
| | | No log | 3.4468 | 324 | 0.6497 | 0.5552 | 0.6497 | 0.8060 | |
| | | No log | 3.4681 | 326 | 0.4973 | 0.6581 | 0.4973 | 0.7052 | |
| | | No log | 3.4894 | 328 | 0.4614 | 0.6413 | 0.4614 | 0.6792 | |
| | | No log | 3.5106 | 330 | 0.4517 | 0.6235 | 0.4517 | 0.6721 | |
| | | No log | 3.5319 | 332 | 0.4821 | 0.6276 | 0.4821 | 0.6943 | |
| | | No log | 3.5532 | 334 | 0.7600 | 0.5046 | 0.7600 | 0.8718 | |
| | | No log | 3.5745 | 336 | 0.8952 | 0.4338 | 0.8952 | 0.9462 | |
| | | No log | 3.5957 | 338 | 0.6456 | 0.5407 | 0.6456 | 0.8035 | |
| | | No log | 3.6170 | 340 | 0.4559 | 0.5763 | 0.4559 | 0.6752 | |
| | | No log | 3.6383 | 342 | 0.4552 | 0.5718 | 0.4552 | 0.6747 | |
| | | No log | 3.6596 | 344 | 0.5587 | 0.5544 | 0.5587 | 0.7475 | |
| | | No log | 3.6809 | 346 | 0.8736 | 0.3948 | 0.8736 | 0.9347 | |
| | | No log | 3.7021 | 348 | 0.9182 | 0.3913 | 0.9182 | 0.9582 | |
| | | No log | 3.7234 | 350 | 0.7058 | 0.4015 | 0.7058 | 0.8401 | |
| | | No log | 3.7447 | 352 | 0.4711 | 0.5278 | 0.4711 | 0.6863 | |
| | | No log | 3.7660 | 354 | 0.4213 | 0.6470 | 0.4213 | 0.6491 | |
| | | No log | 3.7872 | 356 | 0.4500 | 0.5697 | 0.4500 | 0.6708 | |
| | | No log | 3.8085 | 358 | 0.4187 | 0.6261 | 0.4187 | 0.6471 | |
| | | No log | 3.8298 | 360 | 0.5081 | 0.5356 | 0.5081 | 0.7128 | |
| | | No log | 3.8511 | 362 | 0.5966 | 0.5208 | 0.5966 | 0.7724 | |
| | | No log | 3.8723 | 364 | 0.5210 | 0.5622 | 0.5210 | 0.7218 | |
| | | No log | 3.8936 | 366 | 0.4246 | 0.6279 | 0.4246 | 0.6516 | |
| | | No log | 3.9149 | 368 | 0.4143 | 0.6357 | 0.4143 | 0.6437 | |
| | | No log | 3.9362 | 370 | 0.4246 | 0.6496 | 0.4246 | 0.6516 | |
| | | No log | 3.9574 | 372 | 0.5331 | 0.5969 | 0.5331 | 0.7301 | |
| | | No log | 3.9787 | 374 | 0.6567 | 0.5503 | 0.6567 | 0.8104 | |
| | | No log | 4.0 | 376 | 0.5523 | 0.5904 | 0.5523 | 0.7432 | |
| | | No log | 4.0213 | 378 | 0.5043 | 0.5979 | 0.5043 | 0.7102 | |
| | | No log | 4.0426 | 380 | 0.4688 | 0.6092 | 0.4688 | 0.6847 | |
| | | No log | 4.0638 | 382 | 0.4665 | 0.6092 | 0.4665 | 0.6830 | |
| | | No log | 4.0851 | 384 | 0.4614 | 0.6212 | 0.4614 | 0.6792 | |
| | | No log | 4.1064 | 386 | 0.4460 | 0.6129 | 0.4460 | 0.6678 | |
| | | No log | 4.1277 | 388 | 0.5354 | 0.6041 | 0.5354 | 0.7317 | |
| | | No log | 4.1489 | 390 | 0.7533 | 0.5257 | 0.7533 | 0.8679 | |
| | | No log | 4.1702 | 392 | 0.6852 | 0.5412 | 0.6852 | 0.8278 | |
| | | No log | 4.1915 | 394 | 0.5025 | 0.6133 | 0.5025 | 0.7089 | |
| | | No log | 4.2128 | 396 | 0.4772 | 0.6045 | 0.4772 | 0.6908 | |
| | | No log | 4.2340 | 398 | 0.4753 | 0.5917 | 0.4753 | 0.6894 | |
| | | No log | 4.2553 | 400 | 0.4823 | 0.6163 | 0.4823 | 0.6945 | |
| | | No log | 4.2766 | 402 | 0.5673 | 0.6159 | 0.5673 | 0.7532 | |
| | | No log | 4.2979 | 404 | 0.6892 | 0.5960 | 0.6892 | 0.8302 | |
| | | No log | 4.3191 | 406 | 0.6687 | 0.5977 | 0.6687 | 0.8177 | |
| | | No log | 4.3404 | 408 | 0.6032 | 0.5830 | 0.6032 | 0.7767 | |
| | | No log | 4.3617 | 410 | 0.5464 | 0.5984 | 0.5464 | 0.7392 | |
| | | No log | 4.3830 | 412 | 0.5776 | 0.5540 | 0.5776 | 0.7600 | |
| | | No log | 4.4043 | 414 | 0.6166 | 0.5130 | 0.6166 | 0.7852 | |
| | | No log | 4.4255 | 416 | 0.6191 | 0.5047 | 0.6191 | 0.7868 | |
| | | No log | 4.4468 | 418 | 0.5450 | 0.5318 | 0.5450 | 0.7382 | |
| | | No log | 4.4681 | 420 | 0.5421 | 0.5356 | 0.5421 | 0.7363 | |
| | | No log | 4.4894 | 422 | 0.4486 | 0.5492 | 0.4486 | 0.6698 | |
| | | No log | 4.5106 | 424 | 0.4458 | 0.6004 | 0.4458 | 0.6677 | |
| | | No log | 4.5319 | 426 | 0.5333 | 0.5666 | 0.5333 | 0.7303 | |
| | | No log | 4.5532 | 428 | 0.5325 | 0.5844 | 0.5325 | 0.7297 | |
| | | No log | 4.5745 | 430 | 0.4087 | 0.6809 | 0.4087 | 0.6393 | |
| | | No log | 4.5957 | 432 | 0.3983 | 0.6722 | 0.3983 | 0.6311 | |
| | | No log | 4.6170 | 434 | 0.4683 | 0.5863 | 0.4683 | 0.6843 | |
| | | No log | 4.6383 | 436 | 0.6688 | 0.5605 | 0.6688 | 0.8178 | |
| | | No log | 4.6596 | 438 | 0.6600 | 0.5609 | 0.6600 | 0.8124 | |
| | | No log | 4.6809 | 440 | 0.4877 | 0.5916 | 0.4877 | 0.6984 | |
| | | No log | 4.7021 | 442 | 0.4211 | 0.5980 | 0.4211 | 0.6489 | |
| | | No log | 4.7234 | 444 | 0.4257 | 0.6015 | 0.4257 | 0.6524 | |
| | | No log | 4.7447 | 446 | 0.5320 | 0.5658 | 0.5320 | 0.7294 | |
| | | No log | 4.7660 | 448 | 0.7042 | 0.5243 | 0.7042 | 0.8391 | |
| | | No log | 4.7872 | 450 | 0.7423 | 0.5195 | 0.7423 | 0.8615 | |
| | | No log | 4.8085 | 452 | 0.5433 | 0.5966 | 0.5433 | 0.7371 | |
| | | No log | 4.8298 | 454 | 0.4548 | 0.6130 | 0.4548 | 0.6744 | |
| | | No log | 4.8511 | 456 | 0.4497 | 0.6147 | 0.4497 | 0.6706 | |
| | | No log | 4.8723 | 458 | 0.4912 | 0.5299 | 0.4912 | 0.7009 | |
| | | No log | 4.8936 | 460 | 0.7400 | 0.4279 | 0.7400 | 0.8602 | |
| | | No log | 4.9149 | 462 | 1.0617 | 0.3786 | 1.0617 | 1.0304 | |
| | | No log | 4.9362 | 464 | 1.0010 | 0.4013 | 1.0010 | 1.0005 | |
| | | No log | 4.9574 | 466 | 0.6774 | 0.4734 | 0.6774 | 0.8230 | |
| | | No log | 4.9787 | 468 | 0.4630 | 0.6162 | 0.4630 | 0.6805 | |
| | | No log | 5.0 | 470 | 0.4588 | 0.6261 | 0.4588 | 0.6774 | |
| | | No log | 5.0213 | 472 | 0.4921 | 0.6324 | 0.4921 | 0.7015 | |
| | | No log | 5.0426 | 474 | 0.5531 | 0.5887 | 0.5531 | 0.7437 | |
| | | No log | 5.0638 | 476 | 0.5163 | 0.6018 | 0.5163 | 0.7185 | |
| | | No log | 5.0851 | 478 | 0.4896 | 0.5860 | 0.4896 | 0.6997 | |
| | | No log | 5.1064 | 480 | 0.5185 | 0.5351 | 0.5185 | 0.7201 | |
| | | No log | 5.1277 | 482 | 0.4562 | 0.5752 | 0.4562 | 0.6754 | |
| | | No log | 5.1489 | 484 | 0.4147 | 0.5847 | 0.4147 | 0.6440 | |
| | | No log | 5.1702 | 486 | 0.4666 | 0.5825 | 0.4666 | 0.6831 | |
| | | No log | 5.1915 | 488 | 0.4695 | 0.6160 | 0.4695 | 0.6852 | |
| | | No log | 5.2128 | 490 | 0.4102 | 0.6474 | 0.4102 | 0.6404 | |
| | | No log | 5.2340 | 492 | 0.4072 | 0.6437 | 0.4072 | 0.6381 | |
| | | No log | 5.2553 | 494 | 0.4182 | 0.6291 | 0.4182 | 0.6467 | |
| | | No log | 5.2766 | 496 | 0.4877 | 0.5953 | 0.4877 | 0.6984 | |
| | | No log | 5.2979 | 498 | 0.4833 | 0.5887 | 0.4833 | 0.6952 | |
| | | 0.4408 | 5.3191 | 500 | 0.4120 | 0.6437 | 0.4120 | 0.6418 | |
| | | 0.4408 | 5.3404 | 502 | 0.4248 | 0.6129 | 0.4248 | 0.6517 | |
| | | 0.4408 | 5.3617 | 504 | 0.4126 | 0.6574 | 0.4126 | 0.6424 | |
| | | 0.4408 | 5.3830 | 506 | 0.5421 | 0.5807 | 0.5421 | 0.7363 | |
| | | 0.4408 | 5.4043 | 508 | 0.5987 | 0.5667 | 0.5987 | 0.7737 | |
| | | 0.4408 | 5.4255 | 510 | 0.5231 | 0.6083 | 0.5231 | 0.7232 | |
| | | 0.4408 | 5.4468 | 512 | 0.4252 | 0.6705 | 0.4252 | 0.6521 | |
| | | 0.4408 | 5.4681 | 514 | 0.4296 | 0.6597 | 0.4296 | 0.6554 | |
| | | 0.4408 | 5.4894 | 516 | 0.4762 | 0.6551 | 0.4762 | 0.6900 | |
| | | 0.4408 | 5.5106 | 518 | 0.7330 | 0.5582 | 0.7330 | 0.8561 | |
| | | 0.4408 | 5.5319 | 520 | 0.7775 | 0.5370 | 0.7775 | 0.8818 | |
| | | 0.4408 | 5.5532 | 522 | 0.5583 | 0.5988 | 0.5583 | 0.7472 | |
| | | 0.4408 | 5.5745 | 524 | 0.3978 | 0.6511 | 0.3978 | 0.6307 | |
| | | 0.4408 | 5.5957 | 526 | 0.3919 | 0.6545 | 0.3919 | 0.6260 | |
| | | 0.4408 | 5.6170 | 528 | 0.4560 | 0.6055 | 0.4560 | 0.6753 | |
| | | 0.4408 | 5.6383 | 530 | 0.5450 | 0.5794 | 0.5450 | 0.7382 | |
| | | 0.4408 | 5.6596 | 532 | 0.5264 | 0.6002 | 0.5264 | 0.7255 | |
| | | 0.4408 | 5.6809 | 534 | 0.4520 | 0.6439 | 0.4520 | 0.6723 | |
| | | 0.4408 | 5.7021 | 536 | 0.4818 | 0.6275 | 0.4818 | 0.6941 | |
| | | 0.4408 | 5.7234 | 538 | 0.4902 | 0.6435 | 0.4902 | 0.7001 | |
| | | 0.4408 | 5.7447 | 540 | 0.6058 | 0.5956 | 0.6058 | 0.7783 | |
| | | 0.4408 | 5.7660 | 542 | 0.6694 | 0.5677 | 0.6694 | 0.8182 | |
| | | 0.4408 | 5.7872 | 544 | 0.5455 | 0.5691 | 0.5455 | 0.7386 | |
| | |
| | |
| | ### Framework versions |
| | |
| | - Transformers 4.44.2 |
| | - Pytorch 2.4.0+cu118 |
| | - Datasets 2.21.0 |
| | - Tokenizers 0.19.1 |
| | |
