--- library_name: transformers base_model: aubmindlab/bert-base-arabertv02 tags: - generated_from_trainer model-index: - name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask8_development results: [] --- # Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask8_development This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.4744 - Qwk: 0.5496 - Mse: 0.4744 - Rmse: 0.6887 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100 ### Training results | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse | |:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:| | No log | 0.0196 | 2 | 4.1841 | 0.0131 | 4.1841 | 2.0455 | | No log | 0.0392 | 4 | 3.3694 | 0.0367 | 3.3694 | 1.8356 | | No log | 0.0588 | 6 | 1.9011 | 0.1218 | 1.9011 | 1.3788 | | No log | 0.0784 | 8 | 0.8092 | 0.1659 | 0.8092 | 0.8996 | | No log | 0.0980 | 10 | 0.7372 | 0.1594 | 0.7372 | 0.8586 | | No log | 0.1176 | 12 | 0.7884 | 0.0895 | 0.7884 | 0.8879 | | No log | 0.1373 | 14 | 0.7668 | 0.3157 | 0.7668 | 0.8756 | | No log | 0.1569 | 16 | 0.7860 | 0.2846 | 0.7860 | 0.8866 | | No log | 0.1765 | 18 | 0.6591 | 0.2790 | 0.6591 | 0.8119 | | No log | 0.1961 | 20 | 0.6420 | 0.2728 | 0.6420 | 0.8012 | | No log | 0.2157 | 22 | 0.6233 | 0.3185 | 0.6233 | 0.7895 | | No log | 0.2353 | 24 | 0.6843 | 0.1790 | 0.6843 | 0.8272 | | No log | 0.2549 | 26 | 0.6878 | 0.2016 | 0.6878 | 0.8293 | | No log | 0.2745 | 28 | 0.6001 | 0.3500 | 0.6001 | 0.7747 | | No log | 0.2941 | 30 | 0.5105 | 0.4622 | 0.5105 | 0.7145 | | No log | 0.3137 | 32 | 0.5104 | 0.5258 | 0.5104 | 0.7145 | | No log | 0.3333 | 34 | 0.5323 | 0.5412 | 0.5323 | 0.7296 | | No log | 0.3529 | 36 | 0.5752 | 0.5265 | 0.5752 | 0.7584 | | No log | 0.3725 | 38 | 0.7106 | 0.4847 | 0.7106 | 0.8430 | | No log | 0.3922 | 40 | 0.9041 | 0.2287 | 0.9041 | 0.9508 | | No log | 0.4118 | 42 | 1.0775 | 0.0384 | 1.0775 | 1.0380 | | No log | 0.4314 | 44 | 1.3162 | -0.1270 | 1.3162 | 1.1473 | | No log | 0.4510 | 46 | 1.4042 | -0.0351 | 1.4042 | 1.1850 | | No log | 0.4706 | 48 | 1.1193 | 0.0766 | 1.1193 | 1.0580 | | No log | 0.4902 | 50 | 0.7738 | 0.2692 | 0.7738 | 0.8796 | | No log | 0.5098 | 52 | 0.6622 | 0.5501 | 0.6622 | 0.8137 | | No log | 0.5294 | 54 | 0.5766 | 0.5594 | 0.5766 | 0.7594 | | No log | 0.5490 | 56 | 0.5125 | 0.4951 | 0.5125 | 0.7159 | | No log | 0.5686 | 58 | 0.6476 | 0.3506 | 0.6476 | 0.8047 | | No log | 0.5882 | 60 | 0.8667 | 0.1810 | 0.8667 | 0.9310 | | No log | 0.6078 | 62 | 0.9499 | 0.2013 | 0.9499 | 0.9746 | | No log | 0.6275 | 64 | 0.9296 | 0.3390 | 0.9296 | 0.9642 | | No log | 0.6471 | 66 | 0.8488 | 0.3626 | 0.8488 | 0.9213 | | No log | 0.6667 | 68 | 0.6706 | 0.4117 | 0.6706 | 0.8189 | | No log | 0.6863 | 70 | 0.5390 | 0.4752 | 0.5390 | 0.7341 | | No log | 0.7059 | 72 | 0.5347 | 0.5345 | 0.5347 | 0.7312 | | No log | 0.7255 | 74 | 0.5187 | 0.5375 | 0.5187 | 0.7202 | | No log | 0.7451 | 76 | 0.5044 | 0.4763 | 0.5044 | 0.7102 | | No log | 0.7647 | 78 | 0.5615 | 0.3887 | 0.5615 | 0.7494 | | No log | 0.7843 | 80 | 0.5810 | 0.3887 | 0.5810 | 0.7623 | | No log | 0.8039 | 82 | 0.5343 | 0.3959 | 0.5343 | 0.7309 | | No log | 0.8235 | 84 | 0.5005 | 0.4515 | 0.5005 | 0.7074 | | No log | 0.8431 | 86 | 0.4904 | 0.4729 | 0.4904 | 0.7003 | | No log | 0.8627 | 88 | 0.4824 | 0.4530 | 0.4824 | 0.6946 | | No log | 0.8824 | 90 | 0.4866 | 0.4353 | 0.4866 | 0.6975 | | No log | 0.9020 | 92 | 0.5003 | 0.4346 | 0.5003 | 0.7073 | | No log | 0.9216 | 94 | 0.4784 | 0.4640 | 0.4784 | 0.6917 | | No log | 0.9412 | 96 | 0.4885 | 0.5290 | 0.4885 | 0.6989 | | No log | 0.9608 | 98 | 0.4879 | 0.5156 | 0.4879 | 0.6985 | | No log | 0.9804 | 100 | 0.4785 | 0.4936 | 0.4785 | 0.6917 | | No log | 1.0 | 102 | 0.4815 | 0.4512 | 0.4815 | 0.6939 | | No log | 1.0196 | 104 | 0.4857 | 0.5196 | 0.4857 | 0.6969 | | No log | 1.0392 | 106 | 0.4887 | 0.5268 | 0.4887 | 0.6990 | | No log | 1.0588 | 108 | 0.5089 | 0.4412 | 0.5089 | 0.7134 | | No log | 1.0784 | 110 | 0.5336 | 0.4314 | 0.5336 | 0.7305 | | No log | 1.0980 | 112 | 0.5377 | 0.4244 | 0.5377 | 0.7333 | | No log | 1.1176 | 114 | 0.5137 | 0.4316 | 0.5137 | 0.7168 | | No log | 1.1373 | 116 | 0.4879 | 0.4468 | 0.4879 | 0.6985 | | No log | 1.1569 | 118 | 0.4711 | 0.4601 | 0.4711 | 0.6863 | | No log | 1.1765 | 120 | 0.4621 | 0.5111 | 0.4621 | 0.6798 | | No log | 1.1961 | 122 | 0.4667 | 0.5566 | 0.4667 | 0.6831 | | No log | 1.2157 | 124 | 0.4836 | 0.5890 | 0.4836 | 0.6954 | | No log | 1.2353 | 126 | 0.4990 | 0.6142 | 0.4990 | 0.7064 | | No log | 1.2549 | 128 | 0.4753 | 0.5914 | 0.4753 | 0.6894 | | No log | 1.2745 | 130 | 0.4727 | 0.5242 | 0.4727 | 0.6876 | | No log | 1.2941 | 132 | 0.5021 | 0.4952 | 0.5021 | 0.7086 | | No log | 1.3137 | 134 | 0.5289 | 0.4505 | 0.5289 | 0.7272 | | No log | 1.3333 | 136 | 0.5100 | 0.5243 | 0.5100 | 0.7141 | | No log | 1.3529 | 138 | 0.4521 | 0.5791 | 0.4521 | 0.6724 | | No log | 1.3725 | 140 | 0.4599 | 0.5734 | 0.4599 | 0.6782 | | No log | 1.3922 | 142 | 0.4724 | 0.5813 | 0.4724 | 0.6873 | | No log | 1.4118 | 144 | 0.4366 | 0.5448 | 0.4366 | 0.6608 | | No log | 1.4314 | 146 | 0.4612 | 0.4622 | 0.4612 | 0.6791 | | No log | 1.4510 | 148 | 0.4764 | 0.4448 | 0.4764 | 0.6902 | | No log | 1.4706 | 150 | 0.4935 | 0.4061 | 0.4935 | 0.7025 | | No log | 1.4902 | 152 | 0.4972 | 0.3890 | 0.4972 | 0.7051 | | No log | 1.5098 | 154 | 0.5366 | 0.3545 | 0.5366 | 0.7325 | | No log | 1.5294 | 156 | 0.5402 | 0.4241 | 0.5402 | 0.7350 | | No log | 1.5490 | 158 | 0.6181 | 0.4375 | 0.6181 | 0.7862 | | No log | 1.5686 | 160 | 0.5969 | 0.4819 | 0.5969 | 0.7726 | | No log | 1.5882 | 162 | 0.5734 | 0.4808 | 0.5734 | 0.7572 | | No log | 1.6078 | 164 | 0.5033 | 0.5482 | 0.5033 | 0.7094 | | No log | 1.6275 | 166 | 0.4178 | 0.5609 | 0.4178 | 0.6464 | | No log | 1.6471 | 168 | 0.3978 | 0.5996 | 0.3978 | 0.6307 | | No log | 1.6667 | 170 | 0.4323 | 0.6139 | 0.4323 | 0.6575 | | No log | 1.6863 | 172 | 0.6541 | 0.4722 | 0.6541 | 0.8088 | | No log | 1.7059 | 174 | 0.8573 | 0.2931 | 0.8573 | 0.9259 | | No log | 1.7255 | 176 | 0.8885 | 0.2441 | 0.8885 | 0.9426 | | No log | 1.7451 | 178 | 0.7695 | 0.2974 | 0.7695 | 0.8772 | | No log | 1.7647 | 180 | 0.5498 | 0.4455 | 0.5498 | 0.7415 | | No log | 1.7843 | 182 | 0.4817 | 0.5358 | 0.4817 | 0.6940 | | No log | 1.8039 | 184 | 0.4472 | 0.5495 | 0.4472 | 0.6687 | | No log | 1.8235 | 186 | 0.4160 | 0.5757 | 0.4160 | 0.6449 | | No log | 1.8431 | 188 | 0.4343 | 0.5719 | 0.4343 | 0.6590 | | No log | 1.8627 | 190 | 0.4952 | 0.5948 | 0.4952 | 0.7037 | | No log | 1.8824 | 192 | 0.5036 | 0.6279 | 0.5036 | 0.7097 | | No log | 1.9020 | 194 | 0.5333 | 0.6159 | 0.5333 | 0.7303 | | No log | 1.9216 | 196 | 0.6532 | 0.5700 | 0.6532 | 0.8082 | | No log | 1.9412 | 198 | 0.7827 | 0.5312 | 0.7827 | 0.8847 | | No log | 1.9608 | 200 | 0.7066 | 0.5591 | 0.7066 | 0.8406 | | No log | 1.9804 | 202 | 0.5262 | 0.6230 | 0.5262 | 0.7254 | | No log | 2.0 | 204 | 0.4205 | 0.6781 | 0.4205 | 0.6485 | | No log | 2.0196 | 206 | 0.4190 | 0.6787 | 0.4190 | 0.6473 | | No log | 2.0392 | 208 | 0.4111 | 0.6455 | 0.4111 | 0.6412 | | No log | 2.0588 | 210 | 0.4902 | 0.5994 | 0.4902 | 0.7002 | | No log | 2.0784 | 212 | 0.5573 | 0.5412 | 0.5573 | 0.7465 | | No log | 2.0980 | 214 | 0.5682 | 0.4939 | 0.5682 | 0.7538 | | No log | 2.1176 | 216 | 0.4962 | 0.5011 | 0.4962 | 0.7044 | | No log | 2.1373 | 218 | 0.4108 | 0.5544 | 0.4108 | 0.6409 | | No log | 2.1569 | 220 | 0.4203 | 0.5450 | 0.4203 | 0.6483 | | No log | 2.1765 | 222 | 0.4189 | 0.5790 | 0.4189 | 0.6472 | | No log | 2.1961 | 224 | 0.4279 | 0.5636 | 0.4279 | 0.6542 | | No log | 2.2157 | 226 | 0.4954 | 0.5324 | 0.4954 | 0.7038 | | No log | 2.2353 | 228 | 0.5269 | 0.5106 | 0.5269 | 0.7259 | | No log | 2.2549 | 230 | 0.5232 | 0.5579 | 0.5232 | 0.7233 | | No log | 2.2745 | 232 | 0.5288 | 0.5619 | 0.5288 | 0.7272 | | No log | 2.2941 | 234 | 0.5143 | 0.5511 | 0.5143 | 0.7172 | | No log | 2.3137 | 236 | 0.4644 | 0.5513 | 0.4644 | 0.6815 | | No log | 2.3333 | 238 | 0.4138 | 0.6471 | 0.4138 | 0.6432 | | No log | 2.3529 | 240 | 0.3884 | 0.6629 | 0.3884 | 0.6232 | | No log | 2.3725 | 242 | 0.3927 | 0.6557 | 0.3927 | 0.6267 | | No log | 2.3922 | 244 | 0.3944 | 0.6635 | 0.3944 | 0.6280 | | No log | 2.4118 | 246 | 0.3940 | 0.6623 | 0.3940 | 0.6277 | | No log | 2.4314 | 248 | 0.3832 | 0.6799 | 0.3832 | 0.6190 | | No log | 2.4510 | 250 | 0.4090 | 0.6555 | 0.4090 | 0.6395 | | No log | 2.4706 | 252 | 0.4466 | 0.6028 | 0.4466 | 0.6683 | | No log | 2.4902 | 254 | 0.3929 | 0.6773 | 0.3929 | 0.6268 | | No log | 2.5098 | 256 | 0.3974 | 0.6707 | 0.3974 | 0.6304 | | No log | 2.5294 | 258 | 0.4757 | 0.6320 | 0.4757 | 0.6897 | | No log | 2.5490 | 260 | 0.4944 | 0.6079 | 0.4944 | 0.7032 | | No log | 2.5686 | 262 | 0.4317 | 0.6371 | 0.4317 | 0.6570 | | No log | 2.5882 | 264 | 0.3744 | 0.6526 | 0.3744 | 0.6119 | | No log | 2.6078 | 266 | 0.3651 | 0.6791 | 0.3651 | 0.6043 | | No log | 2.6275 | 268 | 0.4125 | 0.6363 | 0.4125 | 0.6423 | | No log | 2.6471 | 270 | 0.4578 | 0.5314 | 0.4578 | 0.6766 | | No log | 2.6667 | 272 | 0.4430 | 0.5414 | 0.4430 | 0.6656 | | No log | 2.6863 | 274 | 0.3968 | 0.6002 | 0.3968 | 0.6299 | | No log | 2.7059 | 276 | 0.3961 | 0.6380 | 0.3961 | 0.6293 | | No log | 2.7255 | 278 | 0.4105 | 0.6220 | 0.4105 | 0.6407 | | No log | 2.7451 | 280 | 0.3911 | 0.6973 | 0.3911 | 0.6254 | | No log | 2.7647 | 282 | 0.4421 | 0.6408 | 0.4421 | 0.6649 | | No log | 2.7843 | 284 | 0.4349 | 0.6583 | 0.4349 | 0.6595 | | No log | 2.8039 | 286 | 0.4395 | 0.6099 | 0.4395 | 0.6629 | | No log | 2.8235 | 288 | 0.5627 | 0.5675 | 0.5627 | 0.7501 | | No log | 2.8431 | 290 | 0.6906 | 0.5024 | 0.6906 | 0.8310 | | No log | 2.8627 | 292 | 0.6768 | 0.5171 | 0.6768 | 0.8227 | | No log | 2.8824 | 294 | 0.5395 | 0.5487 | 0.5395 | 0.7345 | | No log | 2.9020 | 296 | 0.4011 | 0.5961 | 0.4011 | 0.6333 | | No log | 2.9216 | 298 | 0.3767 | 0.6281 | 0.3767 | 0.6138 | | No log | 2.9412 | 300 | 0.3731 | 0.6307 | 0.3731 | 0.6108 | | No log | 2.9608 | 302 | 0.3733 | 0.6302 | 0.3733 | 0.6110 | | No log | 2.9804 | 304 | 0.3923 | 0.6146 | 0.3923 | 0.6263 | | No log | 3.0 | 306 | 0.4366 | 0.5960 | 0.4366 | 0.6608 | | No log | 3.0196 | 308 | 0.4666 | 0.5604 | 0.4666 | 0.6831 | | No log | 3.0392 | 310 | 0.4672 | 0.5359 | 0.4672 | 0.6835 | | No log | 3.0588 | 312 | 0.4776 | 0.5247 | 0.4776 | 0.6911 | | No log | 3.0784 | 314 | 0.4671 | 0.5237 | 0.4671 | 0.6835 | | No log | 3.0980 | 316 | 0.4310 | 0.5414 | 0.4310 | 0.6565 | | No log | 3.1176 | 318 | 0.4162 | 0.6106 | 0.4162 | 0.6452 | | No log | 3.1373 | 320 | 0.4076 | 0.6551 | 0.4076 | 0.6384 | | No log | 3.1569 | 322 | 0.4237 | 0.6314 | 0.4237 | 0.6509 | | No log | 3.1765 | 324 | 0.4840 | 0.5888 | 0.4840 | 0.6957 | | No log | 3.1961 | 326 | 0.6137 | 0.4932 | 0.6137 | 0.7834 | | No log | 3.2157 | 328 | 0.5753 | 0.4731 | 0.5753 | 0.7585 | | No log | 3.2353 | 330 | 0.4805 | 0.6064 | 0.4805 | 0.6932 | | No log | 3.2549 | 332 | 0.4217 | 0.6140 | 0.4217 | 0.6494 | | No log | 3.2745 | 334 | 0.3974 | 0.6458 | 0.3974 | 0.6304 | | No log | 3.2941 | 336 | 0.3710 | 0.6747 | 0.3710 | 0.6091 | | No log | 3.3137 | 338 | 0.4048 | 0.6140 | 0.4048 | 0.6362 | | No log | 3.3333 | 340 | 0.5067 | 0.5906 | 0.5067 | 0.7118 | | No log | 3.3529 | 342 | 0.6642 | 0.5414 | 0.6642 | 0.8150 | | No log | 3.3725 | 344 | 0.7039 | 0.5523 | 0.7039 | 0.8390 | | No log | 3.3922 | 346 | 0.6753 | 0.5581 | 0.6753 | 0.8218 | | No log | 3.4118 | 348 | 0.6209 | 0.5491 | 0.6209 | 0.7880 | | No log | 3.4314 | 350 | 0.5268 | 0.5986 | 0.5268 | 0.7258 | | No log | 3.4510 | 352 | 0.4626 | 0.6267 | 0.4626 | 0.6801 | | No log | 3.4706 | 354 | 0.4954 | 0.6171 | 0.4954 | 0.7038 | | No log | 3.4902 | 356 | 0.4323 | 0.6406 | 0.4323 | 0.6575 | | No log | 3.5098 | 358 | 0.3964 | 0.6615 | 0.3964 | 0.6296 | | No log | 3.5294 | 360 | 0.4061 | 0.6569 | 0.4061 | 0.6373 | | No log | 3.5490 | 362 | 0.4473 | 0.6272 | 0.4473 | 0.6688 | | No log | 3.5686 | 364 | 0.4778 | 0.6258 | 0.4778 | 0.6912 | | No log | 3.5882 | 366 | 0.4399 | 0.6280 | 0.4399 | 0.6632 | | No log | 3.6078 | 368 | 0.3799 | 0.6522 | 0.3799 | 0.6164 | | No log | 3.6275 | 370 | 0.3705 | 0.6574 | 0.3705 | 0.6086 | | No log | 3.6471 | 372 | 0.3639 | 0.6801 | 0.3639 | 0.6032 | | No log | 3.6667 | 374 | 0.3709 | 0.6699 | 0.3709 | 0.6090 | | No log | 3.6863 | 376 | 0.3922 | 0.6858 | 0.3922 | 0.6263 | | No log | 3.7059 | 378 | 0.4650 | 0.6645 | 0.4650 | 0.6819 | | No log | 3.7255 | 380 | 0.6518 | 0.5943 | 0.6518 | 0.8074 | | No log | 3.7451 | 382 | 0.7646 | 0.5710 | 0.7646 | 0.8744 | | No log | 3.7647 | 384 | 0.6800 | 0.5919 | 0.6800 | 0.8246 | | No log | 3.7843 | 386 | 0.5751 | 0.6490 | 0.5751 | 0.7584 | | No log | 3.8039 | 388 | 0.4510 | 0.6615 | 0.4510 | 0.6716 | | No log | 3.8235 | 390 | 0.3944 | 0.6827 | 0.3944 | 0.6280 | | No log | 3.8431 | 392 | 0.4086 | 0.7073 | 0.4086 | 0.6392 | | No log | 3.8627 | 394 | 0.3946 | 0.6889 | 0.3946 | 0.6282 | | No log | 3.8824 | 396 | 0.4322 | 0.6692 | 0.4322 | 0.6574 | | No log | 3.9020 | 398 | 0.4777 | 0.6067 | 0.4777 | 0.6912 | | No log | 3.9216 | 400 | 0.4779 | 0.5876 | 0.4779 | 0.6913 | | No log | 3.9412 | 402 | 0.4130 | 0.6279 | 0.4130 | 0.6426 | | No log | 3.9608 | 404 | 0.3920 | 0.6695 | 0.3920 | 0.6261 | | No log | 3.9804 | 406 | 0.4034 | 0.6527 | 0.4034 | 0.6351 | | No log | 4.0 | 408 | 0.4123 | 0.6516 | 0.4123 | 0.6421 | | No log | 4.0196 | 410 | 0.4488 | 0.5796 | 0.4488 | 0.6699 | | No log | 4.0392 | 412 | 0.5374 | 0.5288 | 0.5374 | 0.7331 | | No log | 4.0588 | 414 | 0.5485 | 0.5675 | 0.5485 | 0.7406 | | No log | 4.0784 | 416 | 0.5611 | 0.5623 | 0.5611 | 0.7490 | | No log | 4.0980 | 418 | 0.5286 | 0.5926 | 0.5286 | 0.7271 | | No log | 4.1176 | 420 | 0.4814 | 0.6253 | 0.4814 | 0.6938 | | No log | 4.1373 | 422 | 0.4475 | 0.6719 | 0.4475 | 0.6690 | | No log | 4.1569 | 424 | 0.4315 | 0.6881 | 0.4315 | 0.6569 | | No log | 4.1765 | 426 | 0.4047 | 0.6739 | 0.4047 | 0.6361 | | No log | 4.1961 | 428 | 0.4295 | 0.6430 | 0.4295 | 0.6554 | | No log | 4.2157 | 430 | 0.4651 | 0.6224 | 0.4651 | 0.6820 | | No log | 4.2353 | 432 | 0.4235 | 0.6340 | 0.4235 | 0.6508 | | No log | 4.2549 | 434 | 0.3942 | 0.6447 | 0.3942 | 0.6278 | | No log | 4.2745 | 436 | 0.3982 | 0.6489 | 0.3982 | 0.6310 | | No log | 4.2941 | 438 | 0.4764 | 0.5611 | 0.4764 | 0.6903 | | No log | 4.3137 | 440 | 0.5092 | 0.5448 | 0.5092 | 0.7136 | | No log | 4.3333 | 442 | 0.4436 | 0.5924 | 0.4436 | 0.6660 | | No log | 4.3529 | 444 | 0.3878 | 0.6386 | 0.3878 | 0.6227 | | No log | 4.3725 | 446 | 0.3776 | 0.6462 | 0.3776 | 0.6145 | | No log | 4.3922 | 448 | 0.4046 | 0.6441 | 0.4046 | 0.6361 | | No log | 4.4118 | 450 | 0.4609 | 0.6176 | 0.4609 | 0.6789 | | No log | 4.4314 | 452 | 0.5155 | 0.6013 | 0.5155 | 0.7180 | | No log | 4.4510 | 454 | 0.4932 | 0.6299 | 0.4932 | 0.7023 | | No log | 4.4706 | 456 | 0.4804 | 0.6326 | 0.4804 | 0.6931 | | No log | 4.4902 | 458 | 0.4366 | 0.6672 | 0.4366 | 0.6607 | | No log | 4.5098 | 460 | 0.4140 | 0.6884 | 0.4140 | 0.6434 | | No log | 4.5294 | 462 | 0.4564 | 0.6646 | 0.4564 | 0.6756 | | No log | 4.5490 | 464 | 0.4848 | 0.6457 | 0.4848 | 0.6963 | | No log | 4.5686 | 466 | 0.4989 | 0.6308 | 0.4989 | 0.7063 | | No log | 4.5882 | 468 | 0.4408 | 0.6615 | 0.4408 | 0.6640 | | No log | 4.6078 | 470 | 0.4229 | 0.6560 | 0.4229 | 0.6503 | | No log | 4.6275 | 472 | 0.3739 | 0.6844 | 0.3739 | 0.6115 | | No log | 4.6471 | 474 | 0.3633 | 0.6968 | 0.3633 | 0.6028 | | No log | 4.6667 | 476 | 0.3928 | 0.6647 | 0.3928 | 0.6267 | | No log | 4.6863 | 478 | 0.4538 | 0.6462 | 0.4538 | 0.6737 | | No log | 4.7059 | 480 | 0.5378 | 0.5818 | 0.5378 | 0.7334 | | No log | 4.7255 | 482 | 0.5477 | 0.5750 | 0.5477 | 0.7401 | | No log | 4.7451 | 484 | 0.5435 | 0.5955 | 0.5435 | 0.7372 | | No log | 4.7647 | 486 | 0.4984 | 0.6274 | 0.4984 | 0.7059 | | No log | 4.7843 | 488 | 0.4782 | 0.6469 | 0.4782 | 0.6915 | | No log | 4.8039 | 490 | 0.4183 | 0.6771 | 0.4183 | 0.6467 | | No log | 4.8235 | 492 | 0.4049 | 0.7001 | 0.4049 | 0.6363 | | No log | 4.8431 | 494 | 0.4742 | 0.6781 | 0.4742 | 0.6886 | | No log | 4.8627 | 496 | 0.5400 | 0.6232 | 0.5400 | 0.7348 | | No log | 4.8824 | 498 | 0.5069 | 0.6391 | 0.5069 | 0.7120 | | 0.4786 | 4.9020 | 500 | 0.4636 | 0.6511 | 0.4636 | 0.6809 | | 0.4786 | 4.9216 | 502 | 0.4543 | 0.6447 | 0.4543 | 0.6740 | | 0.4786 | 4.9412 | 504 | 0.4543 | 0.6353 | 0.4543 | 0.6740 | | 0.4786 | 4.9608 | 506 | 0.4914 | 0.5705 | 0.4914 | 0.7010 | | 0.4786 | 4.9804 | 508 | 0.4954 | 0.5341 | 0.4954 | 0.7039 | | 0.4786 | 5.0 | 510 | 0.4744 | 0.5496 | 0.4744 | 0.6887 | ### Framework versions - Transformers 4.44.2 - Pytorch 2.4.0+cu118 - Datasets 2.21.0 - Tokenizers 0.19.1