Hugging Face's logo

MayBashendy
/
Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask6_organization

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Model card Files
xet
Community
Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask6_organization / README.md
MayBashendy's picture
MayBashendy
End of training
837ac56 verified
preview code
|
raw
history blame contribute delete
23.3 kB
metadata 
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask6_organization
    results: []

Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask6_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.7787
  • Qwk: 0.5654
  • Mse: 0.7787
  • Rmse: 0.8824

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Qwk Mse Rmse
No log 0.0194 2 4.1398 -0.0389 4.1398 2.0346
No log 0.0388 4 2.4118 0.1134 2.4118 1.5530
No log 0.0583 6 1.3055 0.0436 1.3055 1.1426
No log 0.0777 8 1.0944 0.1108 1.0944 1.0461
No log 0.0971 10 1.1481 0.0392 1.1481 1.0715
No log 0.1165 12 1.1043 0.0830 1.1043 1.0508
No log 0.1359 14 1.0030 0.1708 1.0030 1.0015
No log 0.1553 16 1.0923 0.1790 1.0923 1.0452
No log 0.1748 18 1.3665 0.0950 1.3665 1.1690
No log 0.1942 20 1.8233 0.1272 1.8233 1.3503
No log 0.2136 22 1.5082 0.1460 1.5082 1.2281
No log 0.2330 24 0.9831 0.1995 0.9831 0.9915
No log 0.2524 26 0.8261 0.4099 0.8261 0.9089
No log 0.2718 28 0.8261 0.3575 0.8261 0.9089
No log 0.2913 30 0.8932 0.2857 0.8932 0.9451
No log 0.3107 32 0.8670 0.3369 0.8670 0.9312
No log 0.3301 34 0.8270 0.3417 0.8270 0.9094
No log 0.3495 36 0.9090 0.2602 0.9090 0.9534
No log 0.3689 38 0.9472 0.2421 0.9472 0.9733
No log 0.3883 40 0.8775 0.2942 0.8775 0.9368
No log 0.4078 42 0.8436 0.3807 0.8436 0.9185
No log 0.4272 44 0.8100 0.4609 0.8100 0.9000
No log 0.4466 46 0.7906 0.4523 0.7906 0.8892
No log 0.4660 48 0.7712 0.4621 0.7712 0.8782
No log 0.4854 50 0.7721 0.5092 0.7721 0.8787
No log 0.5049 52 0.8385 0.4944 0.8385 0.9157
No log 0.5243 54 0.7542 0.4831 0.7542 0.8685
No log 0.5437 56 0.7422 0.4860 0.7422 0.8615
No log 0.5631 58 0.7727 0.5050 0.7727 0.8790
No log 0.5825 60 0.7520 0.5199 0.7520 0.8672
No log 0.6019 62 0.7061 0.4864 0.7061 0.8403
No log 0.6214 64 0.6897 0.5162 0.6897 0.8305
No log 0.6408 66 0.6958 0.5665 0.6958 0.8342
No log 0.6602 68 0.7106 0.5923 0.7106 0.8430
No log 0.6796 70 0.7961 0.5559 0.7961 0.8922
No log 0.6990 72 0.7921 0.5379 0.7921 0.8900
No log 0.7184 74 0.6771 0.6051 0.6771 0.8229
No log 0.7379 76 0.6842 0.6139 0.6842 0.8272
No log 0.7573 78 0.8096 0.5321 0.8096 0.8998
No log 0.7767 80 0.7182 0.5784 0.7182 0.8475
No log 0.7961 82 0.6674 0.5473 0.6674 0.8169
No log 0.8155 84 0.6881 0.4986 0.6881 0.8295
No log 0.8350 86 0.7020 0.4711 0.7020 0.8379
No log 0.8544 88 0.6864 0.4736 0.6864 0.8285
No log 0.8738 90 0.6741 0.4946 0.6741 0.8210
No log 0.8932 92 0.7005 0.5042 0.7005 0.8370
No log 0.9126 94 0.6847 0.5370 0.6847 0.8275
No log 0.9320 96 0.6566 0.5813 0.6566 0.8103
No log 0.9515 98 0.7424 0.5699 0.7424 0.8616
No log 0.9709 100 0.7828 0.5583 0.7828 0.8848
No log 0.9903 102 0.7411 0.6108 0.7411 0.8609
No log 1.0097 104 0.6652 0.5963 0.6652 0.8156
No log 1.0291 106 0.7123 0.5957 0.7123 0.8440
No log 1.0485 108 0.6905 0.5717 0.6905 0.8310
No log 1.0680 110 0.7199 0.5599 0.7199 0.8485
No log 1.0874 112 0.7659 0.5150 0.7659 0.8751
No log 1.1068 114 0.8183 0.4780 0.8183 0.9046
No log 1.1262 116 0.8503 0.5263 0.8503 0.9221
No log 1.1456 118 0.7778 0.5757 0.7778 0.8819
No log 1.1650 120 0.7302 0.5717 0.7302 0.8545
No log 1.1845 122 0.7102 0.5536 0.7102 0.8427
No log 1.2039 124 0.7605 0.5712 0.7605 0.8721
No log 1.2233 126 0.7759 0.5801 0.7759 0.8808
No log 1.2427 128 0.7304 0.5494 0.7304 0.8546
No log 1.2621 130 0.7349 0.5590 0.7349 0.8572
No log 1.2816 132 0.8223 0.5703 0.8223 0.9068
No log 1.3010 134 0.8822 0.5561 0.8822 0.9393
No log 1.3204 136 0.8066 0.5533 0.8066 0.8981
No log 1.3398 138 0.7047 0.5289 0.7047 0.8395
No log 1.3592 140 0.7007 0.5320 0.7007 0.8371
No log 1.3786 142 0.7120 0.5448 0.7120 0.8438
No log 1.3981 144 0.7210 0.5613 0.7210 0.8491
No log 1.4175 146 0.7232 0.5832 0.7232 0.8504
No log 1.4369 148 0.6947 0.5592 0.6947 0.8335
No log 1.4563 150 0.7419 0.5628 0.7419 0.8613
No log 1.4757 152 0.7313 0.5632 0.7313 0.8551
No log 1.4951 154 0.6618 0.5887 0.6618 0.8135
No log 1.5146 156 0.6953 0.6116 0.6953 0.8339
No log 1.5340 158 0.9191 0.5247 0.9191 0.9587
No log 1.5534 160 0.9546 0.4989 0.9546 0.9771
No log 1.5728 162 0.8426 0.5286 0.8426 0.9179
No log 1.5922 164 0.6930 0.5334 0.6930 0.8325
No log 1.6117 166 0.6666 0.5606 0.6666 0.8165
No log 1.6311 168 0.6300 0.5818 0.6300 0.7938
No log 1.6505 170 0.6508 0.5780 0.6508 0.8067
No log 1.6699 172 0.6518 0.5490 0.6518 0.8074
No log 1.6893 174 0.6323 0.5367 0.6323 0.7952
No log 1.7087 176 0.6477 0.5802 0.6477 0.8048
No log 1.7282 178 0.6462 0.5920 0.6462 0.8038
No log 1.7476 180 0.6561 0.5741 0.6561 0.8100
No log 1.7670 182 0.7697 0.6046 0.7697 0.8773
No log 1.7864 184 0.8001 0.6005 0.8001 0.8945
No log 1.8058 186 0.7196 0.6110 0.7196 0.8483
No log 1.8252 188 0.6393 0.5929 0.6393 0.7995
No log 1.8447 190 0.6533 0.6123 0.6533 0.8083
No log 1.8641 192 0.6579 0.6086 0.6579 0.8111
No log 1.8835 194 0.6164 0.5921 0.6164 0.7851
No log 1.9029 196 0.6413 0.5682 0.6413 0.8008
No log 1.9223 198 0.6834 0.5697 0.6834 0.8267
No log 1.9417 200 0.7164 0.5635 0.7164 0.8464
No log 1.9612 202 0.6886 0.5666 0.6886 0.8298
No log 1.9806 204 0.6064 0.6280 0.6064 0.7787
No log 2.0 206 0.5926 0.6548 0.5926 0.7698
No log 2.0194 208 0.5932 0.6393 0.5932 0.7702
No log 2.0388 210 0.5971 0.6548 0.5971 0.7727
No log 2.0583 212 0.5999 0.6486 0.5999 0.7746
No log 2.0777 214 0.6027 0.6254 0.6027 0.7763
No log 2.0971 216 0.6076 0.5975 0.6076 0.7795
No log 2.1165 218 0.6212 0.5822 0.6212 0.7881
No log 2.1359 220 0.6305 0.5698 0.6305 0.7940
No log 2.1553 222 0.6855 0.5703 0.6855 0.8280
No log 2.1748 224 0.8625 0.5766 0.8625 0.9287
No log 2.1942 226 0.9249 0.5539 0.9249 0.9617
No log 2.2136 228 0.8289 0.5884 0.8289 0.9104
No log 2.2330 230 0.8414 0.5682 0.8414 0.9173
No log 2.2524 232 0.7675 0.5338 0.7675 0.8761
No log 2.2718 234 0.6717 0.5645 0.6717 0.8196
No log 2.2913 236 0.6863 0.5746 0.6863 0.8284
No log 2.3107 238 0.6852 0.5485 0.6852 0.8278
No log 2.3301 240 0.6705 0.5415 0.6705 0.8189
No log 2.3495 242 0.6500 0.5683 0.6500 0.8062
No log 2.3689 244 0.6817 0.5696 0.6817 0.8257
No log 2.3883 246 0.7063 0.6080 0.7063 0.8404
No log 2.4078 248 0.6812 0.5949 0.6812 0.8253
No log 2.4272 250 0.6831 0.6034 0.6831 0.8265
No log 2.4466 252 0.6818 0.6023 0.6818 0.8257
No log 2.4660 254 0.7203 0.6038 0.7203 0.8487
No log 2.4854 256 0.9110 0.5799 0.9110 0.9545
No log 2.5049 258 0.8855 0.5905 0.8855 0.9410
No log 2.5243 260 0.7245 0.5627 0.7245 0.8511
No log 2.5437 262 0.6622 0.5661 0.6622 0.8137
No log 2.5631 264 0.6680 0.5595 0.6680 0.8173
No log 2.5825 266 0.6614 0.5831 0.6614 0.8133
No log 2.6019 268 0.6591 0.5829 0.6591 0.8118
No log 2.6214 270 0.7108 0.6056 0.7108 0.8431
No log 2.6408 272 0.8231 0.6011 0.8231 0.9072
No log 2.6602 274 0.8070 0.6082 0.8070 0.8983
No log 2.6796 276 0.7720 0.6280 0.7720 0.8786
No log 2.6990 278 0.7685 0.6311 0.7685 0.8767
No log 2.7184 280 0.7567 0.6190 0.7567 0.8699
No log 2.7379 282 0.7035 0.6159 0.7035 0.8388
No log 2.7573 284 0.6554 0.6266 0.6554 0.8095
No log 2.7767 286 0.7966 0.6157 0.7966 0.8925
No log 2.7961 288 0.7744 0.5999 0.7744 0.8800
No log 2.8155 290 0.6516 0.5759 0.6516 0.8072
No log 2.8350 292 0.5881 0.6267 0.5881 0.7669
No log 2.8544 294 0.5767 0.6298 0.5767 0.7594
No log 2.8738 296 0.6168 0.6396 0.6168 0.7854
No log 2.8932 298 0.7194 0.6499 0.7194 0.8482
No log 2.9126 300 0.7972 0.6364 0.7972 0.8928
No log 2.9320 302 0.8105 0.6366 0.8105 0.9003
No log 2.9515 304 0.8309 0.6272 0.8309 0.9116
No log 2.9709 306 0.7306 0.6388 0.7306 0.8548
No log 2.9903 308 0.6859 0.6526 0.6859 0.8282
No log 3.0097 310 0.6775 0.6338 0.6775 0.8231
No log 3.0291 312 0.6616 0.6199 0.6616 0.8134
No log 3.0485 314 0.6532 0.6228 0.6532 0.8082
No log 3.0680 316 0.6908 0.5683 0.6908 0.8311
No log 3.0874 318 0.7051 0.5844 0.7051 0.8397
No log 3.1068 320 0.7269 0.5630 0.7269 0.8526
No log 3.1262 322 0.8145 0.5442 0.8145 0.9025
No log 3.1456 324 0.8807 0.5367 0.8807 0.9385
No log 3.1650 326 0.8901 0.5369 0.8901 0.9435
No log 3.1845 328 0.8131 0.5455 0.8131 0.9017
No log 3.2039 330 0.7905 0.5905 0.7905 0.8891
No log 3.2233 332 0.7808 0.6055 0.7808 0.8836
No log 3.2427 334 0.7820 0.5866 0.7820 0.8843
No log 3.2621 336 0.8155 0.5723 0.8155 0.9030
No log 3.2816 338 0.7594 0.5958 0.7594 0.8715
No log 3.3010 340 0.6753 0.6375 0.6753 0.8218
No log 3.3204 342 0.6548 0.6422 0.6548 0.8092
No log 3.3398 344 0.6845 0.6152 0.6845 0.8274
No log 3.3592 346 0.7110 0.5939 0.7110 0.8432
No log 3.3786 348 0.7942 0.5778 0.7942 0.8912
No log 3.3981 350 0.7871 0.5823 0.7871 0.8872
No log 3.4175 352 0.7338 0.6090 0.7338 0.8566
No log 3.4369 354 0.6802 0.6577 0.6802 0.8247
No log 3.4563 356 0.6701 0.6750 0.6701 0.8186
No log 3.4757 358 0.6648 0.6733 0.6648 0.8154
No log 3.4951 360 0.6440 0.6708 0.6440 0.8025
No log 3.5146 362 0.6387 0.6569 0.6387 0.7992
No log 3.5340 364 0.6350 0.6682 0.6350 0.7968
No log 3.5534 366 0.6917 0.6355 0.6917 0.8317
No log 3.5728 368 0.7335 0.6342 0.7335 0.8564
No log 3.5922 370 0.7739 0.6319 0.7739 0.8797
No log 3.6117 372 0.7196 0.6641 0.7196 0.8483
No log 3.6311 374 0.6600 0.6677 0.6600 0.8124
No log 3.6505 376 0.5976 0.6651 0.5976 0.7730
No log 3.6699 378 0.5746 0.6395 0.5746 0.7580
No log 3.6893 380 0.5753 0.6471 0.5753 0.7585
No log 3.7087 382 0.5884 0.6565 0.5884 0.7671
No log 3.7282 384 0.6219 0.6651 0.6219 0.7886
No log 3.7476 386 0.6774 0.6289 0.6774 0.8230
No log 3.7670 388 0.6927 0.6269 0.6927 0.8323
No log 3.7864 390 0.6879 0.6210 0.6879 0.8294
No log 3.8058 392 0.6519 0.6422 0.6519 0.8074
No log 3.8252 394 0.6192 0.6033 0.6192 0.7869
No log 3.8447 396 0.7012 0.6165 0.7012 0.8374
No log 3.8641 398 0.7811 0.5943 0.7811 0.8838
No log 3.8835 400 0.6942 0.5935 0.6942 0.8332
No log 3.9029 402 0.6393 0.6152 0.6393 0.7996
No log 3.9223 404 0.6707 0.5983 0.6707 0.8190
No log 3.9417 406 0.9479 0.5306 0.9479 0.9736
No log 3.9612 408 1.0198 0.4948 1.0198 1.0098
No log 3.9806 410 0.8909 0.5473 0.8909 0.9439
No log 4.0 412 0.7391 0.5968 0.7391 0.8597
No log 4.0194 414 0.6898 0.6045 0.6898 0.8306
No log 4.0388 416 0.6870 0.6135 0.6870 0.8288
No log 4.0583 418 0.7140 0.6225 0.7140 0.8450
No log 4.0777 420 0.8903 0.5826 0.8903 0.9435
No log 4.0971 422 1.1906 0.5440 1.1906 1.0911
No log 4.1165 424 1.1847 0.5411 1.1847 1.0884
No log 4.1359 426 0.9379 0.5827 0.9379 0.9684
No log 4.1553 428 0.7066 0.6117 0.7066 0.8406
No log 4.1748 430 0.6695 0.6161 0.6695 0.8183
No log 4.1942 432 0.6562 0.6034 0.6562 0.8101
No log 4.2136 434 0.6616 0.5959 0.6616 0.8134
No log 4.2330 436 0.7036 0.6309 0.7036 0.8388
No log 4.2524 438 0.8055 0.6105 0.8055 0.8975
No log 4.2718 440 0.8559 0.6046 0.8559 0.9251
No log 4.2913 442 0.8990 0.5978 0.8990 0.9482
No log 4.3107 444 0.8883 0.6225 0.8883 0.9425
No log 4.3301 446 0.8513 0.6378 0.8513 0.9226
No log 4.3495 448 0.8348 0.6239 0.8348 0.9137
No log 4.3689 450 0.7942 0.6227 0.7942 0.8912
No log 4.3883 452 0.7935 0.6121 0.7935 0.8908
No log 4.4078 454 0.9040 0.5852 0.9040 0.9508
No log 4.4272 456 0.9710 0.5418 0.9710 0.9854
No log 4.4466 458 0.9356 0.5561 0.9356 0.9673
No log 4.4660 460 0.8196 0.5830 0.8196 0.9053
No log 4.4854 462 0.7319 0.6371 0.7319 0.8555
No log 4.5049 464 0.8443 0.5866 0.8443 0.9189
No log 4.5243 466 0.8744 0.5557 0.8744 0.9351
No log 4.5437 468 0.7711 0.632 0.7711 0.8781
No log 4.5631 470 0.6972 0.6350 0.6972 0.8350
No log 4.5825 472 0.7152 0.6248 0.7152 0.8457
No log 4.6019 474 0.6699 0.6300 0.6699 0.8184
No log 4.6214 476 0.6461 0.5984 0.6461 0.8038
No log 4.6408 478 0.6826 0.5832 0.6826 0.8262
No log 4.6602 480 0.7369 0.5792 0.7369 0.8584
No log 4.6796 482 0.7684 0.5576 0.7684 0.8766
No log 4.6990 484 0.6972 0.6121 0.6972 0.8350
No log 4.7184 486 0.6495 0.6159 0.6495 0.8059
No log 4.7379 488 0.6442 0.6206 0.6441 0.8026
No log 4.7573 490 0.6788 0.6465 0.6788 0.8239
No log 4.7767 492 0.8319 0.6238 0.8319 0.9121
No log 4.7961 494 0.8090 0.6214 0.8090 0.8995
No log 4.8155 496 0.6423 0.5985 0.6423 0.8015
No log 4.8350 498 0.5933 0.6102 0.5933 0.7702
0.584 4.8544 500 0.5927 0.6127 0.5927 0.7699
0.584 4.8738 502 0.5966 0.6110 0.5966 0.7724
0.584 4.8932 504 0.6422 0.6170 0.6422 0.8014
0.584 4.9126 506 0.7617 0.6358 0.7617 0.8727
0.584 4.9320 508 0.7472 0.6322 0.7472 0.8644
0.584 4.9515 510 0.6571 0.6497 0.6571 0.8106
0.584 4.9709 512 0.6486 0.6605 0.6486 0.8054
0.584 4.9903 514 0.7200 0.6482 0.7200 0.8486
0.584 5.0097 516 0.8576 0.6545 0.8576 0.9261
0.584 5.0291 518 0.8891 0.6451 0.8891 0.9429
0.584 5.0485 520 0.7986 0.6285 0.7986 0.8936
0.584 5.0680 522 0.6797 0.6411 0.6797 0.8244
0.584 5.0874 524 0.6481 0.6241 0.6481 0.8051
0.584 5.1068 526 0.6672 0.6325 0.6672 0.8168
0.584 5.1262 528 0.7338 0.6395 0.7338 0.8566
0.584 5.1456 530 0.9417 0.6043 0.9417 0.9704
0.584 5.1650 532 1.0412 0.5860 1.0412 1.0204
0.584 5.1845 534 0.8635 0.6181 0.8635 0.9292
0.584 5.2039 536 0.6903 0.6621 0.6903 0.8308
0.584 5.2233 538 0.7635 0.6105 0.7635 0.8738
0.584 5.2427 540 0.7809 0.5514 0.7809 0.8837
0.584 5.2621 542 0.6619 0.6091 0.6619 0.8136
0.584 5.2816 544 0.6308 0.6112 0.6308 0.7942
0.584 5.3010 546 0.7787 0.5654 0.7787 0.8824

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1