ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k1_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3536
• Qwk: 0.4590
• Mse: 1.3536
• Rmse: 1.1634

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	7.0721	0.0058	7.0721	2.6594
No log	0.8	4	4.6816	0.0620	4.6816	2.1637
No log	1.2	6	3.7079	-0.0312	3.7079	1.9256
No log	1.6	8	3.2770	-0.0592	3.2770	1.8102
No log	2.0	10	2.2981	0.0606	2.2981	1.5160
No log	2.4	12	2.0121	0.0870	2.0121	1.4185
No log	2.8	14	1.8194	0.1524	1.8194	1.3489
No log	3.2	16	1.7503	0.1538	1.7503	1.3230
No log	3.6	18	1.8316	0.2000	1.8316	1.3534
No log	4.0	20	1.8531	0.1982	1.8531	1.3613
No log	4.4	22	1.8588	0.2281	1.8588	1.3634
No log	4.8	24	1.8474	0.2881	1.8474	1.3592
No log	5.2	26	1.6942	0.2857	1.6942	1.3016
No log	5.6	28	1.5161	0.2018	1.5161	1.2313
No log	6.0	30	1.4475	0.1698	1.4475	1.2031
No log	6.4	32	1.4362	0.1698	1.4362	1.1984
No log	6.8	34	1.4813	0.2182	1.4813	1.2171
No log	7.2	36	1.5918	0.2906	1.5918	1.2617
No log	7.6	38	1.6427	0.3636	1.6427	1.2817
No log	8.0	40	1.5787	0.2931	1.5787	1.2565
No log	8.4	42	1.4105	0.2261	1.4105	1.1876
No log	8.8	44	1.3898	0.4286	1.3898	1.1789
No log	9.2	46	1.3655	0.3193	1.3655	1.1685
No log	9.6	48	1.4519	0.2667	1.4519	1.2050
No log	10.0	50	1.5846	0.2689	1.5846	1.2588
No log	10.4	52	1.6099	0.2393	1.6099	1.2688
No log	10.8	54	1.8039	0.2353	1.8039	1.3431
No log	11.2	56	1.8804	0.1653	1.8804	1.3713
No log	11.6	58	1.7998	0.2810	1.7998	1.3416
No log	12.0	60	1.9261	0.2393	1.9261	1.3878
No log	12.4	62	1.8554	0.2353	1.8554	1.3621
No log	12.8	64	1.5693	0.3150	1.5693	1.2527
No log	13.2	66	1.4834	0.4062	1.4834	1.2180
No log	13.6	68	1.5331	0.3871	1.5331	1.2382
No log	14.0	70	1.5203	0.3846	1.5203	1.2330
No log	14.4	72	1.5115	0.4094	1.5115	1.2294
No log	14.8	74	1.3936	0.3548	1.3936	1.1805
No log	15.2	76	1.3804	0.4098	1.3804	1.1749
No log	15.6	78	1.4770	0.4375	1.4770	1.2153
No log	16.0	80	1.4265	0.3333	1.4265	1.1944
No log	16.4	82	1.4705	0.3115	1.4705	1.2126
No log	16.8	84	1.6893	0.2295	1.6893	1.2997
No log	17.2	86	1.7407	0.3704	1.7407	1.3193
No log	17.6	88	1.5767	0.4148	1.5767	1.2557
No log	18.0	90	1.3837	0.4242	1.3837	1.1763
No log	18.4	92	1.4266	0.3846	1.4266	1.1944
No log	18.8	94	1.6334	0.4098	1.6334	1.2781
No log	19.2	96	1.9281	0.0566	1.9281	1.3886
No log	19.6	98	1.8888	0.0952	1.8888	1.3743
No log	20.0	100	1.7312	0.0550	1.7312	1.3157
No log	20.4	102	1.6528	0.3636	1.6528	1.2856
No log	20.8	104	1.5925	0.4160	1.5925	1.2619
No log	21.2	106	1.5349	0.3710	1.5349	1.2389
No log	21.6	108	1.5170	0.3937	1.5170	1.2316
No log	22.0	110	1.5465	0.3810	1.5465	1.2436
No log	22.4	112	1.6381	0.3200	1.6381	1.2799
No log	22.8	114	1.6929	0.2880	1.6929	1.3011
No log	23.2	116	1.7356	0.2687	1.7356	1.3174
No log	23.6	118	1.5989	0.4060	1.5989	1.2645
No log	24.0	120	1.4803	0.4615	1.4803	1.2167
No log	24.4	122	1.4490	0.4615	1.4490	1.2038
No log	24.8	124	1.4930	0.4724	1.4930	1.2219
No log	25.2	126	1.5079	0.3932	1.5079	1.2280
No log	25.6	128	1.4889	0.3932	1.4889	1.2202
No log	26.0	130	1.4795	0.4677	1.4795	1.2164
No log	26.4	132	1.4949	0.4844	1.4949	1.2227
No log	26.8	134	1.5019	0.4603	1.5019	1.2255
No log	27.2	136	1.4433	0.3932	1.4433	1.2014
No log	27.6	138	1.4089	0.3932	1.4089	1.1870
No log	28.0	140	1.3905	0.3761	1.3905	1.1792
No log	28.4	142	1.4108	0.4370	1.4108	1.1878
No log	28.8	144	1.3814	0.4839	1.3814	1.1753
No log	29.2	146	1.4665	0.4769	1.4665	1.2110
No log	29.6	148	1.5213	0.4615	1.5213	1.2334
No log	30.0	150	1.5614	0.4098	1.5614	1.2496
No log	30.4	152	1.4929	0.3304	1.4929	1.2218
No log	30.8	154	1.4832	0.2569	1.4832	1.2178
No log	31.2	156	1.4901	0.2569	1.4901	1.2207
No log	31.6	158	1.5129	0.2569	1.5129	1.2300
No log	32.0	160	1.4914	0.3419	1.4914	1.2212
No log	32.4	162	1.4881	0.4286	1.4881	1.2199
No log	32.8	164	1.5054	0.4462	1.5054	1.2269
No log	33.2	166	1.5481	0.4154	1.5481	1.2442
No log	33.6	168	1.5215	0.4496	1.5215	1.2335
No log	34.0	170	1.5279	0.4098	1.5279	1.2361
No log	34.4	172	1.5546	0.2222	1.5546	1.2468
No log	34.8	174	1.4905	0.2569	1.4905	1.2208
No log	35.2	176	1.4074	0.2909	1.4074	1.1863
No log	35.6	178	1.3059	0.3571	1.3059	1.1428
No log	36.0	180	1.2992	0.3652	1.2992	1.1398
No log	36.4	182	1.2864	0.4793	1.2864	1.1342
No log	36.8	184	1.3180	0.5039	1.3180	1.1480
No log	37.2	186	1.3153	0.5079	1.3153	1.1469
No log	37.6	188	1.3136	0.5079	1.3136	1.1461
No log	38.0	190	1.3241	0.5079	1.3241	1.1507
No log	38.4	192	1.2851	0.4918	1.2851	1.1336
No log	38.8	194	1.2765	0.4000	1.2765	1.1298
No log	39.2	196	1.2768	0.4035	1.2768	1.1300
No log	39.6	198	1.2695	0.4000	1.2695	1.1267
No log	40.0	200	1.2858	0.4068	1.2858	1.1339
No log	40.4	202	1.3399	0.5161	1.3399	1.1576
No log	40.8	204	1.3933	0.5077	1.3933	1.1804
No log	41.2	206	1.3910	0.5	1.3910	1.1794
No log	41.6	208	1.2866	0.5312	1.2866	1.1343
No log	42.0	210	1.2241	0.4793	1.2241	1.1064
No log	42.4	212	1.2305	0.4553	1.2305	1.1093
No log	42.8	214	1.2298	0.4500	1.2298	1.1090
No log	43.2	216	1.2831	0.5161	1.2831	1.1327
No log	43.6	218	1.3319	0.5203	1.3319	1.1541
No log	44.0	220	1.3370	0.5203	1.3370	1.1563
No log	44.4	222	1.2855	0.4628	1.2855	1.1338
No log	44.8	224	1.2493	0.4500	1.2493	1.1177
No log	45.2	226	1.2371	0.4667	1.2371	1.1123
No log	45.6	228	1.2460	0.4426	1.2460	1.1162
No log	46.0	230	1.2545	0.4463	1.2545	1.1201
No log	46.4	232	1.2727	0.4628	1.2727	1.1281
No log	46.8	234	1.3347	0.4677	1.3347	1.1553
No log	47.2	236	1.3848	0.4715	1.3848	1.1768
No log	47.6	238	1.3852	0.4628	1.3852	1.1769
No log	48.0	240	1.3721	0.3590	1.3721	1.1714
No log	48.4	242	1.3633	0.3478	1.3633	1.1676
No log	48.8	244	1.3530	0.3158	1.3530	1.1632
No log	49.2	246	1.3528	0.4590	1.3528	1.1631
No log	49.6	248	1.3565	0.48	1.3565	1.1647
No log	50.0	250	1.3918	0.496	1.3918	1.1797
No log	50.4	252	1.4100	0.5039	1.4100	1.1874
No log	50.8	254	1.4051	0.4921	1.4051	1.1854
No log	51.2	256	1.4158	0.496	1.4158	1.1899
No log	51.6	258	1.4104	0.3967	1.4104	1.1876
No log	52.0	260	1.3818	0.3621	1.3818	1.1755
No log	52.4	262	1.3505	0.3621	1.3505	1.1621
No log	52.8	264	1.3387	0.3652	1.3387	1.1570
No log	53.2	266	1.3426	0.4068	1.3426	1.1587
No log	53.6	268	1.3331	0.4590	1.3331	1.1546
No log	54.0	270	1.3418	0.4590	1.3418	1.1584
No log	54.4	272	1.3566	0.4355	1.3566	1.1647
No log	54.8	274	1.3893	0.5039	1.3893	1.1787
No log	55.2	276	1.3708	0.5039	1.3708	1.1708
No log	55.6	278	1.3459	0.496	1.3459	1.1601
No log	56.0	280	1.3347	0.4677	1.3347	1.1553
No log	56.4	282	1.3284	0.4590	1.3284	1.1526
No log	56.8	284	1.3305	0.4628	1.3305	1.1535
No log	57.2	286	1.3253	0.4202	1.3253	1.1512
No log	57.6	288	1.3285	0.4202	1.3285	1.1526
No log	58.0	290	1.3425	0.4628	1.3425	1.1586
No log	58.4	292	1.3463	0.4590	1.3463	1.1603
No log	58.8	294	1.3524	0.4677	1.3524	1.1629
No log	59.2	296	1.3271	0.4677	1.3271	1.1520
No log	59.6	298	1.3154	0.4878	1.3154	1.1469
No log	60.0	300	1.3004	0.4628	1.3004	1.1404
No log	60.4	302	1.2956	0.4918	1.2956	1.1382
No log	60.8	304	1.3090	0.4628	1.3090	1.1441
No log	61.2	306	1.3319	0.4298	1.3319	1.1541
No log	61.6	308	1.3731	0.4677	1.3731	1.1718
No log	62.0	310	1.4204	0.4516	1.4204	1.1918
No log	62.4	312	1.4343	0.4516	1.4343	1.1976
No log	62.8	314	1.4043	0.4677	1.4043	1.1850
No log	63.2	316	1.3663	0.4590	1.3663	1.1689
No log	63.6	318	1.3196	0.4298	1.3196	1.1487
No log	64.0	320	1.2856	0.4918	1.2856	1.1338
No log	64.4	322	1.2724	0.4918	1.2724	1.1280
No log	64.8	324	1.2627	0.4918	1.2627	1.1237
No log	65.2	326	1.2546	0.4793	1.2546	1.1201
No log	65.6	328	1.2566	0.4793	1.2566	1.1210
No log	66.0	330	1.2741	0.4500	1.2741	1.1288
No log	66.4	332	1.2986	0.4500	1.2986	1.1395
No log	66.8	334	1.3141	0.4500	1.3141	1.1463
No log	67.2	336	1.3150	0.4500	1.3150	1.1468
No log	67.6	338	1.3134	0.4500	1.3134	1.1460
No log	68.0	340	1.3210	0.4202	1.3210	1.1494
No log	68.4	342	1.3256	0.4500	1.3256	1.1513
No log	68.8	344	1.3457	0.4333	1.3457	1.1600
No log	69.2	346	1.3617	0.4298	1.3617	1.1669
No log	69.6	348	1.3928	0.4098	1.3928	1.1802
No log	70.0	350	1.4466	0.4480	1.4466	1.2027
No log	70.4	352	1.4703	0.4516	1.4703	1.2126
No log	70.8	354	1.4574	0.4516	1.4574	1.2072
No log	71.2	356	1.4332	0.4298	1.4332	1.1971
No log	71.6	358	1.4082	0.4	1.4082	1.1867
No log	72.0	360	1.3781	0.4298	1.3781	1.1739
No log	72.4	362	1.3616	0.4590	1.3616	1.1669
No log	72.8	364	1.3546	0.4590	1.3546	1.1639
No log	73.2	366	1.3357	0.4590	1.3357	1.1557
No log	73.6	368	1.3196	0.4878	1.3196	1.1487
No log	74.0	370	1.3230	0.4590	1.3230	1.1502
No log	74.4	372	1.3329	0.4590	1.3329	1.1545
No log	74.8	374	1.3308	0.4333	1.3308	1.1536
No log	75.2	376	1.3241	0.4333	1.3241	1.1507
No log	75.6	378	1.3237	0.4333	1.3237	1.1505
No log	76.0	380	1.3264	0.4333	1.3264	1.1517
No log	76.4	382	1.3209	0.4590	1.3209	1.1493
No log	76.8	384	1.3248	0.4590	1.3248	1.1510
No log	77.2	386	1.3268	0.4590	1.3268	1.1519
No log	77.6	388	1.3329	0.496	1.3329	1.1545
No log	78.0	390	1.3399	0.496	1.3399	1.1576
No log	78.4	392	1.3505	0.496	1.3505	1.1621
No log	78.8	394	1.3497	0.496	1.3497	1.1618
No log	79.2	396	1.3514	0.496	1.3514	1.1625
No log	79.6	398	1.3476	0.496	1.3476	1.1608
No log	80.0	400	1.3389	0.4677	1.3389	1.1571
No log	80.4	402	1.3284	0.4590	1.3284	1.1526
No log	80.8	404	1.3198	0.4628	1.3198	1.1488
No log	81.2	406	1.3179	0.4793	1.3179	1.1480
No log	81.6	408	1.3218	0.4370	1.3218	1.1497
No log	82.0	410	1.3261	0.4793	1.3261	1.1516
No log	82.4	412	1.3283	0.4500	1.3283	1.1525
No log	82.8	414	1.3317	0.4590	1.3317	1.1540
No log	83.2	416	1.3338	0.4590	1.3338	1.1549
No log	83.6	418	1.3357	0.4590	1.3357	1.1557
No log	84.0	420	1.3446	0.4590	1.3446	1.1596
No log	84.4	422	1.3503	0.4590	1.3503	1.1620
No log	84.8	424	1.3521	0.4590	1.3521	1.1628
No log	85.2	426	1.3544	0.4590	1.3544	1.1638
No log	85.6	428	1.3533	0.4590	1.3533	1.1633
No log	86.0	430	1.3527	0.4590	1.3527	1.1631
No log	86.4	432	1.3572	0.4590	1.3572	1.1650
No log	86.8	434	1.3598	0.4590	1.3598	1.1661
No log	87.2	436	1.3591	0.4590	1.3591	1.1658
No log	87.6	438	1.3592	0.4590	1.3592	1.1659
No log	88.0	440	1.3561	0.4590	1.3561	1.1645
No log	88.4	442	1.3538	0.4590	1.3538	1.1635
No log	88.8	444	1.3471	0.4590	1.3471	1.1606
No log	89.2	446	1.3400	0.4590	1.3400	1.1576
No log	89.6	448	1.3380	0.4590	1.3380	1.1567
No log	90.0	450	1.3356	0.4590	1.3356	1.1557
No log	90.4	452	1.3341	0.4590	1.3341	1.1551
No log	90.8	454	1.3355	0.4590	1.3355	1.1556
No log	91.2	456	1.3401	0.4590	1.3401	1.1576
No log	91.6	458	1.3467	0.4590	1.3467	1.1605
No log	92.0	460	1.3521	0.4590	1.3521	1.1628
No log	92.4	462	1.3588	0.4590	1.3588	1.1657
No log	92.8	464	1.3612	0.4590	1.3612	1.1667
No log	93.2	466	1.3624	0.4298	1.3624	1.1672
No log	93.6	468	1.3607	0.4590	1.3607	1.1665
No log	94.0	470	1.3617	0.4298	1.3617	1.1669
No log	94.4	472	1.3627	0.4298	1.3627	1.1673
No log	94.8	474	1.3629	0.4298	1.3629	1.1674
No log	95.2	476	1.3636	0.4298	1.3636	1.1677
No log	95.6	478	1.3636	0.4590	1.3636	1.1677
No log	96.0	480	1.3616	0.4590	1.3616	1.1669
No log	96.4	482	1.3599	0.4590	1.3599	1.1661
No log	96.8	484	1.3584	0.4590	1.3584	1.1655
No log	97.2	486	1.3574	0.4590	1.3574	1.1651
No log	97.6	488	1.3562	0.4590	1.3562	1.1646
No log	98.0	490	1.3556	0.4590	1.3556	1.1643
No log	98.4	492	1.3553	0.4590	1.3553	1.1642
No log	98.8	494	1.3549	0.4590	1.3549	1.1640
No log	99.2	496	1.3544	0.4590	1.3544	1.1638
No log	99.6	498	1.3539	0.4590	1.3539	1.1636
0.2601	100.0	500	1.3536	0.4590	1.3536	1.1634

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1