ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3493
• Qwk: 0.0887
• Mse: 1.3493
• Rmse: 1.1616

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.5621	0.0010	4.5621	2.1359
No log	0.2667	4	2.5949	0.0248	2.5949	1.6109
No log	0.4	6	1.8308	0.0372	1.8308	1.3531
No log	0.5333	8	1.4714	0.0165	1.4714	1.2130
No log	0.6667	10	1.3338	0.0872	1.3338	1.1549
No log	0.8	12	1.4490	0.0082	1.4490	1.2037
No log	0.9333	14	1.6124	0.0227	1.6124	1.2698
No log	1.0667	16	1.6329	0.0372	1.6329	1.2779
No log	1.2	18	1.4357	0.0682	1.4357	1.1982
No log	1.3333	20	1.2668	0.0254	1.2668	1.1255
No log	1.4667	22	1.2394	0.0473	1.2394	1.1133
No log	1.6	24	1.2786	0.0124	1.2786	1.1307
No log	1.7333	26	1.2192	0.2191	1.2192	1.1042
No log	1.8667	28	1.2189	0.2439	1.2189	1.1041
No log	2.0	30	1.1787	0.2323	1.1787	1.0857
No log	2.1333	32	1.1649	0.2681	1.1649	1.0793
No log	2.2667	34	1.1783	0.2733	1.1783	1.0855
No log	2.4	36	1.3105	0.0811	1.3105	1.1448
No log	2.5333	38	1.5222	0.0403	1.5222	1.2338
No log	2.6667	40	1.4156	0.0403	1.4156	1.1898
No log	2.8	42	1.1696	0.1904	1.1696	1.0815
No log	2.9333	44	1.0899	0.3462	1.0899	1.0440
No log	3.0667	46	1.0781	0.2993	1.0781	1.0383
No log	3.2	48	1.0583	0.2464	1.0583	1.0287
No log	3.3333	50	1.0769	0.2782	1.0769	1.0377
No log	3.4667	52	1.1314	0.2471	1.1314	1.0637
No log	3.6	54	1.1573	0.1713	1.1573	1.0758
No log	3.7333	56	1.0963	0.2408	1.0963	1.0471
No log	3.8667	58	1.1321	0.1585	1.1321	1.0640
No log	4.0	60	1.1427	0.1711	1.1427	1.0690
No log	4.1333	62	1.1486	0.2574	1.1486	1.0717
No log	4.2667	64	1.0704	0.3307	1.0704	1.0346
No log	4.4	66	1.0189	0.3616	1.0189	1.0094
No log	4.5333	68	1.0051	0.3462	1.0051	1.0026
No log	4.6667	70	1.0658	0.2013	1.0658	1.0324
No log	4.8	72	1.3117	0.1219	1.3117	1.1453
No log	4.9333	74	1.4618	0.1840	1.4618	1.2091
No log	5.0667	76	1.4696	0.0887	1.4696	1.2123
No log	5.2	78	1.2977	0.1249	1.2977	1.1391
No log	5.3333	80	1.2953	0.0490	1.2953	1.1381
No log	5.4667	82	1.2781	0.0914	1.2781	1.1305
No log	5.6	84	1.2037	0.1801	1.2037	1.0971
No log	5.7333	86	1.3472	0.2213	1.3472	1.1607
No log	5.8667	88	1.3374	0.1608	1.3374	1.1565
No log	6.0	90	1.1829	0.1747	1.1829	1.0876
No log	6.1333	92	1.1781	0.2175	1.1781	1.0854
No log	6.2667	94	1.2606	0.1997	1.2606	1.1228
No log	6.4	96	1.6025	0.1726	1.6025	1.2659
No log	6.5333	98	1.9154	0.1664	1.9154	1.3840
No log	6.6667	100	1.8548	0.2008	1.8548	1.3619
No log	6.8	102	1.5192	0.1968	1.5192	1.2326
No log	6.9333	104	1.3163	0.1995	1.3163	1.1473
No log	7.0667	106	1.3623	0.2212	1.3623	1.1672
No log	7.2	108	1.5954	0.2206	1.5954	1.2631
No log	7.3333	110	1.8291	0.1577	1.8291	1.3524
No log	7.4667	112	1.7661	0.1987	1.7661	1.3289
No log	7.6	114	1.5504	0.1713	1.5504	1.2452
No log	7.7333	116	1.3493	0.1745	1.3493	1.1616
No log	7.8667	118	1.3658	0.1379	1.3658	1.1687
No log	8.0	120	1.3393	0.1379	1.3393	1.1573
No log	8.1333	122	1.4060	0.1692	1.4060	1.1857
No log	8.2667	124	1.4407	0.1371	1.4407	1.2003
No log	8.4	126	1.4428	0.1659	1.4428	1.2012
No log	8.5333	128	1.3608	0.1405	1.3608	1.1665
No log	8.6667	130	1.3774	0.2074	1.3774	1.1736
No log	8.8	132	1.5114	0.2020	1.5114	1.2294
No log	8.9333	134	1.5778	0.1573	1.5778	1.2561
No log	9.0667	136	1.4516	0.2020	1.4516	1.2048
No log	9.2	138	1.4336	0.2020	1.4336	1.1973
No log	9.3333	140	1.4798	0.1845	1.4798	1.2165
No log	9.4667	142	1.3848	0.2354	1.3848	1.1768
No log	9.6	144	1.3706	0.2354	1.3706	1.1707
No log	9.7333	146	1.4235	0.2354	1.4235	1.1931
No log	9.8667	148	1.3986	0.1483	1.3986	1.1826
No log	10.0	150	1.3538	0.3097	1.3538	1.1635
No log	10.1333	152	1.3327	0.2689	1.3327	1.1544
No log	10.2667	154	1.3888	0.2668	1.3888	1.1785
No log	10.4	156	1.5998	0.1529	1.5998	1.2648
No log	10.5333	158	1.6411	0.1627	1.6411	1.2810
No log	10.6667	160	1.4565	0.2619	1.4565	1.2068
No log	10.8	162	1.4060	0.2754	1.4060	1.1858
No log	10.9333	164	1.4376	0.2589	1.4376	1.1990
No log	11.0667	166	1.3426	0.2460	1.3426	1.1587
No log	11.2	168	1.3010	0.2330	1.3010	1.1406
No log	11.3333	170	1.2416	0.2683	1.2416	1.1143
No log	11.4667	172	1.3114	0.2438	1.3114	1.1452
No log	11.6	174	1.4224	0.1631	1.4224	1.1926
No log	11.7333	176	1.4075	0.2020	1.4075	1.1864
No log	11.8667	178	1.3033	0.2978	1.3033	1.1416
No log	12.0	180	1.2728	0.2978	1.2728	1.1282
No log	12.1333	182	1.2447	0.2061	1.2447	1.1157
No log	12.2667	184	1.2773	0.1641	1.2773	1.1302
No log	12.4	186	1.3302	0.1379	1.3302	1.1534
No log	12.5333	188	1.3363	0.1188	1.3363	1.1560
No log	12.6667	190	1.3247	0.2046	1.3247	1.1509
No log	12.8	192	1.4849	0.1583	1.4849	1.2186
No log	12.9333	194	1.6335	0.1733	1.6335	1.2781
No log	13.0667	196	1.5345	0.1968	1.5345	1.2387
No log	13.2	198	1.4681	0.1845	1.4681	1.2116
No log	13.3333	200	1.4563	0.1583	1.4563	1.2068
No log	13.4667	202	1.3691	0.2460	1.3691	1.1701
No log	13.6	204	1.3901	0.2354	1.3901	1.1790
No log	13.7333	206	1.4178	0.2354	1.4178	1.1907
No log	13.8667	208	1.4549	0.1583	1.4549	1.2062
No log	14.0	210	1.3543	0.2074	1.3543	1.1638
No log	14.1333	212	1.3331	0.2032	1.3331	1.1546
No log	14.2667	214	1.3989	0.1935	1.3989	1.1827
No log	14.4	216	1.4452	0.1935	1.4452	1.2022
No log	14.5333	218	1.4126	0.1554	1.4126	1.1885
No log	14.6667	220	1.5400	0.2020	1.5400	1.2410
No log	14.8	222	1.5949	0.2060	1.5949	1.2629
No log	14.9333	224	1.5726	0.2020	1.5726	1.2540
No log	15.0667	226	1.5667	0.2020	1.5667	1.2517
No log	15.2	228	1.4321	0.1554	1.4321	1.1967
No log	15.3333	230	1.3298	0.1252	1.3298	1.1532
No log	15.4667	232	1.2881	0.1405	1.2881	1.1349
No log	15.6	234	1.2823	0.1405	1.2823	1.1324
No log	15.7333	236	1.3748	0.2074	1.3748	1.1725
No log	15.8667	238	1.6340	0.2281	1.6340	1.2783
No log	16.0	240	1.7264	0.2925	1.7264	1.3139
No log	16.1333	242	1.5664	0.2542	1.5664	1.2516
No log	16.2667	244	1.4143	0.1283	1.4143	1.1892
No log	16.4	246	1.4079	0.1224	1.4079	1.1865
No log	16.5333	248	1.4247	0.0920	1.4247	1.1936
No log	16.6667	250	1.4967	0.1568	1.4967	1.2234
No log	16.8	252	1.4207	0.1283	1.4207	1.1919
No log	16.9333	254	1.3751	0.1659	1.3751	1.1727
No log	17.0667	256	1.4201	0.1608	1.4201	1.1917
No log	17.2	258	1.4379	0.1371	1.4379	1.1991
No log	17.3333	260	1.4832	0.1935	1.4832	1.2179
No log	17.4667	262	1.5133	0.1568	1.5133	1.2301
No log	17.6	264	1.4399	0.1283	1.4399	1.2000
No log	17.7333	266	1.4143	0.0987	1.4143	1.1892
No log	17.8667	268	1.4166	0.0987	1.4166	1.1902
No log	18.0	270	1.3430	0.0526	1.3430	1.1589
No log	18.1333	272	1.3252	0.1252	1.3252	1.1512
No log	18.2667	274	1.3606	0.0851	1.3606	1.1664
No log	18.4	276	1.3617	0.0851	1.3617	1.1669
No log	18.5333	278	1.3419	0.0851	1.3419	1.1584
No log	18.6667	280	1.3454	0.1405	1.3454	1.1599
No log	18.8	282	1.3902	0.1935	1.3902	1.1791
No log	18.9333	284	1.4581	0.2020	1.4581	1.2075
No log	19.0667	286	1.5011	0.2309	1.5011	1.2252
No log	19.2	288	1.6572	0.2754	1.6572	1.2873
No log	19.3333	290	1.6213	0.2251	1.6213	1.2733
No log	19.4667	292	1.4451	0.1979	1.4451	1.2021
No log	19.6	294	1.2815	0.1997	1.2815	1.1321
No log	19.7333	296	1.3077	0.1850	1.3077	1.1436
No log	19.8667	298	1.4268	0.2239	1.4268	1.1945
No log	20.0	300	1.5214	0.1713	1.5214	1.2335
No log	20.1333	302	1.6402	0.1918	1.6402	1.2807
No log	20.2667	304	1.5560	0.1386	1.5560	1.2474
No log	20.4	306	1.3336	0.1371	1.3336	1.1548
No log	20.5333	308	1.1922	0.1910	1.1922	1.0919
No log	20.6667	310	1.1668	0.2072	1.1668	1.0802
No log	20.8	312	1.2129	0.2220	1.2129	1.1013
No log	20.9333	314	1.3757	0.1986	1.3757	1.1729
No log	21.0667	316	1.6912	0.2066	1.6912	1.3004
No log	21.2	318	1.8929	0.2067	1.8929	1.3758
No log	21.3333	320	1.8371	0.2331	1.8371	1.3554
No log	21.4667	322	1.6003	0.2084	1.6003	1.2650
No log	21.6	324	1.3456	0.1313	1.3456	1.1600
No log	21.7333	326	1.2043	0.2009	1.2043	1.0974
No log	21.8667	328	1.1893	0.2220	1.1893	1.0906
No log	22.0	330	1.2554	0.2552	1.2554	1.1204
No log	22.1333	332	1.4439	0.1224	1.4439	1.2016
No log	22.2667	334	1.6574	0.2188	1.6574	1.2874
No log	22.4	336	1.7478	0.2193	1.7478	1.3221
No log	22.5333	338	1.6805	0.1657	1.6805	1.2963
No log	22.6667	340	1.5099	0.1051	1.5099	1.2288
No log	22.8	342	1.3021	0.1053	1.3021	1.1411
No log	22.9333	344	1.2246	0.1689	1.2246	1.1066
No log	23.0667	346	1.2189	0.1689	1.2189	1.1041
No log	23.2	348	1.2529	0.1076	1.2529	1.1193
No log	23.3333	350	1.3092	0.0454	1.3092	1.1442
No log	23.4667	352	1.3970	0.0702	1.3970	1.1819
No log	23.6	354	1.3958	0.0920	1.3958	1.1814
No log	23.7333	356	1.3388	0.1405	1.3388	1.1571
No log	23.8667	358	1.3090	0.1557	1.3090	1.1441
No log	24.0	360	1.3317	0.1405	1.3317	1.1540
No log	24.1333	362	1.4321	0.1339	1.4321	1.1967
No log	24.2667	364	1.4761	0.1339	1.4761	1.2149
No log	24.4	366	1.5043	0.1196	1.5043	1.2265
No log	24.5333	368	1.5179	0.1708	1.5179	1.2320
No log	24.6667	370	1.4637	0.1196	1.4637	1.2098
No log	24.8	372	1.4176	0.1196	1.4176	1.1906
No log	24.9333	374	1.3303	0.1405	1.3303	1.1534
No log	25.0667	376	1.3272	0.1557	1.3272	1.1520
No log	25.2	378	1.3854	0.1554	1.3854	1.1770
No log	25.3333	380	1.4387	0.1162	1.4387	1.1994
No log	25.4667	382	1.4668	0.1461	1.4668	1.2111
No log	25.6	384	1.4069	0.0851	1.4069	1.1861
No log	25.7333	386	1.3149	0.0887	1.3149	1.1467
No log	25.8667	388	1.2660	0.1479	1.2660	1.1252
No log	26.0	390	1.2695	0.1479	1.2695	1.1267
No log	26.1333	392	1.2789	0.1479	1.2789	1.1309
No log	26.2667	394	1.2683	0.1641	1.2683	1.1262
No log	26.4	396	1.3103	0.1282	1.3103	1.1447
No log	26.5333	398	1.3880	0.1554	1.3880	1.1781
No log	26.6667	400	1.4572	0.1112	1.4572	1.2072
No log	26.8	402	1.4740	0.1112	1.4740	1.2141
No log	26.9333	404	1.4422	0.0750	1.4422	1.2009
No log	27.0667	406	1.4592	0.1112	1.4592	1.2080
No log	27.2	408	1.4406	0.0851	1.4406	1.2003
No log	27.3333	410	1.3529	0.1283	1.3529	1.1631
No log	27.4667	412	1.2744	0.1641	1.2744	1.1289
No log	27.6	414	1.2429	0.1641	1.2429	1.1149
No log	27.7333	416	1.2573	0.1479	1.2573	1.1213
No log	27.8667	418	1.3093	0.0887	1.3093	1.1443
No log	28.0	420	1.4009	0.1031	1.4009	1.1836
No log	28.1333	422	1.4120	0.0444	1.4120	1.1883
No log	28.2667	424	1.3567	0.0887	1.3567	1.1648
No log	28.4	426	1.3466	0.0887	1.3466	1.1604
No log	28.5333	428	1.3465	0.0444	1.3465	1.1604
No log	28.6667	430	1.3712	0.0444	1.3712	1.1710
No log	28.8	432	1.3932	0.0444	1.3932	1.1804
No log	28.9333	434	1.4068	0.0444	1.4068	1.1861
No log	29.0667	436	1.3619	0.0887	1.3619	1.1670
No log	29.2	438	1.3124	0.1053	1.3124	1.1456
No log	29.3333	440	1.2712	0.1148	1.2712	1.1275
No log	29.4667	442	1.2767	0.1053	1.2767	1.1299
No log	29.6	444	1.3221	0.1053	1.3221	1.1498
No log	29.7333	446	1.4266	0.1395	1.4266	1.1944
No log	29.8667	448	1.4404	0.1395	1.4404	1.2002
No log	30.0	450	1.3712	0.0964	1.3712	1.1710
No log	30.1333	452	1.2789	0.2046	1.2789	1.1309
No log	30.2667	454	1.2112	0.2019	1.2112	1.1006
No log	30.4	456	1.2043	0.2019	1.2043	1.0974
No log	30.5333	458	1.2430	0.1315	1.2430	1.1149
No log	30.6667	460	1.3483	0.1053	1.3483	1.1612
No log	30.8	462	1.5000	0.1516	1.5000	1.2247
No log	30.9333	464	1.5634	0.1171	1.5634	1.2504
No log	31.0667	466	1.5050	0.1171	1.5050	1.2268
No log	31.2	468	1.4177	0.1745	1.4177	1.1907
No log	31.3333	470	1.3953	0.1745	1.3953	1.1812
No log	31.4667	472	1.4441	0.1533	1.4441	1.2017
No log	31.6	474	1.4571	0.1801	1.4571	1.2071
No log	31.7333	476	1.4847	0.1801	1.4847	1.2185
No log	31.8667	478	1.4416	0.1935	1.4416	1.2007
No log	32.0	480	1.3898	0.2080	1.3898	1.1789
No log	32.1333	482	1.3081	0.0711	1.3081	1.1437
No log	32.2667	484	1.2618	0.1910	1.2618	1.1233
No log	32.4	486	1.2509	0.1910	1.2509	1.1184
No log	32.5333	488	1.2683	0.1315	1.2683	1.1262
No log	32.6667	490	1.3411	0.1031	1.3411	1.1580
No log	32.8	492	1.3967	0.1935	1.3967	1.1818
No log	32.9333	494	1.3974	0.1935	1.3974	1.1821
No log	33.0667	496	1.3593	0.1889	1.3593	1.1659
No log	33.2	498	1.3112	0.0887	1.3112	1.1451
0.285	33.3333	500	1.2962	0.0887	1.2962	1.1385
0.285	33.4667	502	1.2681	0.1048	1.2681	1.1261
0.285	33.6	504	1.2764	0.1379	1.2764	1.1298
0.285	33.7333	506	1.3171	0.1053	1.3171	1.1477
0.285	33.8667	508	1.4004	0.0603	1.4004	1.1834
0.285	34.0	510	1.4891	0.1516	1.4891	1.2203
0.285	34.1333	512	1.5669	0.1842	1.5669	1.2518
0.285	34.2667	514	1.5355	0.1842	1.5355	1.2391
0.285	34.4	516	1.4249	0.0778	1.4249	1.1937
0.285	34.5333	518	1.3515	0.0887	1.3515	1.1626
0.285	34.6667	520	1.3710	0.0887	1.3710	1.1709
0.285	34.8	522	1.3679	0.0887	1.3679	1.1696
0.285	34.9333	524	1.3493	0.0887	1.3493	1.1616

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1