ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2687
• Qwk: 0.1032
• Mse: 1.2687
• Rmse: 1.1263

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	4.6240	0.0010	4.6240	2.1503
No log	0.3333	4	2.6526	0.0012	2.6526	1.6287
No log	0.5	6	1.9458	0.0198	1.9458	1.3949
No log	0.6667	8	1.5579	0.0538	1.5579	1.2482
No log	0.8333	10	1.7352	-0.0669	1.7352	1.3173
No log	1.0	12	2.4648	-0.0334	2.4648	1.5700
No log	1.1667	14	2.1015	0.0165	2.1015	1.4497
No log	1.3333	16	1.4632	-0.0366	1.4632	1.2096
No log	1.5	18	1.3166	0.0464	1.3166	1.1474
No log	1.6667	20	1.4279	-0.1461	1.4279	1.1949
No log	1.8333	22	1.5416	-0.0839	1.5416	1.2416
No log	2.0	24	1.4700	-0.0352	1.4700	1.2124
No log	2.1667	26	1.3033	-0.0031	1.3033	1.1416
No log	2.3333	28	1.2504	0.1314	1.2504	1.1182
No log	2.5	30	1.2462	0.1379	1.2462	1.1163
No log	2.6667	32	1.2614	0.0810	1.2614	1.1231
No log	2.8333	34	1.3262	-0.0199	1.3262	1.1516
No log	3.0	36	1.3795	0.0473	1.3795	1.1745
No log	3.1667	38	1.3780	0.0210	1.3780	1.1739
No log	3.3333	40	1.4345	0.0449	1.4345	1.1977
No log	3.5	42	1.4421	0.0449	1.4421	1.2009
No log	3.6667	44	1.3370	-0.0870	1.3370	1.1563
No log	3.8333	46	1.2685	0.0780	1.2685	1.1263
No log	4.0	48	1.2696	0.1140	1.2696	1.1268
No log	4.1667	50	1.3402	0.0319	1.3402	1.1577
No log	4.3333	52	1.4841	0.0622	1.4841	1.2182
No log	4.5	54	1.4408	0.0562	1.4408	1.2003
No log	4.6667	56	1.2709	0.0449	1.2709	1.1274
No log	4.8333	58	1.2016	0.2167	1.2016	1.0962
No log	5.0	60	1.2254	0.1110	1.2254	1.1070
No log	5.1667	62	1.2719	0.0771	1.2719	1.1278
No log	5.3333	64	1.2949	0.0011	1.2949	1.1379
No log	5.5	66	1.2863	0.0780	1.2863	1.1342
No log	5.6667	68	1.3006	0.0547	1.3006	1.1404
No log	5.8333	70	1.3301	0.0269	1.3301	1.1533
No log	6.0	72	1.2607	0.0519	1.2607	1.1228
No log	6.1667	74	1.2195	0.1110	1.2195	1.1043
No log	6.3333	76	1.3017	0.0584	1.3017	1.1409
No log	6.5	78	1.3416	0.0857	1.3416	1.1583
No log	6.6667	80	1.2687	0.0751	1.2687	1.1264
No log	6.8333	82	1.2420	0.1081	1.2420	1.1145
No log	7.0	84	1.2351	0.1455	1.2351	1.1113
No log	7.1667	86	1.2509	0.1457	1.2509	1.1184
No log	7.3333	88	1.1851	0.1530	1.1851	1.0886
No log	7.5	90	1.2227	0.1585	1.2227	1.1058
No log	7.6667	92	1.3640	0.1379	1.3640	1.1679
No log	7.8333	94	1.4125	0.1026	1.4125	1.1885
No log	8.0	96	1.3513	0.0789	1.3513	1.1625
No log	8.1667	98	1.2374	0.0771	1.2374	1.1124
No log	8.3333	100	1.2178	0.1043	1.2178	1.1035
No log	8.5	102	1.2401	0.1397	1.2401	1.1136
No log	8.6667	104	1.2225	0.1845	1.2225	1.1057
No log	8.8333	106	1.2727	0.1248	1.2727	1.1281
No log	9.0	108	1.4546	0.1659	1.4546	1.2061
No log	9.1667	110	1.4499	0.1461	1.4499	1.2041
No log	9.3333	112	1.2921	0.0527	1.2921	1.1367
No log	9.5	114	1.2038	0.1969	1.2038	1.0972
No log	9.6667	116	1.2061	0.1969	1.2061	1.0982
No log	9.8333	118	1.2542	0.1585	1.2542	1.1199
No log	10.0	120	1.3250	0.0780	1.3250	1.1511
No log	10.1667	122	1.3805	0.1185	1.3805	1.1749
No log	10.3333	124	1.3672	0.0857	1.3672	1.1693
No log	10.5	126	1.3167	0.0857	1.3167	1.1475
No log	10.6667	128	1.2569	0.1482	1.2569	1.1211
No log	10.8333	130	1.2674	0.1482	1.2674	1.1258
No log	11.0	132	1.2685	0.1482	1.2685	1.1263
No log	11.1667	134	1.3146	0.1599	1.3146	1.1466
No log	11.3333	136	1.3613	0.1801	1.3613	1.1668
No log	11.5	138	1.4162	0.1726	1.4162	1.1901
No log	11.6667	140	1.4261	0.1597	1.4261	1.1942
No log	11.8333	142	1.3600	0.2714	1.3600	1.1662
No log	12.0	144	1.4674	0.1416	1.4674	1.2114
No log	12.1667	146	1.4908	0.1256	1.4908	1.2210
No log	12.3333	148	1.4111	0.1713	1.4111	1.1879
No log	12.5	150	1.3245	0.2330	1.3245	1.1509
No log	12.6667	152	1.3291	0.2330	1.3291	1.1529
No log	12.8333	154	1.3250	0.1903	1.3250	1.1511
No log	13.0	156	1.3589	0.1345	1.3589	1.1657
No log	13.1667	158	1.3453	0.1345	1.3453	1.1599
No log	13.3333	160	1.3031	0.1248	1.3031	1.1415
No log	13.5	162	1.2635	0.1371	1.2635	1.1241
No log	13.6667	164	1.2716	0.2110	1.2716	1.1277
No log	13.8333	166	1.3333	0.1854	1.3333	1.1547
No log	14.0	168	1.3204	0.1995	1.3204	1.1491
No log	14.1667	170	1.3179	0.1717	1.3179	1.1480
No log	14.3333	172	1.2924	0.1813	1.2924	1.1368
No log	14.5	174	1.2925	0.2330	1.2925	1.1369
No log	14.6667	176	1.2409	0.1559	1.2409	1.1140
No log	14.8333	178	1.2091	0.1602	1.2091	1.0996
No log	15.0	180	1.2389	0.1853	1.2389	1.1130
No log	15.1667	182	1.2555	0.1654	1.2555	1.1205
No log	15.3333	184	1.2356	0.1602	1.2356	1.1116
No log	15.5	186	1.2726	0.1344	1.2726	1.1281
No log	15.6667	188	1.3020	0.1000	1.3020	1.1410
No log	15.8333	190	1.2691	0.1156	1.2691	1.1265
No log	16.0	192	1.2315	0.2132	1.2315	1.1097
No log	16.1667	194	1.2374	0.2132	1.2374	1.1124
No log	16.3333	196	1.2634	0.1523	1.2634	1.1240
No log	16.5	198	1.3187	0.2236	1.3187	1.1484
No log	16.6667	200	1.3263	0.2132	1.3263	1.1516
No log	16.8333	202	1.2898	0.1578	1.2898	1.1357
No log	17.0	204	1.3008	0.1912	1.3008	1.1405
No log	17.1667	206	1.3413	0.2046	1.3413	1.1581
No log	17.3333	208	1.3608	0.2330	1.3608	1.1665
No log	17.5	210	1.3629	0.2619	1.3629	1.1674
No log	17.6667	212	1.3283	0.2258	1.3283	1.1525
No log	17.8333	214	1.3168	0.1975	1.3168	1.1475
No log	18.0	216	1.3011	0.1975	1.3011	1.1406
No log	18.1667	218	1.2939	0.2352	1.2939	1.1375
No log	18.3333	220	1.3306	0.2714	1.3306	1.1535
No log	18.5	222	1.3245	0.2570	1.3245	1.1509
No log	18.6667	224	1.2566	0.2154	1.2566	1.1210
No log	18.8333	226	1.2561	0.2154	1.2561	1.1207
No log	19.0	228	1.2805	0.1801	1.2805	1.1316
No log	19.1667	230	1.2537	0.1801	1.2537	1.1197
No log	19.3333	232	1.2503	0.1500	1.2503	1.1182
No log	19.5	234	1.2560	0.1801	1.2560	1.1207
No log	19.6667	236	1.2260	0.2343	1.2260	1.1072
No log	19.8333	238	1.1960	0.1722	1.1960	1.0936
No log	20.0	240	1.1981	0.1878	1.1981	1.0946
No log	20.1667	242	1.2097	0.1878	1.2097	1.0998
No log	20.3333	244	1.2512	0.1764	1.2512	1.1186
No log	20.5	246	1.3573	0.1608	1.3573	1.1650
No log	20.6667	248	1.3344	0.1989	1.3344	1.1552
No log	20.8333	250	1.2456	0.1959	1.2456	1.1161
No log	21.0	252	1.2103	0.1767	1.2103	1.1001
No log	21.1667	254	1.2237	0.1969	1.2237	1.1062
No log	21.3333	256	1.3132	0.2184	1.3132	1.1459
No log	21.5	258	1.3671	0.1753	1.3671	1.1692
No log	21.6667	260	1.3166	0.2330	1.3166	1.1474
No log	21.8333	262	1.2507	0.2395	1.2507	1.1183
No log	22.0	264	1.2370	0.2395	1.2370	1.1122
No log	22.1667	266	1.2456	0.2490	1.2456	1.1160
No log	22.3333	268	1.2898	0.2714	1.2898	1.1357
No log	22.5	270	1.2828	0.2714	1.2828	1.1326
No log	22.6667	272	1.3267	0.1943	1.3267	1.1518
No log	22.8333	274	1.3359	0.2184	1.3359	1.1558
No log	23.0	276	1.3003	0.2184	1.3003	1.1403
No log	23.1667	278	1.2241	0.1814	1.2241	1.1064
No log	23.3333	280	1.2089	0.1027	1.2089	1.0995
No log	23.5	282	1.2216	0.1717	1.2216	1.1053
No log	23.6667	284	1.2636	0.2490	1.2636	1.1241
No log	23.8333	286	1.2466	0.1814	1.2466	1.1165
No log	24.0	288	1.2507	0.2490	1.2507	1.1184
No log	24.1667	290	1.2716	0.2762	1.2716	1.1276
No log	24.3333	292	1.3840	0.1795	1.3840	1.1764
No log	24.5	294	1.4205	0.1748	1.4205	1.1918
No log	24.6667	296	1.3223	0.2184	1.3223	1.1499
No log	24.8333	298	1.2282	0.2276	1.2282	1.1082
No log	25.0	300	1.2142	0.2132	1.2142	1.1019
No log	25.1667	302	1.2238	0.2286	1.2238	1.1063
No log	25.3333	304	1.2590	0.1344	1.2590	1.1220
No log	25.5	306	1.3248	0.1159	1.3248	1.1510
No log	25.6667	308	1.3251	0.1159	1.3251	1.1511
No log	25.8333	310	1.3231	0.1159	1.3231	1.1503
No log	26.0	312	1.2748	0.1185	1.2748	1.1291
No log	26.1667	314	1.2320	0.1121	1.2320	1.1100
No log	26.3333	316	1.2137	0.1683	1.2137	1.1017
No log	26.5	318	1.2198	0.1621	1.2198	1.1044
No log	26.6667	320	1.2547	0.2100	1.2547	1.1201
No log	26.8333	322	1.2684	0.1951	1.2684	1.1263
No log	27.0	324	1.2786	0.1951	1.2786	1.1307
No log	27.1667	326	1.2865	0.1614	1.2865	1.1342
No log	27.3333	328	1.2791	0.1311	1.2791	1.1310
No log	27.5	330	1.2573	0.1278	1.2573	1.1213
No log	27.6667	332	1.2675	0.1124	1.2675	1.1258
No log	27.8333	334	1.2715	0.1311	1.2715	1.1276
No log	28.0	336	1.2502	0.1244	1.2502	1.1181
No log	28.1667	338	1.2644	0.0464	1.2644	1.1244
No log	28.3333	340	1.2600	0.0559	1.2600	1.1225
No log	28.5	342	1.2512	0.1468	1.2512	1.1186
No log	28.6667	344	1.2719	0.1878	1.2719	1.1278
No log	28.8333	346	1.3248	0.1521	1.3248	1.1510
No log	29.0	348	1.3431	0.1521	1.3431	1.1589
No log	29.1667	350	1.3407	0.0940	1.3407	1.1579
No log	29.3333	352	1.3629	0.0778	1.3629	1.1674
No log	29.5	354	1.3808	0.0594	1.3808	1.1751
No log	29.6667	356	1.3879	-0.0267	1.3879	1.1781
No log	29.8333	358	1.3758	0.0270	1.3758	1.1729
No log	30.0	360	1.3641	0.0958	1.3641	1.1680
No log	30.1667	362	1.3494	0.0958	1.3494	1.1616
No log	30.3333	364	1.3330	0.0958	1.3330	1.1546
No log	30.5	366	1.3127	0.0625	1.3127	1.1457
No log	30.6667	368	1.3030	0.0625	1.3030	1.1415
No log	30.8333	370	1.2977	0.0789	1.2977	1.1391
No log	31.0	372	1.2890	0.1117	1.2890	1.1353
No log	31.1667	374	1.2856	0.0934	1.2856	1.1339
No log	31.3333	376	1.2905	0.1544	1.2905	1.1360
No log	31.5	378	1.3200	0.1727	1.3200	1.1489
No log	31.6667	380	1.3525	0.1614	1.3525	1.1630
No log	31.8333	382	1.3224	0.1764	1.3224	1.1500
No log	32.0	384	1.2987	0.1671	1.2987	1.1396
No log	32.1667	386	1.2979	0.1764	1.2979	1.1392
No log	32.3333	388	1.2867	0.1371	1.2867	1.1343
No log	32.5	390	1.2714	0.1309	1.2714	1.1275
No log	32.6667	392	1.2689	0.0711	1.2689	1.1265
No log	32.8333	394	1.2742	0.0543	1.2742	1.1288
No log	33.0	396	1.2815	0.0625	1.2815	1.1320
No log	33.1667	398	1.2936	0.1121	1.2936	1.1374
No log	33.3333	400	1.3149	0.1819	1.3149	1.1467
No log	33.5	402	1.3036	0.1121	1.3036	1.1418
No log	33.6667	404	1.2952	0.0934	1.2952	1.1381
No log	33.8333	406	1.3009	0.0625	1.3009	1.1406
No log	34.0	408	1.3152	0.1121	1.3152	1.1468
No log	34.1667	410	1.3445	0.1217	1.3445	1.1595
No log	34.3333	412	1.3761	0.1000	1.3761	1.1731
No log	34.5	414	1.4038	0.0592	1.4038	1.1848
No log	34.6667	416	1.3747	0.1311	1.3747	1.1725
No log	34.8333	418	1.3491	0.0878	1.3491	1.1615
No log	35.0	420	1.3384	0.0940	1.3384	1.1569
No log	35.1667	422	1.3606	0.1311	1.3606	1.1664
No log	35.3333	424	1.3523	0.1188	1.3523	1.1629
No log	35.5	426	1.3217	0.0940	1.3217	1.1497
No log	35.6667	428	1.3059	0.1093	1.3059	1.1427
No log	35.8333	430	1.3087	0.1396	1.3087	1.1440
No log	36.0	432	1.2972	0.1396	1.2972	1.1389
No log	36.1667	434	1.3169	0.1485	1.3169	1.1476
No log	36.3333	436	1.3497	0.1339	1.3497	1.1618
No log	36.5	438	1.3426	0.0958	1.3426	1.1587
No log	36.6667	440	1.2847	0.1727	1.2847	1.1335
No log	36.8333	442	1.2585	0.2069	1.2585	1.1218
No log	37.0	444	1.2774	0.1736	1.2774	1.1302
No log	37.1667	446	1.3090	0.1860	1.3090	1.1441
No log	37.3333	448	1.3148	0.1860	1.3148	1.1466
No log	37.5	450	1.2983	0.1771	1.2983	1.1394
No log	37.6667	452	1.2524	0.2258	1.2524	1.1191
No log	37.8333	454	1.2440	0.1975	1.2440	1.1154
No log	38.0	456	1.2587	0.2258	1.2587	1.1219
No log	38.1667	458	1.2959	0.1867	1.2959	1.1384
No log	38.3333	460	1.3295	0.1813	1.3295	1.1530
No log	38.5	462	1.3053	0.1813	1.3053	1.1425
No log	38.6667	464	1.2623	0.1278	1.2623	1.1235
No log	38.8333	466	1.2492	0.1581	1.2492	1.1177
No log	39.0	468	1.2315	0.1467	1.2315	1.1097
No log	39.1667	470	1.2280	0.1043	1.2280	1.1081
No log	39.3333	472	1.2224	0.1468	1.2224	1.1056
No log	39.5	474	1.2201	0.1309	1.2201	1.1046
No log	39.6667	476	1.2512	0.1521	1.2512	1.1186
No log	39.8333	478	1.2595	0.1521	1.2595	1.1223
No log	40.0	480	1.2574	0.1063	1.2574	1.1214
No log	40.1667	482	1.2251	0.1769	1.2251	1.1069
No log	40.3333	484	1.2081	0.1525	1.2081	1.0991
No log	40.5	486	1.2050	0.1679	1.2050	1.0977
No log	40.6667	488	1.2246	0.1430	1.2246	1.1066
No log	40.8333	490	1.2372	0.1032	1.2372	1.1123
No log	41.0	492	1.2288	0.1032	1.2288	1.1085
No log	41.1667	494	1.2084	0.2242	1.2084	1.0993
No log	41.3333	496	1.2074	0.2455	1.2074	1.0988
No log	41.5	498	1.2104	0.2499	1.2104	1.1002
0.2986	41.6667	500	1.2309	0.2567	1.2309	1.1094
0.2986	41.8333	502	1.2302	0.2016	1.2302	1.1092
0.2986	42.0	504	1.2192	0.2053	1.2192	1.1042
0.2986	42.1667	506	1.2384	0.1371	1.2384	1.1128
0.2986	42.3333	508	1.2633	0.1032	1.2633	1.1240
0.2986	42.5	510	1.2687	0.1032	1.2687	1.1263

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1