ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k20_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3526
• Qwk: 0.2075
• Mse: 1.3526
• Rmse: 1.1630

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	3.9490	0.0070	3.9490	1.9872
No log	0.0833	4	2.2582	0.0868	2.2582	1.5027
No log	0.125	6	1.8695	0.0429	1.8695	1.3673
No log	0.1667	8	1.9632	0.1105	1.9632	1.4012
No log	0.2083	10	1.2313	0.0380	1.2313	1.1096
No log	0.25	12	1.1038	0.2416	1.1038	1.0506
No log	0.2917	14	1.0947	0.0513	1.0947	1.0463
No log	0.3333	16	1.1337	0.1101	1.1337	1.0647
No log	0.375	18	1.1972	0.1482	1.1972	1.0942
No log	0.4167	20	1.2059	0.1119	1.2059	1.0982
No log	0.4583	22	1.1303	0.1408	1.1303	1.0632
No log	0.5	24	1.1634	0.0636	1.1634	1.0786
No log	0.5417	26	1.2656	0.0833	1.2656	1.1250
No log	0.5833	28	1.2853	0.0445	1.2853	1.1337
No log	0.625	30	1.1011	0.0824	1.1011	1.0493
No log	0.6667	32	1.0461	0.1891	1.0461	1.0228
No log	0.7083	34	1.0293	0.3037	1.0293	1.0146
No log	0.75	36	1.0284	0.3645	1.0284	1.0141
No log	0.7917	38	1.0520	0.2465	1.0520	1.0257
No log	0.8333	40	1.0528	0.3104	1.0528	1.0261
No log	0.875	42	1.1237	0.1725	1.1237	1.0600
No log	0.9167	44	1.3334	-0.0870	1.3334	1.1547
No log	0.9583	46	1.3683	-0.1174	1.3683	1.1697
No log	1.0	48	1.3355	-0.0753	1.3355	1.1556
No log	1.0417	50	1.4687	0.0246	1.4687	1.2119
No log	1.0833	52	1.9367	-0.1020	1.9367	1.3917
No log	1.125	54	2.0907	-0.1605	2.0907	1.4459
No log	1.1667	56	1.7538	-0.0048	1.7538	1.3243
No log	1.2083	58	1.5461	0.2035	1.5461	1.2434
No log	1.25	60	1.3725	0.2537	1.3725	1.1715
No log	1.2917	62	1.2395	0.3391	1.2395	1.1133
No log	1.3333	64	1.1379	0.3043	1.1379	1.0667
No log	1.375	66	1.3067	0.3056	1.3067	1.1431
No log	1.4167	68	1.5203	0.1663	1.5203	1.2330
No log	1.4583	70	1.5465	0.1193	1.5465	1.2436
No log	1.5	72	1.4394	0.1197	1.4394	1.1997
No log	1.5417	74	1.2798	0.2137	1.2798	1.1313
No log	1.5833	76	1.4591	0.1619	1.4591	1.2080
No log	1.625	78	1.4845	0.1648	1.4845	1.2184
No log	1.6667	80	1.2810	0.2831	1.2810	1.1318
No log	1.7083	82	1.1935	0.3352	1.1935	1.0925
No log	1.75	84	1.3142	0.2857	1.3142	1.1464
No log	1.7917	86	1.7798	0.0643	1.7798	1.3341
No log	1.8333	88	1.8940	0.0669	1.8940	1.3762
No log	1.875	90	1.6894	0.0969	1.6894	1.2998
No log	1.9167	92	1.5020	0.1197	1.5020	1.2255
No log	1.9583	94	1.3514	0.0741	1.3514	1.1625
No log	2.0	96	1.2874	0.0811	1.2874	1.1346
No log	2.0417	98	1.4565	0.1202	1.4565	1.2069
No log	2.0833	100	1.5882	0.0613	1.5882	1.2603
No log	2.125	102	1.5904	-0.1157	1.5904	1.2611
No log	2.1667	104	1.4435	-0.0091	1.4435	1.2014
No log	2.2083	106	1.2678	0.1379	1.2678	1.1260
No log	2.25	108	1.2971	0.1863	1.2971	1.1389
No log	2.2917	110	1.6372	0.1465	1.6372	1.2795
No log	2.3333	112	1.7658	0.1328	1.7658	1.3288
No log	2.375	114	1.6924	0.1350	1.6924	1.3009
No log	2.4167	116	1.6313	0.1812	1.6313	1.2772
No log	2.4583	118	1.3783	0.2563	1.3783	1.1740
No log	2.5	120	1.4123	0.2389	1.4123	1.1884
No log	2.5417	122	1.5716	0.0922	1.5716	1.2536
No log	2.5833	124	1.5728	0.0922	1.5728	1.2541
No log	2.625	126	1.5162	0.1081	1.5162	1.2313
No log	2.6667	128	1.4679	0.1473	1.4679	1.2116
No log	2.7083	130	1.3442	0.0833	1.3442	1.1594
No log	2.75	132	1.2547	0.1230	1.2547	1.1201
No log	2.7917	134	1.1556	0.1230	1.1556	1.0750
No log	2.8333	136	1.2266	0.2089	1.2266	1.1075
No log	2.875	138	1.5127	0.2070	1.5127	1.2299
No log	2.9167	140	1.9363	0.0957	1.9363	1.3915
No log	2.9583	142	1.9538	0.0694	1.9538	1.3978
No log	3.0	144	1.6854	0.1268	1.6854	1.2982
No log	3.0417	146	1.3298	0.2098	1.3298	1.1532
No log	3.0833	148	1.3280	0.2251	1.3280	1.1524
No log	3.125	150	1.3598	0.2389	1.3598	1.1661
No log	3.1667	152	1.3938	0.1727	1.3938	1.1806
No log	3.2083	154	1.4641	0.1904	1.4641	1.2100
No log	3.25	156	1.5983	0.0340	1.5983	1.2643
No log	3.2917	158	1.5864	0.1058	1.5864	1.2595
No log	3.3333	160	1.4966	0.1024	1.4966	1.2234
No log	3.375	162	1.3433	0.0661	1.3433	1.1590
No log	3.4167	164	1.2243	0.0811	1.2243	1.1065
No log	3.4583	166	1.2058	0.1512	1.2058	1.0981
No log	3.5	168	1.3614	0.2084	1.3614	1.1668
No log	3.5417	170	1.4746	0.2465	1.4746	1.2143
No log	3.5833	172	1.3079	0.1966	1.3079	1.1436
No log	3.625	174	1.2152	0.1255	1.2152	1.1024
No log	3.6667	176	1.2006	0.1255	1.2006	1.0957
No log	3.7083	178	1.1936	0.1512	1.1936	1.0925
No log	3.75	180	1.1997	0.0811	1.1997	1.0953
No log	3.7917	182	1.0724	-0.0091	1.0724	1.0356
No log	3.8333	184	1.0666	-0.0091	1.0666	1.0328
No log	3.875	186	1.1966	0.0661	1.1966	1.0939
No log	3.9167	188	1.3019	0.1052	1.3019	1.1410
No log	3.9583	190	1.2260	0.1370	1.2260	1.1073
No log	4.0	192	1.1551	0.1654	1.1551	1.0748
No log	4.0417	194	1.2598	0.2155	1.2598	1.1224
No log	4.0833	196	1.3788	0.2311	1.3788	1.1742
No log	4.125	198	1.4238	0.2574	1.4238	1.1932
No log	4.1667	200	1.6973	0.2441	1.6973	1.3028
No log	4.2083	202	1.6565	0.2359	1.6565	1.2871
No log	4.25	204	1.3466	0.2015	1.3466	1.1604
No log	4.2917	206	1.0643	0.1259	1.0643	1.0317
No log	4.3333	208	1.0310	0.2175	1.0310	1.0154
No log	4.375	210	1.1545	0.1976	1.1545	1.0745
No log	4.4167	212	1.2333	0.2389	1.2333	1.1105
No log	4.4583	214	1.3347	0.2531	1.3347	1.1553
No log	4.5	216	1.4564	0.2187	1.4564	1.2068
No log	4.5417	218	1.3395	0.1835	1.3395	1.1574
No log	4.5833	220	1.1751	0.2661	1.1751	1.0840
No log	4.625	222	1.1790	0.2661	1.1790	1.0858
No log	4.6667	224	1.3172	0.1835	1.3172	1.1477
No log	4.7083	226	1.4496	0.2132	1.4496	1.2040
No log	4.75	228	1.4251	0.2132	1.4251	1.1938
No log	4.7917	230	1.3093	0.2206	1.3093	1.1443
No log	4.8333	232	1.2664	0.1838	1.2664	1.1254
No log	4.875	234	1.2370	0.1170	1.2370	1.1122
No log	4.9167	236	1.2668	0.0661	1.2668	1.1255
No log	4.9583	238	1.2449	0.0278	1.2449	1.1157
No log	5.0	240	1.2966	0.0661	1.2966	1.1387
No log	5.0417	242	1.3955	0.2015	1.3955	1.1813
No log	5.0833	244	1.5763	0.2465	1.5763	1.2555
No log	5.125	246	1.5491	0.1914	1.5491	1.2446
No log	5.1667	248	1.4998	0.1854	1.4998	1.2247
No log	5.2083	250	1.5059	0.1850	1.5059	1.2272
No log	5.25	252	1.5196	0.1850	1.5196	1.2327
No log	5.2917	254	1.4170	0.1958	1.4170	1.1904
No log	5.3333	256	1.2929	0.2283	1.2929	1.1371
No log	5.375	258	1.3149	0.2337	1.3149	1.1467
No log	5.4167	260	1.4297	0.2631	1.4297	1.1957
No log	5.4583	262	1.5825	0.2555	1.5825	1.2580
No log	5.5	264	1.4824	0.2411	1.4824	1.2175
No log	5.5417	266	1.2488	0.2155	1.2488	1.1175
No log	5.5833	268	1.1123	0.2364	1.1123	1.0547
No log	5.625	270	1.1138	0.1654	1.1138	1.0554
No log	5.6667	272	1.2131	0.1654	1.2131	1.1014
No log	5.7083	274	1.3222	0.1838	1.3222	1.1499
No log	5.75	276	1.4455	0.2457	1.4455	1.2023
No log	5.7917	278	1.4797	0.2079	1.4797	1.2164
No log	5.8333	280	1.4048	0.2138	1.4048	1.1853
No log	5.875	282	1.3646	0.2531	1.3646	1.1681
No log	5.9167	284	1.3590	0.2906	1.3590	1.1658
No log	5.9583	286	1.4344	0.2695	1.4344	1.1977
No log	6.0	288	1.5168	0.2661	1.5168	1.2316
No log	6.0417	290	1.4644	0.2178	1.4644	1.2101
No log	6.0833	292	1.2863	0.2261	1.2863	1.1341
No log	6.125	294	1.2720	0.2261	1.2720	1.1278
No log	6.1667	296	1.3331	0.2138	1.3331	1.1546
No log	6.2083	298	1.3477	0.2138	1.3477	1.1609
No log	6.25	300	1.2852	0.2206	1.2852	1.1337
No log	6.2917	302	1.2714	0.1512	1.2714	1.1276
No log	6.3333	304	1.3535	0.1587	1.3535	1.1634
No log	6.375	306	1.3751	0.2206	1.3751	1.1727
No log	6.4167	308	1.3094	0.2337	1.3094	1.1443
No log	6.4583	310	1.2942	0.2038	1.2942	1.1376
No log	6.5	312	1.2379	0.2051	1.2379	1.1126
No log	6.5417	314	1.1873	0.0994	1.1873	1.0896
No log	6.5833	316	1.2291	0.1845	1.2291	1.1087
No log	6.625	318	1.2309	0.2192	1.2309	1.1095
No log	6.6667	320	1.2595	0.2661	1.2595	1.1223
No log	6.7083	322	1.3165	0.1769	1.3165	1.1474
No log	6.75	324	1.2392	0.2051	1.2392	1.1132
No log	6.7917	326	1.2023	0.2250	1.2023	1.0965
No log	6.8333	328	1.3032	0.2661	1.3032	1.1416
No log	6.875	330	1.5161	0.2417	1.5161	1.2313
No log	6.9167	332	1.7599	0.2315	1.7599	1.3266
No log	6.9583	334	1.7634	0.2606	1.7634	1.3279
No log	7.0	336	1.5204	0.1769	1.5204	1.2330
No log	7.0417	338	1.3375	0.0661	1.3375	1.1565
No log	7.0833	340	1.2765	0.0661	1.2765	1.1298
No log	7.125	342	1.3614	0.1370	1.3614	1.1668
No log	7.1667	344	1.5552	0.2132	1.5552	1.2471
No log	7.2083	346	1.7411	0.2694	1.7411	1.3195
No log	7.25	348	1.7977	0.2406	1.7977	1.3408
No log	7.2917	350	1.6465	0.2437	1.6465	1.2832
No log	7.3333	352	1.4880	0.2372	1.4880	1.2198
No log	7.375	354	1.3772	0.1700	1.3772	1.1735
No log	7.4167	356	1.4054	0.2065	1.4054	1.1855
No log	7.4583	358	1.5452	0.2424	1.5452	1.2430
No log	7.5	360	1.6766	0.2522	1.6766	1.2948
No log	7.5417	362	1.7333	0.2184	1.7333	1.3166
No log	7.5833	364	1.6718	0.2184	1.6718	1.2930
No log	7.625	366	1.5750	0.1814	1.5750	1.2550
No log	7.6667	368	1.4340	0.0401	1.4340	1.1975
No log	7.7083	370	1.3178	0.0	1.3178	1.1479
No log	7.75	372	1.3357	0.0	1.3357	1.1557
No log	7.7917	374	1.4414	0.0401	1.4414	1.2006
No log	7.8333	376	1.5496	0.2015	1.5496	1.2448
No log	7.875	378	1.5941	0.2240	1.5941	1.2626
No log	7.9167	380	1.7450	0.2474	1.7450	1.3210
No log	7.9583	382	1.9066	0.1611	1.9066	1.3808
No log	8.0	384	1.9278	0.1802	1.9278	1.3884
No log	8.0417	386	1.7369	0.2906	1.7369	1.3179
No log	8.0833	388	1.3823	0.1700	1.3823	1.1757
No log	8.125	390	1.2590	0.1700	1.2590	1.1221
No log	8.1667	392	1.2697	0.1700	1.2697	1.1268
No log	8.2083	394	1.4232	0.2015	1.4232	1.1930
No log	8.25	396	1.5612	0.2465	1.5612	1.2495
No log	8.2917	398	1.5330	0.2367	1.5330	1.2381
No log	8.3333	400	1.4309	0.1700	1.4309	1.1962
No log	8.375	402	1.3327	0.0661	1.3327	1.1544
No log	8.4167	404	1.4120	0.0661	1.4120	1.1883
No log	8.4583	406	1.5296	0.1024	1.5296	1.2368
No log	8.5	408	1.5291	0.1052	1.5291	1.2366
No log	8.5417	410	1.5503	0.0661	1.5503	1.2451
No log	8.5833	412	1.4738	0.0661	1.4738	1.2140
No log	8.625	414	1.4906	0.0661	1.4906	1.2209
No log	8.6667	416	1.6340	0.2015	1.6340	1.2783
No log	8.7083	418	1.8118	0.1540	1.8118	1.3460
No log	8.75	420	1.8428	0.1771	1.8428	1.3575
No log	8.7917	422	1.7156	0.2240	1.7156	1.3098
No log	8.8333	424	1.5854	0.2075	1.5854	1.2591
No log	8.875	426	1.3858	0.0661	1.3858	1.1772
No log	8.9167	428	1.3259	0.0811	1.3259	1.1515
No log	8.9583	430	1.3305	0.0	1.3305	1.1535
No log	9.0	432	1.3669	0.0	1.3669	1.1692
No log	9.0417	434	1.3546	0.0	1.3546	1.1639
No log	9.0833	436	1.4207	0.0661	1.4207	1.1919
No log	9.125	438	1.5354	0.2417	1.5354	1.2391
No log	9.1667	440	1.4276	0.2313	1.4276	1.1948
No log	9.2083	442	1.3348	0.2687	1.3348	1.1554
No log	9.25	444	1.3576	0.2623	1.3576	1.1652
No log	9.2917	446	1.3746	0.2206	1.3746	1.1724
No log	9.3333	448	1.4435	0.2542	1.4435	1.2014
No log	9.375	450	1.5368	0.2465	1.5368	1.2397
No log	9.4167	452	1.4749	0.2075	1.4749	1.2145
No log	9.4583	454	1.3234	0.1512	1.3234	1.1504
No log	9.5	456	1.2127	0.1579	1.2127	1.1012
No log	9.5417	458	1.2184	0.2227	1.2184	1.1038
No log	9.5833	460	1.3204	0.2206	1.3204	1.1491
No log	9.625	462	1.4286	0.2132	1.4286	1.1952
No log	9.6667	464	1.5411	0.2793	1.5411	1.2414
No log	9.7083	466	1.4884	0.2752	1.4884	1.2200
No log	9.75	468	1.3412	0.1370	1.3412	1.1581
No log	9.7917	470	1.3140	0.1370	1.3140	1.1463
No log	9.8333	472	1.3590	0.1700	1.3590	1.1658
No log	9.875	474	1.3887	0.1769	1.3887	1.1784
No log	9.9167	476	1.4215	0.1769	1.4215	1.1922
No log	9.9583	478	1.3694	0.1449	1.3694	1.1702
No log	10.0	480	1.3533	0.1370	1.3533	1.1633
No log	10.0417	482	1.3921	0.1449	1.3921	1.1799
No log	10.0833	484	1.5249	0.2132	1.5249	1.2349
No log	10.125	486	1.6050	0.2417	1.6050	1.2669
No log	10.1667	488	1.5920	0.3018	1.5920	1.2617
No log	10.2083	490	1.6218	0.3018	1.6218	1.2735
No log	10.25	492	1.5888	0.2367	1.5888	1.2605
No log	10.2917	494	1.5104	0.1449	1.5104	1.2290
No log	10.3333	496	1.4654	0.1113	1.4654	1.2106
No log	10.375	498	1.5088	0.1449	1.5088	1.2283
0.2794	10.4167	500	1.5755	0.2367	1.5755	1.2552
0.2794	10.4583	502	1.6135	0.2731	1.6135	1.2703
0.2794	10.5	504	1.4757	0.2075	1.4757	1.2148
0.2794	10.5417	506	1.3932	0.2075	1.3932	1.1803
0.2794	10.5833	508	1.3614	0.1769	1.3614	1.1668
0.2794	10.625	510	1.3113	0.1700	1.3113	1.1451
0.2794	10.6667	512	1.3526	0.2075	1.3526	1.1630

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1