ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1816
• Qwk: 0.0401
• Mse: 1.1816
• Rmse: 1.0870

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	4.0543	-0.0061	4.0543	2.0135
No log	0.1176	4	2.2749	-0.0297	2.2749	1.5083
No log	0.1765	6	1.5352	0.0661	1.5352	1.2391
No log	0.2353	8	1.1820	0.0548	1.1820	1.0872
No log	0.2941	10	1.1297	0.0111	1.1297	1.0629
No log	0.3529	12	1.1783	0.1864	1.1783	1.0855
No log	0.4118	14	1.3797	0.0256	1.3797	1.1746
No log	0.4706	16	1.3319	0.0287	1.3319	1.1541
No log	0.5294	18	1.1133	0.3082	1.1133	1.0551
No log	0.5882	20	1.0402	0.2008	1.0402	1.0199
No log	0.6471	22	1.1359	0.0919	1.1359	1.0658
No log	0.7059	24	1.1420	0.0919	1.1420	1.0687
No log	0.7647	26	1.0498	0.1755	1.0498	1.0246
No log	0.8235	28	1.0322	0.3435	1.0322	1.0160
No log	0.8824	30	1.0245	0.2888	1.0245	1.0122
No log	0.9412	32	1.0587	0.1864	1.0587	1.0289
No log	1.0	34	1.1484	0.1292	1.1484	1.0716
No log	1.0588	36	1.2671	-0.0535	1.2671	1.1256
No log	1.1176	38	1.4140	-0.0375	1.4140	1.1891
No log	1.1765	40	1.8065	-0.2120	1.8065	1.3441
No log	1.2353	42	1.7639	-0.1010	1.7639	1.3281
No log	1.2941	44	1.5552	0.0859	1.5552	1.2471
No log	1.3529	46	1.6445	0.0016	1.6445	1.2824
No log	1.4118	48	1.9913	-0.2027	1.9913	1.4111
No log	1.4706	50	1.9013	0.0296	1.9013	1.3789
No log	1.5294	52	2.2267	-0.0325	2.2267	1.4922
No log	1.5882	54	2.2303	0.0404	2.2303	1.4934
No log	1.6471	56	1.4969	0.1970	1.4969	1.2235
No log	1.7059	58	1.2520	0.3352	1.2520	1.1189
No log	1.7647	60	1.4475	0.2043	1.4475	1.2031
No log	1.8235	62	2.1397	0.1173	2.1397	1.4628
No log	1.8824	64	2.0834	0.1395	2.0834	1.4434
No log	1.9412	66	1.5740	0.1789	1.5740	1.2546
No log	2.0	68	1.2892	0.1905	1.2892	1.1354
No log	2.0588	70	1.5195	0.1561	1.5195	1.2327
No log	2.1176	72	1.8769	0.1197	1.8769	1.3700
No log	2.1765	74	1.8536	0.0636	1.8536	1.3615
No log	2.2353	76	1.8352	0.0636	1.8352	1.3547
No log	2.2941	78	1.7494	0.1207	1.7494	1.3226
No log	2.3529	80	1.7745	0.1071	1.7745	1.3321
No log	2.4118	82	1.7460	0.1000	1.7460	1.3214
No log	2.4706	84	1.7240	0.0864	1.7240	1.3130
No log	2.5294	86	1.7115	0.0864	1.7115	1.3082
No log	2.5882	88	1.7139	0.1344	1.7139	1.3092
No log	2.6471	90	1.5943	0.1509	1.5943	1.2627
No log	2.7059	92	1.2631	0.2368	1.2631	1.1239
No log	2.7647	94	1.0850	0.1996	1.0850	1.0416
No log	2.8235	96	1.1399	0.1775	1.1399	1.0677
No log	2.8824	98	1.4770	0.2313	1.4770	1.2153
No log	2.9412	100	1.7432	0.1635	1.7432	1.3203
No log	3.0	102	1.8321	0.1752	1.8321	1.3535
No log	3.0588	104	1.7163	0.1694	1.7163	1.3101
No log	3.1176	106	1.3185	0.2555	1.3185	1.1483
No log	3.1765	108	0.9931	0.1944	0.9931	0.9965
No log	3.2353	110	0.9808	0.1979	0.9808	0.9904
No log	3.2941	112	1.0539	0.1407	1.0539	1.0266
No log	3.3529	114	1.2993	0.1407	1.2993	1.1399
No log	3.4118	116	1.4511	0.1814	1.4511	1.2046
No log	3.4706	118	1.5012	0.1814	1.5012	1.2253
No log	3.5294	120	1.4267	0.2004	1.4267	1.1945
No log	3.5882	122	1.2760	0.2417	1.2760	1.1296
No log	3.6471	124	1.2877	0.2851	1.2877	1.1348
No log	3.7059	126	1.5105	0.1955	1.5105	1.2290
No log	3.7647	128	1.7467	0.1902	1.7467	1.3216
No log	3.8235	130	1.8684	0.0948	1.8684	1.3669
No log	3.8824	132	1.8054	0.0626	1.8054	1.3437
No log	3.9412	134	1.6726	0.1357	1.6726	1.2933
No log	4.0	136	1.6343	0.1142	1.6343	1.2784
No log	4.0588	138	1.4458	0.1473	1.4458	1.2024
No log	4.1176	140	1.2485	0.1816	1.2485	1.1173
No log	4.1765	142	1.1785	0.2843	1.1785	1.0856
No log	4.2353	144	1.1935	0.2143	1.1935	1.0925
No log	4.2941	146	1.1741	0.2143	1.1741	1.0835
No log	4.3529	148	1.2019	0.1816	1.2019	1.0963
No log	4.4118	150	1.2111	0.1816	1.2111	1.1005
No log	4.4706	152	1.2999	0.2143	1.2999	1.1401
No log	4.5294	154	1.4070	0.1943	1.4070	1.1862
No log	4.5882	156	1.4870	0.1744	1.4870	1.2194
No log	4.6471	158	1.5543	0.0896	1.5543	1.2467
No log	4.7059	160	1.4699	0.1486	1.4699	1.2124
No log	4.7647	162	1.2565	0.1744	1.2565	1.1209
No log	4.8235	164	1.0922	0.1744	1.0922	1.0451
No log	4.8824	166	1.0699	0.2065	1.0699	1.0344
No log	4.9412	168	1.2471	0.2239	1.2471	1.1167
No log	5.0	170	1.5520	0.2606	1.5520	1.2458
No log	5.0588	172	1.6934	0.2565	1.6934	1.3013
No log	5.1176	174	1.5386	0.2606	1.5386	1.2404
No log	5.1765	176	1.2963	0.2342	1.2963	1.1386
No log	5.2353	178	1.2237	0.2065	1.2237	1.1062
No log	5.2941	180	1.3223	0.2065	1.3223	1.1499
No log	5.3529	182	1.5757	0.2342	1.5757	1.2553
No log	5.4118	184	1.6835	0.1789	1.6835	1.2975
No log	5.4706	186	1.6342	0.2270	1.6342	1.2783
No log	5.5294	188	1.6646	0.2005	1.6646	1.2902
No log	5.5882	190	1.6123	0.2005	1.6123	1.2698
No log	5.6471	192	1.5211	0.2292	1.5211	1.2333
No log	5.7059	194	1.4531	0.1562	1.4531	1.2054
No log	5.7647	196	1.4663	0.1562	1.4663	1.2109
No log	5.8235	198	1.4028	0.1142	1.4028	1.1844
No log	5.8824	200	1.3675	0.1142	1.3675	1.1694
No log	5.9412	202	1.4258	0.1142	1.4258	1.1941
No log	6.0	204	1.3855	0.1052	1.3855	1.1771
No log	6.0588	206	1.4224	0.1052	1.4224	1.1926
No log	6.1176	208	1.4745	0.1052	1.4745	1.2143
No log	6.1765	210	1.4405	0.1052	1.4405	1.2002
No log	6.2353	212	1.4925	0.1744	1.4925	1.2217
No log	6.2941	214	1.4498	0.2065	1.4498	1.2041
No log	6.3529	216	1.3386	0.1769	1.3386	1.1570
No log	6.4118	218	1.2209	0.1027	1.2209	1.1049
No log	6.4706	220	1.2156	0.1362	1.2156	1.1026
No log	6.5294	222	1.3146	0.2065	1.3146	1.1466
No log	6.5882	224	1.3634	0.2424	1.3634	1.1676
No log	6.6471	226	1.4333	0.2239	1.4333	1.1972
No log	6.7059	228	1.3842	0.2424	1.3842	1.1765
No log	6.7647	230	1.2991	0.1744	1.2991	1.1398
No log	6.8235	232	1.2848	0.2065	1.2848	1.1335
No log	6.8824	234	1.2722	0.2424	1.2722	1.1279
No log	6.9412	236	1.3344	0.2424	1.3344	1.1552
No log	7.0	238	1.3632	0.2239	1.3632	1.1676
No log	7.0588	240	1.4741	0.2568	1.4741	1.2141
No log	7.1176	242	1.5269	0.2940	1.5269	1.2357
No log	7.1765	244	1.5523	0.2770	1.5523	1.2459
No log	7.2353	246	1.5871	0.2806	1.5871	1.2598
No log	7.2941	248	1.6118	0.2525	1.6118	1.2696
No log	7.3529	250	1.4870	0.2793	1.4870	1.2194
No log	7.4118	252	1.3490	0.2474	1.3490	1.1615
No log	7.4706	254	1.1865	0.2126	1.1865	1.0893
No log	7.5294	256	1.1905	0.2126	1.1905	1.0911
No log	7.5882	258	1.2316	0.2474	1.2316	1.1098
No log	7.6471	260	1.2513	0.2667	1.2513	1.1186
No log	7.7059	262	1.4302	0.2694	1.4302	1.1959
No log	7.7647	264	1.6118	0.2525	1.6118	1.2696
No log	7.8235	266	1.5706	0.2126	1.5706	1.2532
No log	7.8824	268	1.4914	0.2424	1.4914	1.2212
No log	7.9412	270	1.3275	0.1744	1.3275	1.1522
No log	8.0	272	1.2512	0.0421	1.2512	1.1186
No log	8.0588	274	1.2690	0.1198	1.2690	1.1265
No log	8.1176	276	1.4003	0.2424	1.4003	1.1833
No log	8.1765	278	1.4357	0.2568	1.4357	1.1982
No log	8.2353	280	1.5155	0.2424	1.5155	1.2310
No log	8.2941	282	1.5116	0.2474	1.5116	1.2295
No log	8.3529	284	1.4482	0.2424	1.4482	1.2034
No log	8.4118	286	1.3251	0.2424	1.3251	1.1511
No log	8.4706	288	1.2540	0.2555	1.2540	1.1198
No log	8.5294	290	1.2993	0.2555	1.2993	1.1399
No log	8.5882	292	1.2742	0.2203	1.2742	1.1288
No log	8.6471	294	1.3321	0.2065	1.3321	1.1542
No log	8.7059	296	1.4523	0.2752	1.4523	1.2051
No log	8.7647	298	1.5621	0.2832	1.5621	1.2499
No log	8.8235	300	1.5166	0.2653	1.5166	1.2315
No log	8.8824	302	1.3122	0.2126	1.3122	1.1455
No log	8.9412	304	1.1857	0.2592	1.1857	1.0889
No log	9.0	306	1.1401	0.2308	1.1401	1.0677
No log	9.0588	308	1.1889	0.2308	1.1889	1.0903
No log	9.1176	310	1.3761	0.2292	1.3761	1.1731
No log	9.1765	312	1.5699	0.2568	1.5699	1.2529
No log	9.2353	314	1.6247	0.2391	1.6247	1.2746
No log	9.2941	316	1.5355	0.2752	1.5355	1.2392
No log	9.3529	318	1.3898	0.1744	1.3898	1.1789
No log	9.4118	320	1.2836	0.1407	1.2836	1.1330
No log	9.4706	322	1.2650	0.1407	1.2650	1.1247
No log	9.5294	324	1.3227	0.1407	1.3227	1.1501
No log	9.5882	326	1.3990	0.2372	1.3990	1.1828
No log	9.6471	328	1.5581	0.2391	1.5581	1.2482
No log	9.7059	330	1.6281	0.2482	1.6281	1.2760
No log	9.7647	332	1.5531	0.2117	1.5531	1.2462
No log	9.8235	334	1.3900	0.2117	1.3900	1.1790
No log	9.8824	336	1.3733	0.2117	1.3733	1.1719
No log	9.9412	338	1.5040	0.2117	1.5040	1.2264
No log	10.0	340	1.6769	0.2363	1.6769	1.2949
No log	10.0588	342	1.7052	0.2694	1.7052	1.3059
No log	10.1176	344	1.6400	0.2752	1.6400	1.2806
No log	10.1765	346	1.5065	0.1486	1.5065	1.2274
No log	10.2353	348	1.4465	0.1407	1.4465	1.2027
No log	10.2941	350	1.3962	0.0878	1.3962	1.1816
No log	10.3529	352	1.4105	0.1228	1.4105	1.1877
No log	10.4118	354	1.4648	0.2239	1.4648	1.2103
No log	10.4706	356	1.5169	0.2752	1.5169	1.2316
No log	10.5294	358	1.5351	0.2568	1.5351	1.2390
No log	10.5882	360	1.4578	0.2184	1.4578	1.2074
No log	10.6471	362	1.4555	0.2568	1.4555	1.2065
No log	10.7059	364	1.5204	0.2522	1.5204	1.2331
No log	10.7647	366	1.4889	0.2239	1.4889	1.2202
No log	10.8235	368	1.3683	0.2149	1.3683	1.1698
No log	10.8824	370	1.3675	0.2149	1.3675	1.1694
No log	10.9412	372	1.4899	0.2342	1.4899	1.2206
No log	11.0	374	1.5153	0.2474	1.5153	1.2310
No log	11.0588	376	1.4159	0.1744	1.4159	1.1899
No log	11.1176	378	1.2679	0.1052	1.2679	1.1260
No log	11.1765	380	1.1348	0.1230	1.1348	1.0652
No log	11.2353	382	1.1264	0.2448	1.1264	1.0613
No log	11.2941	384	1.2373	0.2577	1.2373	1.1123
No log	11.3529	386	1.3750	0.2239	1.3750	1.1726
No log	11.4118	388	1.5393	0.2522	1.5393	1.2407
No log	11.4706	390	1.5501	0.2292	1.5501	1.2450
No log	11.5294	392	1.4628	0.1562	1.4628	1.2094
No log	11.5882	394	1.3259	0.1052	1.3259	1.1515
No log	11.6471	396	1.2266	0.1052	1.2266	1.1075
No log	11.7059	398	1.2275	0.1052	1.2275	1.1079
No log	11.7647	400	1.2666	0.1052	1.2666	1.1254
No log	11.8235	402	1.2410	0.1562	1.2410	1.1140
No log	11.8824	404	1.2607	0.2117	1.2607	1.1228
No log	11.9412	406	1.2534	0.2391	1.2534	1.1195
No log	12.0	408	1.2244	0.2511	1.2244	1.1065
No log	12.0588	410	1.1835	0.1793	1.1835	1.0879
No log	12.1176	412	1.2743	0.1052	1.2743	1.1288
No log	12.1765	414	1.3013	0.0401	1.3013	1.1408
No log	12.2353	416	1.2809	0.0781	1.2809	1.1318
No log	12.2941	418	1.2927	0.1744	1.2927	1.1370
No log	12.3529	420	1.2238	0.2065	1.2238	1.1062
No log	12.4118	422	1.2282	0.2239	1.2282	1.1083
No log	12.4706	424	1.3307	0.2611	1.3307	1.1535
No log	12.5294	426	1.4036	0.2611	1.4036	1.1847
No log	12.5882	428	1.5020	0.2653	1.5020	1.2255
No log	12.6471	430	1.4659	0.2342	1.4659	1.2107
No log	12.7059	432	1.3115	0.2065	1.3115	1.1452
No log	12.7647	434	1.2452	0.0781	1.2452	1.1159
No log	12.8235	436	1.1728	0.0401	1.1728	1.0830
No log	12.8824	438	1.1642	0.0401	1.1642	1.0790
No log	12.9412	440	1.2108	0.1407	1.2108	1.1003
No log	13.0	442	1.2921	0.1407	1.2921	1.1367
No log	13.0588	444	1.2798	0.1407	1.2798	1.1313
No log	13.1176	446	1.2846	0.2065	1.2846	1.1334
No log	13.1765	448	1.3317	0.2117	1.3317	1.1540
No log	13.2353	450	1.3041	0.2174	1.3041	1.1420
No log	13.2941	452	1.2850	0.2174	1.2850	1.1336
No log	13.3529	454	1.2102	0.1790	1.2102	1.1001
No log	13.4118	456	1.0914	0.1230	1.0914	1.0447
No log	13.4706	458	1.0359	0.1322	1.0359	1.0178
No log	13.5294	460	1.0524	0.1294	1.0524	1.0259
No log	13.5882	462	1.1328	0.0	1.1328	1.0643
No log	13.6471	464	1.2484	0.0781	1.2484	1.1173
No log	13.7059	466	1.3398	0.1744	1.3398	1.1575
No log	13.7647	468	1.3429	0.1407	1.3429	1.1589
No log	13.8235	470	1.3066	0.0401	1.3066	1.1430
No log	13.8824	472	1.2635	0.0401	1.2635	1.1240
No log	13.9412	474	1.2281	0.0401	1.2281	1.1082
No log	14.0	476	1.2152	0.0401	1.2152	1.1024
No log	14.0588	478	1.2448	0.1744	1.2448	1.1157
No log	14.1176	480	1.1752	0.1512	1.1752	1.0841
No log	14.1765	482	1.1740	0.1911	1.1740	1.0835
No log	14.2353	484	1.2337	0.1512	1.2337	1.1107
No log	14.2941	486	1.3193	0.1700	1.3193	1.1486
No log	14.3529	488	1.3817	0.1562	1.3817	1.1755
No log	14.4118	490	1.4357	0.1407	1.4357	1.1982
No log	14.4706	492	1.4051	0.0401	1.4051	1.1854
No log	14.5294	494	1.3854	0.0401	1.3854	1.1770
No log	14.5882	496	1.3182	0.1052	1.3182	1.1481
No log	14.6471	498	1.2823	0.1202	1.2823	1.1324
0.2316	14.7059	500	1.2027	0.0587	1.2027	1.0967
0.2316	14.7647	502	1.1992	0.0155	1.1992	1.0951
0.2316	14.8235	504	1.3139	0.0401	1.3139	1.1462
0.2316	14.8824	506	1.4424	0.1228	1.4424	1.2010
0.2316	14.9412	508	1.5494	0.2474	1.5494	1.2448
0.2316	15.0	510	1.5415	0.1880	1.5415	1.2416
0.2316	15.0588	512	1.5269	0.1562	1.5269	1.2357
0.2316	15.1176	514	1.5417	0.1880	1.5417	1.2417
0.2316	15.1765	516	1.5263	0.1407	1.5263	1.2354
0.2316	15.2353	518	1.5344	0.1407	1.5344	1.2387
0.2316	15.2941	520	1.4930	0.0401	1.4930	1.2219
0.2316	15.3529	522	1.5100	0.1407	1.5100	1.2288
0.2316	15.4118	524	1.4947	0.1562	1.4947	1.2226
0.2316	15.4706	526	1.5164	0.1880	1.5164	1.2314
0.2316	15.5294	528	1.5154	0.1228	1.5154	1.2310
0.2316	15.5882	530	1.4277	0.1052	1.4277	1.1949
0.2316	15.6471	532	1.3184	0.0401	1.3184	1.1482
0.2316	15.7059	534	1.2055	0.0556	1.2055	1.0980
0.2316	15.7647	536	1.1941	0.1202	1.1941	1.0928
0.2316	15.8235	538	1.2817	0.2015	1.2817	1.1321
0.2316	15.8824	540	1.4593	0.2342	1.4593	1.2080
0.2316	15.9412	542	1.6250	0.2940	1.6250	1.2747
0.2316	16.0	544	1.6427	0.2653	1.6427	1.2817
0.2316	16.0588	546	1.5495	0.1228	1.5495	1.2448
0.2316	16.1176	548	1.4159	0.0401	1.4159	1.1899
0.2316	16.1765	550	1.3107	0.0	1.3107	1.1449
0.2316	16.2353	552	1.2028	0.0	1.2028	1.0967
0.2316	16.2941	554	1.1444	0.0987	1.1444	1.0697
0.2316	16.3529	556	1.1507	0.0987	1.1507	1.0727
0.2316	16.4118	558	1.2561	0.1744	1.2561	1.1208
0.2316	16.4706	560	1.3406	0.2292	1.3406	1.1578
0.2316	16.5294	562	1.4664	0.2159	1.4664	1.2110
0.2316	16.5882	564	1.5681	0.2488	1.5681	1.2522
0.2316	16.6471	566	1.5407	0.2252	1.5407	1.2413
0.2316	16.7059	568	1.3721	0.2525	1.3721	1.1714
0.2316	16.7647	570	1.1901	0.2126	1.1901	1.0909
0.2316	16.8235	572	1.0926	0.0841	1.0926	1.0453
0.2316	16.8824	574	1.1203	0.0278	1.1203	1.0584
0.2316	16.9412	576	1.1728	0.1744	1.1728	1.0829
0.2316	17.0	578	1.1647	0.0401	1.1647	1.0792
0.2316	17.0588	580	1.1340	0.0401	1.1340	1.0649
0.2316	17.1176	582	1.1457	0.0401	1.1457	1.0704
0.2316	17.1765	584	1.1521	0.0401	1.1521	1.0733
0.2316	17.2353	586	1.1816	0.0401	1.1816	1.0870

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1