ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2422
• Qwk: 0.1641
• Mse: 1.2422
• Rmse: 1.1145

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	4.3962	0.0163	4.3962	2.0967
No log	0.1290	4	2.4920	0.0334	2.4920	1.5786
No log	0.1935	6	1.8508	0.0414	1.8508	1.3604
No log	0.2581	8	1.4915	0.0573	1.4915	1.2213
No log	0.3226	10	1.3472	0.0861	1.3472	1.1607
No log	0.3871	12	1.3457	0.0452	1.3457	1.1601
No log	0.4516	14	1.2934	0.0885	1.2934	1.1373
No log	0.5161	16	1.2843	0.1667	1.2843	1.1333
No log	0.5806	18	1.6802	0.0231	1.6802	1.2962
No log	0.6452	20	2.1227	-0.0081	2.1227	1.4569
No log	0.7097	22	1.9492	0.0260	1.9492	1.3961
No log	0.7742	24	1.3319	0.1076	1.3319	1.1541
No log	0.8387	26	1.1720	0.2223	1.1720	1.0826
No log	0.9032	28	1.2180	0.2485	1.2180	1.1036
No log	0.9677	30	1.2053	0.2478	1.2053	1.0978
No log	1.0323	32	1.1906	0.2520	1.1906	1.0912
No log	1.0968	34	1.2142	0.1370	1.2142	1.1019
No log	1.1613	36	1.2539	0.1532	1.2539	1.1198
No log	1.2258	38	1.2891	0.1300	1.2891	1.1354
No log	1.2903	40	1.3847	-0.0288	1.3847	1.1767
No log	1.3548	42	1.3199	0.1300	1.3199	1.1489
No log	1.4194	44	1.2739	0.2097	1.2739	1.1287
No log	1.4839	46	1.2849	0.1935	1.2849	1.1335
No log	1.5484	48	1.2832	0.1935	1.2832	1.1328
No log	1.6129	50	1.3045	0.1528	1.3045	1.1422
No log	1.6774	52	1.3610	0.2113	1.3610	1.1666
No log	1.7419	54	1.5396	0.0651	1.5396	1.2408
No log	1.8065	56	1.4241	0.0314	1.4241	1.1934
No log	1.8710	58	1.3740	0.1920	1.3740	1.1722
No log	1.9355	60	1.4439	0.1779	1.4439	1.2016
No log	2.0	62	1.4949	0.1942	1.4949	1.2226
No log	2.0645	64	1.4595	0.1942	1.4595	1.2081
No log	2.1290	66	1.3679	0.1387	1.3679	1.1696
No log	2.1935	68	1.3579	0.1748	1.3579	1.1653
No log	2.2581	70	1.3628	0.1744	1.3628	1.1674
No log	2.3226	72	1.4823	0.1942	1.4823	1.2175
No log	2.3871	74	1.4532	0.2346	1.4532	1.2055
No log	2.4516	76	1.3601	0.1525	1.3601	1.1662
No log	2.5161	78	1.3673	0.1915	1.3673	1.1693
No log	2.5806	80	1.3978	0.2314	1.3978	1.1823
No log	2.6452	82	1.4095	0.3061	1.4095	1.1872
No log	2.7097	84	1.3475	0.2611	1.3475	1.1608
No log	2.7742	86	1.4848	0.2311	1.4848	1.2185
No log	2.8387	88	1.7848	0.1818	1.7848	1.3360
No log	2.9032	90	1.7714	0.1978	1.7714	1.3309
No log	2.9677	92	1.4380	0.2033	1.4380	1.1992
No log	3.0323	94	1.3191	0.1895	1.3191	1.1485
No log	3.0968	96	1.3311	0.1774	1.3311	1.1537
No log	3.1613	98	1.3218	0.1635	1.3218	1.1497
No log	3.2258	100	1.4720	0.1981	1.4720	1.2132
No log	3.2903	102	1.5019	0.1974	1.5019	1.2255
No log	3.3548	104	1.3653	0.1834	1.3653	1.1684
No log	3.4194	106	1.3507	0.2686	1.3507	1.1622
No log	3.4839	108	1.4324	0.1817	1.4324	1.1968
No log	3.5484	110	1.5066	0.1776	1.5066	1.2274
No log	3.6129	112	1.6346	0.1328	1.6346	1.2785
No log	3.6774	114	1.6336	0.1168	1.6336	1.2781
No log	3.7419	116	1.5660	0.2173	1.5660	1.2514
No log	3.8065	118	1.6904	0.1344	1.6904	1.3002
No log	3.8710	120	1.9237	0.1401	1.9237	1.3870
No log	3.9355	122	2.0239	0.1358	2.0239	1.4226
No log	4.0	124	1.8050	0.1693	1.8050	1.3435
No log	4.0645	126	1.4897	0.2156	1.4897	1.2206
No log	4.1290	128	1.4335	0.1630	1.4335	1.1973
No log	4.1935	130	1.4460	0.2715	1.4460	1.2025
No log	4.2581	132	1.6893	0.1501	1.6893	1.2997
No log	4.3226	134	1.7271	0.1696	1.7271	1.3142
No log	4.3871	136	1.4819	0.2950	1.4819	1.2173
No log	4.4516	138	1.3381	0.1623	1.3381	1.1568
No log	4.5161	140	1.3131	0.1623	1.3131	1.1459
No log	4.5806	142	1.3107	0.2563	1.3107	1.1449
No log	4.6452	144	1.3965	0.2783	1.3965	1.1818
No log	4.7097	146	1.3277	0.2201	1.3277	1.1522
No log	4.7742	148	1.2473	0.2453	1.2473	1.1168
No log	4.8387	150	1.2417	0.2125	1.2417	1.1143
No log	4.9032	152	1.2848	0.3722	1.2848	1.1335
No log	4.9677	154	1.4866	0.2608	1.4866	1.2193
No log	5.0323	156	1.4610	0.2911	1.4610	1.2087
No log	5.0968	158	1.2769	0.3394	1.2769	1.1300
No log	5.1613	160	1.3028	0.0925	1.3028	1.1414
No log	5.2258	162	1.3988	0.0846	1.3988	1.1827
No log	5.2903	164	1.2653	0.1301	1.2653	1.1249
No log	5.3548	166	1.2467	0.2300	1.2467	1.1166
No log	5.4194	168	1.3900	0.2309	1.3900	1.1790
No log	5.4839	170	1.4273	0.2181	1.4273	1.1947
No log	5.5484	172	1.3480	0.2028	1.3480	1.1610
No log	5.6129	174	1.2737	0.1764	1.2737	1.1286
No log	5.6774	176	1.2685	0.1671	1.2685	1.1263
No log	5.7419	178	1.2923	0.2124	1.2923	1.1368
No log	5.8065	180	1.3654	0.2250	1.3654	1.1685
No log	5.8710	182	1.4680	0.2437	1.4680	1.2116
No log	5.9355	184	1.4707	0.2387	1.4707	1.2127
No log	6.0	186	1.4233	0.2086	1.4233	1.1930
No log	6.0645	188	1.4227	0.0741	1.4227	1.1928
No log	6.1290	190	1.4281	0.0515	1.4281	1.1950
No log	6.1935	192	1.5281	0.2443	1.5281	1.2362
No log	6.2581	194	1.5552	0.1855	1.5552	1.2471
No log	6.3226	196	1.4441	0.1907	1.4441	1.2017
No log	6.3871	198	1.3449	0.1429	1.3449	1.1597
No log	6.4516	200	1.3464	0.1429	1.3464	1.1604
No log	6.5161	202	1.3511	0.2381	1.3511	1.1624
No log	6.5806	204	1.4349	0.2060	1.4349	1.1979
No log	6.6452	206	1.4298	0.1970	1.4298	1.1958
No log	6.7097	208	1.3162	0.1842	1.3162	1.1472
No log	6.7742	210	1.1942	0.2417	1.1942	1.0928
No log	6.8387	212	1.1834	0.1786	1.1834	1.0878
No log	6.9032	214	1.2568	0.1480	1.2568	1.1211
No log	6.9677	216	1.2456	0.1609	1.2456	1.1160
No log	7.0323	218	1.2211	0.2470	1.2211	1.1051
No log	7.0968	220	1.3232	0.2605	1.3232	1.1503
No log	7.1613	222	1.5577	0.2281	1.5577	1.2481
No log	7.2258	224	1.6999	0.1914	1.6999	1.3038
No log	7.2903	226	1.5923	0.2314	1.5923	1.2619
No log	7.3548	228	1.3890	0.1429	1.3890	1.1786
No log	7.4194	230	1.3803	0.1144	1.3803	1.1749
No log	7.4839	232	1.4020	0.0611	1.4020	1.1840
No log	7.5484	234	1.3551	0.1150	1.3551	1.1641
No log	7.6129	236	1.3738	0.1463	1.3738	1.1721
No log	7.6774	238	1.4200	0.1483	1.4200	1.1916
No log	7.7419	240	1.4581	0.1807	1.4581	1.2075
No log	7.8065	242	1.3876	0.1312	1.3876	1.1779
No log	7.8710	244	1.3324	0.1860	1.3324	1.1543
No log	7.9355	246	1.3603	0.0340	1.3603	1.1663
No log	8.0	248	1.3596	0.0253	1.3596	1.1660
No log	8.0645	250	1.3267	0.1767	1.3267	1.1518
No log	8.1290	252	1.4117	0.1135	1.4117	1.1882
No log	8.1935	254	1.5401	0.2406	1.5401	1.2410
No log	8.2581	256	1.5210	0.2406	1.5210	1.2333
No log	8.3226	258	1.3651	0.2261	1.3651	1.1684
No log	8.3871	260	1.3053	0.1787	1.3053	1.1425
No log	8.4516	262	1.3409	0.1297	1.3409	1.1580
No log	8.5161	264	1.2920	0.1239	1.2920	1.1367
No log	8.5806	266	1.2315	0.2409	1.2315	1.1097
No log	8.6452	268	1.3047	0.2163	1.3047	1.1422
No log	8.7097	270	1.3646	0.2321	1.3646	1.1682
No log	8.7742	272	1.3294	0.2450	1.3294	1.1530
No log	8.8387	274	1.2397	0.2184	1.2397	1.1134
No log	8.9032	276	1.1931	0.2304	1.1931	1.0923
No log	8.9677	278	1.1827	0.2604	1.1827	1.0875
No log	9.0323	280	1.1935	0.2702	1.1935	1.0925
No log	9.0968	282	1.2628	0.2650	1.2628	1.1237
No log	9.1613	284	1.3322	0.2298	1.3322	1.1542
No log	9.2258	286	1.3614	0.2607	1.3614	1.1668
No log	9.2903	288	1.3295	0.2261	1.3295	1.1531
No log	9.3548	290	1.3049	0.1576	1.3049	1.1423
No log	9.4194	292	1.3409	0.2077	1.3409	1.1580
No log	9.4839	294	1.3617	0.2333	1.3617	1.1669
No log	9.5484	296	1.3453	0.1812	1.3453	1.1599
No log	9.6129	298	1.2849	0.1576	1.2849	1.1335
No log	9.6774	300	1.2634	0.1485	1.2634	1.1240
No log	9.7419	302	1.2517	0.1037	1.2517	1.1188
No log	9.8065	304	1.2914	0.1951	1.2914	1.1364
No log	9.8710	306	1.3086	0.1807	1.3086	1.1439
No log	9.9355	308	1.3181	0.2223	1.3181	1.1481
No log	10.0	310	1.3269	0.2518	1.3269	1.1519
No log	10.0645	312	1.3404	0.2333	1.3404	1.1578
No log	10.1290	314	1.3482	0.2366	1.3482	1.1611
No log	10.1935	316	1.3624	0.2366	1.3624	1.1672
No log	10.2581	318	1.3968	0.2366	1.3968	1.1819
No log	10.3226	320	1.4565	0.2025	1.4565	1.2069
No log	10.3871	322	1.4262	0.1763	1.4262	1.1942
No log	10.4516	324	1.3050	0.2184	1.3050	1.1423
No log	10.5161	326	1.2249	0.2821	1.2249	1.1067
No log	10.5806	328	1.2298	0.1943	1.2298	1.1089
No log	10.6452	330	1.2223	0.2857	1.2223	1.1056
No log	10.7097	332	1.2660	0.2558	1.2660	1.1252
No log	10.7742	334	1.3199	0.1857	1.3199	1.1489
No log	10.8387	336	1.4135	0.2237	1.4135	1.1889
No log	10.9032	338	1.4974	0.2726	1.4974	1.2237
No log	10.9677	340	1.4400	0.2721	1.4400	1.2000
No log	11.0323	342	1.3350	0.2000	1.3350	1.1554
No log	11.0968	344	1.2684	0.1689	1.2684	1.1262
No log	11.1613	346	1.2817	0.1247	1.2817	1.1321
No log	11.2258	348	1.3265	0.1315	1.3265	1.1517
No log	11.2903	350	1.3768	0.1345	1.3768	1.1734
No log	11.3548	352	1.3683	0.1943	1.3683	1.1697
No log	11.4194	354	1.3355	0.2046	1.3355	1.1556
No log	11.4839	356	1.3090	0.1696	1.3090	1.1441
No log	11.5484	358	1.3367	0.1131	1.3367	1.1562
No log	11.6129	360	1.3124	0.1853	1.3124	1.1456
No log	11.6774	362	1.2803	0.2009	1.2803	1.1315
No log	11.7419	364	1.2943	0.2152	1.2943	1.1377
No log	11.8065	366	1.3207	0.2439	1.3207	1.1492
No log	11.8710	368	1.3106	0.2586	1.3106	1.1448
No log	11.9355	370	1.2941	0.2586	1.2941	1.1376
No log	12.0	372	1.2704	0.2009	1.2704	1.1271
No log	12.0645	374	1.2875	0.2009	1.2875	1.1347
No log	12.1290	376	1.3160	0.2586	1.3160	1.1472
No log	12.1935	378	1.3564	0.2046	1.3564	1.1646
No log	12.2581	380	1.3199	0.2304	1.3199	1.1489
No log	12.3226	382	1.3045	0.1701	1.3045	1.1421
No log	12.3871	384	1.3030	0.1911	1.3030	1.1415
No log	12.4516	386	1.3269	0.1465	1.3269	1.1519
No log	12.5161	388	1.3467	0.1764	1.3467	1.1605
No log	12.5806	390	1.3836	0.2143	1.3836	1.1763
No log	12.6452	392	1.3800	0.2143	1.3800	1.1748
No log	12.7097	394	1.3086	0.2165	1.3086	1.1440
No log	12.7742	396	1.2944	0.2621	1.2944	1.1377
No log	12.8387	398	1.3161	0.1764	1.3161	1.1472
No log	12.9032	400	1.2878	0.1911	1.2878	1.1348
No log	12.9677	402	1.2766	0.1919	1.2766	1.1299
No log	13.0323	404	1.2741	0.2175	1.2741	1.1288
No log	13.0968	406	1.2885	0.2470	1.2885	1.1351
No log	13.1613	408	1.3462	0.1905	1.3462	1.1603
No log	13.2258	410	1.4017	0.1501	1.4017	1.1839
No log	13.2903	412	1.3703	0.1951	1.3703	1.1706
No log	13.3548	414	1.2969	0.2110	1.2969	1.1388
No log	13.4194	416	1.2727	0.1093	1.2727	1.1281
No log	13.4839	418	1.2841	0.0911	1.2841	1.1332
No log	13.5484	420	1.3387	0.2339	1.3387	1.1570
No log	13.6129	422	1.3906	0.2710	1.3906	1.1792
No log	13.6774	424	1.4182	0.1943	1.4182	1.1909
No log	13.7419	426	1.3559	0.1156	1.3559	1.1644
No log	13.8065	428	1.2524	0.1144	1.2524	1.1191
No log	13.8710	430	1.2084	0.2023	1.2084	1.0993
No log	13.9355	432	1.2091	0.2023	1.2091	1.0996
No log	14.0	434	1.2041	0.1918	1.2041	1.0973
No log	14.0645	436	1.2302	0.1645	1.2302	1.1092
No log	14.1290	438	1.3043	0.1961	1.3043	1.1421
No log	14.1935	440	1.4496	0.1756	1.4496	1.2040
No log	14.2581	442	1.5638	0.2047	1.5638	1.2505
No log	14.3226	444	1.5342	0.1498	1.5342	1.2386
No log	14.3871	446	1.4184	0.1935	1.4184	1.1910
No log	14.4516	448	1.3125	0.1707	1.3125	1.1456
No log	14.5161	450	1.2943	0.1857	1.2943	1.1377
No log	14.5806	452	1.3441	0.1905	1.3441	1.1594
No log	14.6452	454	1.3661	0.2032	1.3661	1.1688
No log	14.7097	456	1.4446	0.1718	1.4446	1.2019
No log	14.7742	458	1.5000	0.2047	1.5000	1.2247
No log	14.8387	460	1.4374	0.1171	1.4374	1.1989
No log	14.9032	462	1.3548	0.0526	1.3548	1.1640
No log	14.9677	464	1.2317	0.1961	1.2317	1.1098
No log	15.0323	466	1.1836	0.1585	1.1836	1.0879
No log	15.0968	468	1.1792	0.1482	1.1792	1.0859
No log	15.1613	470	1.2364	0.1645	1.2364	1.1119
No log	15.2258	472	1.2933	0.1707	1.2933	1.1372
No log	15.2903	474	1.3447	0.2084	1.3447	1.1596
No log	15.3548	476	1.3345	0.1899	1.3345	1.1552
No log	15.4194	478	1.2426	0.1128	1.2426	1.1147
No log	15.4839	480	1.2057	0.2317	1.2057	1.0981
No log	15.5484	482	1.2292	0.1559	1.2292	1.1087
No log	15.6129	484	1.3296	0.2201	1.3296	1.1531
No log	15.6774	486	1.4313	0.2806	1.4313	1.1964
No log	15.7419	488	1.4789	0.2839	1.4789	1.2161
No log	15.8065	490	1.4211	0.2457	1.4211	1.1921
No log	15.8710	492	1.3208	0.1405	1.3208	1.1493
No log	15.9355	494	1.2100	0.1502	1.2100	1.1000
No log	16.0	496	1.1818	0.2219	1.1818	1.0871
No log	16.0645	498	1.2038	0.2574	1.2038	1.0972
0.338	16.1290	500	1.2886	0.2261	1.2886	1.1351
0.338	16.1935	502	1.4431	0.1888	1.4431	1.2013
0.338	16.2581	504	1.4880	0.1884	1.4880	1.2198
0.338	16.3226	506	1.3812	0.1631	1.3812	1.1752
0.338	16.3871	508	1.2425	0.2402	1.2425	1.1147
0.338	16.4516	510	1.1744	0.1443	1.1744	1.0837
0.338	16.5161	512	1.1759	0.2219	1.1759	1.0844
0.338	16.5806	514	1.2459	0.2681	1.2459	1.1162
0.338	16.6452	516	1.3471	0.2371	1.3471	1.1606
0.338	16.7097	518	1.5154	0.2147	1.5154	1.2310
0.338	16.7742	520	1.5988	0.2463	1.5988	1.2644
0.338	16.8387	522	1.5436	0.2569	1.5436	1.2424
0.338	16.9032	524	1.3911	0.2065	1.3911	1.1794
0.338	16.9677	526	1.2567	0.1637	1.2567	1.1210
0.338	17.0323	528	1.1872	0.1582	1.1872	1.0896
0.338	17.0968	530	1.1804	0.1582	1.1804	1.0864
0.338	17.1613	532	1.2422	0.1641	1.2422	1.1145

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1