ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3448
• Qwk: 0.1371
• Mse: 1.3448
• Rmse: 1.1596

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.6703	0.0010	4.6703	2.1611
No log	0.0870	4	2.7705	0.0140	2.7705	1.6645
No log	0.1304	6	1.9995	-0.0102	1.9995	1.4140
No log	0.1739	8	1.5140	0.0201	1.5140	1.2305
No log	0.2174	10	1.4260	0.0203	1.4260	1.1942
No log	0.2609	12	1.5264	-0.0161	1.5264	1.2355
No log	0.3043	14	1.4111	-0.0128	1.4111	1.1879
No log	0.3478	16	1.4051	0.0253	1.4051	1.1854
No log	0.3913	18	1.3558	0.0232	1.3558	1.1644
No log	0.4348	20	1.3127	0.0186	1.3127	1.1457
No log	0.4783	22	1.2626	0.0796	1.2626	1.1237
No log	0.5217	24	1.2633	0.0613	1.2633	1.1240
No log	0.5652	26	1.2988	0.1076	1.2988	1.1396
No log	0.6087	28	1.2544	0.1542	1.2544	1.1200
No log	0.6522	30	1.2044	0.1370	1.2044	1.0975
No log	0.6957	32	1.2342	0.0427	1.2342	1.1109
No log	0.7391	34	1.2668	0.0700	1.2668	1.1255
No log	0.7826	36	1.3210	0.0847	1.3210	1.1493
No log	0.8261	38	1.5612	-0.0649	1.5612	1.2495
No log	0.8696	40	1.4555	0.0522	1.4555	1.2065
No log	0.9130	42	1.4345	0.0741	1.4345	1.1977
No log	0.9565	44	1.2526	0.1638	1.2526	1.1192
No log	1.0	46	1.2015	0.2333	1.2015	1.0962
No log	1.0435	48	1.2226	0.1984	1.2226	1.1057
No log	1.0870	50	1.1967	0.1870	1.1967	1.0939
No log	1.1304	52	1.2182	0.1984	1.2182	1.1037
No log	1.1739	54	1.1532	0.1911	1.1532	1.0739
No log	1.2174	56	1.1276	0.1210	1.1276	1.0619
No log	1.2609	58	1.1563	0.1868	1.1563	1.0753
No log	1.3043	60	1.2283	0.1641	1.2283	1.1083
No log	1.3478	62	1.2436	0.1310	1.2436	1.1152
No log	1.3913	64	1.2577	0.0934	1.2577	1.1215
No log	1.4348	66	1.2722	0.1121	1.2722	1.1279
No log	1.4783	68	1.2902	0.125	1.2902	1.1359
No log	1.5217	70	1.2351	0.1902	1.2351	1.1113
No log	1.5652	72	1.1929	0.1977	1.1929	1.0922
No log	1.6087	74	1.2655	0.1480	1.2655	1.1249
No log	1.6522	76	1.2235	0.1267	1.2235	1.1061
No log	1.6957	78	1.1882	0.1767	1.1882	1.0900
No log	1.7391	80	1.2523	0.1755	1.2523	1.1190
No log	1.7826	82	1.3109	0.1063	1.3109	1.1449
No log	1.8261	84	1.3717	0.2772	1.3717	1.1712
No log	1.8696	86	1.5582	0.3045	1.5582	1.2483
No log	1.9130	88	1.5663	0.2925	1.5663	1.2515
No log	1.9565	90	1.4099	0.2772	1.4099	1.1874
No log	2.0	92	1.4024	0.2772	1.4024	1.1842
No log	2.0435	94	1.4858	0.2191	1.4858	1.2189
No log	2.0870	96	1.5393	0.2903	1.5393	1.2407
No log	2.1304	98	1.3932	0.1712	1.3932	1.1803
No log	2.1739	100	1.3922	0.0911	1.3922	1.1799
No log	2.2174	102	1.4386	0.0952	1.4386	1.1994
No log	2.2609	104	1.5498	0.1631	1.5498	1.2449
No log	2.3043	106	1.5142	0.0714	1.5142	1.2305
No log	2.3478	108	1.5403	0.0686	1.5403	1.2411
No log	2.3913	110	1.6341	-0.0063	1.6341	1.2783
No log	2.4348	112	1.8686	0.0621	1.8686	1.3670
No log	2.4783	114	1.9787	0.0746	1.9787	1.4067
No log	2.5217	116	1.9318	0.0934	1.9318	1.3899
No log	2.5652	118	1.7380	0.1057	1.7380	1.3183
No log	2.6087	120	1.5258	0.1156	1.5258	1.2352
No log	2.6522	122	1.4462	0.1217	1.4462	1.2026
No log	2.6957	124	1.4441	0.1026	1.4441	1.2017
No log	2.7391	126	1.5470	0.1891	1.5470	1.2438
No log	2.7826	128	1.6728	0.1025	1.6728	1.2934
No log	2.8261	130	1.6553	0.1144	1.6553	1.2866
No log	2.8696	132	1.6542	0.0146	1.6542	1.2862
No log	2.9130	134	1.5453	0.1028	1.5453	1.2431
No log	2.9565	136	1.5830	0.2606	1.5830	1.2582
No log	3.0	138	1.5493	0.2806	1.5493	1.2447
No log	3.0435	140	1.4233	0.2263	1.4233	1.1930
No log	3.0870	142	1.3423	0.1679	1.3423	1.1586
No log	3.1304	144	1.3219	0.1864	1.3219	1.1497
No log	3.1739	146	1.3804	0.2224	1.3804	1.1749
No log	3.2174	148	1.5223	0.3171	1.5223	1.2338
No log	3.2609	150	1.6121	0.2633	1.6121	1.2697
No log	3.3043	152	1.4892	0.2371	1.4892	1.2203
No log	3.3478	154	1.4161	0.2417	1.4161	1.1900
No log	3.3913	156	1.4059	0.2132	1.4059	1.1857
No log	3.4348	158	1.4538	0.1844	1.4538	1.2058
No log	3.4783	160	1.4560	0.1795	1.4560	1.2066
No log	3.5217	162	1.4301	0.2224	1.4301	1.1959
No log	3.5652	164	1.4453	0.1744	1.4453	1.2022
No log	3.6087	166	1.5440	0.2108	1.5440	1.2426
No log	3.6522	168	1.8101	0.1385	1.8101	1.3454
No log	3.6957	170	1.8431	0.1751	1.8431	1.3576
No log	3.7391	172	1.5631	0.2153	1.5631	1.2502
No log	3.7826	174	1.3899	0.0331	1.3899	1.1790
No log	3.8261	176	1.4112	0.0218	1.4112	1.1879
No log	3.8696	178	1.3916	0.0750	1.3916	1.1797
No log	3.9130	180	1.4274	0.2602	1.4274	1.1947
No log	3.9565	182	1.4927	0.2074	1.4927	1.2218
No log	4.0	184	1.5358	0.2559	1.5358	1.2393
No log	4.0435	186	1.5787	0.2201	1.5787	1.2565
No log	4.0870	188	1.5931	0.1471	1.5931	1.2622
No log	4.1304	190	1.6073	0.2450	1.6073	1.2678
No log	4.1739	192	1.6191	0.1977	1.6191	1.2724
No log	4.2174	194	1.4766	0.2743	1.4766	1.2151
No log	4.2609	196	1.4440	0.0798	1.4440	1.2017
No log	4.3043	198	1.5017	0.2184	1.5017	1.2254
No log	4.3478	200	1.5813	0.2117	1.5813	1.2575
No log	4.3913	202	1.5873	0.1652	1.5873	1.2599
No log	4.4348	204	1.5374	0.0918	1.5374	1.2399
No log	4.4783	206	1.5297	-0.0171	1.5297	1.2368
No log	4.5217	208	1.5310	0.0842	1.5310	1.2373
No log	4.5652	210	1.6574	0.1855	1.6574	1.2874
No log	4.6087	212	1.7471	0.1455	1.7471	1.3218
No log	4.6522	214	1.6158	0.1253	1.6158	1.2711
No log	4.6957	216	1.5500	0.1813	1.5500	1.2450
No log	4.7391	218	1.5343	0.1997	1.5343	1.2387
No log	4.7826	220	1.4766	0.1465	1.4766	1.2152
No log	4.8261	222	1.4529	0.0010	1.4529	1.2054
No log	4.8696	224	1.4440	0.0798	1.4440	1.2017
No log	4.9130	226	1.4724	0.1696	1.4724	1.2134
No log	4.9565	228	1.5486	0.1795	1.5486	1.2444
No log	5.0	230	1.5673	0.1254	1.5673	1.2519
No log	5.0435	232	1.5239	0.2173	1.5239	1.2345
No log	5.0870	234	1.4726	0.1466	1.4726	1.2135
No log	5.1304	236	1.4507	0.1309	1.4507	1.2045
No log	5.1739	238	1.4191	0.1371	1.4191	1.1913
No log	5.2174	240	1.4600	0.1857	1.4600	1.2083
No log	5.2609	242	1.5225	0.1848	1.5225	1.2339
No log	5.3043	244	1.5088	0.1848	1.5088	1.2283
No log	5.3478	246	1.4357	0.2015	1.4357	1.1982
No log	5.3913	248	1.3986	0.0153	1.3986	1.1826
No log	5.4348	250	1.3766	0.1275	1.3766	1.1733
No log	5.4783	252	1.4467	0.2475	1.4467	1.2028
No log	5.5217	254	1.5244	0.1975	1.5244	1.2346
No log	5.5652	256	1.4993	0.2014	1.4993	1.2245
No log	5.6087	258	1.4065	0.2397	1.4065	1.1860
No log	5.6522	260	1.3738	0.2818	1.3738	1.1721
No log	5.6957	262	1.4145	0.2542	1.4145	1.1893
No log	5.7391	264	1.4580	0.2494	1.4580	1.2075
No log	5.7826	266	1.5560	0.1639	1.5560	1.2474
No log	5.8261	268	1.5050	0.3243	1.5050	1.2268
No log	5.8696	270	1.4203	0.2452	1.4203	1.1918
No log	5.9130	272	1.3710	0.2223	1.3710	1.1709
No log	5.9565	274	1.2983	0.1430	1.2983	1.1394
No log	6.0	276	1.3229	0.2050	1.3229	1.1502
No log	6.0435	278	1.4733	0.2857	1.4733	1.2138
No log	6.0870	280	1.5220	0.2295	1.5220	1.2337
No log	6.1304	282	1.4201	0.3046	1.4201	1.1917
No log	6.1739	284	1.4063	0.3046	1.4063	1.1859
No log	6.2174	286	1.4557	0.3284	1.4557	1.2065
No log	6.2609	288	1.5532	0.2903	1.5532	1.2463
No log	6.3043	290	1.4625	0.2870	1.4625	1.2093
No log	6.3478	292	1.3875	0.1122	1.3875	1.1779
No log	6.3913	294	1.3720	0.1282	1.3720	1.1713
No log	6.4348	296	1.3500	0.1344	1.3500	1.1619
No log	6.4783	298	1.4504	0.2980	1.4504	1.2043
No log	6.5217	300	1.6207	0.2163	1.6207	1.2731
No log	6.5652	302	1.6569	0.1811	1.6569	1.2872
No log	6.6087	304	1.5189	0.2237	1.5189	1.2324
No log	6.6522	306	1.4116	0.1860	1.4116	1.1881
No log	6.6957	308	1.4187	0.1280	1.4187	1.1911
No log	6.7391	310	1.5150	0.2224	1.5150	1.2308
No log	6.7826	312	1.4577	0.2224	1.4577	1.2074
No log	6.8261	314	1.3607	0.0835	1.3607	1.1665
No log	6.8696	316	1.3332	0.0664	1.3332	1.1546
No log	6.9130	318	1.3394	0.0835	1.3394	1.1573
No log	6.9565	320	1.3660	0.1185	1.3660	1.1687
No log	7.0	322	1.4106	0.0937	1.4106	1.1877
No log	7.0435	324	1.4714	0.1698	1.4714	1.2130
No log	7.0870	326	1.4423	0.1462	1.4423	1.2010
No log	7.1304	328	1.4083	0.0750	1.4083	1.1867
No log	7.1739	330	1.4269	0.0750	1.4269	1.1945
No log	7.2174	332	1.4927	0.1698	1.4927	1.2218
No log	7.2609	334	1.5382	0.1796	1.5382	1.2402
No log	7.3043	336	1.4619	0.1031	1.4619	1.2091
No log	7.3478	338	1.3628	-0.0212	1.3628	1.1674
No log	7.3913	340	1.3501	-0.0042	1.3501	1.1620
No log	7.4348	342	1.3596	0.0126	1.3596	1.1660
No log	7.4783	344	1.4177	0.0885	1.4177	1.1907
No log	7.5217	346	1.6425	0.2217	1.6425	1.2816
No log	7.5652	348	1.7678	0.1026	1.7678	1.3296
No log	7.6087	350	1.6132	0.2325	1.6132	1.2701
No log	7.6522	352	1.4015	0.1463	1.4015	1.1839
No log	7.6957	354	1.3209	0.0885	1.3209	1.1493
No log	7.7391	356	1.3037	0.0721	1.3037	1.1418
No log	7.7826	358	1.3694	0.1650	1.3694	1.1702
No log	7.8261	360	1.6280	0.3047	1.6280	1.2759
No log	7.8696	362	1.7935	0.1672	1.7935	1.3392
No log	7.9130	364	1.7669	0.1672	1.7669	1.3292
No log	7.9565	366	1.5462	0.2359	1.5462	1.2435
No log	8.0	368	1.3628	0.2905	1.3628	1.1674
No log	8.0435	370	1.3143	0.1053	1.3143	1.1464
No log	8.0870	372	1.3019	0.0954	1.3019	1.1410
No log	8.1304	374	1.3209	0.2535	1.3209	1.1493
No log	8.1739	376	1.3135	0.2446	1.3135	1.1461
No log	8.2174	378	1.3445	0.2716	1.3445	1.1595
No log	8.2609	380	1.4413	0.2126	1.4413	1.2006
No log	8.3043	382	1.5315	0.1890	1.5315	1.2376
No log	8.3478	384	1.5337	0.1812	1.5337	1.2384
No log	8.3913	386	1.4366	0.2222	1.4366	1.1986
No log	8.4348	388	1.3759	0.1769	1.3759	1.1730
No log	8.4783	390	1.3451	0.1769	1.3451	1.1598
No log	8.5217	392	1.3820	0.1578	1.3820	1.1756
No log	8.5652	394	1.3903	0.2100	1.3903	1.1791
No log	8.6087	396	1.3984	0.2100	1.3984	1.1826
No log	8.6522	398	1.3999	0.2100	1.3999	1.1832
No log	8.6957	400	1.3297	0.1442	1.3297	1.1531
No log	8.7391	402	1.3245	0.1442	1.3245	1.1509
No log	8.7826	404	1.4538	0.2527	1.4538	1.2058
No log	8.8261	406	1.6338	0.1726	1.6338	1.2782
No log	8.8696	408	1.6125	0.2084	1.6125	1.2698
No log	8.9130	410	1.4049	0.2479	1.4049	1.1853
No log	8.9565	412	1.2695	0.2110	1.2695	1.1267
No log	9.0	414	1.2517	0.0958	1.2517	1.1188
No log	9.0435	416	1.2658	0.1149	1.2658	1.1251
No log	9.0870	418	1.2798	0.1504	1.2798	1.1313
No log	9.1304	420	1.3175	0.1282	1.3175	1.1478
No log	9.1739	422	1.3459	0.1282	1.3459	1.1601
No log	9.2174	424	1.3848	0.1344	1.3848	1.1768
No log	9.2609	426	1.4113	0.1502	1.4113	1.1880
No log	9.3043	428	1.4710	0.1671	1.4710	1.2128
No log	9.3478	430	1.6104	0.1734	1.6104	1.2690
No log	9.3913	432	1.6624	0.1663	1.6624	1.2894
No log	9.4348	434	1.6335	0.0771	1.6335	1.2781
No log	9.4783	436	1.5920	0.1867	1.5920	1.2618
No log	9.5217	438	1.5650	0.1675	1.5650	1.2510
No log	9.5652	440	1.5540	0.1722	1.5540	1.2466
No log	9.6087	442	1.5584	0.2163	1.5584	1.2483
No log	9.6522	444	1.4837	0.1807	1.4837	1.2181
No log	9.6957	446	1.4286	0.1371	1.4286	1.1953
No log	9.7391	448	1.4487	0.1371	1.4487	1.2036
No log	9.7826	450	1.4990	0.2173	1.4990	1.2243
No log	9.8261	452	1.4932	0.1957	1.4932	1.2220
No log	9.8696	454	1.4607	0.1337	1.4607	1.2086
No log	9.9130	456	1.4302	0.1430	1.4302	1.1959
No log	9.9565	458	1.4525	0.2223	1.4525	1.2052
No log	10.0	460	1.4862	0.2457	1.4862	1.2191
No log	10.0435	462	1.4285	0.2586	1.4285	1.1952
No log	10.0870	464	1.3203	0.1405	1.3203	1.1490
No log	10.1304	466	1.2839	0.0434	1.2839	1.1331
No log	10.1739	468	1.3192	0.0503	1.3192	1.1486
No log	10.2174	470	1.3604	0.0598	1.3604	1.1664
No log	10.2609	472	1.4114	0.0849	1.4114	1.1880
No log	10.3043	474	1.4641	0.1097	1.4641	1.2100
No log	10.3478	476	1.5796	0.1395	1.5796	1.2568
No log	10.3913	478	1.5872	0.1611	1.5872	1.2598
No log	10.4348	480	1.4910	0.0970	1.4910	1.2211
No log	10.4783	482	1.4306	0.0731	1.4306	1.1961
No log	10.5217	484	1.4229	0.0340	1.4229	1.1929
No log	10.5652	486	1.4128	0.0104	1.4128	1.1886
No log	10.6087	488	1.4672	0.1279	1.4672	1.2113
No log	10.6522	490	1.5417	0.1758	1.5417	1.2417
No log	10.6957	492	1.5479	0.2224	1.5479	1.2441
No log	10.7391	494	1.4750	0.1279	1.4750	1.2145
No log	10.7826	496	1.4297	0.1617	1.4297	1.1957
No log	10.8261	498	1.4304	0.1371	1.4304	1.1960
0.3262	10.8696	500	1.4535	0.1667	1.4535	1.2056
0.3262	10.9130	502	1.4061	0.1371	1.4061	1.1858
0.3262	10.9565	504	1.3793	0.0806	1.3793	1.1744
0.3262	11.0	506	1.4296	0.1371	1.4296	1.1957
0.3262	11.0435	508	1.5440	0.2371	1.5440	1.2426
0.3262	11.0870	510	1.5863	0.1929	1.5863	1.2595
0.3262	11.1304	512	1.5293	0.2286	1.5293	1.2366
0.3262	11.1739	514	1.4669	0.1850	1.4669	1.2112
0.3262	11.2174	516	1.4200	0.2046	1.4200	1.1916
0.3262	11.2609	518	1.3666	0.1502	1.3666	1.1690
0.3262	11.3043	520	1.3859	0.1500	1.3859	1.1773
0.3262	11.3478	522	1.4441	0.2141	1.4441	1.2017
0.3262	11.3913	524	1.4971	0.1891	1.4971	1.2236
0.3262	11.4348	526	1.5710	0.2009	1.5710	1.2534
0.3262	11.4783	528	1.4987	0.2060	1.4987	1.2242
0.3262	11.5217	530	1.3525	0.1692	1.3525	1.1630
0.3262	11.5652	532	1.2312	0.1149	1.2312	1.1096
0.3262	11.6087	534	1.2178	0.1275	1.2178	1.1035
0.3262	11.6522	536	1.2377	0.0989	1.2377	1.1125
0.3262	11.6957	538	1.2610	0.0989	1.2610	1.1230
0.3262	11.7391	540	1.3448	0.1371	1.3448	1.1596

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1