ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2349
• Qwk: 0.1405
• Mse: 1.2349
• Rmse: 1.1112

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.7260	-0.0132	4.7260	2.1739
No log	0.0976	4	2.9760	0.0139	2.9760	1.7251
No log	0.1463	6	2.1366	-0.0494	2.1366	1.4617
No log	0.1951	8	2.3163	-0.0732	2.3163	1.5219
No log	0.2439	10	1.7175	0.0062	1.7175	1.3105
No log	0.2927	12	1.4356	0.0165	1.4356	1.1982
No log	0.3415	14	1.2753	0.1448	1.2753	1.1293
No log	0.3902	16	1.2093	0.1870	1.2093	1.0997
No log	0.4390	18	1.2377	0.0319	1.2377	1.1125
No log	0.4878	20	1.2476	0.0473	1.2476	1.1169
No log	0.5366	22	1.1969	0.2485	1.1969	1.0940
No log	0.5854	24	1.1544	0.2351	1.1544	1.0744
No log	0.6341	26	1.2396	0.0253	1.2396	1.1134
No log	0.6829	28	1.2758	0.0427	1.2758	1.1295
No log	0.7317	30	1.2466	0.0454	1.2466	1.1165
No log	0.7805	32	1.2005	0.0802	1.2005	1.0957
No log	0.8293	34	1.1989	0.2520	1.1989	1.0950
No log	0.8780	36	1.2119	0.2212	1.2119	1.1009
No log	0.9268	38	1.2897	0.0984	1.2897	1.1356
No log	0.9756	40	1.3275	0.0984	1.3275	1.1522
No log	1.0244	42	1.4181	0.0955	1.4181	1.1909
No log	1.0732	44	1.4578	0.1106	1.4578	1.2074
No log	1.1220	46	1.3121	0.1076	1.3121	1.1455
No log	1.1707	48	1.1978	0.2402	1.1978	1.0944
No log	1.2195	50	1.2038	0.2273	1.2038	1.0972
No log	1.2683	52	1.1758	0.2647	1.1758	1.0844
No log	1.3171	54	1.2758	0.1527	1.2758	1.1295
No log	1.3659	56	1.2837	0.1470	1.2837	1.1330
No log	1.4146	58	1.1901	0.1849	1.1901	1.0909
No log	1.4634	60	1.3481	0.0923	1.3481	1.1611
No log	1.5122	62	1.3832	0.1500	1.3832	1.1761
No log	1.5610	64	1.2132	0.2288	1.2132	1.1014
No log	1.6098	66	1.0362	0.3142	1.0362	1.0179
No log	1.6585	68	1.0104	0.4075	1.0104	1.0052
No log	1.7073	70	1.0302	0.4093	1.0302	1.0150
No log	1.7561	72	1.0391	0.3135	1.0391	1.0194
No log	1.8049	74	0.9654	0.3629	0.9654	0.9826
No log	1.8537	76	1.1487	0.2471	1.1487	1.0718
No log	1.9024	78	1.3465	0.3087	1.3465	1.1604
No log	1.9512	80	1.2670	0.2371	1.2670	1.1256
No log	2.0	82	1.0964	0.3141	1.0964	1.0471
No log	2.0488	84	1.0260	0.3565	1.0260	1.0129
No log	2.0976	86	1.0282	0.2920	1.0282	1.0140
No log	2.1463	88	1.0721	0.3091	1.0721	1.0354
No log	2.1951	90	1.3851	0.2895	1.3851	1.1769
No log	2.2439	92	1.6024	0.3008	1.6024	1.2659
No log	2.2927	94	1.5595	0.2667	1.5595	1.2488
No log	2.3415	96	1.2557	0.3325	1.2557	1.1206
No log	2.3902	98	1.1865	0.2757	1.1865	1.0892
No log	2.4390	100	1.1437	0.2726	1.1437	1.0695
No log	2.4878	102	1.1304	0.2755	1.1304	1.0632
No log	2.5366	104	1.1928	0.3606	1.1928	1.0922
No log	2.5854	106	1.4583	0.2727	1.4583	1.2076
No log	2.6341	108	1.5608	0.2363	1.5608	1.2493
No log	2.6829	110	1.3470	0.2914	1.3470	1.1606
No log	2.7317	112	1.1445	0.2409	1.1445	1.0698
No log	2.7805	114	1.3015	0.3121	1.3015	1.1409
No log	2.8293	116	1.4643	0.2941	1.4643	1.2101
No log	2.8780	118	1.2746	0.2075	1.2746	1.1290
No log	2.9268	120	1.1830	0.2175	1.1830	1.0877
No log	2.9756	122	1.3387	0.2542	1.3387	1.1570
No log	3.0244	124	1.3349	0.2844	1.3349	1.1554
No log	3.0732	126	1.2164	0.2574	1.2164	1.1029
No log	3.1220	128	1.1630	0.2070	1.1630	1.0784
No log	3.1707	130	1.1536	0.2820	1.1536	1.0741
No log	3.2195	132	1.1444	0.2869	1.1444	1.0698
No log	3.2683	134	1.2724	0.3745	1.2724	1.1280
No log	3.3171	136	1.3481	0.3559	1.3481	1.1611
No log	3.3659	138	1.1883	0.4133	1.1883	1.0901
No log	3.4146	140	1.0984	0.2986	1.0984	1.0480
No log	3.4634	142	1.1706	0.3008	1.1706	1.0819
No log	3.5122	144	1.0403	0.3210	1.0403	1.0200
No log	3.5610	146	1.1205	0.3465	1.1205	1.0585
No log	3.6098	148	1.4058	0.3414	1.4058	1.1856
No log	3.6585	150	1.5313	0.2682	1.5313	1.2374
No log	3.7073	152	1.4272	0.1801	1.4272	1.1947
No log	3.7561	154	1.2370	0.2322	1.2370	1.1122
No log	3.8049	156	1.0804	0.2813	1.0804	1.0394
No log	3.8537	158	1.0563	0.2793	1.0563	1.0278
No log	3.9024	160	1.1245	0.2686	1.1245	1.0604
No log	3.9512	162	1.3296	0.1986	1.3296	1.1531
No log	4.0	164	1.5453	0.2468	1.5453	1.2431
No log	4.0488	166	1.4862	0.2115	1.4862	1.2191
No log	4.0976	168	1.2839	0.1611	1.2839	1.1331
No log	4.1463	170	1.2249	0.1764	1.2249	1.1068
No log	4.1951	172	1.1569	0.2260	1.1569	1.0756
No log	4.2439	174	1.1439	0.1943	1.1439	1.0695
No log	4.2927	176	1.1687	0.2404	1.1687	1.0810
No log	4.3415	178	1.2380	0.2458	1.2380	1.1126
No log	4.3902	180	1.4933	0.3478	1.4933	1.2220
No log	4.4390	182	1.5649	0.2751	1.5649	1.2510
No log	4.4878	184	1.4176	0.1681	1.4176	1.1906
No log	4.5366	186	1.2109	0.2045	1.2109	1.1004
No log	4.5854	188	1.1714	0.2034	1.1714	1.0823
No log	4.6341	190	1.1917	0.1989	1.1917	1.0916
No log	4.6829	192	1.2942	0.1028	1.2942	1.1376
No log	4.7317	194	1.6475	0.2812	1.6475	1.2836
No log	4.7805	196	1.8161	0.1756	1.8161	1.3476
No log	4.8293	198	1.6976	0.2622	1.6976	1.3029
No log	4.8780	200	1.5287	0.2846	1.5287	1.2364
No log	4.9268	202	1.2952	0.2349	1.2952	1.1381
No log	4.9756	204	1.1789	0.2206	1.1789	1.0858
No log	5.0244	206	1.1596	0.1920	1.1596	1.0768
No log	5.0732	208	1.2240	0.2417	1.2240	1.1064
No log	5.1220	210	1.3916	0.2481	1.3916	1.1796
No log	5.1707	212	1.5126	0.2932	1.5126	1.2299
No log	5.2195	214	1.4481	0.2047	1.4481	1.2034
No log	5.2683	216	1.2888	0.2443	1.2888	1.1353
No log	5.3171	218	1.1869	0.2404	1.1869	1.0895
No log	5.3659	220	1.1583	0.2729	1.1583	1.0762
No log	5.4146	222	1.1995	0.2309	1.1995	1.0952
No log	5.4634	224	1.2821	0.2028	1.2821	1.1323
No log	5.5122	226	1.2688	0.1943	1.2688	1.1264
No log	5.5610	228	1.1623	0.2184	1.1623	1.0781
No log	5.6098	230	1.0334	0.3826	1.0334	1.0166
No log	5.6585	232	0.9864	0.4026	0.9864	0.9932
No log	5.7073	234	0.9662	0.4026	0.9662	0.9830
No log	5.7561	236	1.0191	0.4016	1.0191	1.0095
No log	5.8049	238	1.2440	0.3398	1.2440	1.1153
No log	5.8537	240	1.4667	0.2947	1.4667	1.2111
No log	5.9024	242	1.4929	0.2701	1.4929	1.2218
No log	5.9512	244	1.3624	0.2212	1.3624	1.1672
No log	6.0	246	1.1957	0.1912	1.1957	1.0935
No log	6.0488	248	1.1312	0.1727	1.1312	1.0636
No log	6.0976	250	1.1127	0.2563	1.1127	1.0549
No log	6.1463	252	1.1426	0.2270	1.1426	1.0689
No log	6.1951	254	1.2022	0.1949	1.2022	1.0965
No log	6.2439	256	1.2702	0.2191	1.2702	1.1270
No log	6.2927	258	1.1962	0.2126	1.1962	1.0937
No log	6.3415	260	1.1926	0.1678	1.1926	1.0921
No log	6.3902	262	1.2450	0.1943	1.2450	1.1158
No log	6.4390	264	1.2059	0.2367	1.2059	1.0981
No log	6.4878	266	1.1266	0.2121	1.1266	1.0614
No log	6.5366	268	1.0940	0.1732	1.0940	1.0460
No log	6.5854	270	1.1016	0.1786	1.1016	1.0496
No log	6.6341	272	1.1435	0.1662	1.1435	1.0694
No log	6.6829	274	1.1669	0.1562	1.1669	1.0802
No log	6.7317	276	1.1623	0.1968	1.1623	1.0781
No log	6.7805	278	1.1976	0.2006	1.1976	1.0944
No log	6.8293	280	1.2045	0.2006	1.2045	1.0975
No log	6.8780	282	1.1936	0.1814	1.1936	1.0925
No log	6.9268	284	1.1999	0.2009	1.1999	1.0954
No log	6.9756	286	1.2139	0.2108	1.2139	1.1018
No log	7.0244	288	1.2345	0.1801	1.2345	1.1111
No log	7.0732	290	1.2616	0.1641	1.2616	1.1232
No log	7.1220	292	1.1880	0.1801	1.1880	1.0899
No log	7.1707	294	1.1143	0.1528	1.1143	1.0556
No log	7.2195	296	1.0826	0.2455	1.0826	1.0405
No log	7.2683	298	1.0880	0.2492	1.0880	1.0431
No log	7.3171	300	1.1314	0.1406	1.1314	1.0637
No log	7.3659	302	1.2529	0.2195	1.2529	1.1193
No log	7.4146	304	1.2776	0.2330	1.2776	1.1303
No log	7.4634	306	1.2017	0.1801	1.2017	1.0962
No log	7.5122	308	1.1266	0.1820	1.1266	1.0614
No log	7.5610	310	1.0956	0.2145	1.0956	1.0467
No log	7.6098	312	1.0887	0.2694	1.0887	1.0434
No log	7.6585	314	1.0949	0.3042	1.0949	1.0464
No log	7.7073	316	1.1918	0.2288	1.1918	1.0917
No log	7.7561	318	1.3155	0.2028	1.3155	1.1469
No log	7.8049	320	1.4040	0.2983	1.4040	1.1849
No log	7.8537	322	1.3203	0.2250	1.3203	1.1490
No log	7.9024	324	1.1876	0.2195	1.1876	1.0897
No log	7.9512	326	1.1053	0.2857	1.1053	1.0513
No log	8.0	328	1.0895	0.2704	1.0895	1.0438
No log	8.0488	330	1.0893	0.2086	1.0893	1.0437
No log	8.0976	332	1.1158	0.1605	1.1158	1.0563
No log	8.1463	334	1.1788	0.1114	1.1788	1.0857
No log	8.1951	336	1.2099	0.1641	1.2099	1.1000
No log	8.2439	338	1.2408	0.1952	1.2408	1.1139
No log	8.2927	340	1.1753	0.1442	1.1753	1.0841
No log	8.3415	342	1.0802	0.2033	1.0802	1.0393
No log	8.3902	344	1.0751	0.2327	1.0751	1.0369
No log	8.4390	346	1.1030	0.1820	1.1030	1.0502
No log	8.4878	348	1.1300	0.1344	1.1300	1.0630
No log	8.5366	350	1.1541	0.1442	1.1541	1.0743
No log	8.5854	352	1.1266	0.1015	1.1266	1.0614
No log	8.6341	354	1.1324	0.1504	1.1324	1.0641
No log	8.6829	356	1.1113	0.2188	1.1113	1.0542
No log	8.7317	358	1.0998	0.2255	1.0998	1.0487
No log	8.7805	360	1.0825	0.2562	1.0825	1.0404
No log	8.8293	362	1.0679	0.2662	1.0679	1.0334
No log	8.8780	364	1.0431	0.2662	1.0431	1.0213
No log	8.9268	366	1.0294	0.2440	1.0294	1.0146
No log	8.9756	368	1.1333	0.2904	1.1333	1.0646
No log	9.0244	370	1.3646	0.2925	1.3646	1.1681
No log	9.0732	372	1.3898	0.2726	1.3898	1.1789
No log	9.1220	374	1.3013	0.2074	1.3013	1.1407
No log	9.1707	376	1.2876	0.1892	1.2876	1.1347
No log	9.2195	378	1.1756	0.2363	1.1756	1.0842
No log	9.2683	380	1.1651	0.2417	1.1651	1.0794
No log	9.3171	382	1.1344	0.2557	1.1344	1.0651
No log	9.3659	384	1.0806	0.2947	1.0806	1.0395
No log	9.4146	386	1.1050	0.2557	1.1050	1.0512
No log	9.4634	388	1.2508	0.2283	1.2508	1.1184
No log	9.5122	390	1.4976	0.3006	1.4976	1.2237
No log	9.5610	392	1.6210	0.2527	1.6210	1.2732
No log	9.6098	394	1.5472	0.3006	1.5472	1.2439
No log	9.6585	396	1.3755	0.1807	1.3755	1.1728
No log	9.7073	398	1.2213	0.2195	1.2213	1.1051
No log	9.7561	400	1.1268	0.2557	1.1268	1.0615
No log	9.8049	402	1.1248	0.2591	1.1248	1.0605
No log	9.8537	404	1.1874	0.2623	1.1874	1.0897
No log	9.9024	406	1.3450	0.1935	1.3450	1.1598
No log	9.9512	408	1.4776	0.2359	1.4776	1.2155
No log	10.0	410	1.5128	0.2359	1.5128	1.2299
No log	10.0488	412	1.4984	0.2608	1.4984	1.2241
No log	10.0976	414	1.3365	0.2181	1.3365	1.1561
No log	10.1463	416	1.1486	0.2594	1.1486	1.0718
No log	10.1951	418	1.0875	0.2877	1.0875	1.0429
No log	10.2439	420	1.1010	0.2461	1.1010	1.0493
No log	10.2927	422	1.1592	0.2604	1.1592	1.0767
No log	10.3415	424	1.2544	0.1535	1.2544	1.1200
No log	10.3902	426	1.2672	0.1807	1.2672	1.1257
No log	10.4390	428	1.2576	0.1252	1.2576	1.1214
No log	10.4878	430	1.1940	0.1951	1.1940	1.0927
No log	10.5366	432	1.1724	0.1997	1.1724	1.0828
No log	10.5854	434	1.1306	0.2409	1.1306	1.0633
No log	10.6341	436	1.1177	0.2409	1.1177	1.0572
No log	10.6829	438	1.1406	0.2060	1.1406	1.0680
No log	10.7317	440	1.1841	0.1951	1.1841	1.0882
No log	10.7805	442	1.2762	0.1224	1.2762	1.1297
No log	10.8293	444	1.3178	0.1599	1.3178	1.1480
No log	10.8780	446	1.2069	0.1450	1.2069	1.0986
No log	10.9268	448	1.0649	0.2591	1.0649	1.0319
No log	10.9756	450	1.0095	0.3282	1.0095	1.0047
No log	11.0244	452	1.0000	0.3948	1.0000	1.0000
No log	11.0732	454	1.0092	0.3282	1.0092	1.0046
No log	11.1220	456	1.0318	0.3282	1.0318	1.0158
No log	11.1707	458	1.1333	0.1912	1.1333	1.0646
No log	11.2195	460	1.2488	0.1905	1.2488	1.1175
No log	11.2683	462	1.2694	0.1905	1.2694	1.1267
No log	11.3171	464	1.1829	0.1658	1.1829	1.0876
No log	11.3659	466	1.0914	0.1564	1.0914	1.0447
No log	11.4146	468	1.0529	0.2528	1.0529	1.0261
No log	11.4634	470	1.0596	0.2327	1.0596	1.0294
No log	11.5122	472	1.0959	0.1717	1.0959	1.0468
No log	11.5610	474	1.1149	0.1562	1.1149	1.0559
No log	11.6098	476	1.1954	0.2381	1.1954	1.0934
No log	11.6585	478	1.2438	0.2475	1.2438	1.1153
No log	11.7073	480	1.2389	0.2195	1.2389	1.1130
No log	11.7561	482	1.1443	0.1755	1.1443	1.0697
No log	11.8049	484	1.0558	0.1081	1.0558	1.0275
No log	11.8537	486	1.0127	0.2813	1.0127	1.0063
No log	11.9024	488	1.0141	0.2658	1.0141	1.0070
No log	11.9512	490	1.0568	0.2317	1.0568	1.0280
No log	12.0	492	1.1306	0.2152	1.1306	1.0633
No log	12.0488	494	1.1994	0.2195	1.1994	1.0952
No log	12.0976	496	1.1924	0.2236	1.1924	1.0920
No log	12.1463	498	1.1536	0.2143	1.1536	1.0740
0.326	12.1951	500	1.0831	0.2164	1.0831	1.0407
0.326	12.2439	502	1.0300	0.2921	1.0300	1.0149
0.326	12.2927	504	1.0274	0.3237	1.0274	1.0136
0.326	12.3415	506	1.0693	0.2065	1.0693	1.0341
0.326	12.3902	508	1.1539	0.1755	1.1539	1.0742
0.326	12.4390	510	1.2270	0.1951	1.2270	1.1077
0.326	12.4878	512	1.2611	0.1951	1.2611	1.1230
0.326	12.5366	514	1.2349	0.1405	1.2349	1.1112

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1