ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4259
• Qwk: 0.0759
• Mse: 1.4259
• Rmse: 1.1941

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.8331	-0.0075	4.8331	2.1984
No log	0.0976	4	3.2429	-0.0576	3.2429	1.8008
No log	0.1463	6	1.9771	-0.0575	1.9771	1.4061
No log	0.1951	8	1.7978	0.0062	1.7978	1.3408
No log	0.2439	10	1.4920	0.0372	1.4920	1.2215
No log	0.2927	12	1.4400	-0.0293	1.4400	1.2000
No log	0.3415	14	1.3377	-0.0590	1.3377	1.1566
No log	0.3902	16	1.2267	0.2784	1.2267	1.1075
No log	0.4390	18	1.2574	0.0780	1.2574	1.1213
No log	0.4878	20	1.2383	0.2579	1.2383	1.1128
No log	0.5366	22	1.2633	0.2298	1.2633	1.1240
No log	0.5854	24	1.2180	0.2053	1.2180	1.1036
No log	0.6341	26	1.1822	0.0872	1.1822	1.0873
No log	0.6829	28	1.1644	0.0974	1.1644	1.0791
No log	0.7317	30	1.1665	0.2023	1.1665	1.0801
No log	0.7805	32	1.1786	0.3814	1.1786	1.0856
No log	0.8293	34	1.1584	0.2887	1.1584	1.0763
No log	0.8780	36	1.1848	0.2836	1.1848	1.0885
No log	0.9268	38	1.4277	0.0600	1.4277	1.1949
No log	0.9756	40	1.4850	0.0600	1.4850	1.2186
No log	1.0244	42	1.4335	0.0473	1.4335	1.1973
No log	1.0732	44	1.3911	0.1136	1.3911	1.1794
No log	1.1220	46	1.2565	0.1321	1.2565	1.1209
No log	1.1707	48	1.2218	0.1927	1.2218	1.1053
No log	1.2195	50	1.4192	0.1481	1.4192	1.1913
No log	1.2683	52	1.4031	0.1935	1.4031	1.1845
No log	1.3171	54	1.2290	0.2154	1.2290	1.1086
No log	1.3659	56	1.2123	0.1994	1.2123	1.1010
No log	1.4146	58	1.2164	0.1671	1.2164	1.1029
No log	1.4634	60	1.2117	0.1856	1.2117	1.1008
No log	1.5122	62	1.6226	-0.0529	1.6226	1.2738
No log	1.5610	64	2.0287	-0.0474	2.0287	1.4243
No log	1.6098	66	1.9946	-0.0331	1.9946	1.4123
No log	1.6585	68	1.8300	-0.1442	1.8300	1.3528
No log	1.7073	70	1.6389	-0.1062	1.6389	1.2802
No log	1.7561	72	1.4818	0.0644	1.4818	1.2173
No log	1.8049	74	1.4742	0.0706	1.4742	1.2142
No log	1.8537	76	1.4038	0.0477	1.4038	1.1848
No log	1.9024	78	1.2159	0.0571	1.2159	1.1027
No log	1.9512	80	1.2882	0.0612	1.2882	1.1350
No log	2.0	82	1.2343	0.0954	1.2343	1.1110
No log	2.0488	84	1.1108	0.1711	1.1108	1.0540
No log	2.0976	86	1.0817	0.2864	1.0817	1.0401
No log	2.1463	88	1.0733	0.3017	1.0733	1.0360
No log	2.1951	90	1.2471	0.2889	1.2471	1.1167
No log	2.2439	92	1.4756	0.1568	1.4756	1.2148
No log	2.2927	94	1.5602	0.2317	1.5602	1.2491
No log	2.3415	96	1.2498	0.4016	1.2498	1.1179
No log	2.3902	98	1.1934	0.3758	1.1934	1.0924
No log	2.4390	100	1.2594	0.3848	1.2594	1.1222
No log	2.4878	102	1.5579	0.2832	1.5579	1.2482
No log	2.5366	104	1.8559	0.2357	1.8559	1.3623
No log	2.5854	106	1.6390	0.2852	1.6390	1.2802
No log	2.6341	108	1.4702	0.2672	1.4702	1.2125
No log	2.6829	110	1.5073	0.2430	1.5073	1.2277
No log	2.7317	112	1.6081	0.2569	1.6081	1.2681
No log	2.7805	114	1.4310	0.2172	1.4310	1.1962
No log	2.8293	116	1.2266	0.2483	1.2266	1.1075
No log	2.8780	118	1.2880	0.3044	1.2880	1.1349
No log	2.9268	120	1.6089	0.1980	1.6089	1.2684
No log	2.9756	122	1.6859	0.0104	1.6859	1.2984
No log	3.0244	124	1.5067	0.1745	1.5067	1.2275
No log	3.0732	126	1.3893	0.2447	1.3893	1.1787
No log	3.1220	128	1.5218	0.1048	1.5218	1.2336
No log	3.1707	130	1.5020	0.1416	1.5020	1.2256
No log	3.2195	132	1.3522	0.2790	1.3522	1.1628
No log	3.2683	134	1.3377	0.2151	1.3377	1.1566
No log	3.3171	136	1.2792	0.2151	1.2792	1.1310
No log	3.3659	138	1.2534	0.3155	1.2534	1.1196
No log	3.4146	140	1.4121	0.3152	1.4121	1.1883
No log	3.4634	142	1.5838	0.3026	1.5838	1.2585
No log	3.5122	144	1.4241	0.3222	1.4241	1.1934
No log	3.5610	146	1.3216	0.3621	1.3216	1.1496
No log	3.6098	148	1.3880	0.3188	1.3880	1.1781
No log	3.6585	150	1.3206	0.3611	1.3206	1.1492
No log	3.7073	152	1.0885	0.2461	1.0885	1.0433
No log	3.7561	154	1.0464	0.3018	1.0464	1.0229
No log	3.8049	156	1.0911	0.2461	1.0911	1.0445
No log	3.8537	158	1.3526	0.3348	1.3526	1.1630
No log	3.9024	160	1.5759	0.2895	1.5759	1.2553
No log	3.9512	162	1.5827	0.2270	1.5827	1.2581
No log	4.0	164	1.4871	0.2334	1.4871	1.2195
No log	4.0488	166	1.3136	0.3265	1.3136	1.1461
No log	4.0976	168	1.1595	0.1819	1.1595	1.0768
No log	4.1463	170	1.1749	0.1671	1.1749	1.0839
No log	4.1951	172	1.2046	0.25	1.2046	1.0976
No log	4.2439	174	1.0952	0.2424	1.0952	1.0465
No log	4.2927	176	1.0806	0.2871	1.0806	1.0395
No log	4.3415	178	1.2019	0.3739	1.2019	1.0963
No log	4.3902	180	1.3028	0.3902	1.3028	1.1414
No log	4.4390	182	1.3752	0.3449	1.3752	1.1727
No log	4.4878	184	1.2243	0.3967	1.2243	1.1065
No log	4.5366	186	1.1077	0.3256	1.1077	1.0525
No log	4.5854	188	1.1370	0.3113	1.1370	1.0663
No log	4.6341	190	1.3682	0.3734	1.3682	1.1697
No log	4.6829	192	1.7230	0.2251	1.7230	1.3126
No log	4.7317	194	1.7520	0.1349	1.7520	1.3236
No log	4.7805	196	1.4752	0.2418	1.4752	1.2146
No log	4.8293	198	1.2533	0.3863	1.2533	1.1195
No log	4.8780	200	1.3325	0.3742	1.3325	1.1543
No log	4.9268	202	1.4872	0.3067	1.4872	1.2195
No log	4.9756	204	1.5836	0.2162	1.5836	1.2584
No log	5.0244	206	1.4342	0.2512	1.4342	1.1976
No log	5.0732	208	1.2345	0.3095	1.2345	1.1111
No log	5.1220	210	1.2136	0.2590	1.2136	1.1017
No log	5.1707	212	1.4292	0.3339	1.4292	1.1955
No log	5.2195	214	1.6038	0.1880	1.6038	1.2664
No log	5.2683	216	1.6129	0.1407	1.6129	1.2700
No log	5.3171	218	1.4898	0.1929	1.4898	1.2206
No log	5.3659	220	1.3307	0.2647	1.3307	1.1535
No log	5.4146	222	1.3714	0.2647	1.3714	1.1711
No log	5.4634	224	1.4791	0.1802	1.4791	1.2162
No log	5.5122	226	1.5223	0.1802	1.5223	1.2338
No log	5.5610	228	1.6276	0.2047	1.6276	1.2758
No log	5.6098	230	1.5855	0.1639	1.5855	1.2592
No log	5.6585	232	1.6107	0.2036	1.6107	1.2691
No log	5.7073	234	1.4856	0.2685	1.4856	1.2189
No log	5.7561	236	1.2979	0.3197	1.2979	1.1392
No log	5.8049	238	1.3214	0.3046	1.3214	1.1495
No log	5.8537	240	1.4843	0.2740	1.4843	1.2183
No log	5.9024	242	1.5657	0.2424	1.5657	1.2513
No log	5.9512	244	1.5007	0.2829	1.5007	1.2250
No log	6.0	246	1.3750	0.2424	1.3750	1.1726
No log	6.0488	248	1.3502	0.2163	1.3502	1.1620
No log	6.0976	250	1.3769	0.2163	1.3769	1.1734
No log	6.1463	252	1.3937	0.2424	1.3937	1.1806
No log	6.1951	254	1.5269	0.3302	1.5269	1.2357
No log	6.2439	256	1.4824	0.2852	1.4824	1.2175
No log	6.2927	258	1.2092	0.2621	1.2092	1.0996
No log	6.3415	260	1.1638	0.2326	1.1638	1.0788
No log	6.3902	262	1.3308	0.3136	1.3308	1.1536
No log	6.4390	264	1.3881	0.3025	1.3881	1.1782
No log	6.4878	266	1.2388	0.2934	1.2388	1.1130
No log	6.5366	268	1.1541	0.2716	1.1541	1.0743
No log	6.5854	270	1.3285	0.2961	1.3285	1.1526
No log	6.6341	272	1.6883	0.2463	1.6883	1.2993
No log	6.6829	274	1.7217	0.2310	1.7217	1.3121
No log	6.7317	276	1.6035	0.2463	1.6035	1.2663
No log	6.7805	278	1.5907	0.2463	1.5907	1.2612
No log	6.8293	280	1.5220	0.2217	1.5220	1.2337
No log	6.8780	282	1.4013	0.1889	1.4013	1.1838
No log	6.9268	284	1.3924	0.1536	1.3924	1.1800
No log	6.9756	286	1.3678	0.2173	1.3678	1.1695
No log	7.0244	288	1.4295	0.2763	1.4295	1.1956
No log	7.0732	290	1.3828	0.2289	1.3828	1.1759
No log	7.1220	292	1.2915	0.2857	1.2915	1.1364
No log	7.1707	294	1.2143	0.2934	1.2143	1.1020
No log	7.2195	296	1.2937	0.2961	1.2937	1.1374
No log	7.2683	298	1.4846	0.3067	1.4845	1.2184
No log	7.3171	300	1.4817	0.2763	1.4817	1.2172
No log	7.3659	302	1.3401	0.2956	1.3401	1.1576
No log	7.4146	304	1.1796	0.2525	1.1796	1.0861
No log	7.4634	306	1.2215	0.2791	1.2215	1.1052
No log	7.5122	308	1.4237	0.2956	1.4237	1.1932
No log	7.5610	310	1.7447	0.1882	1.7447	1.3209
No log	7.6098	312	1.9284	0.1221	1.9284	1.3887
No log	7.6585	314	1.8409	0.1672	1.8409	1.3568
No log	7.7073	316	1.6892	0.1697	1.6892	1.2997
No log	7.7561	318	1.4744	0.2844	1.4744	1.2143
No log	7.8049	320	1.3494	0.2424	1.3494	1.1616
No log	7.8537	322	1.4381	0.2317	1.4381	1.1992
No log	7.9024	324	1.5153	0.2870	1.5153	1.2310
No log	7.9512	326	1.5048	0.2731	1.5048	1.2267
No log	8.0	328	1.3339	0.2527	1.3339	1.1549
No log	8.0488	330	1.1972	0.2714	1.1972	1.0942
No log	8.0976	332	1.1652	0.2343	1.1652	1.0794
No log	8.1463	334	1.3056	0.2696	1.3056	1.1426
No log	8.1951	336	1.3607	0.2317	1.3607	1.1665
No log	8.2439	338	1.3599	0.2317	1.3599	1.1661
No log	8.2927	340	1.2325	0.2696	1.2325	1.1102
No log	8.3415	342	1.2066	0.2424	1.2066	1.0985
No log	8.3902	344	1.2888	0.2696	1.2888	1.1353
No log	8.4390	346	1.3928	0.2559	1.3928	1.1802
No log	8.4878	348	1.3670	0.2527	1.3670	1.1692
No log	8.5366	350	1.4633	0.2757	1.4633	1.2097
No log	8.5854	352	1.5193	0.2829	1.5193	1.2326
No log	8.6341	354	1.4467	0.3143	1.4467	1.2028
No log	8.6829	356	1.2628	0.2664	1.2628	1.1238
No log	8.7317	358	1.2623	0.2664	1.2623	1.1235
No log	8.7805	360	1.4402	0.3047	1.4402	1.2001
No log	8.8293	362	1.5052	0.2309	1.5052	1.2269
No log	8.8780	364	1.3875	0.2184	1.3875	1.1779
No log	8.9268	366	1.2773	0.2439	1.2773	1.1302
No log	8.9756	368	1.2347	0.3046	1.2347	1.1112
No log	9.0244	370	1.2459	0.3068	1.2459	1.1162
No log	9.0732	372	1.3949	0.2589	1.3949	1.1810
No log	9.1220	374	1.5045	0.2217	1.5045	1.2266
No log	9.1707	376	1.4505	0.1796	1.4505	1.2044
No log	9.2195	378	1.2871	0.2424	1.2871	1.1345
No log	9.2683	380	1.2433	0.2525	1.2433	1.1150
No log	9.3171	382	1.2832	0.2475	1.2832	1.1328
No log	9.3659	384	1.3626	0.2403	1.3626	1.1673
No log	9.4146	386	1.3916	0.1891	1.3916	1.1797
No log	9.4634	388	1.3812	0.2037	1.3812	1.1752
No log	9.5122	390	1.4092	0.2037	1.4092	1.1871
No log	9.5610	392	1.3368	0.2570	1.3368	1.1562
No log	9.6098	394	1.2077	0.1903	1.2077	1.0990
No log	9.6585	396	1.2151	0.2000	1.2151	1.1023
No log	9.7073	398	1.2343	0.2000	1.2343	1.1110
No log	9.7561	400	1.2658	0.1440	1.2658	1.1251
No log	9.8049	402	1.3931	0.2173	1.3931	1.1803
No log	9.8537	404	1.4261	0.2289	1.4261	1.1942
No log	9.9024	406	1.3348	0.2586	1.3348	1.1553
No log	9.9512	408	1.1669	0.1344	1.1669	1.0802
No log	10.0	410	1.0920	0.1605	1.0920	1.0450
No log	10.0488	412	1.0953	0.1919	1.0953	1.0466
No log	10.0976	414	1.1686	0.1654	1.1686	1.0810
No log	10.1463	416	1.3673	0.2956	1.3673	1.1693
No log	10.1951	418	1.4551	0.2424	1.4551	1.2063
No log	10.2439	420	1.3390	0.2664	1.3390	1.1572
No log	10.2927	422	1.2005	0.1654	1.2005	1.0957
No log	10.3415	424	1.1404	0.1602	1.1404	1.0679
No log	10.3902	426	1.1761	0.2009	1.1761	1.0845
No log	10.4390	428	1.2834	0.1952	1.2834	1.1329
No log	10.4878	430	1.3225	0.1891	1.3225	1.1500
No log	10.5366	432	1.2461	0.2403	1.2461	1.1163
No log	10.5854	434	1.1880	0.2978	1.1880	1.0900
No log	10.6341	436	1.1697	0.1441	1.1697	1.0815
No log	10.6829	438	1.1616	0.1282	1.1616	1.0778
No log	10.7317	440	1.1392	0.1541	1.1392	1.0673
No log	10.7805	442	1.1736	0.1282	1.1737	1.0834
No log	10.8293	444	1.1537	0.1282	1.1537	1.0741
No log	10.8780	446	1.0884	0.1761	1.0884	1.0433
No log	10.9268	448	1.0617	0.2188	1.0617	1.0304
No log	10.9756	450	1.0843	0.2019	1.0843	1.0413
No log	11.0244	452	1.1845	0.1795	1.1845	1.0884
No log	11.0732	454	1.3676	0.1980	1.3676	1.1694
No log	11.1220	456	1.3872	0.2763	1.3872	1.1778
No log	11.1707	458	1.3247	0.2895	1.3247	1.1510
No log	11.2195	460	1.2821	0.2647	1.2821	1.1323
No log	11.2683	462	1.1955	0.2864	1.1955	1.0934
No log	11.3171	464	1.1822	0.1750	1.1822	1.0873
No log	11.3659	466	1.2367	0.1379	1.2367	1.1121
No log	11.4146	468	1.2938	0.1379	1.2938	1.1375
No log	11.4634	470	1.3517	0.1379	1.3517	1.1626
No log	11.5122	472	1.3379	0.2586	1.3379	1.1567
No log	11.5610	474	1.2737	0.3003	1.2737	1.1286
No log	11.6098	476	1.1723	0.3136	1.1723	1.0827
No log	11.6585	478	1.1697	0.2889	1.1697	1.0815
No log	11.7073	480	1.2592	0.3136	1.2592	1.1222
No log	11.7561	482	1.2849	0.2619	1.2849	1.1336
No log	11.8049	484	1.1763	0.2889	1.1763	1.0846
No log	11.8537	486	1.0432	0.2248	1.0432	1.0214
No log	11.9024	488	1.0312	0.2830	1.0312	1.0155
No log	11.9512	490	1.1153	0.2772	1.1153	1.0561
No log	12.0	492	1.3095	0.2961	1.3095	1.1443
No log	12.0488	494	1.4130	0.2359	1.4130	1.1887
No log	12.0976	496	1.3551	0.2105	1.3551	1.1641
No log	12.1463	498	1.2154	0.1654	1.2154	1.1025
0.3298	12.1951	500	1.1519	0.1853	1.1519	1.0732
0.3298	12.2439	502	1.1790	0.1853	1.1790	1.0858
0.3298	12.2927	504	1.3149	0.1650	1.3149	1.1467
0.3298	12.3415	506	1.4813	0.2065	1.4813	1.2171
0.3298	12.3902	508	1.4615	0.2424	1.4615	1.2089
0.3298	12.4390	510	1.4517	0.2163	1.4517	1.2048
0.3298	12.4878	512	1.4675	0.1891	1.4675	1.2114
0.3298	12.5366	514	1.4185	0.1071	1.4185	1.1910
0.3298	12.5854	516	1.3028	0.1345	1.3028	1.1414
0.3298	12.6341	518	1.3115	0.1379	1.3115	1.1452
0.3298	12.6829	520	1.3215	0.1379	1.3215	1.1496
0.3298	12.7317	522	1.4259	0.0759	1.4259	1.1941

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1