ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1758
• Qwk: 0.1559
• Mse: 1.1758
• Rmse: 1.0843

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0194	2	5.0198	-0.0049	5.0198	2.2405
No log	0.0388	4	3.0897	-0.0155	3.0897	1.7578
No log	0.0583	6	2.2299	-0.0110	2.2299	1.4933
No log	0.0777	8	1.9386	-0.0598	1.9386	1.3923
No log	0.0971	10	1.4611	-0.0039	1.4611	1.2088
No log	0.1165	12	1.3283	0.0446	1.3283	1.1525
No log	0.1359	14	1.2990	0.1076	1.2990	1.1397
No log	0.1553	16	1.3740	0.0408	1.3740	1.1722
No log	0.1748	18	1.3029	0.0704	1.3029	1.1414
No log	0.1942	20	1.3975	-0.0391	1.3975	1.1822
No log	0.2136	22	1.5308	-0.0993	1.5308	1.2372
No log	0.2330	24	1.4617	-0.0686	1.4617	1.2090
No log	0.2524	26	1.3523	-0.0096	1.3523	1.1629
No log	0.2718	28	1.2254	0.2124	1.2254	1.1070
No log	0.2913	30	1.2150	0.1968	1.2150	1.1023
No log	0.3107	32	1.2005	0.2257	1.2005	1.0957
No log	0.3301	34	1.2283	0.1417	1.2283	1.1083
No log	0.3495	36	1.2476	0.1211	1.2476	1.1170
No log	0.3689	38	1.2554	0.1773	1.2554	1.1205
No log	0.3883	40	1.1882	0.1935	1.1882	1.0901
No log	0.4078	42	1.1984	0.1397	1.1984	1.0947
No log	0.4272	44	1.2249	0.1517	1.2249	1.1067
No log	0.4466	46	1.2853	0.1080	1.2853	1.1337
No log	0.4660	48	1.2712	0.1264	1.2712	1.1275
No log	0.4854	50	1.2221	0.1849	1.2221	1.1055
No log	0.5049	52	1.2469	0.1969	1.2469	1.1166
No log	0.5243	54	1.2723	0.1786	1.2723	1.1280
No log	0.5437	56	1.3043	0.0389	1.3043	1.1421
No log	0.5631	58	1.2982	0.0389	1.2982	1.1394
No log	0.5825	60	1.2540	0.2156	1.2540	1.1198
No log	0.6019	62	1.2827	0.1336	1.2827	1.1326
No log	0.6214	64	1.2460	0.1747	1.2460	1.1163
No log	0.6408	66	1.1524	0.2424	1.1524	1.0735
No log	0.6602	68	1.1619	0.1848	1.1619	1.0779
No log	0.6796	70	1.0955	0.2521	1.0955	1.0467
No log	0.6990	72	1.0329	0.3356	1.0329	1.0163
No log	0.7184	74	1.0809	0.2792	1.0809	1.0397
No log	0.7379	76	1.3533	0.1943	1.3533	1.1633
No log	0.7573	78	1.6411	0.0702	1.6411	1.2811
No log	0.7767	80	1.6521	0.0702	1.6521	1.2853
No log	0.7961	82	1.3596	0.1708	1.3596	1.1660
No log	0.8155	84	1.1288	0.3147	1.1288	1.0624
No log	0.8350	86	1.1188	0.3147	1.1188	1.0577
No log	0.8544	88	1.1959	0.1379	1.1959	1.0936
No log	0.8738	90	1.1421	0.1959	1.1421	1.0687
No log	0.8932	92	1.2859	0.3071	1.2859	1.1340
No log	0.9126	94	1.5415	0.2647	1.5415	1.2416
No log	0.9320	96	1.5468	0.2544	1.5468	1.2437
No log	0.9515	98	1.2506	0.2278	1.2506	1.1183
No log	0.9709	100	1.2166	0.2025	1.2166	1.1030
No log	0.9903	102	1.1999	0.2278	1.1999	1.0954
No log	1.0097	104	1.1389	0.2176	1.1389	1.0672
No log	1.0291	106	1.2761	0.1944	1.2761	1.1296
No log	1.0485	108	1.2981	0.1902	1.2981	1.1393
No log	1.0680	110	1.1990	0.0923	1.1990	1.0950
No log	1.0874	112	1.1269	0.1911	1.1269	1.0616
No log	1.1068	114	1.1785	0.2180	1.1785	1.0856
No log	1.1262	116	1.1714	0.2378	1.1714	1.0823
No log	1.1456	118	1.1564	0.2793	1.1564	1.0753
No log	1.1650	120	1.4204	0.2238	1.4204	1.1918
No log	1.1845	122	1.6911	0.1758	1.6911	1.3004
No log	1.2039	124	1.8583	0.1106	1.8583	1.3632
No log	1.2233	126	1.7635	0.2469	1.7635	1.3280
No log	1.2427	128	1.4992	0.2301	1.4992	1.2244
No log	1.2621	130	1.4125	0.2650	1.4125	1.1885
No log	1.2816	132	1.5125	0.2610	1.5125	1.2298
No log	1.3010	134	1.4772	0.2121	1.4772	1.2154
No log	1.3204	136	1.6028	0.2572	1.6028	1.2660
No log	1.3398	138	1.6870	0.2281	1.6870	1.2988
No log	1.3592	140	1.5034	0.2604	1.5034	1.2261
No log	1.3786	142	1.2856	0.1722	1.2856	1.1338
No log	1.3981	144	1.2963	0.2235	1.2963	1.1385
No log	1.4175	146	1.4049	0.2870	1.4049	1.1853
No log	1.4369	148	1.4025	0.2590	1.4025	1.1843
No log	1.4563	150	1.3977	0.2590	1.3977	1.1823
No log	1.4757	152	1.3591	0.1913	1.3591	1.1658
No log	1.4951	154	1.2931	0.2654	1.2931	1.1371
No log	1.5146	156	1.2234	0.1895	1.2234	1.1061
No log	1.5340	158	1.2291	0.1843	1.2291	1.1087
No log	1.5534	160	1.2621	0.1830	1.2621	1.1234
No log	1.5728	162	1.3242	0.2045	1.3242	1.1508
No log	1.5922	164	1.2703	0.2424	1.2703	1.1271
No log	1.6117	166	1.1573	0.2877	1.1573	1.0758
No log	1.6311	168	1.1197	0.2993	1.1197	1.0582
No log	1.6505	170	1.1396	0.2718	1.1396	1.0675
No log	1.6699	172	1.4063	0.2983	1.4063	1.1859
No log	1.6893	174	1.5174	0.2751	1.5174	1.2318
No log	1.7087	176	1.4178	0.2663	1.4178	1.1907
No log	1.7282	178	1.2084	0.2864	1.2084	1.0993
No log	1.7476	180	1.0822	0.2968	1.0822	1.0403
No log	1.7670	182	1.0785	0.2364	1.0785	1.0385
No log	1.7864	184	1.0723	0.3185	1.0723	1.0355
No log	1.8058	186	1.2385	0.3365	1.2385	1.1129
No log	1.8252	188	1.3953	0.2767	1.3953	1.1812
No log	1.8447	190	1.4874	0.3259	1.4874	1.2196
No log	1.8641	192	1.3514	0.2690	1.3514	1.1625
No log	1.8835	194	1.1492	0.2976	1.1492	1.0720
No log	1.9029	196	1.0633	0.2048	1.0633	1.0312
No log	1.9223	198	1.0640	0.1747	1.0640	1.0315
No log	1.9417	200	1.1024	0.2557	1.1024	1.0500
No log	1.9612	202	1.1988	0.2978	1.1988	1.0949
No log	1.9806	204	1.3484	0.2578	1.3484	1.1612
No log	2.0	206	1.4366	0.2662	1.4366	1.1986
No log	2.0194	208	1.6050	0.2812	1.6050	1.2669
No log	2.0388	210	1.7347	0.1919	1.7347	1.3171
No log	2.0583	212	1.6393	0.2634	1.6393	1.2804
No log	2.0777	214	1.4374	0.2021	1.4374	1.1989
No log	2.0971	216	1.2829	0.2667	1.2829	1.1327
No log	2.1165	218	1.3011	0.2444	1.3011	1.1407
No log	2.1359	220	1.3929	0.2037	1.3929	1.1802
No log	2.1553	222	1.3987	0.2366	1.3987	1.1827
No log	2.1748	224	1.4384	0.2607	1.4384	1.1993
No log	2.1942	226	1.4178	0.2635	1.4178	1.1907
No log	2.2136	228	1.3531	0.2833	1.3531	1.1632
No log	2.2330	230	1.3719	0.2857	1.3719	1.1713
No log	2.2524	232	1.2979	0.2547	1.2979	1.1392
No log	2.2718	234	1.2409	0.2515	1.2409	1.1140
No log	2.2913	236	1.2398	0.2800	1.2398	1.1135
No log	2.3107	238	1.2731	0.2800	1.2731	1.1283
No log	2.3301	240	1.2663	0.2515	1.2663	1.1253
No log	2.3495	242	1.2358	0.2424	1.2358	1.1117
No log	2.3689	244	1.1760	0.3115	1.1760	1.0844
No log	2.3883	246	1.2238	0.2246	1.2238	1.1062
No log	2.4078	248	1.2582	0.2515	1.2582	1.1217
No log	2.4272	250	1.4244	0.2298	1.4244	1.1935
No log	2.4466	252	1.4618	0.2298	1.4618	1.2090
No log	2.4660	254	1.3109	0.2466	1.3109	1.1449
No log	2.4854	256	1.1947	0.1966	1.1947	1.0930
No log	2.5049	258	1.1235	0.2477	1.1235	1.0599
No log	2.5243	260	1.1040	0.1886	1.1040	1.0507
No log	2.5437	262	1.1644	0.2015	1.1644	1.0791
No log	2.5631	264	1.3280	0.2417	1.3280	1.1524
No log	2.5825	266	1.4396	0.2938	1.4396	1.1999
No log	2.6019	268	1.3814	0.3136	1.3814	1.1754
No log	2.6214	270	1.1800	0.2050	1.1800	1.0863
No log	2.6408	272	1.0500	0.1986	1.0500	1.0247
No log	2.6602	274	1.0307	0.1886	1.0307	1.0152
No log	2.6796	276	1.1105	0.2623	1.1105	1.0538
No log	2.6990	278	1.2822	0.2590	1.2822	1.1323
No log	2.7184	280	1.2467	0.2590	1.2467	1.1166
No log	2.7379	282	1.1877	0.2844	1.1877	1.0898
No log	2.7573	284	1.2454	0.2870	1.2454	1.1160
No log	2.7767	286	1.4684	0.3372	1.4684	1.2118
No log	2.7961	288	1.5631	0.2593	1.5631	1.2502
No log	2.8155	290	1.5133	0.2564	1.5133	1.2301
No log	2.8350	292	1.3990	0.2349	1.3990	1.1828
No log	2.8544	294	1.3111	0.2857	1.3111	1.1450
No log	2.8738	296	1.1898	0.2024	1.1898	1.0908
No log	2.8932	298	1.1598	0.2024	1.1598	1.0770
No log	2.9126	300	1.1892	0.1968	1.1892	1.0905
No log	2.9320	302	1.1978	0.1968	1.1978	1.0944
No log	2.9515	304	1.2393	0.2762	1.2393	1.1132
No log	2.9709	306	1.2594	0.2762	1.2594	1.1222
No log	2.9903	308	1.3562	0.3003	1.3562	1.1645
No log	3.0097	310	1.3755	0.3148	1.3755	1.1728
No log	3.0291	312	1.2594	0.2844	1.2594	1.1222
No log	3.0485	314	1.1585	0.2727	1.1585	1.0764
No log	3.0680	316	1.0970	0.2271	1.0970	1.0474
No log	3.0874	318	1.0838	0.2468	1.0838	1.0411
No log	3.1068	320	1.1101	0.2562	1.1101	1.0536
No log	3.1262	322	1.1370	0.2069	1.1370	1.0663
No log	3.1456	324	1.1915	0.2110	1.1915	1.0916
No log	3.1650	326	1.1790	0.2110	1.1790	1.0858
No log	3.1845	328	1.1391	0.2069	1.1391	1.0673
No log	3.2039	330	1.1619	0.2110	1.1619	1.0779
No log	3.2233	332	1.1323	0.1775	1.1323	1.0641
No log	3.2427	334	1.1680	0.2207	1.1680	1.0807
No log	3.2621	336	1.2475	0.2056	1.2475	1.1169
No log	3.2816	338	1.3224	0.2710	1.3224	1.1499
No log	3.3010	340	1.2674	0.2958	1.2674	1.1258
No log	3.3204	342	1.1523	0.2260	1.1523	1.0735
No log	3.3398	344	1.1382	0.2409	1.1382	1.0669
No log	3.3592	346	1.2077	0.2755	1.2077	1.0990
No log	3.3786	348	1.2791	0.2621	1.2791	1.1310
No log	3.3981	350	1.3557	0.3197	1.3557	1.1643
No log	3.4175	352	1.3650	0.3109	1.3650	1.1683
No log	3.4369	354	1.3993	0.3178	1.3993	1.1829
No log	3.4563	356	1.3524	0.2681	1.3524	1.1629
No log	3.4757	358	1.3408	0.2772	1.3408	1.1579
No log	3.4951	360	1.3043	0.1951	1.3043	1.1421
No log	3.5146	362	1.1873	0.1015	1.1873	1.0896
No log	3.5340	364	1.1318	0.1343	1.1318	1.0639
No log	3.5534	366	1.1103	0.1927	1.1103	1.0537
No log	3.5728	368	1.1095	0.1927	1.1095	1.0533
No log	3.5922	370	1.0922	0.1927	1.0922	1.0451
No log	3.6117	372	1.0617	0.2401	1.0617	1.0304
No log	3.6311	374	1.0636	0.1986	1.0636	1.0313
No log	3.6505	376	1.1464	0.1344	1.1464	1.0707
No log	3.6699	378	1.1960	0.1541	1.1960	1.0936
No log	3.6893	380	1.2910	0.1650	1.2910	1.1362
No log	3.7087	382	1.3414	0.1943	1.3414	1.1582
No log	3.7282	384	1.3415	0.2184	1.3415	1.1582
No log	3.7476	386	1.2637	0.1853	1.2637	1.1241
No log	3.7670	388	1.1670	0.1755	1.1670	1.0803
No log	3.7864	390	1.1178	0.1814	1.1178	1.0573
No log	3.8058	392	1.0371	0.2286	1.0371	1.0184
No log	3.8252	394	1.0141	0.3237	1.0141	1.0070
No log	3.8447	396	1.0310	0.2973	1.0310	1.0154
No log	3.8641	398	1.1490	0.2934	1.1490	1.0719
No log	3.8835	400	1.2099	0.3398	1.2099	1.1000
No log	3.9029	402	1.0956	0.2884	1.0956	1.0467
No log	3.9223	404	0.9842	0.1406	0.9842	0.9921
No log	3.9417	406	0.9538	0.2711	0.9538	0.9766
No log	3.9612	408	0.9595	0.2244	0.9595	0.9796
No log	3.9806	410	0.9674	0.1505	0.9674	0.9836
No log	4.0	412	1.0301	0.2056	1.0301	1.0150
No log	4.0194	414	1.1797	0.2772	1.1797	1.0861
No log	4.0388	416	1.2346	0.2772	1.2346	1.1111
No log	4.0583	418	1.2028	0.2772	1.2028	1.0967
No log	4.0777	420	1.2016	0.2509	1.2016	1.0962
No log	4.0971	422	1.1935	0.2683	1.1935	1.0925
No log	4.1165	424	1.1906	0.1853	1.1906	1.0912
No log	4.1359	426	1.1466	0.1755	1.1466	1.0708
No log	4.1553	428	1.1314	0.1755	1.1314	1.0637
No log	4.1748	430	1.0922	0.1755	1.0922	1.0451
No log	4.1942	432	1.0338	0.1755	1.0338	1.0167
No log	4.2136	434	1.0166	0.1562	1.0166	1.0083
No log	4.2330	436	1.0630	0.2056	1.0630	1.0310
No log	4.2524	438	1.1715	0.2953	1.1715	1.0824
No log	4.2718	440	1.3483	0.3590	1.3483	1.1612
No log	4.2913	442	1.3732	0.3821	1.3732	1.1718
No log	4.3107	444	1.2750	0.3590	1.2750	1.1291
No log	4.3301	446	1.1260	0.2586	1.1260	1.0611
No log	4.3495	448	1.0162	0.1406	1.0162	1.0081
No log	4.3689	450	1.0341	0.1406	1.0341	1.0169
No log	4.3883	452	1.1516	0.1853	1.1516	1.0731
No log	4.4078	454	1.3193	0.2250	1.3193	1.1486
No log	4.4272	456	1.3740	0.1053	1.3740	1.1722
No log	4.4466	458	1.3536	0.1148	1.3536	1.1634
No log	4.4660	460	1.2371	0.1315	1.2371	1.1122
No log	4.4854	462	1.1409	0.1442	1.1409	1.0681
No log	4.5049	464	0.9968	0.1871	0.9968	0.9984
No log	4.5243	466	0.9502	0.2327	0.9502	0.9748
No log	4.5437	468	0.9671	0.2686	0.9671	0.9834
No log	4.5631	470	1.1056	0.3178	1.1056	1.0515
No log	4.5825	472	1.3957	0.3667	1.3957	1.1814
No log	4.6019	474	1.4622	0.3566	1.4622	1.2092
No log	4.6214	476	1.3136	0.4036	1.3136	1.1461
No log	4.6408	478	1.1672	0.2864	1.1672	1.0804
No log	4.6602	480	1.0963	0.2056	1.0963	1.0471
No log	4.6796	482	1.0391	0.1658	1.0391	1.0193
No log	4.6990	484	1.0676	0.1658	1.0676	1.0332
No log	4.7184	486	1.1601	0.2152	1.1601	1.0771
No log	4.7379	488	1.2836	0.2424	1.2836	1.1330
No log	4.7573	490	1.2963	0.1896	1.2963	1.1385
No log	4.7767	492	1.2350	0.1896	1.2350	1.1113
No log	4.7961	494	1.1177	0.1853	1.1177	1.0572
No log	4.8155	496	1.0642	0.1658	1.0642	1.0316
No log	4.8350	498	1.0557	0.1658	1.0557	1.0275
0.3937	4.8544	500	1.0797	0.1755	1.0797	1.0391
0.3937	4.8738	502	1.2066	0.2475	1.2066	1.0984
0.3937	4.8932	504	1.3702	0.2754	1.3702	1.1706
0.3937	4.9126	506	1.3937	0.3243	1.3937	1.1805
0.3937	4.9320	508	1.2951	0.2634	1.2951	1.1380
0.3937	4.9515	510	1.1367	0.2362	1.1367	1.0662
0.3937	4.9709	512	1.0706	0.2288	1.0706	1.0347
0.3937	4.9903	514	1.0878	0.2288	1.0878	1.0430
0.3937	5.0097	516	1.1481	0.2362	1.1481	1.0715
0.3937	5.0291	518	1.2347	0.2452	1.2347	1.1112
0.3937	5.0485	520	1.2830	0.2475	1.2830	1.1327
0.3937	5.0680	522	1.2309	0.2683	1.2309	1.1095
0.3937	5.0874	524	1.1411	0.1755	1.1411	1.0682
0.3937	5.1068	526	1.0825	0.1344	1.0825	1.0405
0.3937	5.1262	528	1.0854	0.1344	1.0854	1.0418
0.3937	5.1456	530	1.1637	0.1853	1.1637	1.0788
0.3937	5.1650	532	1.2487	0.2402	1.2487	1.1175
0.3937	5.1845	534	1.3546	0.2837	1.3546	1.1639
0.3937	5.2039	536	1.3987	0.3094	1.3987	1.1826
0.3937	5.2233	538	1.3695	0.3094	1.3695	1.1702
0.3937	5.2427	540	1.1959	0.2743	1.1959	1.0936
0.3937	5.2621	542	1.0910	0.1755	1.0910	1.0445
0.3937	5.2816	544	1.0983	0.1853	1.0983	1.0480
0.3937	5.3010	546	1.1772	0.2152	1.1772	1.0850
0.3937	5.3204	548	1.1806	0.1853	1.1806	1.0865
0.3937	5.3398	550	1.2054	0.1853	1.2054	1.0979
0.3937	5.3592	552	1.2501	0.1853	1.2501	1.1181
0.3937	5.3786	554	1.2625	0.1853	1.2625	1.1236
0.3937	5.3981	556	1.2820	0.1853	1.2820	1.1322
0.3937	5.4175	558	1.2625	0.1442	1.2625	1.1236
0.3937	5.4369	560	1.2555	0.1442	1.2555	1.1205
0.3937	5.4563	562	1.2711	0.1344	1.2711	1.1274
0.3937	5.4757	564	1.2161	0.1559	1.2161	1.1028
0.3937	5.4951	566	1.1758	0.1559	1.1758	1.0843

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1