ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1797
• Qwk: 0.0637
• Mse: 1.1797
• Rmse: 1.0861

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	4.3300	0.0182	4.3300	2.0809
No log	0.0816	4	2.6894	-0.0256	2.6894	1.6399
No log	0.1224	6	1.9847	0.0445	1.9847	1.4088
No log	0.1633	8	1.5992	0.0726	1.5992	1.2646
No log	0.2041	10	1.0983	0.1284	1.0983	1.0480
No log	0.2449	12	1.0623	0.0761	1.0623	1.0307
No log	0.2857	14	1.2878	0.1534	1.2878	1.1348
No log	0.3265	16	1.7120	0.1085	1.7120	1.3084
No log	0.3673	18	1.2945	0.1966	1.2945	1.1377
No log	0.4082	20	1.0629	0.2352	1.0629	1.0310
No log	0.4490	22	1.0408	0.2967	1.0408	1.0202
No log	0.4898	24	1.1586	0.3015	1.1586	1.0764
No log	0.5306	26	1.2130	0.2606	1.2130	1.1014
No log	0.5714	28	1.3624	0.2999	1.3624	1.1672
No log	0.6122	30	1.3467	0.2654	1.3467	1.1605
No log	0.6531	32	1.3589	0.3377	1.3589	1.1657
No log	0.6939	34	1.4257	0.2405	1.4257	1.1940
No log	0.7347	36	1.6003	0.2280	1.6003	1.2650
No log	0.7755	38	1.4384	0.2038	1.4384	1.1993
No log	0.8163	40	1.3419	0.3197	1.3419	1.1584
No log	0.8571	42	1.3661	0.2845	1.3661	1.1688
No log	0.8980	44	1.2633	0.2365	1.2633	1.1240
No log	0.9388	46	1.2490	0.1905	1.2490	1.1176
No log	0.9796	48	1.2801	0.2360	1.2801	1.1314
No log	1.0204	50	1.4328	0.2127	1.4328	1.1970
No log	1.0612	52	1.4685	0.2230	1.4685	1.2118
No log	1.1020	54	1.3498	0.2572	1.3498	1.1618
No log	1.1429	56	1.3639	0.1906	1.3639	1.1679
No log	1.1837	58	1.6215	-0.0052	1.6215	1.2734
No log	1.2245	60	1.3822	0.1323	1.3822	1.1757
No log	1.2653	62	1.1988	0.0650	1.1988	1.0949
No log	1.3061	64	1.1921	0.0981	1.1921	1.0918
No log	1.3469	66	1.1908	0.0981	1.1908	1.0913
No log	1.3878	68	1.1919	0.0140	1.1919	1.0917
No log	1.4286	70	1.3131	0.2311	1.3131	1.1459
No log	1.4694	72	1.4352	0.1288	1.4352	1.1980
No log	1.5102	74	1.3137	0.1986	1.3137	1.1462
No log	1.5510	76	1.3274	0.1797	1.3274	1.1521
No log	1.5918	78	1.3537	0.1507	1.3537	1.1635
No log	1.6327	80	1.3430	0.1481	1.3430	1.1589
No log	1.6735	82	1.3381	0.1683	1.3381	1.1568
No log	1.7143	84	1.3093	0.2242	1.3093	1.1443
No log	1.7551	86	1.3308	0.1275	1.3308	1.1536
No log	1.7959	88	1.2531	0.2696	1.2531	1.1194
No log	1.8367	90	1.3641	0.0913	1.3641	1.1680
No log	1.8776	92	1.3160	0.2063	1.3160	1.1472
No log	1.9184	94	1.3252	0.2361	1.3252	1.1512
No log	1.9592	96	1.3475	0.1965	1.3475	1.1608
No log	2.0	98	1.3238	0.1753	1.3238	1.1506
No log	2.0408	100	1.3077	0.1928	1.3077	1.1435
No log	2.0816	102	1.2367	0.2654	1.2367	1.1121
No log	2.1224	104	1.2473	0.3011	1.2473	1.1168
No log	2.1633	106	1.2298	0.2492	1.2298	1.1090
No log	2.2041	108	1.2311	0.2356	1.2311	1.1095
No log	2.2449	110	1.3732	0.2424	1.3732	1.1719
No log	2.2857	112	1.3624	0.2526	1.3624	1.1672
No log	2.3265	114	1.2511	0.1865	1.2511	1.1185
No log	2.3673	116	1.1791	0.2172	1.1791	1.0858
No log	2.4082	118	1.1647	0.2241	1.1647	1.0792
No log	2.4490	120	1.1529	0.2241	1.1529	1.0737
No log	2.4898	122	1.1761	0.2033	1.1761	1.0845
No log	2.5306	124	1.2259	0.1895	1.2259	1.1072
No log	2.5714	126	1.2314	0.1597	1.2314	1.1097
No log	2.6122	128	1.3468	0.1255	1.3468	1.1605
No log	2.6531	130	1.3741	0.0803	1.3741	1.1722
No log	2.6939	132	1.2848	0.2014	1.2848	1.1335
No log	2.7347	134	1.2792	0.2014	1.2792	1.1310
No log	2.7755	136	1.2567	0.2718	1.2567	1.1210
No log	2.8163	138	1.2173	0.2183	1.2173	1.1033
No log	2.8571	140	1.2009	0.2323	1.2009	1.0958
No log	2.8980	142	1.2375	0.1179	1.2375	1.1124
No log	2.9388	144	1.1666	0.2003	1.1666	1.0801
No log	2.9796	146	1.1541	0.2408	1.1541	1.0743
No log	3.0204	148	1.1664	0.1649	1.1664	1.0800
No log	3.0612	150	1.1720	0.2053	1.1720	1.0826
No log	3.1020	152	1.1844	0.2768	1.1844	1.0883
No log	3.1429	154	1.5045	0.1903	1.5045	1.2266
No log	3.1837	156	1.4793	0.1903	1.4793	1.2163
No log	3.2245	158	1.2024	0.3293	1.2024	1.0965
No log	3.2653	160	1.2239	0.1740	1.2239	1.1063
No log	3.3061	162	1.4421	0.0467	1.4421	1.2009
No log	3.3469	164	1.2484	0.1662	1.2484	1.1173
No log	3.3878	166	1.0909	0.3089	1.0909	1.0445
No log	3.4286	168	1.1428	0.2748	1.1428	1.0690
No log	3.4694	170	1.3038	0.2155	1.3038	1.1419
No log	3.5102	172	1.2793	0.2516	1.2793	1.1311
No log	3.5510	174	1.1608	0.2263	1.1608	1.0774
No log	3.5918	176	1.1783	0.2456	1.1783	1.0855
No log	3.6327	178	1.2080	0.1824	1.2080	1.0991
No log	3.6735	180	1.3658	0.2120	1.3658	1.1687
No log	3.7143	182	1.3741	0.1817	1.3741	1.1722
No log	3.7551	184	1.2764	0.1975	1.2764	1.1298
No log	3.7959	186	1.2719	0.1852	1.2719	1.1278
No log	3.8367	188	1.2873	0.1875	1.2873	1.1346
No log	3.8776	190	1.2827	0.1582	1.2827	1.1326
No log	3.9184	192	1.2722	0.0649	1.2722	1.1279
No log	3.9592	194	1.2778	0.1488	1.2778	1.1304
No log	4.0	196	1.3101	0.1887	1.3101	1.1446
No log	4.0408	198	1.3056	0.2837	1.3056	1.1426
No log	4.0816	200	1.2214	0.1605	1.2214	1.1052
No log	4.1224	202	1.1377	0.0325	1.1377	1.0666
No log	4.1633	204	1.1763	0.2254	1.1763	1.0846
No log	4.2041	206	1.1851	0.2254	1.1851	1.0886
No log	4.2449	208	1.1331	0.1504	1.1331	1.0645
No log	4.2857	210	1.1958	0.1228	1.1958	1.0935
No log	4.3265	212	1.2510	0.1582	1.2510	1.1185
No log	4.3673	214	1.2819	0.1834	1.2819	1.1322
No log	4.4082	216	1.3621	0.2394	1.3621	1.1671
No log	4.4490	218	1.3724	0.1452	1.3724	1.1715
No log	4.4898	220	1.5219	0.1478	1.5219	1.2337
No log	4.5306	222	1.5824	0.1489	1.5824	1.2579
No log	4.5714	224	1.4848	0.1578	1.4848	1.2185
No log	4.6122	226	1.4518	0.1228	1.4518	1.2049
No log	4.6531	228	1.5171	0.1741	1.5171	1.2317
No log	4.6939	230	1.4890	0.1678	1.4890	1.2203
No log	4.7347	232	1.3589	0.1582	1.3589	1.1657
No log	4.7755	234	1.4062	0.2273	1.4062	1.1858
No log	4.8163	236	1.4780	0.2537	1.4780	1.2157
No log	4.8571	238	1.3658	0.2381	1.3658	1.1687
No log	4.8980	240	1.2276	0.1408	1.2276	1.1080
No log	4.9388	242	1.2019	0.1543	1.2019	1.0963
No log	4.9796	244	1.2242	0.1516	1.2242	1.1064
No log	5.0204	246	1.2657	0.1424	1.2657	1.1250
No log	5.0612	248	1.3893	0.1928	1.3893	1.1787
No log	5.1020	250	1.4347	0.1793	1.4347	1.1978
No log	5.1429	252	1.3447	0.2386	1.3447	1.1596
No log	5.1837	254	1.2453	0.1105	1.2453	1.1159
No log	5.2245	256	1.2230	0.1279	1.2230	1.1059
No log	5.2653	258	1.2318	0.0316	1.2318	1.1099
No log	5.3061	260	1.2665	0.1019	1.2665	1.1254
No log	5.3469	262	1.3443	0.2386	1.3443	1.1594
No log	5.3878	264	1.3996	0.2386	1.3996	1.1831
No log	5.4286	266	1.3298	0.1988	1.3298	1.1532
No log	5.4694	268	1.1840	0.1696	1.1840	1.0881
No log	5.5102	270	1.2156	0.1960	1.2156	1.1025
No log	5.5510	272	1.1911	0.1911	1.1911	1.0914
No log	5.5918	274	1.2167	0.2019	1.2167	1.1031
No log	5.6327	276	1.4311	0.2537	1.4311	1.1963
No log	5.6735	278	1.5689	0.2214	1.5689	1.2526
No log	5.7143	280	1.5157	0.2627	1.5157	1.2311
No log	5.7551	282	1.3233	0.1693	1.3233	1.1504
No log	5.7959	284	1.2163	0.1463	1.2163	1.1029
No log	5.8367	286	1.2301	0.1910	1.2301	1.1091
No log	5.8776	288	1.2769	0.2103	1.2769	1.1300
No log	5.9184	290	1.2421	0.1249	1.2421	1.1145
No log	5.9592	292	1.3009	0.1106	1.3009	1.1406
No log	6.0	294	1.3935	0.1081	1.3935	1.1805
No log	6.0408	296	1.4466	0.2304	1.4466	1.2027
No log	6.0816	298	1.4656	0.2198	1.4656	1.2106
No log	6.1224	300	1.4586	0.2071	1.4586	1.2077
No log	6.1633	302	1.3907	0.1935	1.3907	1.1793
No log	6.2041	304	1.3695	0.1912	1.3695	1.1703
No log	6.2449	306	1.3414	0.1780	1.3414	1.1582
No log	6.2857	308	1.3269	0.2378	1.3269	1.1519
No log	6.3265	310	1.3053	0.0649	1.3053	1.1425
No log	6.3673	312	1.2761	0.1047	1.2761	1.1297
No log	6.4082	314	1.2309	0.0730	1.2309	1.1095
No log	6.4490	316	1.2220	0.0482	1.2220	1.1054
No log	6.4898	318	1.2300	0.0801	1.2300	1.1090
No log	6.5306	320	1.2599	0.1192	1.2599	1.1225
No log	6.5714	322	1.3107	0.1414	1.3107	1.1449
No log	6.6122	324	1.4101	0.2565	1.4101	1.1875
No log	6.6531	326	1.5560	0.1982	1.5560	1.2474
No log	6.6939	328	1.5496	0.2262	1.5496	1.2448
No log	6.7347	330	1.4265	0.2749	1.4265	1.1944
No log	6.7755	332	1.2647	0.1801	1.2647	1.1246
No log	6.8163	334	1.1579	0.1042	1.1579	1.0761
No log	6.8571	336	1.1604	0.1398	1.1604	1.0772
No log	6.8980	338	1.1575	0.1249	1.1575	1.0759
No log	6.9388	340	1.1359	0.1041	1.1359	1.0658
No log	6.9796	342	1.1504	0.0606	1.1504	1.0726
No log	7.0204	344	1.1808	0.0730	1.1808	1.0866
No log	7.0612	346	1.2345	0.1106	1.2345	1.1111
No log	7.1020	348	1.2766	0.1801	1.2766	1.1299
No log	7.1429	350	1.2882	0.1801	1.2882	1.1350
No log	7.1837	352	1.2533	0.1462	1.2533	1.1195
No log	7.2245	354	1.2203	0.1106	1.2203	1.1047
No log	7.2653	356	1.2190	0.1106	1.2190	1.1041
No log	7.3061	358	1.2402	0.2239	1.2402	1.1136
No log	7.3469	360	1.1862	0.0730	1.1862	1.0891
No log	7.3878	362	1.1756	0.0947	1.1756	1.0842
No log	7.4286	364	1.1998	0.1370	1.1998	1.0954
No log	7.4694	366	1.2570	0.2207	1.2570	1.1212
No log	7.5102	368	1.4174	0.2204	1.4174	1.1906
No log	7.5510	370	1.4570	0.2647	1.4570	1.2070
No log	7.5918	372	1.4090	0.2791	1.4090	1.1870
No log	7.6327	374	1.3089	0.2061	1.3089	1.1441
No log	7.6735	376	1.2311	0.1462	1.2311	1.1096
No log	7.7143	378	1.1908	0.0741	1.1908	1.0913
No log	7.7551	380	1.1706	0.0606	1.1706	1.0819
No log	7.7959	382	1.1960	0.0984	1.1960	1.0936
No log	7.8367	384	1.2828	0.2680	1.2828	1.1326
No log	7.8776	386	1.3594	0.2579	1.3594	1.1659
No log	7.9184	388	1.2579	0.1641	1.2579	1.1216
No log	7.9592	390	1.2131	0.2057	1.2131	1.1014
No log	8.0	392	1.1693	0.2314	1.1693	1.0813
No log	8.0408	394	1.1561	0.2171	1.1561	1.0752
No log	8.0816	396	1.1857	0.1335	1.1857	1.0889
No log	8.1224	398	1.2865	0.1576	1.2865	1.1343
No log	8.1633	400	1.3420	0.1414	1.3420	1.1584
No log	8.2041	402	1.2512	0.0780	1.2512	1.1186
No log	8.2449	404	1.2349	0.0680	1.2349	1.1113
No log	8.2857	406	1.1904	0.0169	1.1904	1.0911
No log	8.3265	408	1.1933	0.0771	1.1933	1.0924
No log	8.3673	410	1.2358	0.0711	1.2358	1.1117
No log	8.4082	412	1.2545	0.1071	1.2545	1.1201
No log	8.4490	414	1.2521	0.0606	1.2521	1.1190
No log	8.4898	416	1.2993	0.1048	1.2993	1.1399
No log	8.5306	418	1.3176	0.1514	1.3176	1.1479
No log	8.5714	420	1.3006	0.1462	1.3006	1.1404
No log	8.6122	422	1.2820	0.1106	1.2820	1.1323
No log	8.6531	424	1.2697	0.0892	1.2697	1.1268
No log	8.6939	426	1.2693	0.0771	1.2693	1.1267
No log	8.7347	428	1.2889	0.1462	1.2889	1.1353
No log	8.7755	430	1.3621	0.2355	1.3621	1.1671
No log	8.8163	432	1.3526	0.2239	1.3526	1.1630
No log	8.8571	434	1.2821	0.1462	1.2821	1.1323
No log	8.8980	436	1.2473	0.1164	1.2473	1.1168
No log	8.9388	438	1.2612	0.1314	1.2612	1.1230
No log	8.9796	440	1.2971	0.1567	1.2971	1.1389
No log	9.0204	442	1.3860	0.1730	1.3860	1.1773
No log	9.0612	444	1.4331	0.1291	1.4331	1.1971
No log	9.1020	446	1.4087	0.1714	1.4087	1.1869
No log	9.1429	448	1.3521	0.1805	1.3521	1.1628
No log	9.1837	450	1.3176	0.1307	1.3176	1.1479
No log	9.2245	452	1.3028	0.1567	1.3028	1.1414
No log	9.2653	454	1.3797	0.1622	1.3797	1.1746
No log	9.3061	456	1.4206	0.2831	1.4206	1.1919
No log	9.3469	458	1.3731	0.2296	1.3731	1.1718
No log	9.3878	460	1.2831	0.1541	1.2831	1.1327
No log	9.4286	462	1.1970	0.1285	1.1970	1.0941
No log	9.4694	464	1.1945	0.1814	1.1945	1.0929
No log	9.5102	466	1.2159	0.1814	1.2159	1.1027
No log	9.5510	468	1.2378	0.1636	1.2378	1.1125
No log	9.5918	470	1.3344	0.1658	1.3344	1.1552
No log	9.6327	472	1.3920	0.1632	1.3920	1.1798
No log	9.6735	474	1.3596	0.1582	1.3596	1.1660
No log	9.7143	476	1.2975	0.0606	1.2975	1.1391
No log	9.7551	478	1.2843	0.0545	1.2843	1.1332
No log	9.7959	480	1.2795	0.0177	1.2795	1.1312
No log	9.8367	482	1.2837	0.0606	1.2837	1.1330
No log	9.8776	484	1.3072	0.0855	1.3072	1.1433
No log	9.9184	486	1.3271	0.0824	1.3271	1.1520
No log	9.9592	488	1.3107	0.0824	1.3107	1.1448
No log	10.0	490	1.3057	0.0699	1.3057	1.1427
No log	10.0408	492	1.2675	0.0855	1.2675	1.1258
No log	10.0816	494	1.2451	0.0741	1.2451	1.1159
No log	10.1224	496	1.2321	0.1192	1.2321	1.1100
No log	10.1633	498	1.2323	0.1436	1.2323	1.1101
0.2943	10.2041	500	1.2698	0.1195	1.2698	1.1269
0.2943	10.2449	502	1.2705	0.1195	1.2705	1.1272
0.2943	10.2857	504	1.2855	0.1616	1.2855	1.1338
0.2943	10.3265	506	1.2666	0.1576	1.2666	1.1254
0.2943	10.3673	508	1.1971	0.2159	1.1971	1.0941
0.2943	10.4082	510	1.1695	0.1519	1.1695	1.0814
0.2943	10.4490	512	1.1508	0.1909	1.1508	1.0727
0.2943	10.4898	514	1.1425	0.1689	1.1425	1.0689
0.2943	10.5306	516	1.1791	0.1424	1.1791	1.0859
0.2943	10.5714	518	1.2641	0.2296	1.2641	1.1243
0.2943	10.6122	520	1.2599	0.1919	1.2599	1.1224
0.2943	10.6531	522	1.2039	0.1106	1.2039	1.0972
0.2943	10.6939	524	1.1693	0.1167	1.1693	1.0813
0.2943	10.7347	526	1.1576	0.1041	1.1576	1.0759
0.2943	10.7755	528	1.1602	0.1192	1.1602	1.0771
0.2943	10.8163	530	1.1836	0.1516	1.1836	1.0879
0.2943	10.8571	532	1.2071	0.1755	1.2071	1.0987
0.2943	10.8980	534	1.2246	0.2009	1.2246	1.1066
0.2943	10.9388	536	1.1915	0.1895	1.1915	1.0915
0.2943	10.9796	538	1.1511	0.1782	1.1511	1.0729
0.2943	11.0204	540	1.1159	0.2015	1.1159	1.0563
0.2943	11.0612	542	1.0940	0.2140	1.0940	1.0460
0.2943	11.1020	544	1.0902	0.1657	1.0902	1.0441
0.2943	11.1429	546	1.1263	0.1167	1.1263	1.0613
0.2943	11.1837	548	1.1884	0.1462	1.1884	1.0901
0.2943	11.2245	550	1.2119	0.1462	1.2119	1.1009
0.2943	11.2653	552	1.2127	0.1462	1.2127	1.1012
0.2943	11.3061	554	1.2163	0.1462	1.2163	1.1029
0.2943	11.3469	556	1.2203	0.1462	1.2203	1.1047
0.2943	11.3878	558	1.2179	0.1106	1.2179	1.1036
0.2943	11.4286	560	1.2024	0.1106	1.2024	1.0965
0.2943	11.4694	562	1.1663	0.1041	1.1663	1.0799
0.2943	11.5102	564	1.1721	0.0792	1.1721	1.0826
0.2943	11.5510	566	1.1797	0.0637	1.1797	1.0861

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1