ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1615
• Qwk: 0.1935
• Mse: 1.1615
• Rmse: 1.0777

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	4.7723	0.0010	4.7723	2.1846
No log	0.0851	4	2.6535	0.0025	2.6535	1.6290
No log	0.1277	6	1.8418	0.0198	1.8418	1.3571
No log	0.1702	8	1.8351	0.0062	1.8351	1.3547
No log	0.2128	10	1.7906	-0.0080	1.7906	1.3381
No log	0.2553	12	1.6737	0.0526	1.6737	1.2937
No log	0.2979	14	1.7453	0.0080	1.7453	1.3211
No log	0.3404	16	2.1187	-0.0297	2.1187	1.4556
No log	0.3830	18	2.0204	-0.0439	2.0204	1.4214
No log	0.4255	20	1.5803	0.1339	1.5803	1.2571
No log	0.4681	22	1.3958	0.1138	1.3958	1.1814
No log	0.5106	24	1.2279	0.1483	1.2279	1.1081
No log	0.5532	26	1.2834	0.0803	1.2834	1.1329
No log	0.5957	28	1.5561	0.0227	1.5561	1.2475
No log	0.6383	30	1.6796	0.0372	1.6796	1.2960
No log	0.6809	32	1.5527	0.0538	1.5527	1.2461
No log	0.7234	34	1.3717	0.1165	1.3717	1.1712
No log	0.7660	36	1.3456	0.1643	1.3456	1.1600
No log	0.8085	38	1.3678	0.1980	1.3678	1.1695
No log	0.8511	40	1.6408	0.0538	1.6408	1.2809
No log	0.8936	42	1.8734	0.0755	1.8734	1.3687
No log	0.9362	44	1.8291	0.0644	1.8291	1.3524
No log	0.9787	46	1.5837	0.0622	1.5837	1.2585
No log	1.0213	48	1.4194	0.1659	1.4194	1.1914
No log	1.0638	50	1.3166	0.1838	1.3166	1.1474
No log	1.1064	52	1.3063	0.1404	1.3063	1.1429
No log	1.1489	54	1.3582	0.1921	1.3582	1.1654
No log	1.1915	56	1.6767	0.0549	1.6767	1.2949
No log	1.2340	58	2.0941	0.0877	2.0941	1.4471
No log	1.2766	60	2.0279	0.0877	2.0279	1.4240
No log	1.3191	62	1.5416	0.0647	1.5416	1.2416
No log	1.3617	64	1.4810	0.0647	1.4810	1.2170
No log	1.4043	66	1.6936	0.0248	1.6936	1.3014
No log	1.4468	68	1.6751	0.0248	1.6751	1.2942
No log	1.4894	70	1.4703	0.0647	1.4703	1.2126
No log	1.5319	72	1.3319	0.2014	1.3319	1.1541
No log	1.5745	74	1.4183	0.1807	1.4183	1.1909
No log	1.6170	76	1.5665	0.2278	1.5665	1.2516
No log	1.6596	78	1.8365	0.2017	1.8365	1.3552
No log	1.7021	80	1.5131	0.1698	1.5131	1.2301
No log	1.7447	82	1.3425	0.1501	1.3425	1.1586
No log	1.7872	84	1.3693	0.1501	1.3693	1.1702
No log	1.8298	86	1.5042	0.1602	1.5042	1.2265
No log	1.8723	88	1.3968	0.1901	1.3968	1.1819
No log	1.9149	90	1.2266	0.2103	1.2266	1.1075
No log	1.9574	92	1.2122	0.2333	1.2122	1.1010
No log	2.0	94	1.2370	0.2191	1.2370	1.1122
No log	2.0426	96	1.2832	0.1965	1.2832	1.1328
No log	2.0851	98	1.3854	0.2283	1.3854	1.1771
No log	2.1277	100	1.4479	0.1901	1.4479	1.2033
No log	2.1702	102	1.6598	0.2281	1.6598	1.2883
No log	2.2128	104	1.5728	0.1990	1.5728	1.2541
No log	2.2553	106	1.3925	0.2115	1.3925	1.1800
No log	2.2979	108	1.3035	0.2103	1.3035	1.1417
No log	2.3404	110	1.3157	0.2152	1.3157	1.1471
No log	2.3830	112	1.3814	0.2065	1.3814	1.1753
No log	2.4255	114	1.2816	0.1913	1.2816	1.1321
No log	2.4681	116	1.3672	0.2103	1.3672	1.1693
No log	2.5106	118	1.5008	0.2286	1.5008	1.2251
No log	2.5532	120	1.5246	0.2443	1.5246	1.2347
No log	2.5957	122	1.7335	0.1476	1.7335	1.3166
No log	2.6383	124	1.6173	0.1698	1.6173	1.2717
No log	2.6809	126	1.3218	0.1912	1.3218	1.1497
No log	2.7234	128	1.1808	0.2493	1.1808	1.0867
No log	2.7660	130	1.1701	0.2602	1.1701	1.0817
No log	2.8085	132	1.2326	0.2031	1.2326	1.1102
No log	2.8511	134	1.6099	0.3155	1.6099	1.2688
No log	2.8936	136	1.4970	0.2744	1.4970	1.2235
No log	2.9362	138	1.1786	0.2046	1.1786	1.0856
No log	2.9787	140	1.2104	0.3310	1.2104	1.1002
No log	3.0213	142	1.1855	0.1963	1.1855	1.0888
No log	3.0638	144	1.4084	0.2060	1.4084	1.1867
No log	3.1064	146	1.5016	0.2758	1.5016	1.2254
No log	3.1489	148	1.3770	0.2264	1.3770	1.1735
No log	3.1915	150	1.3027	0.2217	1.3027	1.1413
No log	3.2340	152	1.2098	0.2299	1.2098	1.0999
No log	3.2766	154	1.1468	0.2602	1.1468	1.0709
No log	3.3191	156	1.1446	0.3482	1.1446	1.0699
No log	3.3617	158	1.1534	0.2091	1.1534	1.0740
No log	3.4043	160	1.2487	0.1982	1.2487	1.1175
No log	3.4468	162	1.3196	0.1787	1.3196	1.1487
No log	3.4894	164	1.2426	0.2437	1.2426	1.1147
No log	3.5319	166	1.1998	0.2760	1.1998	1.0954
No log	3.5745	168	1.2065	0.2760	1.2065	1.0984
No log	3.6170	170	1.2105	0.2418	1.2105	1.1002
No log	3.6596	172	1.2860	0.2016	1.2860	1.1340
No log	3.7021	174	1.6047	0.2105	1.6047	1.2668
No log	3.7447	176	1.7351	0.1748	1.7351	1.3172
No log	3.7872	178	1.4702	0.2103	1.4702	1.2125
No log	3.8298	180	1.2159	0.1691	1.2159	1.1027
No log	3.8723	182	1.1709	0.2383	1.1709	1.0821
No log	3.9149	184	1.1982	0.2606	1.1982	1.0946
No log	3.9574	186	1.1544	0.2417	1.1544	1.0744
No log	4.0	188	1.2277	0.2138	1.2277	1.1080
No log	4.0426	190	1.6193	0.2508	1.6193	1.2725
No log	4.0851	192	1.9066	0.1268	1.9066	1.3808
No log	4.1277	194	1.7754	0.2221	1.7754	1.3325
No log	4.1702	196	1.3762	0.2329	1.3762	1.1731
No log	4.2128	198	1.1689	0.2014	1.1689	1.0812
No log	4.2553	200	1.1670	0.2308	1.1670	1.0803
No log	4.2979	202	1.2348	0.1758	1.2348	1.1112
No log	4.3404	204	1.4229	0.2277	1.4229	1.1929
No log	4.3830	206	1.4402	0.2144	1.4402	1.2001
No log	4.4255	208	1.2906	0.1626	1.2906	1.1361
No log	4.4681	210	1.1743	0.2308	1.1743	1.0836
No log	4.5106	212	1.1403	0.3186	1.1403	1.0679
No log	4.5532	214	1.1439	0.3186	1.1439	1.0695
No log	4.5957	216	1.1730	0.2576	1.1730	1.0831
No log	4.6383	218	1.1569	0.2323	1.1569	1.0756
No log	4.6809	220	1.1242	0.3312	1.1242	1.0603
No log	4.7234	222	1.1299	0.3612	1.1299	1.0630
No log	4.7660	224	1.1825	0.2863	1.1825	1.0874
No log	4.8085	226	1.3071	0.2555	1.3071	1.1433
No log	4.8511	228	1.3508	0.2260	1.3508	1.1622
No log	4.8936	230	1.2567	0.1773	1.2567	1.1210
No log	4.9362	232	1.2366	0.1469	1.2366	1.1120
No log	4.9787	234	1.2501	0.1852	1.2501	1.1181
No log	5.0213	236	1.3590	0.2103	1.3590	1.1658
No log	5.0638	238	1.7033	0.2041	1.7033	1.3051
No log	5.1064	240	1.7852	0.1865	1.7852	1.3361
No log	5.1489	242	1.4664	0.2236	1.4664	1.2110
No log	5.1915	244	1.1911	0.1697	1.1911	1.0914
No log	5.2340	246	1.1689	0.1697	1.1689	1.0812
No log	5.2766	248	1.2643	0.1490	1.2643	1.1244
No log	5.3191	250	1.2413	0.1678	1.2413	1.1141
No log	5.3617	252	1.1668	0.2060	1.1668	1.0802
No log	5.4043	254	1.1199	0.3167	1.1199	1.0583
No log	5.4468	256	1.1019	0.2706	1.1019	1.0497
No log	5.4894	258	1.1317	0.1876	1.1317	1.0638
No log	5.5319	260	1.1721	0.1928	1.1721	1.0826
No log	5.5745	262	1.3069	0.2744	1.3069	1.1432
No log	5.6170	264	1.3923	0.2857	1.3923	1.1800
No log	5.6596	266	1.2808	0.1943	1.2808	1.1317
No log	5.7021	268	1.2256	0.3101	1.2256	1.1071
No log	5.7447	270	1.2316	0.2993	1.2316	1.1098
No log	5.7872	272	1.2299	0.2906	1.2299	1.1090
No log	5.8298	274	1.2144	0.2993	1.2144	1.1020
No log	5.8723	276	1.1879	0.3167	1.1879	1.0899
No log	5.9149	278	1.1975	0.2906	1.1975	1.0943
No log	5.9574	280	1.1723	0.3059	1.1723	1.0827
No log	6.0	282	1.1633	0.3623	1.1633	1.0786
No log	6.0426	284	1.1563	0.3623	1.1563	1.0753
No log	6.0851	286	1.1552	0.2706	1.1552	1.0748
No log	6.1277	288	1.1939	0.1486	1.1939	1.0926
No log	6.1702	290	1.1821	0.1921	1.1821	1.0873
No log	6.2128	292	1.1902	0.2392	1.1902	1.0910
No log	6.2553	294	1.2048	0.3600	1.2048	1.0976
No log	6.2979	296	1.1251	0.2851	1.1251	1.0607
No log	6.3404	298	1.0871	0.3289	1.0871	1.0426
No log	6.3830	300	1.0744	0.3758	1.0744	1.0365
No log	6.4255	302	1.0909	0.3622	1.0909	1.0445
No log	6.4681	304	1.0748	0.3876	1.0748	1.0367
No log	6.5106	306	1.0850	0.3409	1.0850	1.0417
No log	6.5532	308	1.1005	0.3231	1.1005	1.0491
No log	6.5957	310	1.1327	0.2608	1.1327	1.0643
No log	6.6383	312	1.1779	0.2445	1.1779	1.0853
No log	6.6809	314	1.1621	0.2122	1.1621	1.0780
No log	6.7234	316	1.1455	0.2293	1.1455	1.0703
No log	6.7660	318	1.1407	0.2781	1.1407	1.0681
No log	6.8085	320	1.0748	0.3320	1.0748	1.0367
No log	6.8511	322	1.1249	0.2857	1.1249	1.0606
No log	6.8936	324	1.1379	0.2611	1.1379	1.0667
No log	6.9362	326	1.0581	0.2472	1.0581	1.0286
No log	6.9787	328	1.0352	0.3327	1.0352	1.0175
No log	7.0213	330	1.0479	0.3016	1.0479	1.0237
No log	7.0638	332	1.0703	0.3186	1.0703	1.0345
No log	7.1064	334	1.1255	0.3454	1.1255	1.0609
No log	7.1489	336	1.1446	0.2710	1.1446	1.0699
No log	7.1915	338	1.1162	0.2550	1.1162	1.0565
No log	7.2340	340	1.0816	0.2927	1.0816	1.0400
No log	7.2766	342	1.0706	0.2452	1.0706	1.0347
No log	7.3191	344	1.1110	0.1835	1.1110	1.0540
No log	7.3617	346	1.2950	0.2202	1.2950	1.1380
No log	7.4043	348	1.4325	0.2436	1.4325	1.1969
No log	7.4468	350	1.3627	0.3174	1.3627	1.1674
No log	7.4894	352	1.1967	0.2232	1.1967	1.0939
No log	7.5319	354	1.0729	0.2293	1.0729	1.0358
No log	7.5745	356	1.0790	0.3412	1.0790	1.0387
No log	7.6170	358	1.0869	0.3043	1.0869	1.0425
No log	7.6596	360	1.0619	0.2424	1.0619	1.0305
No log	7.7021	362	1.1632	0.2356	1.1632	1.0785
No log	7.7447	364	1.2163	0.2919	1.2163	1.1029
No log	7.7872	366	1.2417	0.2984	1.2417	1.1143
No log	7.8298	368	1.1406	0.1434	1.1406	1.0680
No log	7.8723	370	1.0931	0.2275	1.0931	1.0455
No log	7.9149	372	1.0914	0.2363	1.0914	1.0447
No log	7.9574	374	1.1458	0.1702	1.1458	1.0704
No log	8.0	376	1.1681	0.1943	1.1681	1.0808
No log	8.0426	378	1.1321	0.1651	1.1321	1.0640
No log	8.0851	380	1.1129	0.1412	1.1129	1.0549
No log	8.1277	382	1.1398	0.1468	1.1398	1.0676
No log	8.1702	384	1.2197	0.2527	1.2197	1.1044
No log	8.2128	386	1.3165	0.2005	1.3165	1.1474
No log	8.2553	388	1.3024	0.1581	1.3024	1.1412
No log	8.2979	390	1.1520	0.2418	1.1520	1.0733
No log	8.3404	392	1.1130	0.2358	1.1130	1.0550
No log	8.3830	394	1.1198	0.2094	1.1198	1.0582
No log	8.4255	396	1.1718	0.2450	1.1718	1.0825
No log	8.4681	398	1.1770	0.3158	1.1770	1.0849
No log	8.5106	400	1.2298	0.2444	1.2298	1.1090
No log	8.5532	402	1.3675	0.3271	1.3675	1.1694
No log	8.5957	404	1.3038	0.2289	1.3038	1.1418
No log	8.6383	406	1.1819	0.2554	1.1819	1.0872
No log	8.6809	408	1.1882	0.2554	1.1882	1.0900
No log	8.7234	410	1.0853	0.2380	1.0853	1.0418
No log	8.7660	412	1.0694	0.2128	1.0694	1.0341
No log	8.8085	414	1.1079	0.2380	1.1079	1.0526
No log	8.8511	416	1.0910	0.2221	1.0910	1.0445
No log	8.8936	418	1.1063	0.2128	1.1063	1.0518
No log	8.9362	420	1.1167	0.1982	1.1167	1.0568
No log	8.9787	422	1.1390	0.1751	1.1390	1.0672
No log	9.0213	424	1.2862	0.3145	1.2862	1.1341
No log	9.0638	426	1.3822	0.3103	1.3822	1.1757
No log	9.1064	428	1.2098	0.1619	1.2098	1.0999
No log	9.1489	430	1.1167	0.1935	1.1167	1.0568
No log	9.1915	432	1.0767	0.2126	1.0767	1.0376
No log	9.2340	434	1.1089	0.1748	1.1089	1.0530
No log	9.2766	436	1.1005	0.2078	1.1005	1.0490
No log	9.3191	438	1.0797	0.2831	1.0797	1.0391
No log	9.3617	440	1.1083	0.2159	1.1083	1.0527
No log	9.4043	442	1.2598	0.2560	1.2598	1.1224
No log	9.4468	444	1.4045	0.2899	1.4045	1.1851
No log	9.4894	446	1.4489	0.2942	1.4489	1.2037
No log	9.5319	448	1.3792	0.2833	1.3792	1.1744
No log	9.5745	450	1.1799	0.1814	1.1799	1.0862
No log	9.6170	452	1.1149	0.1980	1.1149	1.0559
No log	9.6596	454	1.1022	0.2128	1.1022	1.0499
No log	9.7021	456	1.0837	0.2358	1.0837	1.0410
No log	9.7447	458	1.0719	0.2402	1.0719	1.0353
No log	9.7872	460	1.0811	0.2946	1.0811	1.0397
No log	9.8298	462	1.0814	0.3017	1.0814	1.0399
No log	9.8723	464	1.1184	0.2495	1.1184	1.0575
No log	9.9149	466	1.2902	0.2574	1.2902	1.1359
No log	9.9574	468	1.3454	0.2511	1.3454	1.1599
No log	10.0	470	1.2562	0.2228	1.2562	1.1208
No log	10.0426	472	1.1257	0.2324	1.1257	1.0610
No log	10.0851	474	1.0638	0.3017	1.0638	1.0314
No log	10.1277	476	1.0670	0.3344	1.0670	1.0330
No log	10.1702	478	1.0735	0.2991	1.0735	1.0361
No log	10.2128	480	1.0933	0.2210	1.0933	1.0456
No log	10.2553	482	1.1795	0.2191	1.1795	1.0861
No log	10.2979	484	1.3207	0.1601	1.3207	1.1492
No log	10.3404	486	1.4889	0.2450	1.4889	1.2202
No log	10.3830	488	1.4609	0.2239	1.4608	1.2087
No log	10.4255	490	1.3093	0.2313	1.3093	1.1443
No log	10.4681	492	1.1899	0.2418	1.1899	1.0908
No log	10.5106	494	1.1696	0.2405	1.1696	1.0815
No log	10.5532	496	1.1772	0.2235	1.1772	1.0850
No log	10.5957	498	1.1714	0.2366	1.1714	1.0823
0.3694	10.6383	500	1.1457	0.2399	1.1457	1.0704
0.3694	10.6809	502	1.1275	0.2945	1.1275	1.0619
0.3694	10.7234	504	1.1194	0.2637	1.1194	1.0580
0.3694	10.7660	506	1.1696	0.2098	1.1696	1.0815
0.3694	10.8085	508	1.1836	0.2098	1.1836	1.0879
0.3694	10.8511	510	1.1799	0.2140	1.1799	1.0862
0.3694	10.8936	512	1.1056	0.2795	1.1056	1.0515
0.3694	10.9362	514	1.0732	0.3970	1.0732	1.0359
0.3694	10.9787	516	1.0851	0.3145	1.0851	1.0417
0.3694	11.0213	518	1.1108	0.2777	1.1108	1.0539
0.3694	11.0638	520	1.1084	0.2777	1.1084	1.0528
0.3694	11.1064	522	1.1498	0.1523	1.1498	1.0723
0.3694	11.1489	524	1.2588	0.2424	1.2588	1.1219
0.3694	11.1915	526	1.2401	0.1766	1.2401	1.1136
0.3694	11.2340	528	1.1427	0.2138	1.1427	1.0690
0.3694	11.2766	530	1.0838	0.1774	1.0838	1.0411
0.3694	11.3191	532	1.0774	0.3040	1.0774	1.0380
0.3694	11.3617	534	1.0859	0.2499	1.0859	1.0421
0.3694	11.4043	536	1.1392	0.1798	1.1392	1.0673
0.3694	11.4468	538	1.2190	0.2870	1.2190	1.1041
0.3694	11.4894	540	1.1985	0.2516	1.1985	1.0948
0.3694	11.5319	542	1.1094	0.2236	1.1094	1.0533
0.3694	11.5745	544	1.0833	0.2411	1.0833	1.0408
0.3694	11.6170	546	1.0761	0.3037	1.0761	1.0374
0.3694	11.6596	548	1.0953	0.2225	1.0953	1.0466
0.3694	11.7021	550	1.1622	0.1986	1.1622	1.0781
0.3694	11.7447	552	1.2408	0.3026	1.2408	1.1139
0.3694	11.7872	554	1.2113	0.1862	1.2113	1.1006
0.3694	11.8298	556	1.1438	0.1980	1.1438	1.0695
0.3694	11.8723	558	1.1174	0.2556	1.1174	1.0571
0.3694	11.9149	560	1.1182	0.2556	1.1182	1.0574
0.3694	11.9574	562	1.1348	0.2108	1.1348	1.0653
0.3694	12.0	564	1.1595	0.1751	1.1595	1.0768
0.3694	12.0426	566	1.1827	0.2384	1.1827	1.0875
0.3694	12.0851	568	1.2512	0.1629	1.2512	1.1186
0.3694	12.1277	570	1.3575	0.2660	1.3575	1.1651
0.3694	12.1702	572	1.3831	0.2359	1.3831	1.1761
0.3694	12.2128	574	1.3063	0.2660	1.3063	1.1429
0.3694	12.2553	576	1.1895	0.1839	1.1895	1.0906
0.3694	12.2979	578	1.1415	0.2376	1.1415	1.0684
0.3694	12.3404	580	1.1348	0.2222	1.1348	1.0653
0.3694	12.3830	582	1.1534	0.1935	1.1534	1.0740
0.3694	12.4255	584	1.1615	0.1935	1.1615	1.0777

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1