ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3180
• Qwk: 0.0750
• Mse: 1.3180
• Rmse: 1.1480

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	4.9804	-0.0104	4.9804	2.2317
No log	0.0606	4	3.4057	-0.0576	3.4057	1.8455
No log	0.0909	6	2.2446	-0.0361	2.2446	1.4982
No log	0.1212	8	2.0907	-0.0017	2.0907	1.4459
No log	0.1515	10	2.1541	-0.0370	2.1541	1.4677
No log	0.1818	12	1.8379	-0.0017	1.8379	1.3557
No log	0.2121	14	1.7508	-0.0156	1.7508	1.3232
No log	0.2424	16	1.9026	-0.0303	1.9026	1.3793
No log	0.2727	18	2.3372	-0.0982	2.3372	1.5288
No log	0.3030	20	3.6260	-0.0114	3.6260	1.9042
No log	0.3333	22	3.6086	-0.0153	3.6086	1.8996
No log	0.3636	24	2.1658	-0.0796	2.1658	1.4717
No log	0.3939	26	1.4589	0.1821	1.4589	1.2078
No log	0.4242	28	1.2688	0.1858	1.2688	1.1264
No log	0.4545	30	1.2090	0.1638	1.2090	1.0995
No log	0.4848	32	1.2909	0.2044	1.2909	1.1362
No log	0.5152	34	1.6488	0.1449	1.6488	1.2841
No log	0.5455	36	2.1835	0.0554	2.1835	1.4777
No log	0.5758	38	2.1225	0.1103	2.1225	1.4569
No log	0.6061	40	1.8907	0.1663	1.8907	1.3750
No log	0.6364	42	1.8029	0.1060	1.8029	1.3427
No log	0.6667	44	1.8457	0.0405	1.8457	1.3586
No log	0.6970	46	1.6716	0.1135	1.6716	1.2929
No log	0.7273	48	1.4238	0.1165	1.4238	1.1932
No log	0.7576	50	1.3732	0.1165	1.3732	1.1719
No log	0.7879	52	1.3939	0.0038	1.3939	1.1806
No log	0.8182	54	1.2872	0.1165	1.2872	1.1345
No log	0.8485	56	1.3121	0.0038	1.3121	1.1455
No log	0.8788	58	1.2118	0.2351	1.2118	1.1008
No log	0.9091	60	1.1808	0.1943	1.1808	1.0866
No log	0.9394	62	1.2947	0.1809	1.2947	1.1378
No log	0.9697	64	1.6941	0.1758	1.6941	1.3016
No log	1.0	66	2.1821	0.0938	2.1821	1.4772
No log	1.0303	68	2.1725	0.0938	2.1725	1.4739
No log	1.0606	70	1.5373	0.1618	1.5373	1.2399
No log	1.0909	72	1.2368	0.2085	1.2368	1.1121
No log	1.1212	74	1.2264	0.2432	1.2264	1.1074
No log	1.1515	76	1.3798	0.1671	1.3798	1.1747
No log	1.1818	78	2.0083	0.0175	2.0083	1.4171
No log	1.2121	80	2.4723	0.0514	2.4723	1.5723
No log	1.2424	82	2.0736	0.0528	2.0736	1.4400
No log	1.2727	84	1.4336	0.2035	1.4336	1.1973
No log	1.3030	86	1.3139	0.1121	1.3139	1.1463
No log	1.3333	88	1.3722	0.2128	1.3722	1.1714
No log	1.3636	90	1.7131	0.1004	1.7131	1.3088
No log	1.3939	92	1.9863	0.0676	1.9863	1.4094
No log	1.4242	94	1.8364	0.0873	1.8364	1.3551
No log	1.4545	96	1.5324	0.1758	1.5324	1.2379
No log	1.4848	98	1.4761	0.1641	1.4761	1.2149
No log	1.5152	100	1.4704	0.1684	1.4704	1.2126
No log	1.5455	102	1.4680	0.1079	1.4680	1.2116
No log	1.5758	104	1.3747	0.1071	1.3747	1.1725
No log	1.6061	106	1.3506	0.2169	1.3506	1.1622
No log	1.6364	108	1.5935	0.1849	1.5935	1.2623
No log	1.6667	110	2.2300	0.0578	2.2300	1.4933
No log	1.6970	112	2.2795	0.0364	2.2795	1.5098
No log	1.7273	114	1.8050	0.0907	1.8050	1.3435
No log	1.7576	116	1.4670	0.1979	1.4670	1.2112
No log	1.7879	118	1.3737	0.1413	1.3737	1.1720
No log	1.8182	120	1.4314	0.1565	1.4314	1.1964
No log	1.8485	122	1.5849	0.0982	1.5849	1.2589
No log	1.8788	124	1.7385	0.0823	1.7385	1.3185
No log	1.9091	126	1.5997	0.1863	1.5997	1.2648
No log	1.9394	128	1.4119	0.2270	1.4119	1.1882
No log	1.9697	130	1.3707	0.1323	1.3707	1.1707
No log	2.0	132	1.4459	0.1682	1.4459	1.2025
No log	2.0303	134	1.5669	0.1970	1.5669	1.2518
No log	2.0606	136	1.7993	0.1275	1.7993	1.3414
No log	2.0909	138	1.7439	0.1948	1.7439	1.3206
No log	2.1212	140	1.5798	0.1045	1.5798	1.2569
No log	2.1515	142	1.4083	0.1182	1.4083	1.1867
No log	2.1818	144	1.4283	0.1265	1.4283	1.1951
No log	2.2121	146	1.4111	0.1571	1.4111	1.1879
No log	2.2424	148	1.5036	0.0749	1.5036	1.2262
No log	2.2727	150	1.7708	0.0888	1.7708	1.3307
No log	2.3030	152	1.8810	0.0913	1.8810	1.3715
No log	2.3333	154	1.6789	0.0614	1.6789	1.2957
No log	2.3636	156	1.4062	0.0623	1.4062	1.1858
No log	2.3939	158	1.3583	0.0322	1.3583	1.1655
No log	2.4242	160	1.3848	0.0380	1.3848	1.1768
No log	2.4545	162	1.5603	0.1311	1.5603	1.2491
No log	2.4848	164	1.8833	0.1108	1.8833	1.3723
No log	2.5152	166	1.7205	0.1673	1.7205	1.3117
No log	2.5455	168	1.3548	0.0469	1.3548	1.1639
No log	2.5758	170	1.2697	0.1076	1.2697	1.1268
No log	2.6061	172	1.2607	0.1112	1.2607	1.1228
No log	2.6364	174	1.3432	0.0935	1.3432	1.1590
No log	2.6667	176	1.6098	0.2303	1.6098	1.2688
No log	2.6970	178	1.5534	0.2387	1.5533	1.2463
No log	2.7273	180	1.4100	0.2044	1.4100	1.1875
No log	2.7576	182	1.2719	0.1538	1.2719	1.1278
No log	2.7879	184	1.2142	0.1397	1.2142	1.1019
No log	2.8182	186	1.2467	0.1761	1.2467	1.1166
No log	2.8485	188	1.4234	0.1347	1.4234	1.1931
No log	2.8788	190	1.7645	0.1852	1.7645	1.3284
No log	2.9091	192	1.9587	0.1679	1.9587	1.3995
No log	2.9394	194	1.8040	0.1960	1.8040	1.3431
No log	2.9697	196	1.5276	0.0890	1.5276	1.2360
No log	3.0	198	1.3860	0.1213	1.3860	1.1773
No log	3.0303	200	1.3853	0.1213	1.3853	1.1770
No log	3.0606	202	1.5029	0.1612	1.5029	1.2259
No log	3.0909	204	1.7164	0.1325	1.7164	1.3101
No log	3.1212	206	2.0466	0.1293	2.0466	1.4306
No log	3.1515	208	2.0238	0.1293	2.0238	1.4226
No log	3.1818	210	1.7343	0.0733	1.7343	1.3169
No log	3.2121	212	1.4419	0.1877	1.4419	1.2008
No log	3.2424	214	1.3055	0.1423	1.3055	1.1426
No log	3.2727	216	1.2853	0.1362	1.2853	1.1337
No log	3.3030	218	1.3343	0.1592	1.3343	1.1551
No log	3.3333	220	1.5124	0.1336	1.5124	1.2298
No log	3.3636	222	1.8719	0.1204	1.8719	1.3682
No log	3.3939	224	1.9426	0.1204	1.9426	1.3938
No log	3.4242	226	1.7355	0.1481	1.7355	1.3174
No log	3.4545	228	1.4259	0.1379	1.4259	1.1941
No log	3.4848	230	1.3322	0.1379	1.3322	1.1542
No log	3.5152	232	1.3112	0.1466	1.3112	1.1451
No log	3.5455	234	1.3803	0.1412	1.3803	1.1749
No log	3.5758	236	1.5520	0.1124	1.5520	1.2458
No log	3.6061	238	1.6630	0.1106	1.6630	1.2896
No log	3.6364	240	1.5791	0.1121	1.5791	1.2566
No log	3.6667	242	1.4253	0.0950	1.4253	1.1939
No log	3.6970	244	1.3306	0.1176	1.3306	1.1535
No log	3.7273	246	1.3079	0.1054	1.3079	1.1436
No log	3.7576	248	1.3171	0.1354	1.3171	1.1477
No log	3.7879	250	1.4279	0.1347	1.4279	1.1950
No log	3.8182	252	1.7154	0.0741	1.7154	1.3097
No log	3.8485	254	1.7931	0.0879	1.7931	1.3391
No log	3.8788	256	1.6238	0.1436	1.6238	1.2743
No log	3.9091	258	1.3938	0.0893	1.3938	1.1806
No log	3.9394	260	1.3201	0.0941	1.3201	1.1490
No log	3.9697	262	1.3031	0.1029	1.3031	1.1415
No log	4.0	264	1.3219	0.0854	1.3219	1.1497
No log	4.0303	266	1.3408	0.1469	1.3408	1.1579
No log	4.0606	268	1.2820	0.1560	1.2820	1.1323
No log	4.0909	270	1.2180	0.2263	1.2180	1.1036
No log	4.1212	272	1.2445	0.2168	1.2445	1.1156
No log	4.1515	274	1.3737	0.1862	1.3737	1.1720
No log	4.1818	276	1.5956	0.1993	1.5956	1.2632
No log	4.2121	278	1.6074	0.1673	1.6074	1.2678
No log	4.2424	280	1.3891	0.1316	1.3891	1.1786
No log	4.2727	282	1.2404	0.2071	1.2404	1.1137
No log	4.3030	284	1.2540	0.1975	1.2540	1.1198
No log	4.3333	286	1.3469	0.1113	1.3469	1.1606
No log	4.3636	288	1.3971	0.1371	1.3971	1.1820
No log	4.3939	290	1.3979	0.1632	1.3979	1.1823
No log	4.4242	292	1.5578	0.2387	1.5578	1.2481
No log	4.4545	294	1.6900	0.1917	1.6900	1.3000
No log	4.4848	296	1.7018	0.1419	1.7018	1.3045
No log	4.5152	298	1.4397	0.1457	1.4397	1.1999
No log	4.5455	300	1.2458	0.1863	1.2458	1.1161
No log	4.5758	302	1.1798	0.1944	1.1798	1.0862
No log	4.6061	304	1.2111	0.2113	1.2111	1.1005
No log	4.6364	306	1.2995	0.2315	1.2995	1.1400
No log	4.6667	308	1.5833	0.0546	1.5833	1.2583
No log	4.6970	310	1.8014	0.1111	1.8014	1.3422
No log	4.7273	312	1.7911	0.1698	1.7911	1.3383
No log	4.7576	314	1.6554	0.1176	1.6554	1.2866
No log	4.7879	316	1.5821	0.1531	1.5821	1.2578
No log	4.8182	318	1.5723	0.0833	1.5723	1.2539
No log	4.8485	320	1.5029	0.0458	1.5029	1.2259
No log	4.8788	322	1.4357	0.0085	1.4357	1.1982
No log	4.9091	324	1.4131	0.0085	1.4131	1.1887
No log	4.9394	326	1.4550	0.0777	1.4550	1.2062
No log	4.9697	328	1.4919	0.1371	1.4919	1.2214
No log	5.0	330	1.4808	0.1371	1.4808	1.2169
No log	5.0303	332	1.4662	0.1371	1.4662	1.2109
No log	5.0606	334	1.4307	0.1773	1.4307	1.1961
No log	5.0909	336	1.3735	0.2361	1.3735	1.1720
No log	5.1212	338	1.3906	0.2091	1.3906	1.1792
No log	5.1515	340	1.4307	0.1913	1.4307	1.1961
No log	5.1818	342	1.5804	0.1831	1.5804	1.2571
No log	5.2121	344	1.6124	0.1831	1.6124	1.2698
No log	5.2424	346	1.4702	0.1929	1.4702	1.2125
No log	5.2727	348	1.3447	0.1120	1.3447	1.1596
No log	5.3030	350	1.2706	0.0407	1.2706	1.1272
No log	5.3333	352	1.2814	0.0241	1.2814	1.1320
No log	5.3636	354	1.3670	0.1080	1.3670	1.1692
No log	5.3939	356	1.3921	0.0990	1.3921	1.1799
No log	5.4242	358	1.4520	0.0485	1.4520	1.2050
No log	5.4545	360	1.4237	0.0661	1.4237	1.1932
No log	5.4848	362	1.4554	0.1259	1.4554	1.2064
No log	5.5152	364	1.5689	0.0393	1.5689	1.2526
No log	5.5455	366	1.4830	0.0774	1.4830	1.2178
No log	5.5758	368	1.3255	0.1329	1.3255	1.1513
No log	5.6061	370	1.2914	0.1397	1.2914	1.1364
No log	5.6364	372	1.3225	0.1667	1.3225	1.1500
No log	5.6667	374	1.4742	0.0437	1.4742	1.2142
No log	5.6970	376	1.7209	0.1109	1.7209	1.3118
No log	5.7273	378	1.7425	0.1156	1.7425	1.3200
No log	5.7576	380	1.5673	0.0226	1.5673	1.2519
No log	5.7879	382	1.3730	0.1329	1.3730	1.1717
No log	5.8182	384	1.3174	0.1155	1.3174	1.1478
No log	5.8485	386	1.3305	0.1214	1.3305	1.1535
No log	5.8788	388	1.4021	0.1267	1.4021	1.1841
No log	5.9091	390	1.5472	0.0498	1.5472	1.2439
No log	5.9394	392	1.6009	0.0587	1.6009	1.2653
No log	5.9697	394	1.5333	0.0699	1.5333	1.2383
No log	6.0	396	1.5718	0.1358	1.5718	1.2537
No log	6.0303	398	1.5504	0.1796	1.5504	1.2452
No log	6.0606	400	1.4626	0.0923	1.4626	1.2094
No log	6.0909	402	1.3706	0.0482	1.3706	1.1707
No log	6.1212	404	1.3731	0.0619	1.3731	1.1718
No log	6.1515	406	1.4422	0.0741	1.4422	1.2009
No log	6.1818	408	1.6785	0.1226	1.6785	1.2956
No log	6.2121	410	1.8890	0.1157	1.8890	1.3744
No log	6.2424	412	1.7685	0.0962	1.7685	1.3299
No log	6.2727	414	1.5116	0.1751	1.5116	1.2295
No log	6.3030	416	1.3355	0.1055	1.3355	1.1556
No log	6.3333	418	1.2842	0.1779	1.2842	1.1332
No log	6.3636	420	1.3001	0.1880	1.3001	1.1402
No log	6.3939	422	1.4026	0.1144	1.4026	1.1843
No log	6.4242	424	1.5913	0.1094	1.5913	1.2615
No log	6.4545	426	1.6284	0.1226	1.6284	1.2761
No log	6.4848	428	1.5042	0.1498	1.5042	1.2265
No log	6.5152	430	1.4361	0.1286	1.4361	1.1984
No log	6.5455	432	1.3742	0.1691	1.3742	1.1723
No log	6.5758	434	1.4072	0.1682	1.4072	1.1863
No log	6.6061	436	1.4524	0.1286	1.4524	1.2052
No log	6.6364	438	1.5215	0.1751	1.5215	1.2335
No log	6.6667	440	1.5070	0.1116	1.5070	1.2276
No log	6.6970	442	1.5438	0.1031	1.5438	1.2425
No log	6.7273	444	1.4357	0.1858	1.4357	1.1982
No log	6.7576	446	1.3135	0.1296	1.3135	1.1461
No log	6.7879	448	1.2743	0.1148	1.2743	1.1289
No log	6.8182	450	1.2963	0.1207	1.2963	1.1385
No log	6.8485	452	1.3364	0.1114	1.3364	1.1560
No log	6.8788	454	1.4621	0.1341	1.4621	1.2092
No log	6.9091	456	1.6222	0.1822	1.6222	1.2736
No log	6.9394	458	1.6067	0.1851	1.6067	1.2676
No log	6.9697	460	1.5055	0.1427	1.5055	1.2270
No log	7.0	462	1.4272	0.1228	1.4272	1.1947
No log	7.0303	464	1.3451	0.2191	1.3451	1.1598
No log	7.0606	466	1.3321	0.1896	1.3321	1.1542
No log	7.0909	468	1.4161	0.1547	1.4161	1.1900
No log	7.1212	470	1.5283	0.1763	1.5283	1.2362
No log	7.1515	472	1.5379	0.1763	1.5379	1.2401
No log	7.1818	474	1.4596	0.1458	1.4596	1.2081
No log	7.2121	476	1.3681	0.0385	1.3681	1.1697
No log	7.2424	478	1.3336	0.0793	1.3336	1.1548
No log	7.2727	480	1.3752	0.0471	1.3752	1.1727
No log	7.3030	482	1.4317	0.0995	1.4317	1.1965
No log	7.3333	484	1.4424	0.1290	1.4424	1.2010
No log	7.3636	486	1.4724	0.1581	1.4724	1.2134
No log	7.3939	488	1.3907	0.0777	1.3907	1.1793
No log	7.4242	490	1.3020	0.0660	1.3020	1.1411
No log	7.4545	492	1.2852	0.0993	1.2852	1.1337
No log	7.4848	494	1.3283	0.0896	1.3283	1.1525
No log	7.5152	496	1.4175	0.0839	1.4175	1.1906
No log	7.5455	498	1.4562	0.1088	1.4562	1.2067
0.3402	7.5758	500	1.3960	0.1290	1.3960	1.1815
0.3402	7.6061	502	1.4204	0.1734	1.4204	1.1918
0.3402	7.6364	504	1.4400	0.2094	1.4400	1.2000
0.3402	7.6667	506	1.4021	0.2094	1.4021	1.1841
0.3402	7.6970	508	1.4678	0.2430	1.4678	1.2115
0.3402	7.7273	510	1.4495	0.2055	1.4495	1.2039
0.3402	7.7576	512	1.3752	0.1964	1.3752	1.1727
0.3402	7.7879	514	1.3180	0.2091	1.3180	1.1480
0.3402	7.8182	516	1.3532	0.2091	1.3532	1.1633
0.3402	7.8485	518	1.4790	0.1447	1.4790	1.2161
0.3402	7.8788	520	1.5404	0.1456	1.5404	1.2411
0.3402	7.9091	522	1.4663	0.1479	1.4663	1.2109
0.3402	7.9394	524	1.3540	0.1667	1.3540	1.1636
0.3402	7.9697	526	1.2788	0.1958	1.2788	1.1308
0.3402	8.0	528	1.2774	0.1998	1.2774	1.1302
0.3402	8.0303	530	1.2770	0.1827	1.2770	1.1301
0.3402	8.0606	532	1.3298	0.1347	1.3298	1.1532
0.3402	8.0909	534	1.3451	0.1581	1.3451	1.1598
0.3402	8.1212	536	1.2619	0.1468	1.2619	1.1233
0.3402	8.1515	538	1.2260	0.2222	1.2260	1.1073
0.3402	8.1818	540	1.2527	0.2324	1.2527	1.1193
0.3402	8.2121	542	1.2721	0.2609	1.2721	1.1279
0.3402	8.2424	544	1.2718	0.2609	1.2718	1.1278
0.3402	8.2727	546	1.2718	0.2232	1.2718	1.1277
0.3402	8.3030	548	1.3289	0.2644	1.3289	1.1528
0.3402	8.3333	550	1.2913	0.2565	1.2913	1.1364
0.3402	8.3636	552	1.2459	0.2285	1.2459	1.1162
0.3402	8.3939	554	1.2674	0.2816	1.2674	1.1258
0.3402	8.4242	556	1.2744	0.2432	1.2744	1.1289
0.3402	8.4545	558	1.2783	0.2324	1.2783	1.1306
0.3402	8.4848	560	1.2334	0.1671	1.2334	1.1106
0.3402	8.5152	562	1.2473	0.1766	1.2473	1.1168
0.3402	8.5455	564	1.3269	0.1503	1.3269	1.1519
0.3402	8.5758	566	1.4263	0.1615	1.4263	1.1943
0.3402	8.6061	568	1.5486	0.1329	1.5486	1.2444
0.3402	8.6364	570	1.6403	0.1916	1.6403	1.2808
0.3402	8.6667	572	1.4903	0.1551	1.4903	1.2208
0.3402	8.6970	574	1.2859	0.1388	1.2859	1.1340
0.3402	8.7273	576	1.1941	0.1397	1.1941	1.0928
0.3402	8.7576	578	1.1939	0.1456	1.1939	1.0927
0.3402	8.7879	580	1.2477	0.1203	1.2477	1.1170
0.3402	8.8182	582	1.4228	0.0697	1.4228	1.1928
0.3402	8.8485	584	1.6946	0.1082	1.6946	1.3018
0.3402	8.8788	586	1.7542	0.1393	1.7542	1.3245
0.3402	8.9091	588	1.6390	0.1252	1.6390	1.2802
0.3402	8.9394	590	1.4510	0.0961	1.4510	1.2046
0.3402	8.9697	592	1.3469	0.1935	1.3469	1.1606
0.3402	9.0	594	1.2975	0.1388	1.2975	1.1391
0.3402	9.0303	596	1.2878	0.1388	1.2878	1.1348
0.3402	9.0606	598	1.3496	0.1598	1.3496	1.1617
0.3402	9.0909	600	1.4624	0.0911	1.4624	1.2093
0.3402	9.1212	602	1.5116	0.1004	1.5116	1.2295
0.3402	9.1515	604	1.4678	0.0891	1.4678	1.2115
0.3402	9.1818	606	1.3617	0.1050	1.3617	1.1669
0.3402	9.2121	608	1.3180	0.0750	1.3180	1.1480

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1