ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k6_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1747
• Qwk: 0.0831
• Mse: 1.1747
• Rmse: 1.0838

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	4.0852	-0.0075	4.0852	2.0212
No log	0.1481	4	2.3309	-0.0062	2.3309	1.5267
No log	0.2222	6	2.1536	0.0709	2.1536	1.4675
No log	0.2963	8	2.2570	0.0462	2.2570	1.5023
No log	0.3704	10	1.4618	0.2353	1.4618	1.2090
No log	0.4444	12	1.6118	0.1663	1.6118	1.2696
No log	0.5185	14	1.7913	0.1511	1.7913	1.3384
No log	0.5926	16	2.0656	0.1229	2.0656	1.4372
No log	0.6667	18	1.5307	0.1421	1.5307	1.2372
No log	0.7407	20	1.1896	0.3211	1.1896	1.0907
No log	0.8148	22	1.4398	0.1894	1.4398	1.1999
No log	0.8889	24	1.6399	0.1687	1.6399	1.2806
No log	0.9630	26	1.7655	0.0976	1.7655	1.3287
No log	1.0370	28	1.2822	0.1729	1.2822	1.1324
No log	1.1111	30	1.2851	0.2028	1.2851	1.1336
No log	1.1852	32	1.6239	0.2091	1.6239	1.2743
No log	1.2593	34	2.3057	0.0735	2.3057	1.5184
No log	1.3333	36	1.9097	0.1720	1.9097	1.3819
No log	1.4074	38	1.4424	0.2379	1.4424	1.2010
No log	1.4815	40	1.1761	0.2216	1.1761	1.0845
No log	1.5556	42	1.1457	0.2836	1.1457	1.0704
No log	1.6296	44	1.1586	0.2300	1.1586	1.0764
No log	1.7037	46	1.2374	0.1950	1.2374	1.1124
No log	1.7778	48	1.4895	0.1327	1.4895	1.2205
No log	1.8519	50	1.3902	0.2303	1.3902	1.1791
No log	1.9259	52	1.1347	0.1986	1.1347	1.0652
No log	2.0	54	1.1058	0.1977	1.1058	1.0516
No log	2.0741	56	1.1487	0.1986	1.1487	1.0718
No log	2.1481	58	1.5287	0.1416	1.5287	1.2364
No log	2.2222	60	2.3210	0.0603	2.3210	1.5235
No log	2.2963	62	2.4526	0.0867	2.4526	1.5661
No log	2.3704	64	1.9722	0.1670	1.9722	1.4044
No log	2.4444	66	1.4276	0.1035	1.4276	1.1948
No log	2.5185	68	1.3169	0.1197	1.3169	1.1476
No log	2.5926	70	1.2041	0.2617	1.2041	1.0973
No log	2.6667	72	1.2123	0.1944	1.2123	1.1011
No log	2.7407	74	1.3285	0.1663	1.3285	1.1526
No log	2.8148	76	1.3869	0.1063	1.3869	1.1777
No log	2.8889	78	1.4052	0.2694	1.4052	1.1854
No log	2.9630	80	1.2498	0.2357	1.2498	1.1179
No log	3.0370	82	1.2382	0.3487	1.2382	1.1128
No log	3.1111	84	1.2335	0.2278	1.2335	1.1106
No log	3.1852	86	1.2227	0.2674	1.2227	1.1058
No log	3.2593	88	1.2064	0.2651	1.2064	1.0984
No log	3.3333	90	1.1172	0.3711	1.1172	1.0570
No log	3.4074	92	1.1044	0.3711	1.1044	1.0509
No log	3.4815	94	1.0960	0.2920	1.0960	1.0469
No log	3.5556	96	1.0841	0.2920	1.0841	1.0412
No log	3.6296	98	1.0925	0.2560	1.0925	1.0452
No log	3.7037	100	1.1810	0.2396	1.1810	1.0867
No log	3.7778	102	1.3472	0.2198	1.3472	1.1607
No log	3.8519	104	1.3584	0.2980	1.3584	1.1655
No log	3.9259	106	1.2187	0.2417	1.2187	1.1039
No log	4.0	108	1.3011	0.2610	1.3011	1.1407
No log	4.0741	110	1.3714	0.2552	1.3714	1.1711
No log	4.1481	112	1.2557	0.2539	1.2557	1.1206
No log	4.2222	114	1.2805	0.2900	1.2805	1.1316
No log	4.2963	116	1.3011	0.2514	1.3011	1.1407
No log	4.3704	118	1.5645	0.1529	1.5645	1.2508
No log	4.4444	120	1.7437	0.0399	1.7437	1.3205
No log	4.5185	122	1.4496	0.1768	1.4496	1.2040
No log	4.5926	124	1.3258	0.1803	1.3258	1.1514
No log	4.6667	126	1.3937	0.2301	1.3937	1.1805
No log	4.7407	128	1.3169	0.2518	1.3169	1.1476
No log	4.8148	130	1.2863	0.2647	1.2863	1.1341
No log	4.8889	132	1.1520	0.0787	1.1520	1.0733
No log	4.9630	134	1.0937	0.1722	1.0937	1.0458
No log	5.0370	136	1.1191	0.1039	1.1191	1.0579
No log	5.1111	138	1.2385	0.2280	1.2385	1.1129
No log	5.1852	140	1.1661	0.2518	1.1661	1.0799
No log	5.2593	142	1.0637	0.1067	1.0637	1.0314
No log	5.3333	144	1.0907	0.1683	1.0907	1.0444
No log	5.4074	146	1.1505	0.1627	1.1505	1.0726
No log	5.4815	148	1.2417	0.2466	1.2417	1.1143
No log	5.5556	150	1.1978	0.2037	1.1978	1.0944
No log	5.6296	152	1.2829	0.2997	1.2829	1.1327
No log	5.7037	154	1.3572	0.2863	1.3572	1.1650
No log	5.7778	156	1.2393	0.1402	1.2393	1.1133
No log	5.8519	158	1.2144	0.1966	1.2144	1.1020
No log	5.9259	160	1.2241	0.2310	1.2241	1.1064
No log	6.0	162	1.2372	0.1899	1.2372	1.1123
No log	6.0741	164	1.4189	0.2915	1.4189	1.1912
No log	6.1481	166	1.5122	0.2694	1.5122	1.2297
No log	6.2222	168	1.2559	0.2477	1.2559	1.1207
No log	6.2963	170	1.1369	0.2743	1.1369	1.0662
No log	6.3704	172	1.2161	0.2440	1.2161	1.1028
No log	6.4444	174	1.2033	0.2440	1.2033	1.0970
No log	6.5185	176	1.1244	0.2019	1.1244	1.0604
No log	6.5926	178	1.4696	0.2272	1.4696	1.2123
No log	6.6667	180	1.8978	0.0818	1.8978	1.3776
No log	6.7407	182	1.7770	0.1291	1.7770	1.3330
No log	6.8148	184	1.4050	0.2599	1.4050	1.1853
No log	6.8889	186	1.2184	0.1990	1.2184	1.1038
No log	6.9630	188	1.2276	0.1051	1.2276	1.1080
No log	7.0370	190	1.2537	0.1704	1.2537	1.1197
No log	7.1111	192	1.4139	0.2015	1.4139	1.1891
No log	7.1852	194	1.5627	0.1600	1.5627	1.2501
No log	7.2593	196	1.5001	0.1992	1.5001	1.2248
No log	7.3333	198	1.2739	0.1436	1.2739	1.1287
No log	7.4074	200	1.2050	0.1723	1.2050	1.0977
No log	7.4815	202	1.2322	0.2135	1.2322	1.1101
No log	7.5556	204	1.2757	0.1517	1.2757	1.1295
No log	7.6296	206	1.4244	0.1740	1.4244	1.1935
No log	7.7037	208	1.4359	0.1740	1.4359	1.1983
No log	7.7778	210	1.2803	0.1554	1.2803	1.1315
No log	7.8519	212	1.2459	0.1466	1.2459	1.1162
No log	7.9259	214	1.2483	0.0934	1.2483	1.1173
No log	8.0	216	1.3285	0.1758	1.3285	1.1526
No log	8.0741	218	1.5029	0.2198	1.5029	1.2259
No log	8.1481	220	1.5184	0.1644	1.5184	1.2322
No log	8.2222	222	1.4029	0.1447	1.4029	1.1844
No log	8.2963	224	1.3634	0.1557	1.3634	1.1676
No log	8.3704	226	1.3164	0.0857	1.3164	1.1473
No log	8.4444	228	1.3421	0.1735	1.3421	1.1585
No log	8.5185	230	1.3873	0.2350	1.3873	1.1778
No log	8.5926	232	1.5185	0.1591	1.5185	1.2323
No log	8.6667	234	1.6431	0.1820	1.6431	1.2818
No log	8.7407	236	1.6228	0.1730	1.6228	1.2739
No log	8.8148	238	1.4245	0.2063	1.4245	1.1935
No log	8.8889	240	1.1728	0.2980	1.1728	1.0830
No log	8.9630	242	1.0868	0.2991	1.0868	1.0425
No log	9.0370	244	1.1319	0.2239	1.1319	1.0639
No log	9.1111	246	1.0483	0.1755	1.0483	1.0239
No log	9.1852	248	1.0408	0.3004	1.0408	1.0202
No log	9.2593	250	1.2224	0.3121	1.2224	1.1056
No log	9.3333	252	1.2853	0.3005	1.2853	1.1337
No log	9.4074	254	1.1630	0.2997	1.1630	1.0784
No log	9.4815	256	1.0903	0.3072	1.0903	1.0442
No log	9.5556	258	1.1186	0.3788	1.1186	1.0576
No log	9.6296	260	1.1056	0.3365	1.1056	1.0515
No log	9.7037	262	1.0892	0.3365	1.0892	1.0436
No log	9.7778	264	1.0646	0.3378	1.0646	1.0318
No log	9.8519	266	1.0576	0.3427	1.0576	1.0284
No log	9.9259	268	1.0669	0.3149	1.0669	1.0329
No log	10.0	270	1.0823	0.3093	1.0823	1.0404
No log	10.0741	272	1.0933	0.2740	1.0933	1.0456
No log	10.1481	274	1.1257	0.2011	1.1257	1.0610
No log	10.2222	276	1.2412	0.2404	1.2412	1.1141
No log	10.2963	278	1.2290	0.2259	1.2290	1.1086
No log	10.3704	280	1.1843	0.2341	1.1843	1.0882
No log	10.4444	282	1.1482	0.2432	1.1482	1.0716
No log	10.5185	284	1.1731	0.3029	1.1731	1.0831
No log	10.5926	286	1.1401	0.2379	1.1401	1.0678
No log	10.6667	288	1.1862	0.2140	1.1862	1.0891
No log	10.7407	290	1.2711	0.2486	1.2711	1.1274
No log	10.8148	292	1.2386	0.2694	1.2386	1.1129
No log	10.8889	294	1.1797	0.2299	1.1797	1.0861
No log	10.9630	296	1.1720	0.2482	1.1720	1.0826
No log	11.0370	298	1.1677	0.3262	1.1677	1.0806
No log	11.1111	300	1.1397	0.2747	1.1397	1.0675
No log	11.1852	302	1.0702	0.2242	1.0702	1.0345
No log	11.2593	304	1.1012	0.2380	1.1012	1.0494
No log	11.3333	306	1.1764	0.2486	1.1764	1.0846
No log	11.4074	308	1.2287	0.2431	1.2287	1.1085
No log	11.4815	310	1.3025	0.1986	1.3025	1.1413
No log	11.5556	312	1.2879	0.2226	1.2879	1.1348
No log	11.6296	314	1.2796	0.2310	1.2796	1.1312
No log	11.7037	316	1.2696	0.1097	1.2696	1.1268
No log	11.7778	318	1.2703	0.2206	1.2703	1.1271
No log	11.8519	320	1.2404	0.2626	1.2404	1.1137
No log	11.9259	322	1.2183	0.2626	1.2183	1.1038
No log	12.0	324	1.2070	0.2647	1.2070	1.0986
No log	12.0741	326	1.1737	0.2496	1.1737	1.0834
No log	12.1481	328	1.1335	0.1864	1.1335	1.0646
No log	12.2222	330	1.1256	0.2454	1.1256	1.0609
No log	12.2963	332	1.1200	0.2068	1.1200	1.0583
No log	12.3704	334	1.1233	0.2222	1.1233	1.0599
No log	12.4444	336	1.2076	0.2801	1.2076	1.0989
No log	12.5185	338	1.2813	0.3193	1.2813	1.1319
No log	12.5926	340	1.2019	0.2864	1.2019	1.0963
No log	12.6667	342	1.1167	0.1704	1.1167	1.0567
No log	12.7407	344	1.1041	0.1696	1.1041	1.0508
No log	12.8148	346	1.1109	0.1992	1.1109	1.0540
No log	12.8889	348	1.1147	0.2454	1.1147	1.0558
No log	12.9630	350	1.1354	0.1975	1.1354	1.0655
No log	13.0370	352	1.1584	0.2485	1.1584	1.0763
No log	13.1111	354	1.1989	0.2371	1.1989	1.0949
No log	13.1852	356	1.2053	0.2371	1.2053	1.0979
No log	13.2593	358	1.1945	0.2371	1.1945	1.0929
No log	13.3333	360	1.1466	0.1468	1.1466	1.0708
No log	13.4074	362	1.1408	0.1239	1.1408	1.0681
No log	13.4815	364	1.1537	0.1126	1.1537	1.0741
No log	13.5556	366	1.1643	0.2023	1.1643	1.0790
No log	13.6296	368	1.1961	0.2690	1.1961	1.0936
No log	13.7037	370	1.1453	0.2097	1.1453	1.0702
No log	13.7778	372	1.1331	0.1371	1.1331	1.0645
No log	13.8519	374	1.1481	0.1840	1.1481	1.0715
No log	13.9259	376	1.1744	0.1481	1.1744	1.0837
No log	14.0	378	1.2608	0.2973	1.2608	1.1229
No log	14.0741	380	1.3113	0.2539	1.3113	1.1451
No log	14.1481	382	1.2639	0.1507	1.2639	1.1242
No log	14.2222	384	1.2525	0.1493	1.2525	1.1191
No log	14.2963	386	1.2336	0.1833	1.2336	1.1107
No log	14.3704	388	1.1837	0.2432	1.1837	1.0880
No log	14.4444	390	1.1303	0.1857	1.1303	1.0631
No log	14.5185	392	1.1435	0.0900	1.1435	1.0693
No log	14.5926	394	1.2442	0.2069	1.2442	1.1154
No log	14.6667	396	1.3019	0.1805	1.3019	1.1410
No log	14.7407	398	1.2788	0.2671	1.2788	1.1309
No log	14.8148	400	1.1933	0.1928	1.1933	1.0924
No log	14.8889	402	1.1672	0.1928	1.1672	1.0804
No log	14.9630	404	1.1592	0.1928	1.1592	1.0766
No log	15.0370	406	1.2056	0.2069	1.2056	1.0980
No log	15.1111	408	1.2929	0.1745	1.2929	1.1371
No log	15.1852	410	1.2471	0.2668	1.2471	1.1167
No log	15.2593	412	1.1590	0.2311	1.1590	1.0766
No log	15.3333	414	1.1076	0.2176	1.1076	1.0524
No log	15.4074	416	1.0897	0.2300	1.0897	1.0439
No log	15.4815	418	1.0620	0.2629	1.0620	1.0305
No log	15.5556	420	1.0677	0.2245	1.0677	1.0333
No log	15.6296	422	1.1195	0.2069	1.1195	1.0581
No log	15.7037	424	1.1121	0.1735	1.1121	1.0546
No log	15.7778	426	1.1007	0.2697	1.1007	1.0492
No log	15.8519	428	1.1329	0.2679	1.1329	1.0644
No log	15.9259	430	1.1435	0.2679	1.1435	1.0693
No log	16.0	432	1.1501	0.2697	1.1501	1.0724
No log	16.0741	434	1.1620	0.2439	1.1620	1.0780
No log	16.1481	436	1.1866	0.2140	1.1866	1.0893
No log	16.2222	438	1.1948	0.1735	1.1948	1.0931
No log	16.2963	440	1.1712	0.1888	1.1712	1.0822
No log	16.3704	442	1.1297	0.1505	1.1297	1.0629
No log	16.4444	444	1.1428	0.2159	1.1428	1.0690
No log	16.5185	446	1.1640	0.2252	1.1640	1.0789
No log	16.5926	448	1.1654	0.2159	1.1654	1.0795
No log	16.6667	450	1.1718	0.1722	1.1718	1.0825
No log	16.7407	452	1.2098	0.1801	1.2098	1.0999
No log	16.8148	454	1.1935	0.2073	1.1935	1.0925
No log	16.8889	456	1.1535	0.1361	1.1535	1.0740
No log	16.9630	458	1.1597	0.2393	1.1597	1.0769
No log	17.0370	460	1.1781	0.2432	1.1781	1.0854
No log	17.1111	462	1.1679	0.2312	1.1679	1.0807
No log	17.1852	464	1.1680	0.1095	1.1680	1.0807
No log	17.2593	466	1.2701	0.1171	1.2701	1.1270
No log	17.3333	468	1.2991	0.1546	1.2991	1.1398
No log	17.4074	470	1.2341	0.1801	1.2341	1.1109
No log	17.4815	472	1.2176	0.1864	1.2176	1.1034
No log	17.5556	474	1.2284	0.1567	1.2284	1.1083
No log	17.6296	476	1.2235	0.1505	1.2235	1.1061
No log	17.7037	478	1.2076	0.2393	1.2076	1.0989
No log	17.7778	480	1.1985	0.1755	1.1985	1.0948
No log	17.8519	482	1.1727	0.1408	1.1727	1.0829
No log	17.9259	484	1.1552	0.1408	1.1552	1.0748
No log	18.0	486	1.1382	0.1707	1.1382	1.0669
No log	18.0741	488	1.1264	0.0890	1.1264	1.0613
No log	18.1481	490	1.1522	0.2151	1.1522	1.0734
No log	18.2222	492	1.2385	0.2239	1.2385	1.1129
No log	18.2963	494	1.2515	0.2293	1.2515	1.1187
No log	18.3704	496	1.1736	0.0916	1.1736	1.0833
No log	18.4444	498	1.1394	0.1698	1.1394	1.0674
0.2961	18.5185	500	1.1369	0.1217	1.1369	1.0662
0.2961	18.5926	502	1.1669	0.2336	1.1669	1.0802
0.2961	18.6667	504	1.1833	0.1715	1.1833	1.0878
0.2961	18.7407	506	1.2082	0.1299	1.2082	1.0992
0.2961	18.8148	508	1.2560	0.1483	1.2560	1.1207
0.2961	18.8889	510	1.2950	0.1145	1.2950	1.1380
0.2961	18.9630	512	1.2757	0.0648	1.2757	1.1295
0.2961	19.0370	514	1.2150	0.0951	1.2150	1.1023
0.2961	19.1111	516	1.2014	0.1786	1.2014	1.0961
0.2961	19.1852	518	1.1945	0.1994	1.1945	1.0929
0.2961	19.2593	520	1.1825	0.1662	1.1825	1.0874
0.2961	19.3333	522	1.1837	0.1067	1.1837	1.0880
0.2961	19.4074	524	1.1960	0.1733	1.1960	1.0936
0.2961	19.4815	526	1.2066	0.1733	1.2066	1.0985
0.2961	19.5556	528	1.1939	0.1319	1.1939	1.0927
0.2961	19.6296	530	1.1945	0.1040	1.1945	1.0929
0.2961	19.7037	532	1.2010	0.1319	1.2010	1.0959
0.2961	19.7778	534	1.2139	0.1206	1.2139	1.1018
0.2961	19.8519	536	1.2087	0.1319	1.2087	1.0994
0.2961	19.9259	538	1.2224	0.1557	1.2224	1.1056
0.2961	20.0	540	1.2283	0.1305	1.2283	1.1083
0.2961	20.0741	542	1.2267	0.1305	1.2267	1.1075
0.2961	20.1481	544	1.1990	0.1319	1.1990	1.0950
0.2961	20.2222	546	1.1951	0.1683	1.1951	1.0932
0.2961	20.2963	548	1.1668	0.0980	1.1668	1.0802
0.2961	20.3704	550	1.1606	0.0980	1.1606	1.0773
0.2961	20.4444	552	1.1731	0.1009	1.1731	1.0831
0.2961	20.5185	554	1.1744	0.0980	1.1744	1.0837
0.2961	20.5926	556	1.1747	0.0831	1.1747	1.0838

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1