ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1724
• Qwk: 0.1893
• Mse: 1.1724
• Rmse: 1.0828

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0513	2	4.5963	-0.0191	4.5963	2.1439
No log	0.1026	4	2.7995	-0.0282	2.7995	1.6732
No log	0.1538	6	2.7268	-0.0705	2.7268	1.6513
No log	0.2051	8	3.0247	-0.1259	3.0247	1.7392
No log	0.2564	10	1.9423	0.0062	1.9423	1.3936
No log	0.3077	12	1.7479	0.0372	1.7479	1.3221
No log	0.3590	14	1.8920	0.0	1.8920	1.3755
No log	0.4103	16	1.6461	0.0	1.6461	1.2830
No log	0.4615	18	1.4761	0.0169	1.4761	1.2149
No log	0.5128	20	1.3366	0.1643	1.3366	1.1561
No log	0.5641	22	1.2730	0.1658	1.2730	1.1283
No log	0.6154	24	1.2367	0.1076	1.2367	1.1121
No log	0.6667	26	1.4112	0.0408	1.4112	1.1879
No log	0.7179	28	2.1873	0.0163	2.1873	1.4790
No log	0.7692	30	2.4169	0.0248	2.4169	1.5547
No log	0.8205	32	1.7114	0.1172	1.7114	1.3082
No log	0.8718	34	1.3289	0.1196	1.3289	1.1528
No log	0.9231	36	1.2931	0.1106	1.2931	1.1371
No log	0.9744	38	1.2931	0.1255	1.2931	1.1371
No log	1.0256	40	1.3264	0.1643	1.3264	1.1517
No log	1.0769	42	1.5537	-0.0227	1.5537	1.2465
No log	1.1282	44	1.8486	0.0283	1.8486	1.3596
No log	1.1795	46	1.6897	0.0	1.6897	1.2999
No log	1.2308	48	1.4907	-0.0149	1.4907	1.2209
No log	1.2821	50	1.3442	0.0776	1.3442	1.1594
No log	1.3333	52	1.2482	0.1766	1.2482	1.1172
No log	1.3846	54	1.1419	0.2485	1.1419	1.0686
No log	1.4359	56	1.0768	0.3616	1.0768	1.0377
No log	1.4872	58	1.1826	0.1562	1.1826	1.0875
No log	1.5385	60	1.7819	0.1981	1.7819	1.3349
No log	1.5897	62	2.0044	0.1161	2.0044	1.4158
No log	1.6410	64	1.6083	0.1769	1.6083	1.2682
No log	1.6923	66	1.2104	0.1912	1.2104	1.1002
No log	1.7436	68	1.0928	0.3714	1.0928	1.0454
No log	1.7949	70	1.0894	0.2448	1.0894	1.0437
No log	1.8462	72	1.0723	0.2569	1.0723	1.0355
No log	1.8974	74	1.0460	0.3674	1.0460	1.0228
No log	1.9487	76	1.2869	0.3004	1.2869	1.1344
No log	2.0	78	2.1039	0.1283	2.1039	1.4505
No log	2.0513	80	2.2460	0.1150	2.2460	1.4987
No log	2.1026	82	1.8326	0.1862	1.8326	1.3537
No log	2.1538	84	1.3364	0.1875	1.3364	1.1560
No log	2.2051	86	1.0841	0.2835	1.0841	1.0412
No log	2.2564	88	1.0801	0.2346	1.0801	1.0393
No log	2.3077	90	1.0832	0.3174	1.0832	1.0408
No log	2.3590	92	1.1993	0.2537	1.1993	1.0951
No log	2.4103	94	1.5409	0.0449	1.5409	1.2413
No log	2.4615	96	1.9405	0.1246	1.9405	1.3930
No log	2.5128	98	2.0149	0.1667	2.0149	1.4195
No log	2.5641	100	1.6173	0.1329	1.6173	1.2717
No log	2.6154	102	1.1080	0.2988	1.1080	1.0526
No log	2.6667	104	1.0373	0.4097	1.0373	1.0185
No log	2.7179	106	1.0674	0.2233	1.0674	1.0332
No log	2.7692	108	1.0328	0.4097	1.0328	1.0163
No log	2.8205	110	1.1898	0.2040	1.1898	1.0908
No log	2.8718	112	1.3829	0.2321	1.3829	1.1760
No log	2.9231	114	1.2679	0.2644	1.2679	1.1260
No log	2.9744	116	1.2725	0.2364	1.2725	1.1280
No log	3.0256	118	1.3653	0.2321	1.3653	1.1684
No log	3.0769	120	1.2471	0.2398	1.2471	1.1167
No log	3.1282	122	1.1449	0.3329	1.1449	1.0700
No log	3.1795	124	1.2456	0.3404	1.2456	1.1161
No log	3.2308	126	1.2778	0.2943	1.2778	1.1304
No log	3.2821	128	1.2920	0.2685	1.2920	1.1367
No log	3.3333	130	1.3942	0.2392	1.3942	1.1808
No log	3.3846	132	1.5321	0.0961	1.5321	1.2378
No log	3.4359	134	1.3867	0.1700	1.3867	1.1776
No log	3.4872	136	1.3248	0.1601	1.3248	1.1510
No log	3.5385	138	1.1810	0.1747	1.1810	1.0867
No log	3.5897	140	1.1496	0.2231	1.1496	1.0722
No log	3.6410	142	1.1660	0.2111	1.1660	1.0798
No log	3.6923	144	1.4705	0.2520	1.4705	1.2126
No log	3.7436	146	1.7146	0.1582	1.7146	1.3094
No log	3.7949	148	1.5457	0.2983	1.5457	1.2433
No log	3.8462	150	1.3443	0.3006	1.3443	1.1594
No log	3.8974	152	1.2079	0.2055	1.2079	1.0990
No log	3.9487	154	1.1498	0.1714	1.1498	1.0723
No log	4.0	156	1.1495	0.2349	1.1495	1.0722
No log	4.0513	158	1.1931	0.2276	1.1931	1.0923
No log	4.1026	160	1.2481	0.2337	1.2481	1.1172
No log	4.1538	162	1.3615	0.1965	1.3615	1.1668
No log	4.2051	164	1.3275	0.2100	1.3275	1.1522
No log	4.2564	166	1.2107	0.2777	1.2107	1.1003
No log	4.3077	168	1.1544	0.2795	1.1544	1.0744
No log	4.3590	170	1.1604	0.2795	1.1604	1.0772
No log	4.4103	172	1.1993	0.2844	1.1993	1.0951
No log	4.4615	174	1.2099	0.2685	1.2099	1.1000
No log	4.5128	176	1.1950	0.2988	1.1950	1.0932
No log	4.5641	178	1.1493	0.3445	1.1493	1.0721
No log	4.6154	180	1.1506	0.3303	1.1506	1.0726
No log	4.6667	182	1.2113	0.2824	1.2113	1.1006
No log	4.7179	184	1.3985	0.1830	1.3985	1.1826
No log	4.7692	186	1.2928	0.2544	1.2928	1.1370
No log	4.8205	188	1.1770	0.2349	1.1770	1.0849
No log	4.8718	190	1.1736	0.2349	1.1736	1.0833
No log	4.9231	192	1.2026	0.2651	1.2026	1.0966
No log	4.9744	194	1.3341	0.1913	1.3341	1.1550
No log	5.0256	196	1.2804	0.1773	1.2804	1.1315
No log	5.0769	198	1.1731	0.2637	1.1731	1.0831
No log	5.1282	200	1.1846	0.2353	1.1846	1.0884
No log	5.1795	202	1.2157	0.2546	1.2157	1.1026
No log	5.2308	204	1.2531	0.2236	1.2531	1.1194
No log	5.2821	206	1.4222	0.1492	1.4222	1.1926
No log	5.3333	208	1.4656	0.0975	1.4656	1.2106
No log	5.3846	210	1.3487	0.1803	1.3487	1.1613
No log	5.4359	212	1.2844	0.2458	1.2844	1.1333
No log	5.4872	214	1.2350	0.2634	1.2350	1.1113
No log	5.5385	216	1.3081	0.1456	1.3081	1.1437
No log	5.5897	218	1.3515	0.1768	1.3515	1.1625
No log	5.6410	220	1.1916	0.2546	1.1916	1.0916
No log	5.6923	222	1.1365	0.3382	1.1365	1.0661
No log	5.7436	224	1.1270	0.2601	1.1270	1.0616
No log	5.7949	226	1.1193	0.2278	1.1193	1.0580
No log	5.8462	228	1.1472	0.2461	1.1472	1.0711
No log	5.8974	230	1.2228	0.2501	1.2228	1.1058
No log	5.9487	232	1.2099	0.2452	1.2099	1.1000
No log	6.0	234	1.1699	0.2495	1.1699	1.0816
No log	6.0513	236	1.1801	0.2495	1.1801	1.0863
No log	6.1026	238	1.2427	0.2311	1.2427	1.1148
No log	6.1538	240	1.4077	0.1565	1.4077	1.1865
No log	6.2051	242	1.4753	0.0982	1.4753	1.2146
No log	6.2564	244	1.3870	0.1512	1.3870	1.1777
No log	6.3077	246	1.3592	0.1858	1.3592	1.1658
No log	6.3590	248	1.2543	0.1882	1.2543	1.1199
No log	6.4103	250	1.2754	0.2026	1.2754	1.1293
No log	6.4615	252	1.4083	0.1527	1.4083	1.1867
No log	6.5128	254	1.4146	0.1289	1.4146	1.1894
No log	6.5641	256	1.3248	0.1321	1.3248	1.1510
No log	6.6154	258	1.2944	0.1598	1.2944	1.1377
No log	6.6667	260	1.2562	0.1691	1.2562	1.1208
No log	6.7179	262	1.2202	0.2417	1.2202	1.1046
No log	6.7692	264	1.2138	0.2417	1.2138	1.1017
No log	6.8205	266	1.2655	0.1785	1.2655	1.1250
No log	6.8718	268	1.3131	0.1080	1.3131	1.1459
No log	6.9231	270	1.2931	0.1080	1.2931	1.1372
No log	6.9744	272	1.1986	0.1598	1.1986	1.0948
No log	7.0256	274	1.1403	0.2499	1.1403	1.0679
No log	7.0769	276	1.1281	0.3552	1.1281	1.0621
No log	7.1282	278	1.1633	0.2588	1.1633	1.0785
No log	7.1795	280	1.2514	0.2131	1.2514	1.1187
No log	7.2308	282	1.2411	0.2170	1.2411	1.1141
No log	7.2821	284	1.1540	0.2728	1.1540	1.0742
No log	7.3333	286	1.1309	0.3573	1.1309	1.0635
No log	7.3846	288	1.1288	0.3771	1.1288	1.0625
No log	7.4359	290	1.1466	0.2694	1.1466	1.0708
No log	7.4872	292	1.2009	0.2760	1.2009	1.0959
No log	7.5385	294	1.1773	0.1557	1.1773	1.0850
No log	7.5897	296	1.1384	0.2409	1.1384	1.0670
No log	7.6410	298	1.1436	0.1960	1.1436	1.0694
No log	7.6923	300	1.1350	0.2346	1.1350	1.0654
No log	7.7436	302	1.1388	0.2346	1.1388	1.0671
No log	7.7949	304	1.1442	0.2268	1.1442	1.0697
No log	7.8462	306	1.2235	0.2328	1.2235	1.1061
No log	7.8974	308	1.2189	0.2328	1.2189	1.1041
No log	7.9487	310	1.1355	0.2409	1.1355	1.0656
No log	8.0	312	1.1105	0.2592	1.1105	1.0538
No log	8.0513	314	1.1015	0.2991	1.1015	1.0495
No log	8.1026	316	1.1182	0.2843	1.1182	1.0574
No log	8.1538	318	1.0976	0.3283	1.0976	1.0477
No log	8.2051	320	1.0753	0.2145	1.0753	1.0369
No log	8.2564	322	1.0793	0.1935	1.0793	1.0389
No log	8.3077	324	1.0942	0.1834	1.0942	1.0461
No log	8.3590	326	1.1449	0.1779	1.1449	1.0700
No log	8.4103	328	1.2597	0.2750	1.2597	1.1224
No log	8.4615	330	1.2437	0.2748	1.2437	1.1152
No log	8.5128	332	1.1653	0.2757	1.1653	1.0795
No log	8.5641	334	1.1684	0.2863	1.1684	1.0809
No log	8.6154	336	1.1650	0.2757	1.1650	1.0794
No log	8.6667	338	1.2112	0.2261	1.2112	1.1005
No log	8.7179	340	1.2118	0.2261	1.2118	1.1008
No log	8.7692	342	1.1669	0.2539	1.1669	1.0802
No log	8.8205	344	1.1440	0.2757	1.1440	1.0696
No log	8.8718	346	1.1394	0.2567	1.1394	1.0674
No log	8.9231	348	1.1466	0.2368	1.1466	1.0708
No log	8.9744	350	1.1587	0.2907	1.1587	1.0764
No log	9.0256	352	1.1623	0.2907	1.1623	1.0781
No log	9.0769	354	1.1646	0.2278	1.1646	1.0792
No log	9.1282	356	1.2033	0.2777	1.2033	1.0970
No log	9.1795	358	1.2086	0.2777	1.2086	1.0994
No log	9.2308	360	1.1939	0.2777	1.1939	1.0926
No log	9.2821	362	1.1859	0.1974	1.1859	1.0890
No log	9.3333	364	1.2144	0.2353	1.2144	1.1020
No log	9.3846	366	1.2873	0.2560	1.2873	1.1346
No log	9.4359	368	1.3156	0.2560	1.3156	1.1470
No log	9.4872	370	1.2767	0.2417	1.2767	1.1299
No log	9.5385	372	1.2281	0.2489	1.2281	1.1082
No log	9.5897	374	1.2229	0.2105	1.2229	1.1058
No log	9.6410	376	1.2809	0.1982	1.2809	1.1318
No log	9.6923	378	1.3289	0.1950	1.3289	1.1528
No log	9.7436	380	1.3996	0.1686	1.3996	1.1831
No log	9.7949	382	1.4750	0.0953	1.4750	1.2145
No log	9.8462	384	1.3766	0.1773	1.3766	1.1733
No log	9.8974	386	1.2165	0.2007	1.2165	1.1030
No log	9.9487	388	1.1961	0.2242	1.1961	1.0937
No log	10.0	390	1.1959	0.1895	1.1959	1.0936
No log	10.0513	392	1.2524	0.2276	1.2524	1.1191
No log	10.1026	394	1.3799	0.1880	1.3799	1.1747
No log	10.1538	396	1.4153	0.1796	1.4153	1.1897
No log	10.2051	398	1.3003	0.1898	1.3003	1.1403
No log	10.2564	400	1.2189	0.2572	1.2189	1.1040
No log	10.3077	402	1.2228	0.2065	1.2228	1.1058
No log	10.3590	404	1.3203	0.1671	1.3203	1.1490
No log	10.4103	406	1.3373	0.1636	1.3373	1.1564
No log	10.4615	408	1.3053	0.1779	1.3053	1.1425
No log	10.5128	410	1.2523	0.1711	1.2523	1.1190
No log	10.5641	412	1.2030	0.1505	1.2030	1.0968
No log	10.6154	414	1.2371	0.1761	1.2371	1.1122
No log	10.6667	416	1.2143	0.1797	1.2143	1.1019
No log	10.7179	418	1.1758	0.2823	1.1758	1.0844
No log	10.7692	420	1.2046	0.1974	1.2046	1.0976
No log	10.8205	422	1.2700	0.2084	1.2700	1.1269
No log	10.8718	424	1.3285	0.2484	1.3285	1.1526
No log	10.9231	426	1.3207	0.2484	1.3207	1.1492
No log	10.9744	428	1.2581	0.1667	1.2581	1.1217
No log	11.0256	430	1.1595	0.2310	1.1595	1.0768
No log	11.0769	432	1.1332	0.2314	1.1332	1.0645
No log	11.1282	434	1.1318	0.2628	1.1318	1.0638
No log	11.1795	436	1.1462	0.2372	1.1462	1.0706
No log	11.2308	438	1.1541	0.1943	1.1541	1.0743
No log	11.2821	440	1.2257	0.2280	1.2257	1.1071
No log	11.3333	442	1.2329	0.2280	1.2329	1.1104
No log	11.3846	444	1.1676	0.2232	1.1676	1.0806
No log	11.4359	446	1.1000	0.3363	1.1000	1.0488
No log	11.4872	448	1.1040	0.3373	1.1040	1.0507
No log	11.5385	450	1.1120	0.2605	1.1120	1.0545
No log	11.5897	452	1.1249	0.2273	1.1249	1.0606
No log	11.6410	454	1.1308	0.2467	1.1308	1.0634
No log	11.6923	456	1.1327	0.2467	1.1327	1.0643
No log	11.7436	458	1.0951	0.3059	1.0951	1.0465
No log	11.7949	460	1.0879	0.2871	1.0879	1.0430
No log	11.8462	462	1.0977	0.2871	1.0977	1.0477
No log	11.8974	464	1.1129	0.3458	1.1129	1.0549
No log	11.9487	466	1.1502	0.2712	1.1502	1.0725
No log	12.0	468	1.1726	0.2561	1.1726	1.0829
No log	12.0513	470	1.2221	0.2699	1.2221	1.1055
No log	12.1026	472	1.2298	0.2699	1.2298	1.1090
No log	12.1538	474	1.2190	0.2699	1.2190	1.1041
No log	12.2051	476	1.2751	0.2094	1.2751	1.1292
No log	12.2564	478	1.3431	0.1785	1.3431	1.1589
No log	12.3077	480	1.2610	0.1734	1.2610	1.1230
No log	12.3590	482	1.2312	0.1803	1.2312	1.1096
No log	12.4103	484	1.2129	0.2234	1.2129	1.1013
No log	12.4615	486	1.1944	0.2168	1.1944	1.0929
No log	12.5128	488	1.2122	0.2180	1.2122	1.1010
No log	12.5641	490	1.2669	0.1436	1.2669	1.1256
No log	12.6154	492	1.3058	0.1144	1.3058	1.1427
No log	12.6667	494	1.3152	0.1458	1.3152	1.1468
No log	12.7179	496	1.2887	0.1458	1.2887	1.1352
No log	12.7692	498	1.2477	0.1862	1.2477	1.1170
0.3138	12.8205	500	1.1951	0.2532	1.1951	1.0932
0.3138	12.8718	502	1.1589	0.2424	1.1589	1.0765
0.3138	12.9231	504	1.1644	0.2424	1.1644	1.0791
0.3138	12.9744	506	1.1905	0.2892	1.1905	1.0911
0.3138	13.0256	508	1.2498	0.2040	1.2498	1.1179
0.3138	13.0769	510	1.2799	0.1720	1.2799	1.1313
0.3138	13.1282	512	1.2324	0.2311	1.2324	1.1101
0.3138	13.1795	514	1.1775	0.1693	1.1775	1.0851
0.3138	13.2308	516	1.1724	0.1893	1.1724	1.0828

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1