ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1524
• Qwk: 0.2333
• Mse: 1.1524
• Rmse: 1.0735

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.7675	-0.0132	4.7675	2.1835
No log	0.1818	4	3.2240	-0.0519	3.2240	1.7955
No log	0.2727	6	1.8290	0.0062	1.8290	1.3524
No log	0.3636	8	2.2828	-0.0124	2.2828	1.5109
No log	0.4545	10	2.5386	-0.0133	2.5386	1.5933
No log	0.5455	12	1.5646	0.0757	1.5646	1.2509
No log	0.6364	14	1.3190	0.0741	1.3190	1.1485
No log	0.7273	16	1.3131	0.1080	1.3131	1.1459
No log	0.8182	18	1.4108	0.0185	1.4108	1.1878
No log	0.9091	20	1.7274	0.0372	1.7274	1.3143
No log	1.0	22	1.8817	0.1060	1.8817	1.3717
No log	1.0909	24	1.9660	0.0982	1.9660	1.4021
No log	1.1818	26	2.2209	0.0881	2.2209	1.4903
No log	1.2727	28	1.8709	0.0862	1.8709	1.3678
No log	1.3636	30	1.4539	0.1371	1.4539	1.2058
No log	1.4545	32	1.1974	0.1809	1.1974	1.0942
No log	1.5455	34	1.1791	0.1809	1.1791	1.0859
No log	1.6364	36	1.2801	0.1772	1.2801	1.1314
No log	1.7273	38	1.3607	0.2304	1.3607	1.1665
No log	1.8182	40	1.6046	0.0749	1.6046	1.2667
No log	1.9091	42	1.4872	0.1726	1.4872	1.2195
No log	2.0	44	1.5778	0.1248	1.5778	1.2561
No log	2.0909	46	1.4881	0.1907	1.4881	1.2199
No log	2.1818	48	1.5215	0.1571	1.5215	1.2335
No log	2.2727	50	1.4280	0.2693	1.4280	1.1950
No log	2.3636	52	1.3818	0.2503	1.3818	1.1755
No log	2.4545	54	1.1958	0.1950	1.1958	1.0935
No log	2.5455	56	1.3104	0.2405	1.3104	1.1447
No log	2.6364	58	1.2373	0.2280	1.2373	1.1123
No log	2.7273	60	1.3554	0.2747	1.3554	1.1642
No log	2.8182	62	1.3759	0.2747	1.3759	1.1730
No log	2.9091	64	1.6042	0.2345	1.6042	1.2666
No log	3.0	66	1.3719	0.2289	1.3719	1.1713
No log	3.0909	68	1.1840	0.1858	1.1840	1.0881
No log	3.1818	70	1.1383	0.2622	1.1383	1.0669
No log	3.2727	72	1.2511	0.2015	1.2511	1.1185
No log	3.3636	74	1.3099	0.2405	1.3099	1.1445
No log	3.4545	76	1.4401	0.2677	1.4401	1.2001
No log	3.5455	78	1.3738	0.2321	1.3738	1.1721
No log	3.6364	80	1.4141	0.2029	1.4141	1.1892
No log	3.7273	82	1.2330	0.1928	1.2330	1.1104
No log	3.8182	84	1.1546	0.2797	1.1546	1.0745
No log	3.9091	86	1.1416	0.2644	1.1416	1.0685
No log	4.0	88	1.2814	0.2399	1.2814	1.1320
No log	4.0909	90	1.7535	0.2092	1.7535	1.3242
No log	4.1818	92	1.8483	0.2092	1.8483	1.3595
No log	4.2727	94	1.4411	0.2680	1.4411	1.2005
No log	4.3636	96	1.0034	0.2815	1.0034	1.0017
No log	4.4545	98	0.9503	0.4321	0.9503	0.9748
No log	4.5455	100	0.9388	0.3970	0.9388	0.9689
No log	4.6364	102	0.9653	0.2786	0.9653	0.9825
No log	4.7273	104	1.1187	0.3088	1.1187	1.0577
No log	4.8182	106	1.2658	0.3725	1.2658	1.1251
No log	4.9091	108	1.1670	0.3458	1.1670	1.0803
No log	5.0	110	0.9842	0.3783	0.9842	0.9921
No log	5.0909	112	0.9069	0.3852	0.9069	0.9523
No log	5.1818	114	0.9169	0.4794	0.9169	0.9575
No log	5.2727	116	1.1085	0.4329	1.1085	1.0528
No log	5.3636	118	1.6140	0.3043	1.6140	1.2704
No log	5.4545	120	1.6094	0.3154	1.6094	1.2686
No log	5.5455	122	1.3025	0.4306	1.3025	1.1413
No log	5.6364	124	1.0491	0.4492	1.0491	1.0242
No log	5.7273	126	0.9036	0.4681	0.9036	0.9506
No log	5.8182	128	0.9234	0.4265	0.9234	0.9609
No log	5.9091	130	0.9941	0.4103	0.9941	0.9971
No log	6.0	132	1.0993	0.3959	1.0993	1.0485
No log	6.0909	134	1.1319	0.3574	1.1319	1.0639
No log	6.1818	136	1.0521	0.3115	1.0521	1.0257
No log	6.2727	138	1.0132	0.3908	1.0132	1.0066
No log	6.3636	140	1.0482	0.5102	1.0482	1.0238
No log	6.4545	142	1.2636	0.4254	1.2636	1.1241
No log	6.5455	144	1.4434	0.3833	1.4434	1.2014
No log	6.6364	146	1.2426	0.4085	1.2426	1.1147
No log	6.7273	148	1.0595	0.5387	1.0595	1.0293
No log	6.8182	150	1.0095	0.4952	1.0095	1.0047
No log	6.9091	152	1.0350	0.4810	1.0350	1.0174
No log	7.0	154	1.1588	0.4216	1.1588	1.0765
No log	7.0909	156	1.2475	0.3793	1.2475	1.1169
No log	7.1818	158	1.1774	0.4216	1.1774	1.0851
No log	7.2727	160	1.0280	0.4554	1.0280	1.0139
No log	7.3636	162	1.0132	0.4677	1.0132	1.0066
No log	7.4545	164	1.1029	0.4817	1.1029	1.0502
No log	7.5455	166	1.1454	0.4939	1.1454	1.0702
No log	7.6364	168	1.0650	0.3975	1.0650	1.0320
No log	7.7273	170	1.0925	0.4681	1.0925	1.0452
No log	7.8182	172	1.0857	0.3554	1.0857	1.0420
No log	7.9091	174	1.0259	0.3964	1.0259	1.0129
No log	8.0	176	1.0094	0.4007	1.0094	1.0047
No log	8.0909	178	0.9584	0.4122	0.9584	0.9790
No log	8.1818	180	0.9688	0.3443	0.9688	0.9843
No log	8.2727	182	1.0916	0.3475	1.0916	1.0448
No log	8.3636	184	1.3985	0.3894	1.3985	1.1826
No log	8.4545	186	1.5982	0.2768	1.5982	1.2642
No log	8.5455	188	1.3505	0.3455	1.3505	1.1621
No log	8.6364	190	1.1777	0.4186	1.1777	1.0852
No log	8.7273	192	1.0605	0.5364	1.0605	1.0298
No log	8.8182	194	1.0419	0.5175	1.0419	1.0207
No log	8.9091	196	1.1052	0.3462	1.1052	1.0513
No log	9.0	198	1.1514	0.3160	1.1514	1.0730
No log	9.0909	200	1.2356	0.3574	1.2356	1.1116
No log	9.1818	202	1.1524	0.3291	1.1524	1.0735
No log	9.2727	204	1.0098	0.2892	1.0098	1.0049
No log	9.3636	206	0.9818	0.4084	0.9818	0.9909
No log	9.4545	208	0.9999	0.3500	0.9999	1.0000
No log	9.5455	210	1.1766	0.3416	1.1766	1.0847
No log	9.6364	212	1.6463	0.2530	1.6463	1.2831
No log	9.7273	214	1.6508	0.2598	1.6508	1.2848
No log	9.8182	216	1.2655	0.3403	1.2655	1.1250
No log	9.9091	218	1.0383	0.3775	1.0383	1.0190
No log	10.0	220	0.9751	0.4066	0.9751	0.9875
No log	10.0909	222	0.9832	0.3250	0.9832	0.9916
No log	10.1818	224	1.1566	0.3363	1.1566	1.0755
No log	10.2727	226	1.3615	0.3258	1.3615	1.1668
No log	10.3636	228	1.3871	0.3258	1.3871	1.1777
No log	10.4545	230	1.1925	0.3537	1.1925	1.0920
No log	10.5455	232	1.0757	0.2324	1.0757	1.0372
No log	10.6364	234	1.0141	0.2864	1.0141	1.0070
No log	10.7273	236	1.0728	0.2844	1.0728	1.0357
No log	10.8182	238	1.2129	0.3291	1.2129	1.1013
No log	10.9091	240	1.2575	0.3726	1.2575	1.1214
No log	11.0	242	1.1740	0.3117	1.1740	1.0835
No log	11.0909	244	1.2309	0.3416	1.2309	1.1095
No log	11.1818	246	1.2285	0.3706	1.2285	1.1084
No log	11.2727	248	1.2782	0.3706	1.2782	1.1306
No log	11.3636	250	1.2269	0.3706	1.2269	1.1076
No log	11.4545	252	1.1763	0.3449	1.1763	1.0846
No log	11.5455	254	1.0484	0.2913	1.0484	1.0239
No log	11.6364	256	1.0220	0.3541	1.0220	1.0109
No log	11.7273	258	1.0630	0.2917	1.0630	1.0310
No log	11.8182	260	1.1085	0.3805	1.1085	1.0528
No log	11.9091	262	1.0949	0.4053	1.0949	1.0464
No log	12.0	264	1.2140	0.3265	1.2140	1.1018
No log	12.0909	266	1.2844	0.3898	1.2844	1.1333
No log	12.1818	268	1.1914	0.3559	1.1914	1.0915
No log	12.2727	270	1.1061	0.3595	1.1061	1.0517
No log	12.3636	272	1.1962	0.3559	1.1962	1.0937
No log	12.4545	274	1.3601	0.3527	1.3601	1.1662
No log	12.5455	276	1.3285	0.3865	1.3285	1.1526
No log	12.6364	278	1.2346	0.3429	1.2346	1.1111
No log	12.7273	280	1.1590	0.2923	1.1590	1.0766
No log	12.8182	282	1.1347	0.2857	1.1347	1.0652
No log	12.9091	284	1.1636	0.3171	1.1636	1.0787
No log	13.0	286	1.3000	0.2962	1.3000	1.1402
No log	13.0909	288	1.2437	0.3309	1.2437	1.1152
No log	13.1818	290	1.1496	0.3642	1.1496	1.0722
No log	13.2727	292	1.1995	0.3487	1.1995	1.0952
No log	13.3636	294	1.2781	0.3106	1.2781	1.1306
No log	13.4545	296	1.4423	0.3779	1.4423	1.2010
No log	13.5455	298	1.5683	0.3038	1.5683	1.2523
No log	13.6364	300	1.5016	0.3439	1.5016	1.2254
No log	13.7273	302	1.3265	0.3152	1.3265	1.1517
No log	13.8182	304	1.1316	0.2361	1.1316	1.0637
No log	13.9091	306	1.0741	0.1935	1.0741	1.0364
No log	14.0	308	1.1232	0.2085	1.1232	1.0598
No log	14.0909	310	1.2304	0.2807	1.2304	1.1093
No log	14.1818	312	1.2950	0.3127	1.2950	1.1380
No log	14.2727	314	1.1837	0.3179	1.1837	1.0880
No log	14.3636	316	1.0720	0.1935	1.0720	1.0354
No log	14.4545	318	1.0566	0.2372	1.0566	1.0279
No log	14.5455	320	1.1067	0.3137	1.1067	1.0520
No log	14.6364	322	1.2376	0.3621	1.2376	1.1125
No log	14.7273	324	1.3257	0.3703	1.3257	1.1514
No log	14.8182	326	1.2694	0.3785	1.2694	1.1267
No log	14.9091	328	1.2564	0.3785	1.2564	1.1209
No log	15.0	330	1.2156	0.4267	1.2156	1.1026
No log	15.0909	332	1.1748	0.3687	1.1748	1.0839
No log	15.1818	334	1.1752	0.3687	1.1752	1.0841
No log	15.2727	336	1.2486	0.3785	1.2486	1.1174
No log	15.3636	338	1.2796	0.3902	1.2796	1.1312
No log	15.4545	340	1.2307	0.3416	1.2307	1.1093
No log	15.5455	342	1.1706	0.3179	1.1706	1.0820
No log	15.6364	344	1.1690	0.3092	1.1690	1.0812
No log	15.7273	346	1.1618	0.3092	1.1618	1.0779
No log	15.8182	348	1.1151	0.3179	1.1151	1.0560
No log	15.9091	350	1.1579	0.3449	1.1579	1.0761
No log	16.0	352	1.2434	0.3658	1.2434	1.1151
No log	16.0909	354	1.3234	0.3902	1.3234	1.1504
No log	16.1818	356	1.3190	0.3941	1.3190	1.1485
No log	16.2727	358	1.2256	0.3621	1.2256	1.1071
No log	16.3636	360	1.1131	0.3547	1.1131	1.0550
No log	16.4545	362	1.0876	0.2857	1.0876	1.0429
No log	16.5455	364	1.0629	0.2989	1.0629	1.0310
No log	16.6364	366	1.0832	0.3255	1.0832	1.0408
No log	16.7273	368	1.0671	0.2467	1.0671	1.0330
No log	16.8182	370	1.1171	0.2516	1.1171	1.0569
No log	16.9091	372	1.1232	0.2516	1.1232	1.0598
No log	17.0	374	1.1546	0.2657	1.1546	1.0745
No log	17.0909	376	1.2017	0.2780	1.2017	1.0962
No log	17.1818	378	1.2964	0.3117	1.2964	1.1386
No log	17.2727	380	1.2339	0.3092	1.2339	1.1108
No log	17.3636	382	1.1390	0.2940	1.1390	1.0672
No log	17.4545	384	1.1960	0.3031	1.1960	1.0936
No log	17.5455	386	1.4334	0.3604	1.4334	1.1973
No log	17.6364	388	1.5091	0.2690	1.5091	1.2285
No log	17.7273	390	1.5072	0.2628	1.5072	1.2277
No log	17.8182	392	1.3043	0.3087	1.3043	1.1421
No log	17.9091	394	1.1684	0.2870	1.1684	1.0809
No log	18.0	396	1.1403	0.2501	1.1403	1.0678
No log	18.0909	398	1.2346	0.2962	1.2346	1.1111
No log	18.1818	400	1.4595	0.3022	1.4595	1.2081
No log	18.2727	402	1.5289	0.2717	1.5289	1.2365
No log	18.3636	404	1.3341	0.3210	1.3341	1.1550
No log	18.4545	406	1.1067	0.3262	1.1067	1.0520
No log	18.5455	408	1.0510	0.2374	1.0510	1.0252
No log	18.6364	410	1.0497	0.2468	1.0497	1.0246
No log	18.7273	412	1.0689	0.2963	1.0689	1.0339
No log	18.8182	414	1.1786	0.3028	1.1786	1.0856
No log	18.9091	416	1.3202	0.3022	1.3202	1.1490
No log	19.0	418	1.3998	0.3039	1.3998	1.1831
No log	19.0909	420	1.2852	0.3002	1.2852	1.1337
No log	19.1818	422	1.1532	0.2516	1.1532	1.0738
No log	19.2727	424	1.1036	0.2718	1.1036	1.0505
No log	19.3636	426	1.0959	0.2572	1.0959	1.0469
No log	19.4545	428	1.1310	0.2439	1.1310	1.0635
No log	19.5455	430	1.2298	0.3220	1.2298	1.1090
No log	19.6364	432	1.3323	0.3135	1.3323	1.1543
No log	19.7273	434	1.3242	0.3403	1.3242	1.1507
No log	19.8182	436	1.2411	0.3368	1.2411	1.1141
No log	19.9091	438	1.1596	0.3484	1.1596	1.0769
No log	20.0	440	1.1784	0.3179	1.1784	1.0855
No log	20.0909	442	1.3258	0.3171	1.3258	1.1514
No log	20.1818	444	1.4257	0.3019	1.4257	1.1940
No log	20.2727	446	1.3590	0.2638	1.3590	1.1658
No log	20.3636	448	1.1567	0.2337	1.1567	1.0755
No log	20.4545	450	1.0801	0.2289	1.0801	1.0393
No log	20.5455	452	1.1151	0.2191	1.1151	1.0560
No log	20.6364	454	1.2631	0.1587	1.2631	1.1239
No log	20.7273	456	1.3075	0.2024	1.3075	1.1435
No log	20.8182	458	1.2371	0.1530	1.2371	1.1123
No log	20.9091	460	1.1474	0.2095	1.1474	1.0712
No log	21.0	462	1.1416	0.2095	1.1416	1.0684
No log	21.0909	464	1.2274	0.3160	1.2274	1.1079
No log	21.1818	466	1.2368	0.3160	1.2368	1.1121
No log	21.2727	468	1.2089	0.2807	1.2089	1.0995
No log	21.3636	470	1.2443	0.3742	1.2443	1.1155
No log	21.4545	472	1.4279	0.3663	1.4279	1.1949
No log	21.5455	474	1.5042	0.3131	1.5042	1.2264
No log	21.6364	476	1.3778	0.4052	1.3779	1.1738
No log	21.7273	478	1.1789	0.2191	1.1789	1.0858
No log	21.8182	480	1.0740	0.2234	1.0740	1.0364
No log	21.9091	482	1.0522	0.1728	1.0522	1.0258
No log	22.0	484	1.0688	0.1830	1.0688	1.0338
No log	22.0909	486	1.1584	0.2285	1.1584	1.0763
No log	22.1818	488	1.2472	0.2565	1.2472	1.1168
No log	22.2727	490	1.2770	0.2982	1.2770	1.1300
No log	22.3636	492	1.2015	0.2825	1.2015	1.0961
No log	22.4545	494	1.1180	0.2870	1.1180	1.0574
No log	22.5455	496	1.1172	0.3121	1.1172	1.0570
No log	22.6364	498	1.1348	0.3314	1.1348	1.0653
0.294	22.7273	500	1.2142	0.3363	1.2142	1.1019
0.294	22.8182	502	1.2704	0.3370	1.2704	1.1271
0.294	22.9091	504	1.2758	0.3108	1.2758	1.1295
0.294	23.0	506	1.3136	0.3215	1.3136	1.1461
0.294	23.0909	508	1.2883	0.2807	1.2883	1.1350
0.294	23.1818	510	1.2417	0.2554	1.2417	1.1143
0.294	23.2727	512	1.1524	0.2333	1.1524	1.0735

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1