ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0297
• Qwk: 0.2857
• Mse: 1.0297
• Rmse: 1.0147

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	4.3163	-0.0197	4.3163	2.0776
No log	0.1111	4	2.5626	0.0390	2.5626	1.6008
No log	0.1667	6	1.9546	0.0123	1.9546	1.3981
No log	0.2222	8	1.3832	0.1145	1.3832	1.1761
No log	0.2778	10	1.2036	0.1379	1.2036	1.0971
No log	0.3333	12	1.2908	0.0771	1.2908	1.1361
No log	0.3889	14	2.1420	0.0110	2.1420	1.4636
No log	0.4444	16	2.6660	-0.0706	2.6660	1.6328
No log	0.5	18	1.9254	0.0749	1.9254	1.3876
No log	0.5556	20	1.2952	-0.0632	1.2952	1.1381
No log	0.6111	22	1.2216	0.0513	1.2216	1.1053
No log	0.6667	24	1.2155	0.1424	1.2155	1.1025
No log	0.7222	26	1.1503	0.0608	1.1503	1.0725
No log	0.7778	28	1.3782	0.1303	1.3782	1.1740
No log	0.8333	30	1.9815	0.0816	1.9815	1.4077
No log	0.8889	32	2.1808	0.0878	2.1808	1.4768
No log	0.9444	34	1.8718	0.1464	1.8718	1.3681
No log	1.0	36	1.6575	0.1878	1.6575	1.2875
No log	1.0556	38	1.4900	0.2021	1.4900	1.2207
No log	1.1111	40	1.4539	0.2021	1.4539	1.2058
No log	1.1667	42	1.6556	0.1560	1.6556	1.2867
No log	1.2222	44	1.6328	0.2124	1.6328	1.2778
No log	1.2778	46	1.3693	0.1872	1.3693	1.1702
No log	1.3333	48	1.3117	0.1659	1.3117	1.1453
No log	1.3889	50	1.6572	0.1929	1.6572	1.2873
No log	1.4444	52	1.9929	0.0976	1.9929	1.4117
No log	1.5	54	2.1804	0.1035	2.1804	1.4766
No log	1.5556	56	1.5955	0.2309	1.5955	1.2631
No log	1.6111	58	1.1529	0.1935	1.1529	1.0737
No log	1.6667	60	1.1021	0.2103	1.1021	1.0498
No log	1.7222	62	1.1750	0.2712	1.1750	1.0840
No log	1.7778	64	1.6610	0.1530	1.6610	1.2888
No log	1.8333	66	2.0356	0.1123	2.0356	1.4268
No log	1.8889	68	2.1231	0.1830	2.1231	1.4571
No log	1.9444	70	1.7522	0.1583	1.7522	1.3237
No log	2.0	72	1.2316	0.2568	1.2316	1.1098
No log	2.0556	74	1.0514	0.1667	1.0514	1.0254
No log	2.1111	76	1.1817	0.2886	1.1817	1.0871
No log	2.1667	78	1.2128	0.3584	1.2128	1.1013
No log	2.2222	80	1.1867	0.3482	1.1867	1.0894
No log	2.2778	82	1.7391	0.1583	1.7391	1.3187
No log	2.3333	84	1.8295	0.1661	1.8295	1.3526
No log	2.3889	86	1.4488	0.2822	1.4488	1.2037
No log	2.4444	88	1.2281	0.2611	1.2281	1.1082
No log	2.5	90	1.2179	0.2647	1.2179	1.1036
No log	2.5556	92	1.3186	0.1751	1.3186	1.1483
No log	2.6111	94	1.3227	0.1648	1.3227	1.1501
No log	2.6667	96	1.1942	0.1871	1.1942	1.0928
No log	2.7222	98	1.1900	0.1715	1.1900	1.0909
No log	2.7778	100	1.3274	0.2480	1.3274	1.1521
No log	2.8333	102	1.5069	0.1820	1.5069	1.2275
No log	2.8889	104	1.4065	0.1761	1.4065	1.1860
No log	2.9444	106	1.2969	0.2144	1.2969	1.1388
No log	3.0	108	1.1552	0.2590	1.1552	1.0748
No log	3.0556	110	1.0973	0.3526	1.0973	1.0475
No log	3.1111	112	1.0761	0.3181	1.0761	1.0373
No log	3.1667	114	1.1442	0.2579	1.1442	1.0697
No log	3.2222	116	1.2231	0.2292	1.2231	1.1059
No log	3.2778	118	1.1344	0.2665	1.1344	1.0651
No log	3.3333	120	1.0717	0.2352	1.0717	1.0353
No log	3.3889	122	0.9790	0.2591	0.9790	0.9895
No log	3.4444	124	0.9809	0.2993	0.9809	0.9904
No log	3.5	126	0.9852	0.2742	0.9852	0.9926
No log	3.5556	128	0.9995	0.3427	0.9995	0.9998
No log	3.6111	130	1.0551	0.3175	1.0551	1.0272
No log	3.6667	132	1.1361	0.3379	1.1361	1.0659
No log	3.7222	134	1.1167	0.3389	1.1167	1.0568
No log	3.7778	136	1.0729	0.4134	1.0729	1.0358
No log	3.8333	138	1.0742	0.3736	1.0742	1.0364
No log	3.8889	140	1.0669	0.4013	1.0669	1.0329
No log	3.9444	142	1.1495	0.3010	1.1495	1.0722
No log	4.0	144	1.2355	0.2329	1.2355	1.1115
No log	4.0556	146	1.1164	0.3117	1.1164	1.0566
No log	4.1111	148	1.0342	0.3237	1.0342	1.0170
No log	4.1667	150	1.0034	0.4219	1.0034	1.0017
No log	4.2222	152	0.9852	0.3704	0.9852	0.9926
No log	4.2778	154	1.0451	0.3449	1.0451	1.0223
No log	4.3333	156	1.1298	0.2690	1.1298	1.0629
No log	4.3889	158	1.0333	0.2965	1.0333	1.0165
No log	4.4444	160	0.9705	0.3117	0.9705	0.9851
No log	4.5	162	0.9746	0.3112	0.9746	0.9872
No log	4.5556	164	1.0007	0.3753	1.0007	1.0004
No log	4.6111	166	1.0338	0.3243	1.0338	1.0167
No log	4.6667	168	1.1420	0.3501	1.1420	1.0687
No log	4.7222	170	1.1532	0.3524	1.1532	1.0739
No log	4.7778	172	1.1005	0.4149	1.1005	1.0490
No log	4.8333	174	1.1167	0.3282	1.1167	1.0568
No log	4.8889	176	1.2208	0.1950	1.2208	1.1049
No log	4.9444	178	1.1457	0.2650	1.1457	1.0704
No log	5.0	180	1.1025	0.2028	1.1025	1.0500
No log	5.0556	182	1.1147	0.2942	1.1147	1.0558
No log	5.1111	184	1.1564	0.3466	1.1564	1.0753
No log	5.1667	186	1.2453	0.2694	1.2453	1.1159
No log	5.2222	188	1.2445	0.2851	1.2445	1.1156
No log	5.2778	190	1.1631	0.2541	1.1631	1.0785
No log	5.3333	192	1.1412	0.2978	1.1412	1.0683
No log	5.3889	194	1.1579	0.2806	1.1579	1.0761
No log	5.4444	196	1.1177	0.2978	1.1177	1.0572
No log	5.5	198	1.1135	0.1415	1.1135	1.0552
No log	5.5556	200	1.1049	0.1885	1.1049	1.0512
No log	5.6111	202	1.1051	0.2068	1.1051	1.0513
No log	5.6667	204	1.1159	0.2068	1.1159	1.0563
No log	5.7222	206	1.1319	0.1837	1.1319	1.0639
No log	5.7778	208	1.1754	0.2519	1.1754	1.0842
No log	5.8333	210	1.2450	0.2823	1.2450	1.1158
No log	5.8889	212	1.2120	0.2883	1.2120	1.1009
No log	5.9444	214	1.2009	0.2984	1.2009	1.0959
No log	6.0	216	1.1824	0.2984	1.1824	1.0874
No log	6.0556	218	1.1651	0.2678	1.1651	1.0794
No log	6.1111	220	1.1798	0.2388	1.1798	1.0862
No log	6.1667	222	1.2498	0.2527	1.2498	1.1180
No log	6.2222	224	1.2128	0.2782	1.2128	1.1013
No log	6.2778	226	1.1871	0.2764	1.1871	1.0895
No log	6.3333	228	1.2879	0.3134	1.2879	1.1348
No log	6.3889	230	1.3371	0.3080	1.3371	1.1563
No log	6.4444	232	1.2923	0.3539	1.2923	1.1368
No log	6.5	234	1.3931	0.2363	1.3931	1.1803
No log	6.5556	236	1.4804	0.2021	1.4804	1.2167
No log	6.6111	238	1.3489	0.2398	1.3489	1.1614
No log	6.6667	240	1.2299	0.2025	1.2299	1.1090
No log	6.7222	242	1.1878	0.1327	1.1878	1.0899
No log	6.7778	244	1.1897	0.2482	1.1897	1.0907
No log	6.8333	246	1.2352	0.1753	1.2352	1.1114
No log	6.8889	248	1.3842	0.1831	1.3842	1.1765
No log	6.9444	250	1.5277	0.0589	1.5277	1.2360
No log	7.0	252	1.3892	0.1831	1.3892	1.1786
No log	7.0556	254	1.2157	0.2110	1.2157	1.1026
No log	7.1111	256	1.2721	0.2682	1.2721	1.1279
No log	7.1667	258	1.3865	0.2172	1.3865	1.1775
No log	7.2222	260	1.3496	0.2172	1.3496	1.1617
No log	7.2778	262	1.2307	0.1541	1.2307	1.1094
No log	7.3333	264	1.1739	0.1649	1.1739	1.0835
No log	7.3889	266	1.2513	0.2234	1.2513	1.1186
No log	7.4444	268	1.2630	0.2121	1.2630	1.1239
No log	7.5	270	1.1778	0.2073	1.1778	1.0853
No log	7.5556	272	1.1621	0.2482	1.1621	1.0780
No log	7.6111	274	1.1971	0.3192	1.1971	1.0941
No log	7.6667	276	1.2277	0.2830	1.2277	1.1080
No log	7.7222	278	1.1756	0.2878	1.1756	1.0843
No log	7.7778	280	1.1457	0.1840	1.1457	1.0704
No log	7.8333	282	1.1440	0.2222	1.1440	1.0696
No log	7.8889	284	1.1237	0.1567	1.1237	1.0601
No log	7.9444	286	1.1161	0.1361	1.1161	1.0565
No log	8.0	288	1.1301	0.0983	1.1301	1.0630
No log	8.0556	290	1.1554	0.2049	1.1554	1.0749
No log	8.1111	292	1.1732	0.2049	1.1732	1.0832
No log	8.1667	294	1.1833	0.2158	1.1833	1.0878
No log	8.2222	296	1.1846	0.2698	1.1846	1.0884
No log	8.2778	298	1.1636	0.1833	1.1636	1.0787
No log	8.3333	300	1.1419	0.1334	1.1419	1.0686
No log	8.3889	302	1.1449	0.1671	1.1449	1.0700
No log	8.4444	304	1.1480	0.2001	1.1480	1.0714
No log	8.5	306	1.2056	0.2802	1.2056	1.0980
No log	8.5556	308	1.2554	0.2802	1.2554	1.1204
No log	8.6111	310	1.2248	0.2256	1.2248	1.1067
No log	8.6667	312	1.2277	0.2352	1.2277	1.1080
No log	8.7222	314	1.2278	0.1805	1.2278	1.1081
No log	8.7778	316	1.2115	0.1076	1.2115	1.1007
No log	8.8333	318	1.1906	0.1489	1.1906	1.0912
No log	8.8889	320	1.1593	0.1812	1.1593	1.0767
No log	8.9444	322	1.1668	0.2278	1.1668	1.0802
No log	9.0	324	1.1431	0.2871	1.1431	1.0692
No log	9.0556	326	1.1082	0.2003	1.1082	1.0527
No log	9.1111	328	1.1430	0.1579	1.1430	1.0691
No log	9.1667	330	1.1651	0.2365	1.1651	1.0794
No log	9.2222	332	1.1391	0.1543	1.1391	1.0673
No log	9.2778	334	1.1268	0.2357	1.1268	1.0615
No log	9.3333	336	1.1776	0.2828	1.1776	1.0852
No log	9.3889	338	1.1540	0.2828	1.1540	1.0742
No log	9.4444	340	1.1179	0.2196	1.1179	1.0573
No log	9.5	342	1.1288	0.2416	1.1288	1.0624
No log	9.5556	344	1.1482	0.2633	1.1482	1.0716
No log	9.6111	346	1.1228	0.2830	1.1228	1.0596
No log	9.6667	348	1.0978	0.3204	1.0978	1.0478
No log	9.7222	350	1.1076	0.3384	1.1076	1.0524
No log	9.7778	352	1.1195	0.3787	1.1195	1.0581
No log	9.8333	354	1.1371	0.3380	1.1371	1.0663
No log	9.8889	356	1.1257	0.3561	1.1257	1.0610
No log	9.9444	358	1.1139	0.3224	1.1139	1.0554
No log	10.0	360	1.1236	0.2669	1.1236	1.0600
No log	10.0556	362	1.1898	0.2348	1.1898	1.0908
No log	10.1111	364	1.2282	0.1472	1.2282	1.1082
No log	10.1667	366	1.2078	0.1984	1.2078	1.0990
No log	10.2222	368	1.1386	0.2716	1.1386	1.0671
No log	10.2778	370	1.1732	0.2416	1.1732	1.0832
No log	10.3333	372	1.2171	0.2252	1.2171	1.1032
No log	10.3889	374	1.2338	0.2252	1.2338	1.1107
No log	10.4444	376	1.1559	0.2836	1.1559	1.0751
No log	10.5	378	1.1201	0.2604	1.1201	1.0583
No log	10.5556	380	1.2202	0.1983	1.2202	1.1046
No log	10.6111	382	1.2318	0.1873	1.2318	1.1099
No log	10.6667	384	1.1498	0.2211	1.1498	1.0723
No log	10.7222	386	1.1231	0.2892	1.1231	1.0598
No log	10.7778	388	1.1089	0.2116	1.1089	1.0531
No log	10.8333	390	1.0969	0.2416	1.0969	1.0473
No log	10.8889	392	1.1006	0.2721	1.1006	1.0491
No log	10.9444	394	1.0969	0.2766	1.0969	1.0473
No log	11.0	396	1.0881	0.2830	1.0881	1.0431
No log	11.0556	398	1.0782	0.2830	1.0782	1.0384
No log	11.1111	400	1.0498	0.3408	1.0498	1.0246
No log	11.1667	402	1.1196	0.2507	1.1196	1.0581
No log	11.2222	404	1.1628	0.2601	1.1628	1.0783
No log	11.2778	406	1.1679	0.2417	1.1679	1.0807
No log	11.3333	408	1.1315	0.2507	1.1315	1.0637
No log	11.3889	410	1.0889	0.3190	1.0889	1.0435
No log	11.4444	412	1.1013	0.2470	1.1013	1.0494
No log	11.5	414	1.1186	0.3049	1.1186	1.0576
No log	11.5556	416	1.0847	0.2696	1.0847	1.0415
No log	11.6111	418	1.0656	0.2078	1.0656	1.0323
No log	11.6667	420	1.0601	0.2394	1.0601	1.0296
No log	11.7222	422	1.0740	0.3032	1.0740	1.0363
No log	11.7778	424	1.0603	0.3408	1.0603	1.0297
No log	11.8333	426	1.0476	0.3762	1.0476	1.0235
No log	11.8889	428	1.0424	0.3485	1.0424	1.0210
No log	11.9444	430	1.0344	0.2954	1.0344	1.0170
No log	12.0	432	1.0304	0.2304	1.0304	1.0151
No log	12.0556	434	1.0273	0.2834	1.0273	1.0135
No log	12.1111	436	1.0362	0.2761	1.0362	1.0179
No log	12.1667	438	1.0565	0.3117	1.0565	1.0279
No log	12.2222	440	1.0566	0.3117	1.0566	1.0279
No log	12.2778	442	1.0287	0.3981	1.0287	1.0143
No log	12.3333	444	1.0431	0.3680	1.0431	1.0213
No log	12.3889	446	1.0322	0.2899	1.0322	1.0160
No log	12.4444	448	0.9915	0.3596	0.9915	0.9957
No log	12.5	450	1.0169	0.2549	1.0169	1.0084
No log	12.5556	452	1.1163	0.2478	1.1163	1.0566
No log	12.6111	454	1.1507	0.2552	1.1507	1.0727
No log	12.6667	456	1.1019	0.2199	1.1019	1.0497
No log	12.7222	458	1.0279	0.3373	1.0279	1.0139
No log	12.7778	460	1.0413	0.3631	1.0413	1.0205
No log	12.8333	462	1.0679	0.3719	1.0679	1.0334
No log	12.8889	464	1.0415	0.3218	1.0415	1.0205
No log	12.9444	466	1.0237	0.2879	1.0237	1.0118
No log	13.0	468	1.0240	0.2761	1.0240	1.0119
No log	13.0556	470	1.0478	0.2666	1.0478	1.0236
No log	13.1111	472	1.0276	0.3097	1.0276	1.0137
No log	13.1667	474	1.0045	0.3373	1.0045	1.0023
No log	13.2222	476	1.0004	0.4279	1.0004	1.0002
No log	13.2778	478	1.0116	0.3896	1.0116	1.0058
No log	13.3333	480	0.9953	0.3356	0.9953	0.9976
No log	13.3889	482	0.9977	0.3356	0.9977	0.9989
No log	13.4444	484	1.0068	0.2615	1.0068	1.0034
No log	13.5	486	1.0522	0.1909	1.0522	1.0258
No log	13.5556	488	1.1509	0.2951	1.1509	1.0728
No log	13.6111	490	1.1621	0.3528	1.1621	1.0780
No log	13.6667	492	1.1381	0.3357	1.1381	1.0668
No log	13.7222	494	1.1323	0.2961	1.1323	1.0641
No log	13.7778	496	1.1121	0.2424	1.1121	1.0546
No log	13.8333	498	1.1071	0.2424	1.1071	1.0522
0.3322	13.8889	500	1.1449	0.3069	1.1449	1.0700
0.3322	13.9444	502	1.1388	0.3572	1.1388	1.0671
0.3322	14.0	504	1.0859	0.2040	1.0859	1.0421
0.3322	14.0556	506	1.0746	0.2871	1.0746	1.0366
0.3322	14.1111	508	1.0551	0.2871	1.0551	1.0272
0.3322	14.1667	510	1.0281	0.2942	1.0281	1.0140
0.3322	14.2222	512	1.0297	0.2857	1.0297	1.0147

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1