ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0283
• Qwk: 0.2587
• Mse: 1.0283
• Rmse: 1.0140

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	4.9329	0.0010	4.9329	2.2210
No log	0.0656	4	2.9767	-0.0276	2.9767	1.7253
No log	0.0984	6	2.1454	-0.0634	2.1454	1.4647
No log	0.1311	8	1.8085	0.0062	1.8085	1.3448
No log	0.1639	10	1.4801	-0.0211	1.4801	1.2166
No log	0.1967	12	1.3134	0.0777	1.3134	1.1460
No log	0.2295	14	1.2963	0.0324	1.2963	1.1385
No log	0.2623	16	1.3703	-0.0147	1.3703	1.1706
No log	0.2951	18	1.5798	-0.0674	1.5798	1.2569
No log	0.3279	20	1.7228	0.0078	1.7228	1.3126
No log	0.3607	22	1.5746	0.0549	1.5746	1.2548
No log	0.3934	24	1.4460	0.0319	1.4460	1.2025
No log	0.4262	26	1.4687	-0.0029	1.4687	1.2119
No log	0.4590	28	1.4606	0.0189	1.4606	1.2085
No log	0.4918	30	1.4770	-0.0132	1.4770	1.2153
No log	0.5246	32	1.2853	-0.0165	1.2853	1.1337
No log	0.5574	34	1.2136	0.1417	1.2136	1.1016
No log	0.5902	36	1.2321	0.0353	1.2321	1.1100
No log	0.6230	38	1.2099	0.1417	1.2099	1.1000
No log	0.6557	40	1.1978	0.2083	1.1978	1.0945
No log	0.6885	42	1.1998	0.1507	1.1998	1.0954
No log	0.7213	44	1.3215	0.0984	1.3215	1.1495
No log	0.7541	46	1.3721	0.1016	1.3721	1.1714
No log	0.7869	48	1.3178	0.1076	1.3178	1.1480
No log	0.8197	50	1.2741	0.0676	1.2741	1.1287
No log	0.8525	52	1.3286	0.2020	1.3286	1.1527
No log	0.8852	54	1.3174	0.1709	1.3174	1.1478
No log	0.9180	56	1.3585	0.2552	1.3585	1.1656
No log	0.9508	58	1.4302	0.1457	1.4302	1.1959
No log	0.9836	60	1.3775	0.0901	1.3775	1.1737
No log	1.0164	62	1.4856	0.0046	1.4856	1.2188
No log	1.0492	64	1.5382	0.0486	1.5382	1.2403
No log	1.0820	66	1.5552	0.1403	1.5552	1.2471
No log	1.1148	68	1.3569	0.1100	1.3569	1.1649
No log	1.1475	70	1.7634	0.1814	1.7634	1.3279
No log	1.1803	72	2.0794	0.1431	2.0794	1.4420
No log	1.2131	74	1.6338	0.2572	1.6338	1.2782
No log	1.2459	76	1.2060	0.1995	1.2060	1.0982
No log	1.2787	78	1.2677	0.1354	1.2677	1.1259
No log	1.3115	80	1.2145	0.2251	1.2145	1.1020
No log	1.3443	82	1.1869	0.3396	1.1869	1.0894
No log	1.3770	84	1.3696	0.1763	1.3696	1.1703
No log	1.4098	86	1.5043	0.2658	1.5043	1.2265
No log	1.4426	88	1.3213	0.2069	1.3213	1.1495
No log	1.4754	90	1.0920	0.3210	1.0920	1.0450
No log	1.5082	92	1.0251	0.3660	1.0251	1.0125
No log	1.5410	94	0.9576	0.3660	0.9576	0.9786
No log	1.5738	96	0.8756	0.3952	0.8756	0.9357
No log	1.6066	98	1.1027	0.3596	1.1027	1.0501
No log	1.6393	100	0.9661	0.3844	0.9661	0.9829
No log	1.6721	102	0.8026	0.3278	0.8026	0.8959
No log	1.7049	104	0.7842	0.2967	0.7842	0.8855
No log	1.7377	106	0.7988	0.3820	0.7988	0.8937
No log	1.7705	108	0.7989	0.3535	0.7989	0.8938
No log	1.8033	110	0.8107	0.4916	0.8107	0.9004
No log	1.8361	112	0.8435	0.4303	0.8435	0.9184
No log	1.8689	114	0.9528	0.3887	0.9528	0.9761
No log	1.9016	116	1.3421	0.4310	1.3421	1.1585
No log	1.9344	118	1.0046	0.4588	1.0046	1.0023
No log	1.9672	120	0.8509	0.5012	0.8509	0.9224
No log	2.0	122	1.1856	0.5283	1.1856	1.0889
No log	2.0328	124	1.2796	0.4902	1.2796	1.1312
No log	2.0656	126	0.9614	0.5290	0.9614	0.9805
No log	2.0984	128	0.7961	0.4912	0.7961	0.8923
No log	2.1311	130	0.9974	0.4578	0.9974	0.9987
No log	2.1639	132	0.9700	0.4578	0.9700	0.9849
No log	2.1967	134	0.8423	0.4124	0.8423	0.9178
No log	2.2295	136	0.8883	0.4181	0.8883	0.9425
No log	2.2623	138	0.9196	0.2969	0.9196	0.9589
No log	2.2951	140	0.9602	0.2944	0.9602	0.9799
No log	2.3279	142	1.0209	0.2417	1.0209	1.0104
No log	2.3607	144	1.2763	0.2959	1.2763	1.1297
No log	2.3934	146	1.3454	0.2295	1.3454	1.1599
No log	2.4262	148	1.1968	0.2815	1.1968	1.0940
No log	2.4590	150	1.1273	0.1709	1.1273	1.0617
No log	2.4918	152	1.2537	0.4063	1.2537	1.1197
No log	2.5246	154	1.3448	0.2925	1.3448	1.1597
No log	2.5574	156	1.2219	0.3474	1.2219	1.1054
No log	2.5902	158	1.1140	0.2341	1.1140	1.0554
No log	2.6230	160	1.1072	0.2793	1.1072	1.0522
No log	2.6557	162	1.1089	0.2694	1.1089	1.0531
No log	2.6885	164	1.1348	0.2567	1.1348	1.0653
No log	2.7213	166	1.1050	0.2919	1.1050	1.0512
No log	2.7541	168	1.0936	0.3387	1.0936	1.0457
No log	2.7869	170	1.1209	0.2953	1.1209	1.0587
No log	2.8197	172	1.1183	0.3326	1.1183	1.0575
No log	2.8525	174	1.0871	0.2899	1.0871	1.0427
No log	2.8852	176	1.0130	0.2711	1.0130	1.0065
No log	2.9180	178	1.0050	0.1753	1.0050	1.0025
No log	2.9508	180	0.9970	0.1952	0.9970	0.9985
No log	2.9836	182	1.0407	0.3302	1.0407	1.0201
No log	3.0164	184	1.1055	0.3879	1.1055	1.0514
No log	3.0492	186	1.0209	0.3365	1.0209	1.0104
No log	3.0820	188	0.9139	0.2726	0.9139	0.9560
No log	3.1148	190	0.9585	0.4078	0.9585	0.9790
No log	3.1475	192	0.9202	0.4113	0.9202	0.9593
No log	3.1803	194	0.8845	0.4011	0.8845	0.9405
No log	3.2131	196	1.0323	0.4745	1.0323	1.0160
No log	3.2459	198	1.0422	0.4563	1.0422	1.0209
No log	3.2787	200	0.9205	0.4341	0.9205	0.9594
No log	3.3115	202	0.8679	0.3943	0.8679	0.9316
No log	3.3443	204	0.8859	0.4120	0.8859	0.9412
No log	3.3770	206	0.9498	0.3942	0.9498	0.9746
No log	3.4098	208	0.9074	0.3627	0.9074	0.9526
No log	3.4426	210	0.9108	0.3621	0.9108	0.9543
No log	3.4754	212	0.9693	0.4390	0.9693	0.9846
No log	3.5082	214	1.0279	0.4468	1.0279	1.0138
No log	3.5410	216	0.9531	0.3982	0.9531	0.9763
No log	3.5738	218	0.9340	0.4013	0.9340	0.9665
No log	3.6066	220	0.9222	0.2712	0.9222	0.9603
No log	3.6393	222	1.0136	0.4116	1.0136	1.0068
No log	3.6721	224	1.0069	0.3839	1.0069	1.0034
No log	3.7049	226	0.9362	0.2714	0.9362	0.9676
No log	3.7377	228	0.9988	0.3306	0.9988	0.9994
No log	3.7705	230	1.1906	0.4367	1.1906	1.0911
No log	3.8033	232	1.2400	0.4027	1.2400	1.1136
No log	3.8361	234	1.0874	0.3924	1.0874	1.0428
No log	3.8689	236	0.9541	0.3820	0.9541	0.9768
No log	3.9016	238	0.9411	0.2712	0.9411	0.9701
No log	3.9344	240	0.9380	0.2712	0.9380	0.9685
No log	3.9672	242	0.9100	0.3804	0.9100	0.9539
No log	4.0	244	0.9417	0.4805	0.9417	0.9704
No log	4.0328	246	0.9204	0.3995	0.9204	0.9594
No log	4.0656	248	0.9143	0.4032	0.9143	0.9562
No log	4.0984	250	0.9834	0.4156	0.9834	0.9916
No log	4.1311	252	1.1820	0.4355	1.1820	1.0872
No log	4.1639	254	1.2312	0.3792	1.2312	1.1096
No log	4.1967	256	1.1074	0.4404	1.1074	1.0523
No log	4.2295	258	1.0391	0.3644	1.0391	1.0193
No log	4.2623	260	0.9727	0.4032	0.9727	0.9862
No log	4.2951	262	1.0251	0.3892	1.0251	1.0125
No log	4.3279	264	1.0297	0.3747	1.0297	1.0147
No log	4.3607	266	0.9865	0.3185	0.9865	0.9932
No log	4.3934	268	0.9991	0.2344	0.9991	0.9995
No log	4.4262	270	1.0153	0.2489	1.0153	1.0076
No log	4.4590	272	1.0212	0.3621	1.0212	1.0105
No log	4.4918	274	1.1021	0.3560	1.1021	1.0498
No log	4.5246	276	1.0639	0.3533	1.0639	1.0314
No log	4.5574	278	1.0263	0.2579	1.0263	1.0131
No log	4.5902	280	1.0650	0.1974	1.0650	1.0320
No log	4.6230	282	1.0958	0.1576	1.0958	1.0468
No log	4.6557	284	1.0970	0.1576	1.0970	1.0474
No log	4.6885	286	1.0663	0.1928	1.0663	1.0326
No log	4.7213	288	1.0123	0.2409	1.0123	1.0061
No log	4.7541	290	0.9863	0.2793	0.9863	0.9931
No log	4.7869	292	0.9828	0.3263	0.9828	0.9914
No log	4.8197	294	0.9616	0.3371	0.9616	0.9806
No log	4.8525	296	0.9686	0.2871	0.9686	0.9842
No log	4.8852	298	0.9739	0.3312	0.9739	0.9869
No log	4.9180	300	0.9532	0.3511	0.9532	0.9763
No log	4.9508	302	0.9747	0.4013	0.9747	0.9873
No log	4.9836	304	1.1608	0.4487	1.1608	1.0774
No log	5.0164	306	1.1988	0.4293	1.1988	1.0949
No log	5.0492	308	1.0593	0.4851	1.0593	1.0292
No log	5.0820	310	0.9208	0.4050	0.9208	0.9596
No log	5.1148	312	0.9109	0.4048	0.9109	0.9544
No log	5.1475	314	0.9826	0.4412	0.9826	0.9913
No log	5.1803	316	1.2808	0.3974	1.2808	1.1317
No log	5.2131	318	1.4466	0.3074	1.4466	1.2028
No log	5.2459	320	1.3096	0.3785	1.3096	1.1444
No log	5.2787	322	1.1022	0.3962	1.1022	1.0498
No log	5.3115	324	0.9627	0.3522	0.9627	0.9812
No log	5.3443	326	0.9650	0.2439	0.9650	0.9823
No log	5.3770	328	0.9844	0.3294	0.9844	0.9922
No log	5.4098	330	0.9630	0.2775	0.9630	0.9813
No log	5.4426	332	0.9940	0.3920	0.9940	0.9970
No log	5.4754	334	1.0907	0.3394	1.0907	1.0444
No log	5.5082	336	1.1080	0.3394	1.1080	1.0526
No log	5.5410	338	1.0368	0.3753	1.0368	1.0182
No log	5.5738	340	0.9725	0.3317	0.9725	0.9861
No log	5.6066	342	0.9409	0.2993	0.9409	0.9700
No log	5.6393	344	0.9438	0.2678	0.9438	0.9715
No log	5.6721	346	0.9629	0.2520	0.9629	0.9813
No log	5.7049	348	0.9880	0.2674	0.9880	0.9940
No log	5.7377	350	1.0138	0.3048	1.0138	1.0069
No log	5.7705	352	0.9956	0.2674	0.9956	0.9978
No log	5.8033	354	0.9750	0.2574	0.9750	0.9874
No log	5.8361	356	1.0486	0.4213	1.0486	1.0240
No log	5.8689	358	1.3144	0.3020	1.3144	1.1465
No log	5.9016	360	1.4710	0.2908	1.4710	1.2129
No log	5.9344	362	1.3128	0.3780	1.3128	1.1458
No log	5.9672	364	1.0232	0.5037	1.0232	1.0115
No log	6.0	366	0.9172	0.3566	0.9172	0.9577
No log	6.0328	368	0.9156	0.3897	0.9156	0.9569
No log	6.0656	370	0.8986	0.3930	0.8986	0.9479
No log	6.0984	372	0.9815	0.4570	0.9815	0.9907
No log	6.1311	374	1.0494	0.4880	1.0494	1.0244
No log	6.1639	376	1.0075	0.4957	1.0075	1.0037
No log	6.1967	378	0.9207	0.4197	0.9207	0.9595
No log	6.2295	380	0.9260	0.3705	0.9260	0.9623
No log	6.2623	382	1.0255	0.3343	1.0255	1.0127
No log	6.2951	384	1.0570	0.3809	1.0570	1.0281
No log	6.3279	386	0.9778	0.4087	0.9778	0.9888
No log	6.3607	388	0.9203	0.4479	0.9203	0.9593
No log	6.3934	390	0.9382	0.4007	0.9382	0.9686
No log	6.4262	392	0.9460	0.4741	0.9460	0.9726
No log	6.4590	394	0.9077	0.4617	0.9077	0.9527
No log	6.4918	396	0.9203	0.4087	0.9203	0.9593
No log	6.5246	398	0.9354	0.4308	0.9354	0.9672
No log	6.5574	400	0.9179	0.4087	0.9179	0.9581
No log	6.5902	402	0.9533	0.4238	0.9533	0.9764
No log	6.6230	404	1.0059	0.4110	1.0059	1.0029
No log	6.6557	406	0.9939	0.4110	0.9939	0.9969
No log	6.6885	408	0.9297	0.3762	0.9297	0.9642
No log	6.7213	410	0.9203	0.3960	0.9203	0.9593
No log	6.7541	412	0.9881	0.4507	0.9881	0.9940
No log	6.7869	414	0.9965	0.4507	0.9965	0.9983
No log	6.8197	416	0.9614	0.3970	0.9614	0.9805
No log	6.8525	418	0.9510	0.3070	0.9510	0.9752
No log	6.8852	420	0.9939	0.3418	0.9939	0.9969
No log	6.9180	422	1.0211	0.3777	1.0211	1.0105
No log	6.9508	424	0.9954	0.3577	0.9954	0.9977
No log	6.9836	426	0.9663	0.3508	0.9663	0.9830
No log	7.0164	428	0.9753	0.3392	0.9753	0.9875
No log	7.0492	430	0.9739	0.3392	0.9739	0.9868
No log	7.0820	432	0.9686	0.3652	0.9686	0.9842
No log	7.1148	434	0.9806	0.3771	0.9806	0.9902
No log	7.1475	436	1.0729	0.3848	1.0729	1.0358
No log	7.1803	438	1.1289	0.3424	1.1289	1.0625
No log	7.2131	440	1.0867	0.3848	1.0867	1.0424
No log	7.2459	442	0.9951	0.4107	0.9951	0.9975
No log	7.2787	444	0.9427	0.3565	0.9427	0.9709
No log	7.3115	446	0.9847	0.3813	0.9847	0.9923
No log	7.3443	448	1.0340	0.3546	1.0340	1.0168
No log	7.3770	450	0.9837	0.4042	0.9837	0.9918
No log	7.4098	452	0.9445	0.4102	0.9445	0.9719
No log	7.4426	454	0.9304	0.3705	0.9304	0.9646
No log	7.4754	456	0.9645	0.3762	0.9645	0.9821
No log	7.5082	458	1.0334	0.3834	1.0334	1.0166
No log	7.5410	460	1.0478	0.3317	1.0478	1.0236
No log	7.5738	462	1.0141	0.3317	1.0141	1.0070
No log	7.6066	464	0.9863	0.3326	0.9863	0.9931
No log	7.6393	466	0.9659	0.3223	0.9659	0.9828
No log	7.6721	468	0.9522	0.3392	0.9522	0.9758
No log	7.7049	470	0.9354	0.3539	0.9354	0.9672
No log	7.7377	472	0.9245	0.3705	0.9245	0.9615
No log	7.7705	474	0.9440	0.3508	0.9440	0.9716
No log	7.8033	476	1.0287	0.4072	1.0287	1.0142
No log	7.8361	478	1.0590	0.3908	1.0590	1.0291
No log	7.8689	480	1.0473	0.3945	1.0473	1.0234
No log	7.9016	482	1.0383	0.3707	1.0383	1.0190
No log	7.9344	484	1.0041	0.3720	1.0041	1.0020
No log	7.9672	486	0.9870	0.3463	0.9870	0.9935
No log	8.0	488	0.9821	0.3463	0.9821	0.9910
No log	8.0328	490	1.0073	0.3169	1.0073	1.0036
No log	8.0656	492	1.0297	0.3434	1.0297	1.0147
No log	8.0984	494	1.0446	0.3308	1.0446	1.0221
No log	8.1311	496	1.0774	0.3359	1.0774	1.0380
No log	8.1639	498	1.0706	0.3359	1.0706	1.0347
0.3563	8.1967	500	1.0368	0.3716	1.0368	1.0182
0.3563	8.2295	502	0.9732	0.3729	0.9732	0.9865
0.3563	8.2623	504	0.9176	0.3811	0.9176	0.9579
0.3563	8.2951	506	0.8941	0.3565	0.8941	0.9455
0.3563	8.3279	508	0.9025	0.3508	0.9025	0.9500
0.3563	8.3607	510	0.9596	0.3827	0.9596	0.9796
0.3563	8.3934	512	1.0528	0.3556	1.0528	1.0261
0.3563	8.4262	514	1.1966	0.3706	1.1966	1.0939
0.3563	8.4590	516	1.2295	0.3324	1.2295	1.1088
0.3563	8.4918	518	1.1752	0.3706	1.1752	1.0841
0.3563	8.5246	520	1.0430	0.3908	1.0430	1.0213
0.3563	8.5574	522	0.9770	0.3861	0.9770	0.9884
0.3563	8.5902	524	0.9653	0.3508	0.9653	0.9825
0.3563	8.6230	526	0.9800	0.3243	0.9800	0.9899
0.3563	8.6557	528	0.9943	0.3243	0.9943	0.9972
0.3563	8.6885	530	1.0042	0.3243	1.0042	1.0021
0.3563	8.7213	532	1.0283	0.2587	1.0283	1.0140

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1