ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8902
• Qwk: 0.3879
• Mse: 0.8902
• Rmse: 0.9435

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	4.8251	-0.0132	4.8251	2.1966
No log	0.125	4	2.8151	-0.0678	2.8151	1.6778
No log	0.1875	6	2.0894	-0.0575	2.0894	1.4455
No log	0.25	8	1.9221	-0.0303	1.9221	1.3864
No log	0.3125	10	1.4045	0.0777	1.4045	1.1851
No log	0.375	12	1.2846	0.0704	1.2846	1.1334
No log	0.4375	14	1.2093	0.1960	1.2093	1.0997
No log	0.5	16	1.2786	0.1347	1.2786	1.1308
No log	0.5625	18	1.3218	0.0851	1.3218	1.1497
No log	0.625	20	1.1957	0.2388	1.1957	1.0935
No log	0.6875	22	1.1487	0.3204	1.1487	1.0718
No log	0.75	24	1.1152	0.3457	1.1152	1.0560
No log	0.8125	26	1.1239	0.2988	1.1239	1.0601
No log	0.875	28	1.1484	0.2681	1.1484	1.0716
No log	0.9375	30	1.1193	0.3570	1.1193	1.0580
No log	1.0	32	1.1129	0.2729	1.1129	1.0550
No log	1.0625	34	1.1163	0.3462	1.1163	1.0565
No log	1.125	36	1.1145	0.3510	1.1145	1.0557
No log	1.1875	38	1.1377	0.2579	1.1377	1.0666
No log	1.25	40	1.1156	0.2887	1.1156	1.0562
No log	1.3125	42	1.1033	0.1343	1.1033	1.0504
No log	1.375	44	1.0767	0.1585	1.0767	1.0377
No log	1.4375	46	1.1511	0.1860	1.1511	1.0729
No log	1.5	48	1.2975	0.2542	1.2975	1.1391
No log	1.5625	50	1.4601	0.2967	1.4601	1.2083
No log	1.625	52	1.5323	0.2790	1.5323	1.2378
No log	1.6875	54	1.4227	0.1972	1.4227	1.1928
No log	1.75	56	1.4434	0.2008	1.4434	1.2014
No log	1.8125	58	1.5865	0.2790	1.5865	1.2595
No log	1.875	60	1.4487	0.2272	1.4487	1.2036
No log	1.9375	62	1.2273	0.2780	1.2273	1.1078
No log	2.0	64	1.0951	0.2624	1.0951	1.0465
No log	2.0625	66	1.2597	0.1655	1.2597	1.1224
No log	2.125	68	1.2426	0.2388	1.2426	1.1147
No log	2.1875	70	1.1465	0.2912	1.1465	1.0708
No log	2.25	72	1.2103	0.1904	1.2103	1.1001
No log	2.3125	74	1.2301	0.2298	1.2301	1.1091
No log	2.375	76	1.1983	0.2342	1.1983	1.0946
No log	2.4375	78	1.0767	0.2684	1.0767	1.0376
No log	2.5	80	1.0704	0.2716	1.0704	1.0346
No log	2.5625	82	1.1079	0.2764	1.1079	1.0526
No log	2.625	84	1.0912	0.2313	1.0912	1.0446
No log	2.6875	86	1.3358	0.2822	1.3358	1.1557
No log	2.75	88	1.5219	0.2334	1.5219	1.2336
No log	2.8125	90	1.4590	0.2820	1.4590	1.2079
No log	2.875	92	1.1692	0.2574	1.1692	1.0813
No log	2.9375	94	1.2191	0.2302	1.2191	1.1041
No log	3.0	96	1.1863	0.2776	1.1863	1.0892
No log	3.0625	98	1.0467	0.2830	1.0466	1.0231
No log	3.125	100	1.0937	0.4003	1.0937	1.0458
No log	3.1875	102	1.0689	0.3989	1.0689	1.0339
No log	3.25	104	0.9775	0.3434	0.9775	0.9887
No log	3.3125	106	0.9397	0.3583	0.9397	0.9694
No log	3.375	108	0.9441	0.3414	0.9441	0.9717
No log	3.4375	110	0.9658	0.2834	0.9658	0.9827
No log	3.5	112	0.9805	0.2674	0.9805	0.9902
No log	3.5625	114	0.9611	0.2865	0.9611	0.9804
No log	3.625	116	0.9451	0.2569	0.9451	0.9721
No log	3.6875	118	0.9476	0.3866	0.9476	0.9735
No log	3.75	120	1.0057	0.3441	1.0057	1.0028
No log	3.8125	122	0.9772	0.3753	0.9772	0.9885
No log	3.875	124	0.9350	0.3685	0.9350	0.9669
No log	3.9375	126	0.9267	0.3765	0.9267	0.9627
No log	4.0	128	0.9491	0.3584	0.9491	0.9742
No log	4.0625	130	0.9186	0.3552	0.9186	0.9584
No log	4.125	132	0.9484	0.3434	0.9484	0.9739
No log	4.1875	134	0.9431	0.3147	0.9431	0.9711
No log	4.25	136	0.9612	0.3270	0.9612	0.9804
No log	4.3125	138	0.9819	0.3643	0.9819	0.9909
No log	4.375	140	1.0558	0.3318	1.0558	1.0275
No log	4.4375	142	1.1237	0.3539	1.1237	1.0600
No log	4.5	144	1.1121	0.3261	1.1121	1.0546
No log	4.5625	146	1.0460	0.2668	1.0460	1.0228
No log	4.625	148	0.9710	0.3431	0.9710	0.9854
No log	4.6875	150	0.9639	0.3299	0.9639	0.9818
No log	4.75	152	0.9885	0.3806	0.9885	0.9943
No log	4.8125	154	0.9791	0.3909	0.9791	0.9895
No log	4.875	156	0.9917	0.2729	0.9917	0.9959
No log	4.9375	158	1.0068	0.2409	1.0068	1.0034
No log	5.0	160	0.9975	0.4560	0.9975	0.9988
No log	5.0625	162	1.0340	0.4145	1.0340	1.0169
No log	5.125	164	1.0512	0.3897	1.0512	1.0253
No log	5.1875	166	1.1361	0.3826	1.1361	1.0659
No log	5.25	168	1.0994	0.3755	1.0994	1.0485
No log	5.3125	170	0.9848	0.3124	0.9848	0.9924
No log	5.375	172	0.9762	0.3584	0.9762	0.9880
No log	5.4375	174	1.0127	0.4118	1.0127	1.0063
No log	5.5	176	0.9669	0.4004	0.9669	0.9833
No log	5.5625	178	0.9533	0.3089	0.9533	0.9764
No log	5.625	180	1.0033	0.3343	1.0033	1.0016
No log	5.6875	182	1.0317	0.4043	1.0317	1.0157
No log	5.75	184	1.0036	0.3725	1.0036	1.0018
No log	5.8125	186	1.0159	0.3400	1.0159	1.0079
No log	5.875	188	1.0032	0.3697	1.0032	1.0016
No log	5.9375	190	1.0179	0.3464	1.0179	1.0089
No log	6.0	192	1.0354	0.3794	1.0354	1.0175
No log	6.0625	194	1.0133	0.2608	1.0133	1.0066
No log	6.125	196	1.0416	0.3137	1.0416	1.0206
No log	6.1875	198	1.1232	0.2521	1.1232	1.0598
No log	6.25	200	1.1313	0.2669	1.1313	1.0636
No log	6.3125	202	1.0313	0.3115	1.0313	1.0155
No log	6.375	204	0.9996	0.2086	0.9996	0.9998
No log	6.4375	206	1.0590	0.2060	1.0590	1.0291
No log	6.5	208	1.0916	0.3478	1.0916	1.0448
No log	6.5625	210	1.0629	0.2976	1.0629	1.0310
No log	6.625	212	0.9875	0.2506	0.9875	0.9937
No log	6.6875	214	0.9646	0.2995	0.9646	0.9821
No log	6.75	216	0.9763	0.3326	0.9763	0.9881
No log	6.8125	218	1.0529	0.3676	1.0529	1.0261
No log	6.875	220	1.0986	0.2937	1.0986	1.0481
No log	6.9375	222	1.0376	0.3451	1.0376	1.0186
No log	7.0	224	0.9936	0.2801	0.9936	0.9968
No log	7.0625	226	0.9482	0.3609	0.9482	0.9738
No log	7.125	228	0.9818	0.3160	0.9818	0.9908
No log	7.1875	230	1.0125	0.2877	1.0125	1.0062
No log	7.25	232	1.0414	0.2218	1.0414	1.0205
No log	7.3125	234	1.0076	0.2440	1.0076	1.0038
No log	7.375	236	0.9789	0.2300	0.9789	0.9894
No log	7.4375	238	0.9300	0.3627	0.9300	0.9643
No log	7.5	240	0.9261	0.3627	0.9261	0.9623
No log	7.5625	242	0.9427	0.3271	0.9427	0.9709
No log	7.625	244	0.9479	0.2773	0.9479	0.9736
No log	7.6875	246	1.0042	0.3492	1.0042	1.0021
No log	7.75	248	1.0287	0.4167	1.0287	1.0142
No log	7.8125	250	0.9935	0.3568	0.9935	0.9967
No log	7.875	252	0.9572	0.4016	0.9572	0.9784
No log	7.9375	254	0.9219	0.3724	0.9219	0.9601
No log	8.0	256	0.9203	0.3663	0.9203	0.9593
No log	8.0625	258	0.9358	0.3548	0.9358	0.9673
No log	8.125	260	0.9237	0.4142	0.9237	0.9611
No log	8.1875	262	0.9025	0.4373	0.9025	0.9500
No log	8.25	264	0.9029	0.4690	0.9029	0.9502
No log	8.3125	266	0.9409	0.5102	0.9409	0.9700
No log	8.375	268	1.0109	0.4533	1.0109	1.0054
No log	8.4375	270	1.0233	0.4539	1.0233	1.0116
No log	8.5	272	0.9673	0.4600	0.9673	0.9835
No log	8.5625	274	0.9854	0.4600	0.9854	0.9927
No log	8.625	276	1.0552	0.4138	1.0552	1.0272
No log	8.6875	278	1.2048	0.3649	1.2048	1.0976
No log	8.75	280	1.2856	0.3492	1.2856	1.1338
No log	8.8125	282	1.2093	0.3649	1.2093	1.0997
No log	8.875	284	1.1084	0.3726	1.1084	1.0528
No log	8.9375	286	1.1031	0.3719	1.1031	1.0503
No log	9.0	288	1.0585	0.3982	1.0585	1.0288
No log	9.0625	290	1.0067	0.4309	1.0067	1.0033
No log	9.125	292	0.9326	0.4754	0.9326	0.9657
No log	9.1875	294	0.9595	0.4583	0.9595	0.9795
No log	9.25	296	0.9921	0.4576	0.9921	0.9961
No log	9.3125	298	1.0017	0.4862	1.0017	1.0008
No log	9.375	300	0.9831	0.5080	0.9831	0.9915
No log	9.4375	302	1.0360	0.4769	1.0360	1.0178
No log	9.5	304	1.1302	0.4320	1.1302	1.0631
No log	9.5625	306	1.0669	0.3977	1.0669	1.0329
No log	9.625	308	0.9331	0.4648	0.9331	0.9659
No log	9.6875	310	0.8860	0.4571	0.8860	0.9413
No log	9.75	312	0.8770	0.3970	0.8770	0.9365
No log	9.8125	314	0.8587	0.4563	0.8587	0.9266
No log	9.875	316	0.8889	0.4240	0.8889	0.9428
No log	9.9375	318	1.0399	0.4304	1.0399	1.0198
No log	10.0	320	1.0908	0.3798	1.0908	1.0444
No log	10.0625	322	0.9840	0.4468	0.9840	0.9920
No log	10.125	324	0.9757	0.4672	0.9757	0.9878
No log	10.1875	326	1.0764	0.4329	1.0764	1.0375
No log	10.25	328	1.1637	0.4186	1.1637	1.0788
No log	10.3125	330	1.2119	0.3898	1.2119	1.1008
No log	10.375	332	1.0972	0.4217	1.0972	1.0475
No log	10.4375	334	0.9127	0.4826	0.9127	0.9554
No log	10.5	336	0.8694	0.4811	0.8694	0.9324
No log	10.5625	338	0.8939	0.4568	0.8939	0.9455
No log	10.625	340	0.9558	0.4165	0.9558	0.9776
No log	10.6875	342	0.9453	0.3812	0.9453	0.9723
No log	10.75	344	0.9197	0.3142	0.9197	0.9590
No log	10.8125	346	0.9094	0.3095	0.9094	0.9536
No log	10.875	348	0.9327	0.3868	0.9327	0.9658
No log	10.9375	350	1.0381	0.3503	1.0381	1.0189
No log	11.0	352	1.1415	0.4001	1.1415	1.0684
No log	11.0625	354	1.1511	0.4001	1.1511	1.0729
No log	11.125	356	1.0352	0.3936	1.0352	1.0174
No log	11.1875	358	0.9279	0.4648	0.9279	0.9633
No log	11.25	360	0.9247	0.4429	0.9247	0.9616
No log	11.3125	362	0.9812	0.3785	0.9812	0.9905
No log	11.375	364	1.0746	0.4218	1.0746	1.0366
No log	11.4375	366	1.1314	0.4374	1.1314	1.0637
No log	11.5	368	1.1338	0.4186	1.1338	1.0648
No log	11.5625	370	1.0815	0.4104	1.0815	1.0400
No log	11.625	372	1.0031	0.3785	1.0031	1.0015
No log	11.6875	374	0.9898	0.3543	0.9898	0.9949
No log	11.75	376	1.0483	0.3465	1.0483	1.0238
No log	11.8125	378	1.1018	0.3667	1.1018	1.0496
No log	11.875	380	1.2168	0.4110	1.2168	1.1031
No log	11.9375	382	1.1964	0.4109	1.1964	1.0938
No log	12.0	384	1.1230	0.4104	1.1230	1.0597
No log	12.0625	386	1.0227	0.3349	1.0227	1.0113
No log	12.125	388	0.9958	0.2745	0.9958	0.9979
No log	12.1875	390	1.0315	0.2837	1.0315	1.0156
No log	12.25	392	1.0703	0.2637	1.0703	1.0345
No log	12.3125	394	1.0528	0.2810	1.0528	1.0261
No log	12.375	396	1.0107	0.2752	1.0107	1.0053
No log	12.4375	398	0.9893	0.3144	0.9893	0.9947
No log	12.5	400	0.9663	0.2772	0.9663	0.9830
No log	12.5625	402	0.9922	0.3478	0.9922	0.9961
No log	12.625	404	1.0684	0.3617	1.0684	1.0337
No log	12.6875	406	1.1156	0.3516	1.1156	1.0562
No log	12.75	408	1.1369	0.3551	1.1369	1.0663
No log	12.8125	410	1.1145	0.2157	1.1145	1.0557
No log	12.875	412	1.0759	0.2385	1.0759	1.0373
No log	12.9375	414	1.0490	0.2749	1.0490	1.0242
No log	13.0	416	1.0434	0.3225	1.0434	1.0215
No log	13.0625	418	1.0373	0.3181	1.0373	1.0185
No log	13.125	420	1.0760	0.2997	1.0760	1.0373
No log	13.1875	422	1.1591	0.2844	1.1591	1.0766
No log	13.25	424	1.1707	0.3658	1.1707	1.0820
No log	13.3125	426	1.1185	0.3068	1.1185	1.0576
No log	13.375	428	1.0259	0.2782	1.0259	1.0129
No log	13.4375	430	0.9919	0.3165	0.9919	0.9959
No log	13.5	432	0.9832	0.3165	0.9832	0.9916
No log	13.5625	434	1.0023	0.2810	1.0023	1.0012
No log	13.625	436	1.0576	0.2978	1.0576	1.0284
No log	13.6875	438	1.0823	0.3504	1.0823	1.0403
No log	13.75	440	1.0572	0.3134	1.0572	1.0282
No log	13.8125	442	1.0239	0.3113	1.0239	1.0119
No log	13.875	444	0.9827	0.3613	0.9827	0.9913
No log	13.9375	446	0.9637	0.3165	0.9637	0.9817
No log	14.0	448	0.9489	0.3656	0.9489	0.9741
No log	14.0625	450	1.0016	0.4572	1.0016	1.0008
No log	14.125	452	1.0637	0.3793	1.0637	1.0314
No log	14.1875	454	1.0394	0.4131	1.0394	1.0195
No log	14.25	456	1.0541	0.3793	1.0541	1.0267
No log	14.3125	458	1.1787	0.3536	1.1787	1.0857
No log	14.375	460	1.2846	0.3641	1.2846	1.1334
No log	14.4375	462	1.2284	0.4106	1.2284	1.1083
No log	14.5	464	1.0755	0.3813	1.0755	1.0371
No log	14.5625	466	0.9535	0.3716	0.9535	0.9765
No log	14.625	468	0.9327	0.3434	0.9327	0.9657
No log	14.6875	470	0.9576	0.3520	0.9576	0.9786
No log	14.75	472	0.9908	0.3771	0.9908	0.9954
No log	14.8125	474	1.0619	0.3898	1.0619	1.0305
No log	14.875	476	1.0527	0.4229	1.0527	1.0260
No log	14.9375	478	1.0733	0.4927	1.0733	1.0360
No log	15.0	480	1.1393	0.4743	1.1393	1.0674
No log	15.0625	482	1.1796	0.4324	1.1796	1.0861
No log	15.125	484	1.1420	0.4256	1.1420	1.0686
No log	15.1875	486	1.0215	0.5053	1.0215	1.0107
No log	15.25	488	0.9276	0.4128	0.9276	0.9631
No log	15.3125	490	0.9043	0.4479	0.9043	0.9510
No log	15.375	492	0.9141	0.4126	0.9141	0.9561
No log	15.4375	494	0.9734	0.4300	0.9734	0.9866
No log	15.5	496	1.1284	0.4154	1.1284	1.0623
No log	15.5625	498	1.3195	0.4170	1.3195	1.1487
0.369	15.625	500	1.3336	0.3910	1.3336	1.1548
0.369	15.6875	502	1.2358	0.4214	1.2358	1.1117
0.369	15.75	504	1.0740	0.4325	1.0740	1.0364
0.369	15.8125	506	0.9622	0.4583	0.9622	0.9809
0.369	15.875	508	0.9310	0.3982	0.9310	0.9649
0.369	15.9375	510	0.9273	0.3886	0.9273	0.9630
0.369	16.0	512	0.9022	0.4277	0.9022	0.9498
0.369	16.0625	514	0.8923	0.4181	0.8923	0.9446
0.369	16.125	516	0.8913	0.3845	0.8913	0.9441
0.369	16.1875	518	0.9065	0.4143	0.9065	0.9521
0.369	16.25	520	0.9333	0.3834	0.9333	0.9661
0.369	16.3125	522	0.9266	0.3656	0.9266	0.9626
0.369	16.375	524	0.9293	0.3656	0.9293	0.9640
0.369	16.4375	526	0.8950	0.3879	0.8950	0.9460
0.369	16.5	528	0.8902	0.3879	0.8902	0.9435

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1