ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9728
• Qwk: 0.4098
• Mse: 0.9728
• Rmse: 0.9863

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	4.8251	-0.0132	4.8251	2.1966
No log	0.125	4	2.8151	-0.0678	2.8151	1.6778
No log	0.1875	6	2.0894	-0.0575	2.0894	1.4455
No log	0.25	8	1.9221	-0.0303	1.9221	1.3864
No log	0.3125	10	1.4045	0.0777	1.4045	1.1851
No log	0.375	12	1.2846	0.0704	1.2846	1.1334
No log	0.4375	14	1.2093	0.1960	1.2093	1.0997
No log	0.5	16	1.2787	0.1347	1.2787	1.1308
No log	0.5625	18	1.3218	0.0851	1.3218	1.1497
No log	0.625	20	1.1957	0.2388	1.1957	1.0935
No log	0.6875	22	1.1487	0.3204	1.1487	1.0718
No log	0.75	24	1.1152	0.3457	1.1152	1.0560
No log	0.8125	26	1.1239	0.2988	1.1239	1.0601
No log	0.875	28	1.1484	0.2681	1.1484	1.0716
No log	0.9375	30	1.1193	0.3570	1.1193	1.0580
No log	1.0	32	1.1129	0.2729	1.1129	1.0550
No log	1.0625	34	1.1163	0.3462	1.1163	1.0565
No log	1.125	36	1.1145	0.3510	1.1145	1.0557
No log	1.1875	38	1.1377	0.2579	1.1377	1.0666
No log	1.25	40	1.1156	0.2887	1.1156	1.0562
No log	1.3125	42	1.1033	0.1343	1.1033	1.0504
No log	1.375	44	1.0767	0.1585	1.0767	1.0377
No log	1.4375	46	1.1511	0.1860	1.1511	1.0729
No log	1.5	48	1.2975	0.2542	1.2975	1.1391
No log	1.5625	50	1.4601	0.2967	1.4601	1.2083
No log	1.625	52	1.5323	0.2790	1.5323	1.2378
No log	1.6875	54	1.4227	0.1972	1.4227	1.1928
No log	1.75	56	1.4434	0.2008	1.4434	1.2014
No log	1.8125	58	1.5865	0.2790	1.5865	1.2595
No log	1.875	60	1.4487	0.2272	1.4487	1.2036
No log	1.9375	62	1.2273	0.2780	1.2273	1.1078
No log	2.0	64	1.0951	0.2624	1.0951	1.0465
No log	2.0625	66	1.2598	0.1655	1.2598	1.1224
No log	2.125	68	1.2426	0.2388	1.2426	1.1147
No log	2.1875	70	1.1465	0.2912	1.1465	1.0708
No log	2.25	72	1.2103	0.1904	1.2103	1.1001
No log	2.3125	74	1.2301	0.2298	1.2301	1.1091
No log	2.375	76	1.1983	0.2342	1.1983	1.0947
No log	2.4375	78	1.0767	0.2684	1.0767	1.0376
No log	2.5	80	1.0704	0.2716	1.0704	1.0346
No log	2.5625	82	1.1079	0.2764	1.1079	1.0526
No log	2.625	84	1.0912	0.2313	1.0912	1.0446
No log	2.6875	86	1.3358	0.2822	1.3358	1.1558
No log	2.75	88	1.5219	0.2334	1.5219	1.2336
No log	2.8125	90	1.4590	0.2820	1.4590	1.2079
No log	2.875	92	1.1692	0.2574	1.1692	1.0813
No log	2.9375	94	1.2191	0.2302	1.2191	1.1041
No log	3.0	96	1.1863	0.2776	1.1863	1.0892
No log	3.0625	98	1.0466	0.2830	1.0466	1.0231
No log	3.125	100	1.0937	0.4003	1.0937	1.0458
No log	3.1875	102	1.0689	0.3989	1.0689	1.0339
No log	3.25	104	0.9775	0.3434	0.9775	0.9887
No log	3.3125	106	0.9397	0.3583	0.9397	0.9694
No log	3.375	108	0.9441	0.3414	0.9441	0.9717
No log	3.4375	110	0.9658	0.2834	0.9658	0.9827
No log	3.5	112	0.9805	0.2674	0.9805	0.9902
No log	3.5625	114	0.9612	0.2865	0.9612	0.9804
No log	3.625	116	0.9451	0.2569	0.9451	0.9721
No log	3.6875	118	0.9476	0.3866	0.9476	0.9735
No log	3.75	120	1.0057	0.3441	1.0057	1.0028
No log	3.8125	122	0.9772	0.3753	0.9772	0.9885
No log	3.875	124	0.9350	0.3685	0.9350	0.9669
No log	3.9375	126	0.9267	0.3765	0.9267	0.9627
No log	4.0	128	0.9491	0.3584	0.9491	0.9742
No log	4.0625	130	0.9186	0.3552	0.9186	0.9584
No log	4.125	132	0.9484	0.3434	0.9484	0.9739
No log	4.1875	134	0.9431	0.3147	0.9431	0.9711
No log	4.25	136	0.9612	0.3270	0.9612	0.9804
No log	4.3125	138	0.9819	0.3643	0.9819	0.9909
No log	4.375	140	1.0558	0.3318	1.0558	1.0275
No log	4.4375	142	1.1237	0.3539	1.1237	1.0600
No log	4.5	144	1.1121	0.3261	1.1121	1.0546
No log	4.5625	146	1.0460	0.2668	1.0460	1.0227
No log	4.625	148	0.9710	0.3431	0.9710	0.9854
No log	4.6875	150	0.9640	0.3299	0.9640	0.9818
No log	4.75	152	0.9886	0.3806	0.9886	0.9943
No log	4.8125	154	0.9791	0.3909	0.9791	0.9895
No log	4.875	156	0.9918	0.2729	0.9918	0.9959
No log	4.9375	158	1.0068	0.2409	1.0068	1.0034
No log	5.0	160	0.9975	0.4560	0.9975	0.9988
No log	5.0625	162	1.0340	0.4145	1.0340	1.0169
No log	5.125	164	1.0513	0.3897	1.0513	1.0253
No log	5.1875	166	1.1362	0.3826	1.1362	1.0659
No log	5.25	168	1.0995	0.3755	1.0995	1.0486
No log	5.3125	170	0.9848	0.3124	0.9848	0.9924
No log	5.375	172	0.9763	0.3584	0.9763	0.9881
No log	5.4375	174	1.0127	0.4118	1.0127	1.0063
No log	5.5	176	0.9669	0.4004	0.9669	0.9833
No log	5.5625	178	0.9534	0.3089	0.9534	0.9764
No log	5.625	180	1.0032	0.3343	1.0032	1.0016
No log	5.6875	182	1.0316	0.4043	1.0316	1.0157
No log	5.75	184	1.0036	0.3725	1.0036	1.0018
No log	5.8125	186	1.0164	0.3400	1.0164	1.0082
No log	5.875	188	1.0043	0.3697	1.0043	1.0021
No log	5.9375	190	1.0182	0.3464	1.0182	1.0090
No log	6.0	192	1.0352	0.3794	1.0352	1.0175
No log	6.0625	194	1.0138	0.2271	1.0138	1.0069
No log	6.125	196	1.0434	0.2745	1.0434	1.0215
No log	6.1875	198	1.1247	0.2521	1.1247	1.0605
No log	6.25	200	1.1316	0.2669	1.1316	1.0637
No log	6.3125	202	1.0308	0.3115	1.0308	1.0153
No log	6.375	204	0.9990	0.2244	0.9990	0.9995
No log	6.4375	206	1.0568	0.2060	1.0568	1.0280
No log	6.5	208	1.0875	0.3478	1.0875	1.0428
No log	6.5625	210	1.0584	0.2716	1.0584	1.0288
No log	6.625	212	0.9857	0.2721	0.9857	0.9928
No log	6.6875	214	0.9645	0.2995	0.9645	0.9821
No log	6.75	216	0.9765	0.3326	0.9765	0.9882
No log	6.8125	218	1.0533	0.3676	1.0533	1.0263
No log	6.875	220	1.0986	0.2937	1.0986	1.0481
No log	6.9375	222	1.0373	0.3206	1.0373	1.0185
No log	7.0	224	0.9923	0.2801	0.9923	0.9962
No log	7.0625	226	0.9472	0.3609	0.9472	0.9733
No log	7.125	228	0.9832	0.2783	0.9832	0.9916
No log	7.1875	230	1.0178	0.2877	1.0178	1.0089
No log	7.25	232	1.0464	0.1927	1.0464	1.0229
No log	7.3125	234	1.0118	0.2539	1.0118	1.0059
No log	7.375	236	0.9814	0.2300	0.9814	0.9907
No log	7.4375	238	0.9307	0.3627	0.9307	0.9647
No log	7.5	240	0.9273	0.3771	0.9273	0.9630
No log	7.5625	242	0.9436	0.3421	0.9436	0.9714
No log	7.625	244	0.9512	0.3042	0.9512	0.9753
No log	7.6875	246	1.0086	0.3492	1.0086	1.0043
No log	7.75	248	1.0326	0.3954	1.0326	1.0162
No log	7.8125	250	0.9953	0.3557	0.9953	0.9976
No log	7.875	252	0.9559	0.4016	0.9559	0.9777
No log	7.9375	254	0.9216	0.3724	0.9216	0.9600
No log	8.0	256	0.9207	0.3663	0.9207	0.9595
No log	8.0625	258	0.9373	0.3548	0.9373	0.9681
No log	8.125	260	0.9303	0.3779	0.9303	0.9645
No log	8.1875	262	0.9104	0.4105	0.9104	0.9542
No log	8.25	264	0.9081	0.4681	0.9081	0.9529
No log	8.3125	266	0.9422	0.4685	0.9422	0.9707
No log	8.375	268	1.0161	0.4533	1.0161	1.0080
No log	8.4375	270	1.0389	0.4533	1.0389	1.0193
No log	8.5	272	0.9811	0.4600	0.9811	0.9905
No log	8.5625	274	0.9975	0.4600	0.9975	0.9987
No log	8.625	276	1.0585	0.4300	1.0585	1.0288
No log	8.6875	278	1.1915	0.3459	1.1915	1.0916
No log	8.75	280	1.2712	0.3492	1.2712	1.1275
No log	8.8125	282	1.1998	0.3113	1.1998	1.0954
No log	8.875	284	1.1270	0.3766	1.1270	1.0616
No log	8.9375	286	1.1359	0.3726	1.1359	1.0658
No log	9.0	288	1.0653	0.3907	1.0653	1.0321
No log	9.0625	290	0.9950	0.4010	0.9950	0.9975
No log	9.125	292	0.9172	0.4105	0.9172	0.9577
No log	9.1875	294	0.9361	0.4858	0.9361	0.9675
No log	9.25	296	0.9843	0.4252	0.9843	0.9921
No log	9.3125	298	1.0042	0.4251	1.0042	1.0021
No log	9.375	300	0.9874	0.4778	0.9874	0.9937
No log	9.4375	302	1.0397	0.4769	1.0397	1.0197
No log	9.5	304	1.1348	0.4139	1.1348	1.0653
No log	9.5625	306	1.0765	0.3870	1.0765	1.0375
No log	9.625	308	0.9481	0.4639	0.9481	0.9737
No log	9.6875	310	0.8906	0.4385	0.8906	0.9437
No log	9.75	312	0.8896	0.3970	0.8896	0.9432
No log	9.8125	314	0.8737	0.4327	0.8737	0.9347
No log	9.875	316	0.8881	0.4811	0.8881	0.9424
No log	9.9375	318	1.0366	0.4306	1.0366	1.0181
No log	10.0	320	1.1185	0.3490	1.1185	1.0576
No log	10.0625	322	1.0254	0.4342	1.0254	1.0126
No log	10.125	324	1.0105	0.4672	1.0105	1.0052
No log	10.1875	326	1.0845	0.4332	1.0845	1.0414
No log	10.25	328	1.1597	0.4186	1.1597	1.0769
No log	10.3125	330	1.2653	0.3898	1.2653	1.1249
No log	10.375	332	1.1592	0.4186	1.1592	1.0767
No log	10.4375	334	0.9451	0.4591	0.9451	0.9722
No log	10.5	336	0.8736	0.5111	0.8736	0.9346
No log	10.5625	338	0.8935	0.4775	0.8935	0.9453
No log	10.625	340	0.9456	0.5201	0.9456	0.9724
No log	10.6875	342	0.9226	0.4240	0.9226	0.9605
No log	10.75	344	0.9042	0.3652	0.9042	0.9509
No log	10.8125	346	0.9172	0.3652	0.9172	0.9577
No log	10.875	348	0.9559	0.3970	0.9559	0.9777
No log	10.9375	350	1.0256	0.4372	1.0257	1.0127
No log	11.0	352	1.1511	0.3811	1.1511	1.0729
No log	11.0625	354	1.1856	0.4186	1.1856	1.0889
No log	11.125	356	1.0912	0.3726	1.0912	1.0446
No log	11.1875	358	0.9779	0.3908	0.9779	0.9889
No log	11.25	360	0.9423	0.3802	0.9423	0.9707
No log	11.3125	362	0.9594	0.3530	0.9594	0.9795
No log	11.375	364	1.0246	0.3676	1.0246	1.0122
No log	11.4375	366	1.1088	0.3701	1.1088	1.0530
No log	11.5	368	1.1364	0.3708	1.1364	1.0660
No log	11.5625	370	1.0580	0.3912	1.0580	1.0286
No log	11.625	372	1.0059	0.4304	1.0059	1.0029
No log	11.6875	374	1.0465	0.3907	1.0465	1.0230
No log	11.75	376	1.0833	0.4106	1.0833	1.0408
No log	11.8125	378	1.0617	0.4186	1.0617	1.0304
No log	11.875	380	1.1067	0.4186	1.1067	1.0520
No log	11.9375	382	1.0658	0.3992	1.0658	1.0324
No log	12.0	384	0.9812	0.4740	0.9812	0.9906
No log	12.0625	386	0.9298	0.4484	0.9298	0.9642
No log	12.125	388	0.9897	0.4740	0.9897	0.9949
No log	12.1875	390	1.1540	0.3921	1.1540	1.0742
No log	12.25	392	1.1977	0.3811	1.1977	1.0944
No log	12.3125	394	1.1074	0.4105	1.1074	1.0523
No log	12.375	396	0.9948	0.3438	0.9948	0.9974
No log	12.4375	398	0.9594	0.3560	0.9594	0.9795
No log	12.5	400	0.9529	0.3697	0.9529	0.9762
No log	12.5625	402	1.0147	0.3090	1.0147	1.0073
No log	12.625	404	1.0851	0.3813	1.0851	1.0417
No log	12.6875	406	1.1035	0.3778	1.1035	1.0505
No log	12.75	408	1.0864	0.3465	1.0864	1.0423
No log	12.8125	410	1.0198	0.2395	1.0198	1.0099
No log	12.875	412	0.9567	0.2506	0.9567	0.9781
No log	12.9375	414	0.9187	0.3812	0.9187	0.9585
No log	13.0	416	0.9210	0.3069	0.9210	0.9597
No log	13.0625	418	0.9213	0.3834	0.9213	0.9599
No log	13.125	420	0.9797	0.3962	0.9797	0.9898
No log	13.1875	422	1.0853	0.3986	1.0853	1.0418
No log	13.25	424	1.1095	0.4186	1.1095	1.0533
No log	13.3125	426	1.0357	0.3763	1.0357	1.0177
No log	13.375	428	0.9208	0.5016	0.9208	0.9596
No log	13.4375	430	0.8804	0.4998	0.8804	0.9383
No log	13.5	432	0.8571	0.4777	0.8571	0.9258
No log	13.5625	434	0.8513	0.4777	0.8513	0.9227
No log	13.625	436	0.8933	0.4622	0.8933	0.9452
No log	13.6875	438	0.9440	0.4007	0.9440	0.9716
No log	13.75	440	0.9719	0.4430	0.9719	0.9859
No log	13.8125	442	0.9695	0.4430	0.9695	0.9846
No log	13.875	444	0.9307	0.4513	0.9307	0.9647
No log	13.9375	446	0.9207	0.4712	0.9207	0.9595
No log	14.0	448	0.9158	0.48	0.9158	0.9570
No log	14.0625	450	0.9620	0.4874	0.9620	0.9808
No log	14.125	452	1.0522	0.4106	1.0522	1.0258
No log	14.1875	454	1.0312	0.4410	1.0312	1.0155
No log	14.25	456	0.9852	0.4948	0.9852	0.9926
No log	14.3125	458	1.0803	0.3998	1.0803	1.0394
No log	14.375	460	1.2660	0.3849	1.2660	1.1252
No log	14.4375	462	1.2971	0.3611	1.2971	1.1389
No log	14.5	464	1.1683	0.3409	1.1683	1.0809
No log	14.5625	466	1.0040	0.3630	1.0040	1.0020
No log	14.625	468	0.9709	0.3892	0.9709	0.9853
No log	14.6875	470	0.9967	0.4219	0.9967	0.9983
No log	14.75	472	1.0411	0.4217	1.0411	1.0204
No log	14.8125	474	1.1310	0.4186	1.1310	1.0635
No log	14.875	476	1.0873	0.3992	1.0873	1.0427
No log	14.9375	478	1.0939	0.3992	1.0939	1.0459
No log	15.0	480	1.1400	0.4555	1.1400	1.0677
No log	15.0625	482	1.1935	0.4365	1.1935	1.0925
No log	15.125	484	1.1758	0.4365	1.1758	1.0843
No log	15.1875	486	1.0879	0.4186	1.0879	1.0430
No log	15.25	488	1.0132	0.3982	1.0132	1.0066
No log	15.3125	490	0.9984	0.3755	0.9984	0.9992
No log	15.375	492	0.9979	0.3747	0.9979	0.9990
No log	15.4375	494	1.0590	0.3982	1.0590	1.0291
No log	15.5	496	1.1756	0.4377	1.1756	1.0843
No log	15.5625	498	1.3221	0.4607	1.3221	1.1498
0.3666	15.625	500	1.3290	0.4707	1.3290	1.1528
0.3666	15.6875	502	1.2630	0.4538	1.2630	1.1238
0.3666	15.75	504	1.1499	0.4186	1.1499	1.0723
0.3666	15.8125	506	1.0499	0.3771	1.0499	1.0246
0.3666	15.875	508	1.0028	0.3763	1.0028	1.0014
0.3666	15.9375	510	0.9728	0.4098	0.9728	0.9863

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1