ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1743
• Qwk: 0.5390
• Mse: 1.1743
• Rmse: 1.0836

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	6.7535	0.0308	6.7535	2.5987
No log	0.0784	4	4.1478	0.0779	4.1478	2.0366
No log	0.1176	6	3.0688	0.0870	3.0688	1.7518
No log	0.1569	8	2.3231	0.1007	2.3231	1.5242
No log	0.1961	10	1.9036	0.1607	1.9036	1.3797
No log	0.2353	12	1.8910	0.2301	1.8910	1.3751
No log	0.2745	14	1.8360	0.2478	1.8360	1.3550
No log	0.3137	16	1.7504	0.2545	1.7504	1.3230
No log	0.3529	18	1.8125	0.2931	1.8125	1.3463
No log	0.3922	20	1.6724	0.2569	1.6724	1.2932
No log	0.4314	22	1.6998	0.2703	1.6998	1.3038
No log	0.4706	24	2.0476	0.1290	2.0476	1.4309
No log	0.5098	26	2.2110	0.0769	2.2110	1.4870
No log	0.5490	28	2.0564	0.1791	2.0564	1.4340
No log	0.5882	30	1.6174	0.1897	1.6174	1.2718
No log	0.6275	32	1.4967	0.2385	1.4967	1.2234
No log	0.6667	34	1.5731	0.3306	1.5731	1.2542
No log	0.7059	36	1.5390	0.3577	1.5390	1.2406
No log	0.7451	38	1.4809	0.2759	1.4809	1.2169
No log	0.7843	40	1.4105	0.3393	1.4105	1.1877
No log	0.8235	42	1.4319	0.3455	1.4319	1.1966
No log	0.8627	44	1.3938	0.4107	1.3938	1.1806
No log	0.9020	46	1.3237	0.3860	1.3237	1.1505
No log	0.9412	48	1.3378	0.4274	1.3378	1.1566
No log	0.9804	50	1.3512	0.4590	1.3512	1.1624
No log	1.0196	52	1.4117	0.4697	1.4117	1.1882
No log	1.0588	54	1.5275	0.3636	1.5275	1.2359
No log	1.0980	56	1.6809	0.3286	1.6809	1.2965
No log	1.1373	58	1.7589	0.3143	1.7589	1.3262
No log	1.1765	60	1.7301	0.3309	1.7301	1.3153
No log	1.2157	62	1.6138	0.3741	1.6138	1.2703
No log	1.2549	64	1.3820	0.4638	1.3820	1.1756
No log	1.2941	66	1.2668	0.5362	1.2668	1.1255
No log	1.3333	68	1.2390	0.5821	1.2390	1.1131
No log	1.3725	70	1.3631	0.5191	1.3631	1.1675
No log	1.4118	72	1.4435	0.4769	1.4435	1.2015
No log	1.4510	74	1.4501	0.4478	1.4501	1.2042
No log	1.4902	76	1.3786	0.4526	1.3786	1.1742
No log	1.5294	78	1.3395	0.4930	1.3395	1.1574
No log	1.5686	80	1.2205	0.5152	1.2205	1.1047
No log	1.6078	82	1.2295	0.4923	1.2295	1.1088
No log	1.6471	84	1.1819	0.4923	1.1819	1.0872
No log	1.6863	86	1.1789	0.5106	1.1789	1.0858
No log	1.7255	88	1.4781	0.4179	1.4781	1.2158
No log	1.7647	90	1.5647	0.3802	1.5647	1.2509
No log	1.8039	92	1.3394	0.4754	1.3394	1.1573
No log	1.8431	94	1.1156	0.6176	1.1156	1.0562
No log	1.8824	96	1.0324	0.6119	1.0324	1.0161
No log	1.9216	98	0.9971	0.5802	0.9971	0.9986
No log	1.9608	100	1.0176	0.5455	1.0176	1.0088
No log	2.0	102	1.0228	0.5630	1.0228	1.0114
No log	2.0392	104	1.0696	0.6043	1.0696	1.0342
No log	2.0784	106	1.0766	0.5496	1.0766	1.0376
No log	2.1176	108	1.0465	0.5606	1.0465	1.0230
No log	2.1569	110	1.2129	0.5362	1.2129	1.1013
No log	2.1961	112	1.4475	0.4493	1.4475	1.2031
No log	2.2353	114	1.6736	0.3252	1.6736	1.2937
No log	2.2745	116	1.6451	0.3415	1.6451	1.2826
No log	2.3137	118	1.5365	0.4	1.5365	1.2396
No log	2.3529	120	1.3307	0.4677	1.3307	1.1535
No log	2.3922	122	1.2364	0.5564	1.2364	1.1119
No log	2.4314	124	1.2217	0.5468	1.2217	1.1053
No log	2.4706	126	1.2882	0.5037	1.2882	1.1350
No log	2.5098	128	1.2547	0.5581	1.2547	1.1201
No log	2.5490	130	1.2678	0.5397	1.2678	1.1260
No log	2.5882	132	1.2127	0.5354	1.2127	1.1012
No log	2.6275	134	1.1180	0.5736	1.1180	1.0573
No log	2.6667	136	1.0561	0.5970	1.0561	1.0277
No log	2.7059	138	1.0117	0.5736	1.0117	1.0058
No log	2.7451	140	1.0088	0.5781	1.0088	1.0044
No log	2.7843	142	1.0914	0.5970	1.0914	1.0447
No log	2.8235	144	1.1311	0.5649	1.1311	1.0635
No log	2.8627	146	1.1220	0.5538	1.1220	1.0593
No log	2.9020	148	1.0449	0.5238	1.0449	1.0222
No log	2.9412	150	0.9465	0.6061	0.9465	0.9729
No log	2.9804	152	0.9146	0.6269	0.9146	0.9563
No log	3.0196	154	0.8781	0.6286	0.8781	0.9371
No log	3.0588	156	1.0883	0.5890	1.0883	1.0432
No log	3.0980	158	1.4737	0.4085	1.4737	1.2140
No log	3.1373	160	1.5903	0.3143	1.5903	1.2611
No log	3.1765	162	1.3682	0.4384	1.3682	1.1697
No log	3.2157	164	0.9932	0.6797	0.9932	0.9966
No log	3.2549	166	0.8305	0.7170	0.8305	0.9113
No log	3.2941	168	0.8511	0.7162	0.8511	0.9226
No log	3.3333	170	0.8474	0.7	0.8474	0.9205
No log	3.3725	172	0.9623	0.6143	0.9623	0.9809
No log	3.4118	174	1.1073	0.5942	1.1073	1.0523
No log	3.4510	176	1.0914	0.5985	1.0914	1.0447
No log	3.4902	178	0.9408	0.6471	0.9408	0.9699
No log	3.5294	180	0.8551	0.6763	0.8551	0.9247
No log	3.5686	182	0.8346	0.7042	0.8346	0.9136
No log	3.6078	184	0.8714	0.6761	0.8714	0.9335
No log	3.6471	186	0.9798	0.6111	0.9798	0.9899
No log	3.6863	188	1.1298	0.5634	1.1298	1.0629
No log	3.7255	190	1.2441	0.5468	1.2441	1.1154
No log	3.7647	192	1.2801	0.5294	1.2801	1.1314
No log	3.8039	194	1.1992	0.5294	1.1992	1.0951
No log	3.8431	196	1.0682	0.5821	1.0682	1.0335
No log	3.8824	198	1.0245	0.6087	1.0245	1.0122
No log	3.9216	200	1.0037	0.6331	1.0037	1.0019
No log	3.9608	202	1.0376	0.5758	1.0376	1.0186
No log	4.0	204	1.0644	0.5821	1.0644	1.0317
No log	4.0392	206	1.0778	0.5865	1.0778	1.0382
No log	4.0784	208	1.1290	0.5522	1.1290	1.0625
No log	4.1176	210	1.1396	0.5333	1.1396	1.0675
No log	4.1569	212	1.0319	0.5865	1.0319	1.0158
No log	4.1961	214	1.0155	0.6047	1.0155	1.0077
No log	4.2353	216	1.0145	0.6190	1.0145	1.0072
No log	4.2745	218	1.0258	0.5246	1.0258	1.0128
No log	4.3137	220	1.0750	0.6299	1.0750	1.0368
No log	4.3529	222	1.1937	0.5522	1.1937	1.0926
No log	4.3922	224	1.1896	0.5481	1.1896	1.0907
No log	4.4314	226	1.1415	0.5735	1.1415	1.0684
No log	4.4706	228	1.1114	0.6165	1.1114	1.0543
No log	4.5098	230	1.1437	0.5429	1.1437	1.0694
No log	4.5490	232	1.1740	0.5255	1.1740	1.0835
No log	4.5882	234	1.1128	0.5255	1.1128	1.0549
No log	4.6275	236	1.0002	0.6043	1.0002	1.0001
No log	4.6667	238	0.8943	0.6176	0.8943	0.9457
No log	4.7059	240	0.8682	0.6269	0.8682	0.9318
No log	4.7451	242	0.9007	0.6471	0.9007	0.9490
No log	4.7843	244	0.9599	0.6099	0.9599	0.9798
No log	4.8235	246	0.9926	0.5775	0.9926	0.9963
No log	4.8627	248	0.9926	0.5694	0.9926	0.9963
No log	4.9020	250	0.9121	0.6765	0.9121	0.9550
No log	4.9412	252	0.8574	0.6269	0.8574	0.9259
No log	4.9804	254	0.8671	0.6466	0.8671	0.9312
No log	5.0196	256	0.8681	0.6815	0.8681	0.9317
No log	5.0588	258	0.8798	0.6815	0.8798	0.9380
No log	5.0980	260	0.9033	0.6569	0.9033	0.9504
No log	5.1373	262	0.8691	0.6522	0.8691	0.9322
No log	5.1765	264	0.8744	0.6423	0.8744	0.9351
No log	5.2157	266	0.8742	0.6515	0.8742	0.9350
No log	5.2549	268	0.8754	0.6260	0.8754	0.9356
No log	5.2941	270	0.8988	0.6364	0.8988	0.9480
No log	5.3333	272	0.9593	0.6277	0.9593	0.9794
No log	5.3725	274	1.0387	0.5714	1.0387	1.0192
No log	5.4118	276	1.0882	0.5674	1.0882	1.0432
No log	5.4510	278	1.1103	0.5674	1.1103	1.0537
No log	5.4902	280	1.0872	0.5674	1.0872	1.0427
No log	5.5294	282	1.1503	0.5674	1.1503	1.0725
No log	5.5686	284	1.1996	0.5850	1.1996	1.0953
No log	5.6078	286	1.2541	0.5714	1.2541	1.1199
No log	5.6471	288	1.1018	0.5890	1.1018	1.0497
No log	5.6863	290	0.9567	0.6567	0.9567	0.9781
No log	5.7255	292	0.9247	0.6567	0.9247	0.9616
No log	5.7647	294	0.9375	0.6667	0.9375	0.9683
No log	5.8039	296	0.9386	0.6667	0.9386	0.9688
No log	5.8431	298	0.9353	0.6232	0.9353	0.9671
No log	5.8824	300	0.8320	0.6812	0.8320	0.9121
No log	5.9216	302	0.7761	0.7338	0.7761	0.8810
No log	5.9608	304	0.7797	0.7133	0.7797	0.8830
No log	6.0	306	0.7584	0.7183	0.7584	0.8709
No log	6.0392	308	0.8288	0.6763	0.8288	0.9104
No log	6.0784	310	0.9517	0.6618	0.9517	0.9756
No log	6.1176	312	0.9813	0.6716	0.9813	0.9906
No log	6.1569	314	0.9318	0.6466	0.9318	0.9653
No log	6.1961	316	0.8855	0.6567	0.8855	0.9410
No log	6.2353	318	0.9215	0.6667	0.9215	0.9599
No log	6.2745	320	1.0174	0.6286	1.0174	1.0087
No log	6.3137	322	1.0149	0.6286	1.0149	1.0074
No log	6.3529	324	0.9491	0.6571	0.9491	0.9742
No log	6.3922	326	0.9253	0.6619	0.9253	0.9619
No log	6.4314	328	0.9650	0.6619	0.9650	0.9824
No log	6.4706	330	1.0403	0.6370	1.0403	1.0200
No log	6.5098	332	1.0315	0.6119	1.0315	1.0156
No log	6.5490	334	1.0442	0.6222	1.0442	1.0218
No log	6.5882	336	1.0787	0.5652	1.0787	1.0386
No log	6.6275	338	1.0414	0.6014	1.0414	1.0205
No log	6.6667	340	0.9672	0.6429	0.9672	0.9835
No log	6.7059	342	0.9581	0.6014	0.9581	0.9788
No log	6.7451	344	0.9607	0.5833	0.9607	0.9801
No log	6.7843	346	0.8812	0.6763	0.8812	0.9387
No log	6.8235	348	0.8489	0.6567	0.8489	0.9213
No log	6.8627	350	0.8209	0.6308	0.8209	0.9060
No log	6.9020	352	0.8422	0.6667	0.8422	0.9177
No log	6.9412	354	0.8948	0.6232	0.8948	0.9460
No log	6.9804	356	0.9236	0.6111	0.9236	0.9611
No log	7.0196	358	0.9040	0.625	0.9040	0.9508
No log	7.0588	360	0.8339	0.6429	0.8339	0.9132
No log	7.0980	362	0.8513	0.6429	0.8513	0.9226
No log	7.1373	364	0.8992	0.6571	0.8992	0.9483
No log	7.1765	366	0.9488	0.6479	0.9488	0.9740
No log	7.2157	368	0.9098	0.6528	0.9098	0.9538
No log	7.2549	370	0.8698	0.6619	0.8698	0.9326
No log	7.2941	372	0.8611	0.6619	0.8611	0.9280
No log	7.3333	374	0.8836	0.6418	0.8836	0.9400
No log	7.3725	376	0.9034	0.6364	0.9034	0.9505
No log	7.4118	378	0.9027	0.6667	0.9027	0.9501
No log	7.4510	380	0.8839	0.6471	0.8839	0.9402
No log	7.4902	382	0.8798	0.6471	0.8798	0.9380
No log	7.5294	384	0.9413	0.6286	0.9413	0.9702
No log	7.5686	386	0.9479	0.6286	0.9479	0.9736
No log	7.6078	388	0.9245	0.6617	0.9245	0.9615
No log	7.6471	390	0.9065	0.6308	0.9065	0.9521
No log	7.6863	392	0.9421	0.6364	0.9421	0.9706
No log	7.7255	394	0.9630	0.6165	0.9630	0.9813
No log	7.7647	396	0.9320	0.6316	0.9320	0.9654
No log	7.8039	398	0.8802	0.6815	0.8802	0.9382
No log	7.8431	400	0.8653	0.6466	0.8653	0.9302
No log	7.8824	402	0.9231	0.6471	0.9231	0.9608
No log	7.9216	404	1.1155	0.5571	1.1155	1.0562
No log	7.9608	406	1.2029	0.5390	1.2029	1.0968
No log	8.0	408	1.0759	0.5970	1.0759	1.0372
No log	8.0392	410	0.9360	0.6615	0.9360	0.9675
No log	8.0784	412	0.8937	0.6412	0.8937	0.9453
No log	8.1176	414	0.9362	0.6519	0.9362	0.9676
No log	8.1569	416	1.0134	0.5797	1.0134	1.0067
No log	8.1961	418	1.0827	0.5714	1.0827	1.0405
No log	8.2353	420	1.0207	0.6324	1.0207	1.0103
No log	8.2745	422	0.9785	0.6269	0.9785	0.9892
No log	8.3137	424	1.0069	0.6107	1.0069	1.0034
No log	8.3529	426	1.0802	0.5942	1.0802	1.0393
No log	8.3922	428	1.1168	0.5714	1.1168	1.0568
No log	8.4314	430	1.2163	0.5556	1.2163	1.1029
No log	8.4706	432	1.2044	0.5556	1.2044	1.0974
No log	8.5098	434	1.0961	0.5714	1.0961	1.0469
No log	8.5490	436	1.0113	0.6131	1.0113	1.0056
No log	8.5882	438	1.0080	0.6131	1.0080	1.0040
No log	8.6275	440	1.0093	0.6370	1.0093	1.0046
No log	8.6667	442	0.9625	0.6716	0.9625	0.9811
No log	8.7059	444	0.9049	0.6667	0.9049	0.9512
No log	8.7451	446	0.8470	0.6765	0.8470	0.9203
No log	8.7843	448	0.7959	0.7101	0.7959	0.8921
No log	8.8235	450	0.7862	0.7194	0.7862	0.8867
No log	8.8627	452	0.7961	0.7101	0.7961	0.8922
No log	8.9020	454	0.8263	0.6906	0.8263	0.9090
No log	8.9412	456	0.9175	0.6143	0.9175	0.9578
No log	8.9804	458	1.0163	0.6	1.0163	1.0081
No log	9.0196	460	1.0683	0.6043	1.0683	1.0336
No log	9.0588	462	1.0478	0.5926	1.0478	1.0236
No log	9.0980	464	1.0173	0.6515	1.0173	1.0086
No log	9.1373	466	0.9534	0.6765	0.9534	0.9764
No log	9.1765	468	0.9216	0.6667	0.9216	0.9600
No log	9.2157	470	0.9152	0.6260	0.9152	0.9567
No log	9.2549	472	0.9440	0.6716	0.9440	0.9716
No log	9.2941	474	0.9840	0.6515	0.9840	0.9919
No log	9.3333	476	1.0806	0.6565	1.0806	1.0395
No log	9.3725	478	1.1359	0.5970	1.1359	1.0658
No log	9.4118	480	1.1550	0.5547	1.1550	1.0747
No log	9.4510	482	1.0223	0.5839	1.0223	1.0111
No log	9.4902	484	0.9117	0.6331	0.9117	0.9548
No log	9.5294	486	0.8100	0.6912	0.8100	0.9000
No log	9.5686	488	0.8164	0.6567	0.8164	0.9035
No log	9.6078	490	0.8792	0.6377	0.8792	0.9376
No log	9.6471	492	0.9612	0.6187	0.9612	0.9804
No log	9.6863	494	1.0505	0.5926	1.0505	1.0250
No log	9.7255	496	1.0423	0.5970	1.0423	1.0209
No log	9.7647	498	0.9738	0.6212	0.9738	0.9868
0.4179	9.8039	500	0.9275	0.6515	0.9275	0.9631
0.4179	9.8431	502	0.9409	0.6212	0.9409	0.9700
0.4179	9.8824	504	1.0792	0.5694	1.0792	1.0388
0.4179	9.9216	506	1.2923	0.5867	1.2923	1.1368
0.4179	9.9608	508	1.3180	0.5714	1.3180	1.1481
0.4179	10.0	510	1.1743	0.5390	1.1743	1.0836

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1