ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k17_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5206
• Qwk: 0.5492
• Mse: 0.5206
• Rmse: 0.7215

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	2.5216	-0.0788	2.5216	1.5880
No log	0.0930	4	1.3298	0.0987	1.3298	1.1531
No log	0.1395	6	1.1231	-0.1802	1.1231	1.0598
No log	0.1860	8	0.9602	0.1584	0.9602	0.9799
No log	0.2326	10	0.9949	0.1787	0.9949	0.9974
No log	0.2791	12	0.9448	0.1914	0.9448	0.9720
No log	0.3256	14	0.8636	-0.0500	0.8636	0.9293
No log	0.3721	16	0.8411	0.0428	0.8411	0.9171
No log	0.4186	18	0.8386	0.0	0.8386	0.9158
No log	0.4651	20	0.8513	0.0481	0.8513	0.9227
No log	0.5116	22	0.8073	0.0481	0.8073	0.8985
No log	0.5581	24	0.7473	-0.0027	0.7473	0.8645
No log	0.6047	26	0.7141	0.0393	0.7141	0.8450
No log	0.6512	28	0.7378	0.1863	0.7378	0.8590
No log	0.6977	30	0.7711	0.1508	0.7711	0.8781
No log	0.7442	32	0.7876	0.0798	0.7876	0.8875
No log	0.7907	34	0.7918	0.1863	0.7918	0.8899
No log	0.8372	36	0.7878	0.1508	0.7878	0.8876
No log	0.8837	38	0.7839	0.1863	0.7839	0.8854
No log	0.9302	40	0.7700	0.1863	0.7700	0.8775
No log	0.9767	42	0.7589	0.1313	0.7589	0.8711
No log	1.0233	44	0.7514	0.1508	0.7514	0.8669
No log	1.0698	46	0.7350	0.1187	0.7350	0.8573
No log	1.1163	48	0.7033	0.1508	0.7033	0.8387
No log	1.1628	50	0.7157	0.1407	0.7157	0.8460
No log	1.2093	52	0.8240	0.2116	0.8240	0.9078
No log	1.2558	54	0.8788	0.2843	0.8788	0.9374
No log	1.3023	56	0.8123	0.1766	0.8123	0.9013
No log	1.3488	58	0.7238	0.2589	0.7238	0.8508
No log	1.3953	60	0.6827	0.3166	0.6827	0.8263
No log	1.4419	62	0.6554	0.3465	0.6554	0.8096
No log	1.4884	64	0.6981	0.3032	0.6981	0.8355
No log	1.5349	66	0.7468	0.3494	0.7468	0.8642
No log	1.5814	68	0.7420	0.3894	0.7420	0.8614
No log	1.6279	70	0.6926	0.3167	0.6926	0.8322
No log	1.6744	72	0.6332	0.3387	0.6332	0.7957
No log	1.7209	74	0.6267	0.3754	0.6267	0.7916
No log	1.7674	76	0.7521	0.2796	0.7521	0.8672
No log	1.8140	78	0.7386	0.2610	0.7386	0.8594
No log	1.8605	80	0.6403	0.3200	0.6403	0.8002
No log	1.9070	82	0.5881	0.3465	0.5881	0.7669
No log	1.9535	84	0.6596	0.4392	0.6596	0.8121
No log	2.0	86	0.6852	0.4089	0.6852	0.8278
No log	2.0465	88	0.6648	0.3409	0.6648	0.8154
No log	2.0930	90	0.6343	0.3312	0.6343	0.7964
No log	2.1395	92	0.6310	0.4354	0.6310	0.7943
No log	2.1860	94	0.6324	0.4660	0.6324	0.7953
No log	2.2326	96	0.6357	0.4659	0.6357	0.7973
No log	2.2791	98	0.6348	0.3728	0.6348	0.7967
No log	2.3256	100	0.6218	0.4659	0.6218	0.7886
No log	2.3721	102	0.6559	0.3963	0.6559	0.8099
No log	2.4186	104	0.6696	0.4123	0.6696	0.8183
No log	2.4651	106	0.6710	0.4369	0.6710	0.8192
No log	2.5116	108	0.6682	0.4369	0.6682	0.8174
No log	2.5581	110	0.6889	0.4587	0.6889	0.8300
No log	2.6047	112	0.6762	0.4369	0.6762	0.8223
No log	2.6512	114	0.6553	0.4036	0.6553	0.8095
No log	2.6977	116	0.6317	0.3700	0.6317	0.7948
No log	2.7442	118	0.6269	0.4007	0.6269	0.7918
No log	2.7907	120	0.6786	0.4144	0.6786	0.8238
No log	2.8372	122	0.7461	0.4223	0.7461	0.8638
No log	2.8837	124	0.6931	0.4243	0.6931	0.8325
No log	2.9302	126	0.6620	0.4428	0.6620	0.8136
No log	2.9767	128	0.7196	0.4486	0.7196	0.8483
No log	3.0233	130	0.7905	0.4286	0.7905	0.8891
No log	3.0698	132	0.7932	0.4667	0.7932	0.8906
No log	3.1163	134	0.7309	0.3844	0.7309	0.8550
No log	3.1628	136	0.7509	0.3992	0.7509	0.8665
No log	3.2093	138	0.7730	0.4468	0.7730	0.8792
No log	3.2558	140	0.8695	0.3377	0.8695	0.9324
No log	3.3023	142	0.7781	0.4366	0.7781	0.8821
No log	3.3488	144	0.7173	0.4197	0.7173	0.8470
No log	3.3953	146	0.7185	0.3723	0.7185	0.8476
No log	3.4419	148	0.8004	0.3891	0.8004	0.8947
No log	3.4884	150	0.7193	0.3817	0.7193	0.8481
No log	3.5349	152	0.6513	0.3978	0.6513	0.8071
No log	3.5814	154	0.7636	0.4063	0.7636	0.8738
No log	3.6279	156	0.7489	0.4236	0.7489	0.8654
No log	3.6744	158	0.6498	0.5200	0.6498	0.8061
No log	3.7209	160	0.6581	0.4444	0.6581	0.8113
No log	3.7674	162	0.8335	0.4013	0.8335	0.9129
No log	3.8140	164	0.8437	0.3501	0.8437	0.9185
No log	3.8605	166	0.7447	0.2558	0.7447	0.8630
No log	3.9070	168	0.6562	0.2909	0.6562	0.8101
No log	3.9535	170	0.5951	0.3357	0.5951	0.7714
No log	4.0	172	0.5613	0.4527	0.5613	0.7492
No log	4.0465	174	0.5433	0.4547	0.5433	0.7371
No log	4.0930	176	0.5683	0.5086	0.5683	0.7538
No log	4.1395	178	0.5865	0.5086	0.5865	0.7658
No log	4.1860	180	0.5787	0.5166	0.5787	0.7607
No log	4.2326	182	0.6390	0.4684	0.6390	0.7994
No log	4.2791	184	0.7665	0.4552	0.7665	0.8755
No log	4.3256	186	0.7546	0.4350	0.7546	0.8687
No log	4.3721	188	0.7207	0.4159	0.7207	0.8489
No log	4.4186	190	0.6486	0.4684	0.6486	0.8054
No log	4.4651	192	0.6186	0.4916	0.6186	0.7865
No log	4.5116	194	0.5859	0.4495	0.5859	0.7655
No log	4.5581	196	0.5910	0.5286	0.5910	0.7688
No log	4.6047	198	0.6384	0.4315	0.6384	0.7990
No log	4.6512	200	0.7494	0.3560	0.7494	0.8657
No log	4.6977	202	0.7975	0.3160	0.7975	0.8930
No log	4.7442	204	0.8886	0.2948	0.8886	0.9427
No log	4.7907	206	0.7379	0.3803	0.7379	0.8590
No log	4.8372	208	0.6294	0.4354	0.6294	0.7933
No log	4.8837	210	0.5940	0.4190	0.5940	0.7707
No log	4.9302	212	0.6110	0.4776	0.6110	0.7817
No log	4.9767	214	0.5942	0.4244	0.5942	0.7709
No log	5.0233	216	0.6811	0.4819	0.6811	0.8253
No log	5.0698	218	0.8033	0.4032	0.8033	0.8963
No log	5.1163	220	0.7555	0.4102	0.7555	0.8692
No log	5.1628	222	0.5789	0.5237	0.5789	0.7608
No log	5.2093	224	0.5514	0.5020	0.5514	0.7425
No log	5.2558	226	0.5517	0.4620	0.5517	0.7427
No log	5.3023	228	0.6169	0.5149	0.6169	0.7854
No log	5.3488	230	0.7253	0.3688	0.7253	0.8516
No log	5.3953	232	0.7342	0.4133	0.7342	0.8568
No log	5.4419	234	0.6497	0.4315	0.6497	0.8061
No log	5.4884	236	0.5848	0.4933	0.5848	0.7647
No log	5.5349	238	0.5436	0.5362	0.5436	0.7373
No log	5.5814	240	0.5463	0.5032	0.5463	0.7391
No log	5.6279	242	0.5442	0.5291	0.5442	0.7377
No log	5.6744	244	0.5396	0.5047	0.5396	0.7346
No log	5.7209	246	0.5480	0.5242	0.5480	0.7403
No log	5.7674	248	0.5402	0.5242	0.5402	0.7350
No log	5.8140	250	0.5453	0.5242	0.5453	0.7384
No log	5.8605	252	0.5531	0.5242	0.5531	0.7437
No log	5.9070	254	0.5434	0.5473	0.5434	0.7372
No log	5.9535	256	0.5160	0.5662	0.5160	0.7183
No log	6.0	258	0.5160	0.5923	0.5160	0.7183
No log	6.0465	260	0.5171	0.5923	0.5171	0.7191
No log	6.0930	262	0.5071	0.5845	0.5071	0.7121
No log	6.1395	264	0.5086	0.5528	0.5086	0.7131
No log	6.1860	266	0.5321	0.4970	0.5321	0.7294
No log	6.2326	268	0.5695	0.5620	0.5695	0.7546
No log	6.2791	270	0.5719	0.5911	0.5719	0.7562
No log	6.3256	272	0.5960	0.5745	0.5960	0.7720
No log	6.3721	274	0.6061	0.5742	0.6061	0.7785
No log	6.4186	276	0.5626	0.5906	0.5626	0.7500
No log	6.4651	278	0.5226	0.6240	0.5226	0.7229
No log	6.5116	280	0.5520	0.5403	0.5520	0.7430
No log	6.5581	282	0.5524	0.5512	0.5524	0.7432
No log	6.6047	284	0.5383	0.5288	0.5383	0.7337
No log	6.6512	286	0.5500	0.5867	0.5500	0.7416
No log	6.6977	288	0.5527	0.5853	0.5527	0.7434
No log	6.7442	290	0.5843	0.5433	0.5843	0.7644
No log	6.7907	292	0.6500	0.5561	0.6500	0.8062
No log	6.8372	294	0.6336	0.5459	0.6336	0.7960
No log	6.8837	296	0.5709	0.5368	0.5709	0.7556
No log	6.9302	298	0.5321	0.5958	0.5321	0.7294
No log	6.9767	300	0.5142	0.5436	0.5142	0.7171
No log	7.0233	302	0.5128	0.5234	0.5128	0.7161
No log	7.0698	304	0.4991	0.6184	0.4991	0.7065
No log	7.1163	306	0.5110	0.6115	0.5110	0.7148
No log	7.1628	308	0.5253	0.5173	0.5253	0.7248
No log	7.2093	310	0.5148	0.5845	0.5148	0.7175
No log	7.2558	312	0.5069	0.5926	0.5069	0.7120
No log	7.3023	314	0.5171	0.5669	0.5171	0.7191
No log	7.3488	316	0.5130	0.6198	0.5130	0.7163
No log	7.3953	318	0.5291	0.5597	0.5291	0.7274
No log	7.4419	320	0.5148	0.6173	0.5148	0.7175
No log	7.4884	322	0.5239	0.5479	0.5239	0.7238
No log	7.5349	324	0.5541	0.5710	0.5541	0.7443
No log	7.5814	326	0.5379	0.5392	0.5379	0.7334
No log	7.6279	328	0.5232	0.5586	0.5232	0.7233
No log	7.6744	330	0.5155	0.5383	0.5155	0.7180
No log	7.7209	332	0.5242	0.5273	0.5242	0.7240
No log	7.7674	334	0.5127	0.5273	0.5127	0.7161
No log	7.8140	336	0.5084	0.5505	0.5084	0.7130
No log	7.8605	338	0.5196	0.5953	0.5196	0.7208
No log	7.9070	340	0.5300	0.5854	0.5300	0.7280
No log	7.9535	342	0.5353	0.5854	0.5353	0.7316
No log	8.0	344	0.5411	0.5594	0.5411	0.7356
No log	8.0465	346	0.6454	0.4887	0.6454	0.8034
No log	8.0930	348	0.7014	0.4648	0.7014	0.8375
No log	8.1395	350	0.6181	0.5042	0.6181	0.7862
No log	8.1860	352	0.5315	0.5768	0.5315	0.7290
No log	8.2326	354	0.5378	0.5234	0.5378	0.7333
No log	8.2791	356	0.5326	0.5580	0.5326	0.7298
No log	8.3256	358	0.5372	0.6083	0.5372	0.7330
No log	8.3721	360	0.5563	0.6083	0.5563	0.7458
No log	8.4186	362	0.5489	0.6083	0.5489	0.7409
No log	8.4651	364	0.5385	0.5965	0.5385	0.7338
No log	8.5116	366	0.5414	0.4876	0.5414	0.7358
No log	8.5581	368	0.5258	0.4762	0.5258	0.7251
No log	8.6047	370	0.5210	0.4991	0.5210	0.7218
No log	8.6512	372	0.5310	0.5784	0.5310	0.7287
No log	8.6977	374	0.5675	0.5845	0.5675	0.7533
No log	8.7442	376	0.5497	0.6088	0.5497	0.7414
No log	8.7907	378	0.5233	0.5769	0.5233	0.7234
No log	8.8372	380	0.5636	0.4980	0.5636	0.7508
No log	8.8837	382	0.5783	0.5217	0.5783	0.7605
No log	8.9302	384	0.5414	0.5160	0.5414	0.7358
No log	8.9767	386	0.5160	0.5286	0.5160	0.7183
No log	9.0233	388	0.5182	0.5852	0.5182	0.7198
No log	9.0698	390	0.5763	0.4980	0.5763	0.7591
No log	9.1163	392	0.5587	0.5418	0.5587	0.7474
No log	9.1628	394	0.5338	0.5926	0.5338	0.7306
No log	9.2093	396	0.5939	0.5621	0.5939	0.7706
No log	9.2558	398	0.6101	0.4955	0.6101	0.7811
No log	9.3023	400	0.5695	0.5368	0.5695	0.7546
No log	9.3488	402	0.5653	0.5770	0.5653	0.7518
No log	9.3953	404	0.5978	0.4864	0.5978	0.7732
No log	9.4419	406	0.5967	0.5098	0.5967	0.7725
No log	9.4884	408	0.5915	0.5357	0.5915	0.7691
No log	9.5349	410	0.6021	0.5596	0.6021	0.7760
No log	9.5814	412	0.6094	0.5390	0.6094	0.7806
No log	9.6279	414	0.5992	0.4941	0.5992	0.7741
No log	9.6744	416	0.6239	0.5373	0.6239	0.7899
No log	9.7209	418	0.6507	0.5042	0.6507	0.8067
No log	9.7674	420	0.6357	0.5470	0.6357	0.7973
No log	9.8140	422	0.5666	0.5442	0.5666	0.7527
No log	9.8605	424	0.5267	0.5753	0.5267	0.7257
No log	9.9070	426	0.5416	0.5452	0.5416	0.7359
No log	9.9535	428	0.5407	0.5373	0.5407	0.7353
No log	10.0	430	0.5432	0.4972	0.5432	0.7371
No log	10.0465	432	0.5509	0.5235	0.5509	0.7422
No log	10.0930	434	0.5915	0.4836	0.5915	0.7691
No log	10.1395	436	0.5975	0.5059	0.5975	0.7730
No log	10.1860	438	0.5578	0.5323	0.5578	0.7469
No log	10.2326	440	0.5494	0.4972	0.5494	0.7412
No log	10.2791	442	0.5541	0.5095	0.5541	0.7444
No log	10.3256	444	0.5909	0.4513	0.5909	0.7687
No log	10.3721	446	0.6025	0.4369	0.6025	0.7762
No log	10.4186	448	0.5725	0.5239	0.5725	0.7566
No log	10.4651	450	0.5514	0.5522	0.5514	0.7426
No log	10.5116	452	0.5513	0.5522	0.5513	0.7425
No log	10.5581	454	0.5566	0.5357	0.5566	0.7460
No log	10.6047	456	0.5965	0.5059	0.5965	0.7723
No log	10.6512	458	0.6391	0.4606	0.6391	0.7994
No log	10.6977	460	0.6118	0.5059	0.6118	0.7822
No log	10.7442	462	0.5671	0.5626	0.5671	0.7531
No log	10.7907	464	0.5605	0.5201	0.5605	0.7487
No log	10.8372	466	0.5549	0.5373	0.5549	0.7449
No log	10.8837	468	0.5477	0.4866	0.5477	0.7400
No log	10.9302	470	0.5882	0.4239	0.5882	0.7669
No log	10.9767	472	0.6669	0.4587	0.6669	0.8166
No log	11.0233	474	0.6715	0.4819	0.6715	0.8195
No log	11.0698	476	0.6319	0.5042	0.6319	0.7949
No log	11.1163	478	0.5830	0.4737	0.5830	0.7636
No log	11.1628	480	0.5574	0.5336	0.5574	0.7466
No log	11.2093	482	0.6026	0.5190	0.6026	0.7763
No log	11.2558	484	0.6056	0.4981	0.6056	0.7782
No log	11.3023	486	0.5971	0.4881	0.5971	0.7727
No log	11.3488	488	0.6458	0.4568	0.6458	0.8036
No log	11.3953	490	0.6907	0.5227	0.6907	0.8311
No log	11.4419	492	0.6787	0.5227	0.6787	0.8238
No log	11.4884	494	0.6398	0.4606	0.6398	0.7999
No log	11.5349	496	0.5749	0.4542	0.5749	0.7582
No log	11.5814	498	0.5322	0.5177	0.5322	0.7295
0.3477	11.6279	500	0.5443	0.5687	0.5443	0.7378
0.3477	11.6744	502	0.5416	0.5479	0.5416	0.7359
0.3477	11.7209	504	0.5316	0.5734	0.5316	0.7291
0.3477	11.7674	506	0.5578	0.4534	0.5578	0.7468
0.3477	11.8140	508	0.6063	0.4531	0.6063	0.7787
0.3477	11.8605	510	0.6020	0.4759	0.6020	0.7759
0.3477	11.9070	512	0.5536	0.5076	0.5536	0.7440
0.3477	11.9535	514	0.5206	0.5492	0.5206	0.7215

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1