ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k13_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5755
• Qwk: 0.5472
• Mse: 0.5755
• Rmse: 0.7586

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	3.2641	0.0337	3.2641	1.8067
No log	0.0656	4	1.4830	-0.0070	1.4830	1.2178
No log	0.0984	6	0.8743	0.0916	0.8743	0.9351
No log	0.1311	8	0.7142	0.2967	0.7142	0.8451
No log	0.1639	10	0.6334	0.2575	0.6334	0.7959
No log	0.1967	12	0.5996	0.1515	0.5996	0.7743
No log	0.2295	14	0.8257	0.0078	0.8257	0.9087
No log	0.2623	16	0.9302	0.0	0.9302	0.9645
No log	0.2951	18	0.8235	0.0388	0.8235	0.9075
No log	0.3279	20	0.7822	0.0894	0.7822	0.8844
No log	0.3607	22	0.6297	0.3067	0.6297	0.7935
No log	0.3934	24	0.5372	0.0569	0.5372	0.7329
No log	0.4262	26	0.5549	0.0569	0.5549	0.7449
No log	0.4590	28	0.5454	0.0569	0.5454	0.7385
No log	0.4918	30	1.0625	-0.0159	1.0625	1.0308
No log	0.5246	32	1.2646	0.0255	1.2646	1.1245
No log	0.5574	34	0.7775	0.1795	0.7775	0.8817
No log	0.5902	36	0.6104	0.2821	0.6104	0.7813
No log	0.6230	38	0.5388	0.0	0.5388	0.7340
No log	0.6557	40	0.5549	0.0	0.5549	0.7449
No log	0.6885	42	0.6246	0.0638	0.6246	0.7903
No log	0.7213	44	0.7008	0.1919	0.7008	0.8371
No log	0.7541	46	0.7945	0.0667	0.7945	0.8914
No log	0.7869	48	0.8456	0.0794	0.8456	0.9196
No log	0.8197	50	0.6851	0.1515	0.6851	0.8277
No log	0.8525	52	0.6064	0.0303	0.6064	0.7787
No log	0.8852	54	0.5776	0.0815	0.5776	0.7600
No log	0.9180	56	0.5502	-0.0159	0.5502	0.7418
No log	0.9508	58	0.5470	0.1407	0.5470	0.7396
No log	0.9836	60	0.6480	0.2350	0.6480	0.8050
No log	1.0164	62	0.6765	0.2410	0.6765	0.8225
No log	1.0492	64	0.6168	0.2281	0.6168	0.7853
No log	1.0820	66	0.5837	0.2704	0.5837	0.7640
No log	1.1148	68	0.7053	0.1373	0.7053	0.8398
No log	1.1475	70	0.9958	0.136	0.9958	0.9979
No log	1.1803	72	0.8395	0.1660	0.8395	0.9162
No log	1.2131	74	0.5799	0.1899	0.5799	0.7615
No log	1.2459	76	0.6454	0.1258	0.6454	0.8034
No log	1.2787	78	0.6191	0.25	0.6191	0.7868
No log	1.3115	80	0.6039	0.2000	0.6039	0.7771
No log	1.3443	82	0.6460	0.2609	0.6460	0.8038
No log	1.3770	84	0.6952	0.3061	0.6952	0.8338
No log	1.4098	86	0.5593	0.1788	0.5593	0.7478
No log	1.4426	88	0.6768	0.2265	0.6768	0.8227
No log	1.4754	90	0.5822	0.1801	0.5822	0.7630
No log	1.5082	92	0.6061	0.3757	0.6061	0.7785
No log	1.5410	94	0.7683	0.2000	0.7683	0.8765
No log	1.5738	96	0.7148	0.1841	0.7148	0.8455
No log	1.6066	98	0.5747	0.2405	0.5747	0.7581
No log	1.6393	100	0.6147	0.3580	0.6147	0.7841
No log	1.6721	102	0.5698	0.1111	0.5698	0.7548
No log	1.7049	104	0.5347	0.0857	0.5347	0.7313
No log	1.7377	106	0.7113	0.2381	0.7113	0.8434
No log	1.7705	108	0.7392	0.2217	0.7392	0.8598
No log	1.8033	110	0.5263	0.2215	0.5263	0.7255
No log	1.8361	112	0.5375	0.0720	0.5375	0.7331
No log	1.8689	114	0.5326	0.1385	0.5326	0.7298
No log	1.9016	116	0.5024	0.0534	0.5024	0.7088
No log	1.9344	118	0.5111	0.1176	0.5111	0.7149
No log	1.9672	120	0.4969	0.1176	0.4969	0.7049
No log	2.0	122	0.4725	0.2752	0.4725	0.6874
No log	2.0328	124	0.5214	0.3191	0.5214	0.7221
No log	2.0656	126	0.4875	0.2795	0.4875	0.6982
No log	2.0984	128	0.5003	0.2676	0.5003	0.7073
No log	2.1311	130	0.6550	0.3231	0.6550	0.8093
No log	2.1639	132	0.5734	0.4667	0.5734	0.7572
No log	2.1967	134	0.5086	0.5027	0.5086	0.7131
No log	2.2295	136	0.4681	0.4682	0.4681	0.6842
No log	2.2623	138	0.5608	0.3103	0.5608	0.7489
No log	2.2951	140	0.7118	0.3274	0.7118	0.8437
No log	2.3279	142	0.4816	0.4595	0.4816	0.6940
No log	2.3607	144	0.8396	0.1331	0.8396	0.9163
No log	2.3934	146	1.0920	0.1186	1.0920	1.0450
No log	2.4262	148	0.8600	0.1343	0.8600	0.9274
No log	2.4590	150	0.5127	0.4536	0.5127	0.7160
No log	2.4918	152	0.4735	0.4943	0.4735	0.6881
No log	2.5246	154	0.4671	0.4743	0.4671	0.6835
No log	2.5574	156	0.4962	0.4839	0.4962	0.7044
No log	2.5902	158	0.6162	0.4286	0.6162	0.7850
No log	2.6230	160	0.6812	0.3271	0.6812	0.8254
No log	2.6557	162	0.6813	0.3271	0.6813	0.8254
No log	2.6885	164	0.8344	0.2248	0.8344	0.9134
No log	2.7213	166	0.6098	0.3301	0.6098	0.7809
No log	2.7541	168	0.4990	0.4229	0.4990	0.7064
No log	2.7869	170	0.5103	0.4975	0.5103	0.7144
No log	2.8197	172	0.5542	0.3299	0.5542	0.7445
No log	2.8525	174	0.6925	0.2838	0.6925	0.8322
No log	2.8852	176	0.7979	0.2605	0.7979	0.8933
No log	2.9180	178	0.6043	0.3422	0.6043	0.7774
No log	2.9508	180	0.5036	0.4783	0.5036	0.7097
No log	2.9836	182	0.4999	0.4654	0.4999	0.7071
No log	3.0164	184	0.6500	0.3739	0.6500	0.8062
No log	3.0492	186	0.7406	0.3388	0.7406	0.8606
No log	3.0820	188	0.5179	0.4798	0.5179	0.7197
No log	3.1148	190	0.4894	0.4234	0.4894	0.6996
No log	3.1475	192	0.6685	0.3128	0.6685	0.8176
No log	3.1803	194	1.0057	0.1944	1.0057	1.0029
No log	3.2131	196	0.8385	0.1938	0.8385	0.9157
No log	3.2459	198	0.5531	0.4336	0.5531	0.7437
No log	3.2787	200	0.5066	0.4605	0.5066	0.7118
No log	3.3115	202	0.5442	0.4286	0.5442	0.7377
No log	3.3443	204	0.5337	0.3962	0.5337	0.7305
No log	3.3770	206	0.9981	0.1943	0.9981	0.9991
No log	3.4098	208	1.1267	0.1429	1.1267	1.0615
No log	3.4426	210	0.8583	0.25	0.8583	0.9264
No log	3.4754	212	0.6225	0.4081	0.6225	0.7890
No log	3.5082	214	0.6155	0.3818	0.6155	0.7845
No log	3.5410	216	0.5627	0.5122	0.5627	0.7502
No log	3.5738	218	0.6799	0.3665	0.6799	0.8245
No log	3.6066	220	0.4919	0.5152	0.4919	0.7014
No log	3.6393	222	0.4800	0.4839	0.4800	0.6928
No log	3.6721	224	0.6538	0.4123	0.6538	0.8086
No log	3.7049	226	0.7485	0.3004	0.7485	0.8651
No log	3.7377	228	0.5725	0.4510	0.5725	0.7566
No log	3.7705	230	0.4752	0.2749	0.4752	0.6894
No log	3.8033	232	0.4792	0.2771	0.4792	0.6923
No log	3.8361	234	0.5271	0.4112	0.5271	0.7260
No log	3.8689	236	0.5623	0.4229	0.5623	0.7499
No log	3.9016	238	0.4807	0.3939	0.4807	0.6933
No log	3.9344	240	0.5559	0.2893	0.5559	0.7456
No log	3.9672	242	0.4952	0.2663	0.4952	0.7037
No log	4.0	244	0.6128	0.4393	0.6128	0.7828
No log	4.0328	246	0.9074	0.1355	0.9074	0.9526
No log	4.0656	248	0.9290	0.1355	0.9290	0.9638
No log	4.0984	250	0.5915	0.4010	0.5915	0.7691
No log	4.1311	252	0.5023	0.3216	0.5023	0.7087
No log	4.1639	254	0.5432	0.3200	0.5432	0.7370
No log	4.1967	256	0.4978	0.4222	0.4978	0.7056
No log	4.2295	258	0.6643	0.4067	0.6643	0.8151
No log	4.2623	260	0.6674	0.4654	0.6674	0.8169
No log	4.2951	262	0.6491	0.4233	0.6491	0.8057
No log	4.3279	264	0.5511	0.3962	0.5511	0.7424
No log	4.3607	266	0.5192	0.4286	0.5192	0.7206
No log	4.3934	268	0.5762	0.4178	0.5762	0.7591
No log	4.4262	270	0.7529	0.2646	0.7529	0.8677
No log	4.4590	272	0.6983	0.3427	0.6983	0.8357
No log	4.4918	274	0.5093	0.4400	0.5093	0.7137
No log	4.5246	276	0.5124	0.3829	0.5124	0.7158
No log	4.5574	278	0.5255	0.3073	0.5255	0.7249
No log	4.5902	280	0.4763	0.4350	0.4763	0.6901
No log	4.6230	282	0.6310	0.3427	0.6310	0.7943
No log	4.6557	284	0.8285	0.1933	0.8285	0.9102
No log	4.6885	286	0.7648	0.2646	0.7648	0.8745
No log	4.7213	288	0.5597	0.4680	0.5597	0.7481
No log	4.7541	290	0.5193	0.4924	0.5193	0.7206
No log	4.7869	292	0.5427	0.4450	0.5427	0.7367
No log	4.8197	294	0.5123	0.4396	0.5123	0.7157
No log	4.8525	296	0.6289	0.4605	0.6289	0.7930
No log	4.8852	298	0.8314	0.2275	0.8314	0.9118
No log	4.9180	300	0.7979	0.2208	0.7979	0.8932
No log	4.9508	302	0.6285	0.4815	0.6285	0.7928
No log	4.9836	304	0.5304	0.3769	0.5304	0.7283
No log	5.0164	306	0.5233	0.3769	0.5233	0.7234
No log	5.0492	308	0.6114	0.5349	0.6114	0.7819
No log	5.0820	310	0.8752	0.1934	0.8752	0.9355
No log	5.1148	312	0.8306	0.2269	0.8306	0.9114
No log	5.1475	314	0.5709	0.4175	0.5709	0.7556
No log	5.1803	316	0.5012	0.4924	0.5012	0.7080
No log	5.2131	318	0.4528	0.4346	0.4528	0.6729
No log	5.2459	320	0.4405	0.3609	0.4405	0.6637
No log	5.2787	322	0.4445	0.3757	0.4445	0.6667
No log	5.3115	324	0.4916	0.4286	0.4916	0.7011
No log	5.3443	326	0.7214	0.2727	0.7214	0.8493
No log	5.3770	328	0.8590	0.2314	0.8590	0.9268
No log	5.4098	330	0.7079	0.3028	0.7079	0.8414
No log	5.4426	332	0.4844	0.4783	0.4844	0.6960
No log	5.4754	334	0.5759	0.3427	0.5759	0.7589
No log	5.5082	336	0.7070	0.3333	0.7070	0.8408
No log	5.5410	338	0.5922	0.3761	0.5922	0.7695
No log	5.5738	340	0.4740	0.4400	0.4740	0.6884
No log	5.6066	342	0.6748	0.3665	0.6748	0.8215
No log	5.6393	344	0.9874	0.1367	0.9874	0.9937
No log	5.6721	346	1.0700	0.1389	1.0700	1.0344
No log	5.7049	348	0.8852	0.2569	0.8852	0.9408
No log	5.7377	350	0.5763	0.5349	0.5763	0.7592
No log	5.7705	352	0.4623	0.4510	0.4623	0.6799
No log	5.8033	354	0.4653	0.4573	0.4653	0.6821
No log	5.8361	356	0.4586	0.4400	0.4586	0.6772
No log	5.8689	358	0.5936	0.4563	0.5936	0.7705
No log	5.9016	360	0.8339	0.2258	0.8339	0.9132
No log	5.9344	362	0.9594	0.1940	0.9594	0.9795
No log	5.9672	364	0.8576	0.2253	0.8576	0.9261
No log	6.0	366	0.6155	0.4074	0.6155	0.7845
No log	6.0328	368	0.4675	0.5094	0.4675	0.6838
No log	6.0656	370	0.4581	0.4175	0.4581	0.6768
No log	6.0984	372	0.4886	0.5215	0.4886	0.6990
No log	6.1311	374	0.6120	0.3973	0.6120	0.7823
No log	6.1639	376	0.7138	0.3028	0.7138	0.8449
No log	6.1967	378	0.6585	0.3427	0.6585	0.8115
No log	6.2295	380	0.5278	0.4615	0.5278	0.7265
No log	6.2623	382	0.4580	0.4346	0.4580	0.6767
No log	6.2951	384	0.4651	0.3478	0.4651	0.6820
No log	6.3279	386	0.4538	0.4157	0.4538	0.6736
No log	6.3607	388	0.4763	0.5215	0.4763	0.6902
No log	6.3934	390	0.5881	0.3398	0.5881	0.7669
No log	6.4262	392	0.6138	0.3846	0.6138	0.7835
No log	6.4590	394	0.5442	0.4605	0.5442	0.7377
No log	6.4918	396	0.4762	0.5025	0.4762	0.6901
No log	6.5246	398	0.4685	0.4346	0.4685	0.6844
No log	6.5574	400	0.4619	0.4167	0.4619	0.6796
No log	6.5902	402	0.4651	0.4227	0.4651	0.6820
No log	6.6230	404	0.4663	0.4227	0.4663	0.6829
No log	6.6557	406	0.4688	0.4227	0.4688	0.6847
No log	6.6885	408	0.4856	0.4346	0.4856	0.6969
No log	6.7213	410	0.5124	0.4229	0.5124	0.7158
No log	6.7541	412	0.6089	0.4798	0.6089	0.7803
No log	6.7869	414	0.6875	0.4595	0.6875	0.8292
No log	6.8197	416	0.6663	0.5023	0.6663	0.8163
No log	6.8525	418	0.5690	0.5044	0.5690	0.7543
No log	6.8852	420	0.5180	0.4444	0.5180	0.7197
No log	6.9180	422	0.5164	0.4703	0.5164	0.7186
No log	6.9508	424	0.5374	0.4643	0.5374	0.7331
No log	6.9836	426	0.6269	0.4737	0.6269	0.7918
No log	7.0164	428	0.7476	0.3719	0.7476	0.8646
No log	7.0492	430	0.7508	0.3719	0.7508	0.8665
No log	7.0820	432	0.7024	0.4844	0.7024	0.8381
No log	7.1148	434	0.6107	0.4737	0.6107	0.7814
No log	7.1475	436	0.5343	0.4930	0.5343	0.7310
No log	7.1803	438	0.5145	0.4833	0.5145	0.7173
No log	7.2131	440	0.5449	0.5157	0.5449	0.7382
No log	7.2459	442	0.5973	0.4844	0.5973	0.7728
No log	7.2787	444	0.6255	0.4595	0.6255	0.7909
No log	7.3115	446	0.5901	0.4844	0.5901	0.7682
No log	7.3443	448	0.5803	0.4844	0.5803	0.7618
No log	7.3770	450	0.5002	0.4747	0.5002	0.7072
No log	7.4098	452	0.4351	0.4639	0.4351	0.6596
No log	7.4426	454	0.4288	0.4563	0.4288	0.6548
No log	7.4754	456	0.4301	0.4639	0.4301	0.6558
No log	7.5082	458	0.4372	0.4639	0.4372	0.6612
No log	7.5410	460	0.4502	0.4639	0.4502	0.6710
No log	7.5738	462	0.4823	0.4468	0.4823	0.6945
No log	7.6066	464	0.5769	0.5023	0.5769	0.7595
No log	7.6393	466	0.6960	0.3886	0.6960	0.8343
No log	7.6721	468	0.6875	0.3886	0.6875	0.8292
No log	7.7049	470	0.6211	0.4338	0.6211	0.7881
No log	7.7377	472	0.5363	0.5556	0.5363	0.7323
No log	7.7705	474	0.4852	0.4851	0.4852	0.6966
No log	7.8033	476	0.4696	0.4518	0.4696	0.6853
No log	7.8361	478	0.4750	0.4518	0.4750	0.6892
No log	7.8689	480	0.5081	0.5728	0.5081	0.7128
No log	7.9016	482	0.5879	0.4338	0.5879	0.7667
No log	7.9344	484	0.6897	0.2920	0.6897	0.8305
No log	7.9672	486	0.7256	0.2646	0.7256	0.8518
No log	8.0	488	0.6944	0.2646	0.6944	0.8333
No log	8.0328	490	0.6241	0.3929	0.6241	0.7900
No log	8.0656	492	0.5363	0.5248	0.5363	0.7323
No log	8.0984	494	0.4846	0.5233	0.4846	0.6961
No log	8.1311	496	0.4549	0.4839	0.4549	0.6744
No log	8.1639	498	0.4545	0.4583	0.4545	0.6742
0.4257	8.1967	500	0.4706	0.4764	0.4706	0.6860
0.4257	8.2295	502	0.5247	0.5769	0.5247	0.7243
0.4257	8.2623	504	0.6109	0.4595	0.6109	0.7816
0.4257	8.2951	506	0.6696	0.3929	0.6696	0.8183
0.4257	8.3279	508	0.6698	0.3929	0.6698	0.8184
0.4257	8.3607	510	0.6261	0.4595	0.6261	0.7913
0.4257	8.3934	512	0.5828	0.5088	0.5828	0.7634
0.4257	8.4262	514	0.5844	0.5088	0.5844	0.7645
0.4257	8.4590	516	0.6085	0.4844	0.6085	0.7801
0.4257	8.4918	518	0.6092	0.4844	0.6092	0.7805
0.4257	8.5246	520	0.5922	0.5157	0.5922	0.7695
0.4257	8.5574	522	0.5850	0.5157	0.5850	0.7649
0.4257	8.5902	524	0.5762	0.5157	0.5762	0.7591
0.4257	8.6230	526	0.5679	0.5157	0.5679	0.7536
0.4257	8.6557	528	0.5410	0.5385	0.5410	0.7356
0.4257	8.6885	530	0.5096	0.4764	0.5096	0.7138
0.4257	8.7213	532	0.4989	0.4639	0.4989	0.7063
0.4257	8.7541	534	0.4925	0.4518	0.4925	0.7018
0.4257	8.7869	536	0.4885	0.4639	0.4885	0.6989
0.4257	8.8197	538	0.4930	0.4639	0.4930	0.7021
0.4257	8.8525	540	0.5152	0.4404	0.5152	0.7177
0.4257	8.8852	542	0.5493	0.5305	0.5493	0.7412
0.4257	8.9180	544	0.5622	0.5273	0.5622	0.7498
0.4257	8.9508	546	0.5659	0.5273	0.5659	0.7523
0.4257	8.9836	548	0.5864	0.5273	0.5864	0.7658
0.4257	9.0164	550	0.6026	0.5023	0.6026	0.7763
0.4257	9.0492	552	0.5915	0.5273	0.5915	0.7691
0.4257	9.0820	554	0.5676	0.5273	0.5676	0.7534
0.4257	9.1148	556	0.5497	0.5305	0.5497	0.7414
0.4257	9.1475	558	0.5448	0.5305	0.5448	0.7381
0.4257	9.1803	560	0.5250	0.5385	0.5250	0.7246
0.4257	9.2131	562	0.5201	0.5074	0.5201	0.7212
0.4257	9.2459	564	0.5170	0.5074	0.5170	0.7190
0.4257	9.2787	566	0.5181	0.5074	0.5181	0.7198
0.4257	9.3115	568	0.5166	0.5074	0.5166	0.7188
0.4257	9.3443	570	0.5108	0.4747	0.5108	0.7147
0.4257	9.3770	572	0.5148	0.5385	0.5148	0.7175
0.4257	9.4098	574	0.5268	0.5385	0.5268	0.7258
0.4257	9.4426	576	0.5347	0.5385	0.5347	0.7312
0.4257	9.4754	578	0.5433	0.5305	0.5433	0.7371
0.4257	9.5082	580	0.5397	0.5305	0.5397	0.7347
0.4257	9.5410	582	0.5350	0.5305	0.5350	0.7314
0.4257	9.5738	584	0.5306	0.5385	0.5306	0.7284
0.4257	9.6066	586	0.5310	0.5385	0.5310	0.7287
0.4257	9.6393	588	0.5369	0.5305	0.5369	0.7328
0.4257	9.6721	590	0.5465	0.5429	0.5465	0.7392
0.4257	9.7049	592	0.5572	0.5429	0.5572	0.7465
0.4257	9.7377	594	0.5682	0.5721	0.5682	0.7538
0.4257	9.7705	596	0.5712	0.5721	0.5712	0.7558
0.4257	9.8033	598	0.5747	0.5472	0.5747	0.7581
0.4257	9.8361	600	0.5797	0.5472	0.5797	0.7614
0.4257	9.8689	602	0.5796	0.5472	0.5796	0.7613
0.4257	9.9016	604	0.5777	0.5472	0.5777	0.7601
0.4257	9.9344	606	0.5756	0.5472	0.5756	0.7587
0.4257	9.9672	608	0.5752	0.5472	0.5752	0.7584
0.4257	10.0	610	0.5755	0.5472	0.5755	0.7586

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1