ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k13_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4598
• Qwk: 0.4536
• Mse: 0.4598
• Rmse: 0.6781

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	3.4817	-0.0066	3.4817	1.8659
No log	0.0656	4	1.7809	-0.0070	1.7809	1.3345
No log	0.0984	6	1.2499	0.0294	1.2499	1.1180
No log	0.1311	8	0.7278	0.0877	0.7278	0.8531
No log	0.1639	10	0.5922	0.0569	0.5922	0.7695
No log	0.1967	12	0.6267	0.0556	0.6267	0.7917
No log	0.2295	14	1.3841	0.0571	1.3841	1.1765
No log	0.2623	16	1.4961	0.0530	1.4961	1.2231
No log	0.2951	18	1.0130	0.0345	1.0130	1.0065
No log	0.3279	20	0.6682	0.2970	0.6682	0.8174
No log	0.3607	22	0.6324	0.0	0.6324	0.7952
No log	0.3934	24	0.6134	0.0	0.6134	0.7832
No log	0.4262	26	0.5538	0.0	0.5538	0.7442
No log	0.4590	28	0.5810	0.0569	0.5810	0.7622
No log	0.4918	30	0.7427	0.1289	0.7427	0.8618
No log	0.5246	32	1.0811	0.0345	1.0811	1.0398
No log	0.5574	34	1.9357	0.0130	1.9357	1.3913
No log	0.5902	36	1.5936	0.0255	1.5936	1.2624
No log	0.6230	38	0.8366	0.0947	0.8366	0.9147
No log	0.6557	40	0.5621	0.0	0.5621	0.7497
No log	0.6885	42	0.5743	0.0	0.5743	0.7578
No log	0.7213	44	0.6108	0.0	0.6108	0.7815
No log	0.7541	46	0.6148	0.1884	0.6148	0.7841
No log	0.7869	48	0.6416	0.3778	0.6416	0.8010
No log	0.8197	50	0.7271	0.2208	0.7271	0.8527
No log	0.8525	52	0.6944	0.3242	0.6944	0.8333
No log	0.8852	54	0.9028	0.1870	0.9028	0.9502
No log	0.9180	56	0.7058	0.3607	0.7058	0.8401
No log	0.9508	58	0.5607	0.3684	0.5607	0.7488
No log	0.9836	60	0.5800	0.3978	0.5800	0.7616
No log	1.0164	62	0.5578	0.3778	0.5578	0.7469
No log	1.0492	64	0.7610	0.2281	0.7610	0.8723
No log	1.0820	66	0.8670	0.2000	0.8670	0.9312
No log	1.1148	68	0.6853	0.2593	0.6853	0.8278
No log	1.1475	70	0.5524	0.2418	0.5524	0.7432
No log	1.1803	72	0.5795	0.2201	0.5795	0.7612
No log	1.2131	74	0.7120	0.2511	0.7120	0.8438
No log	1.2459	76	0.6703	0.3143	0.6703	0.8187
No log	1.2787	78	0.5369	0.2533	0.5369	0.7328
No log	1.3115	80	0.7049	0.2762	0.7049	0.8396
No log	1.3443	82	1.1540	0.0571	1.1540	1.0743
No log	1.3770	84	0.8168	0.3021	0.8168	0.9037
No log	1.4098	86	0.5969	0.1111	0.5969	0.7726
No log	1.4426	88	0.6122	0.2000	0.6122	0.7825
No log	1.4754	90	0.6471	0.2766	0.6471	0.8044
No log	1.5082	92	0.8531	0.2184	0.8531	0.9237
No log	1.5410	94	0.6763	0.1705	0.6763	0.8224
No log	1.5738	96	0.5742	0.3757	0.5742	0.7578
No log	1.6066	98	0.6765	0.2577	0.6765	0.8225
No log	1.6393	100	0.5091	0.3086	0.5091	0.7135
No log	1.6721	102	0.7683	0.2222	0.7683	0.8765
No log	1.7049	104	0.6296	0.2688	0.6296	0.7935
No log	1.7377	106	0.5034	0.2105	0.5034	0.7095
No log	1.7705	108	0.5106	0.2105	0.5106	0.7146
No log	1.8033	110	0.5819	0.3216	0.5819	0.7628
No log	1.8361	112	0.8530	0.1934	0.8530	0.9236
No log	1.8689	114	0.7430	0.2000	0.7430	0.8620
No log	1.9016	116	0.4821	0.1329	0.4821	0.6943
No log	1.9344	118	0.7775	0.2681	0.7775	0.8817
No log	1.9672	120	0.8698	0.2653	0.8698	0.9326
No log	2.0	122	0.5849	0.3488	0.5849	0.7648
No log	2.0328	124	0.4895	0.1141	0.4895	0.6997
No log	2.0656	126	0.5340	0.3659	0.5340	0.7308
No log	2.0984	128	0.5956	0.3297	0.5956	0.7718
No log	2.1311	130	0.5238	0.1899	0.5238	0.7237
No log	2.1639	132	0.5729	0.3533	0.5729	0.7569
No log	2.1967	134	0.5316	0.2663	0.5316	0.7291
No log	2.2295	136	0.6007	0.2917	0.6007	0.7751
No log	2.2623	138	0.5871	0.2350	0.5871	0.7662
No log	2.2951	140	0.5491	0.2558	0.5491	0.7410
No log	2.3279	142	0.5303	0.2795	0.5303	0.7282
No log	2.3607	144	0.5291	0.2350	0.5291	0.7274
No log	2.3934	146	0.4905	0.3103	0.4905	0.7004
No log	2.4262	148	0.4741	0.3591	0.4741	0.6885
No log	2.4590	150	0.5017	0.4682	0.5017	0.7083
No log	2.4918	152	0.4721	0.3295	0.4721	0.6871
No log	2.5246	154	0.5161	0.2917	0.5161	0.7184
No log	2.5574	156	0.5173	0.4872	0.5173	0.7192
No log	2.5902	158	0.6608	0.4439	0.6608	0.8129
No log	2.6230	160	0.5538	0.48	0.5538	0.7442
No log	2.6557	162	0.5874	0.3982	0.5874	0.7664
No log	2.6885	164	0.6162	0.3886	0.6162	0.7850
No log	2.7213	166	0.5125	0.3333	0.5125	0.7159
No log	2.7541	168	0.5198	0.3191	0.5198	0.7209
No log	2.7869	170	0.5784	0.4167	0.5784	0.7605
No log	2.8197	172	0.5619	0.3469	0.5619	0.7496
No log	2.8525	174	0.5568	0.3913	0.5568	0.7462
No log	2.8852	176	0.5379	0.4023	0.5379	0.7334
No log	2.9180	178	0.5168	0.3258	0.5168	0.7189
No log	2.9508	180	0.5484	0.3224	0.5484	0.7406
No log	2.9836	182	0.5068	0.3149	0.5068	0.7119
No log	3.0164	184	0.5139	0.3149	0.5139	0.7169
No log	3.0492	186	0.5458	0.2967	0.5458	0.7388
No log	3.0820	188	0.5516	0.3636	0.5516	0.7427
No log	3.1148	190	0.5811	0.3371	0.5811	0.7623
No log	3.1475	192	0.5813	0.3371	0.5813	0.7624
No log	3.1803	194	0.6103	0.3371	0.6103	0.7812
No log	3.2131	196	0.7484	0.3043	0.7484	0.8651
No log	3.2459	198	0.6197	0.3412	0.6197	0.7872
No log	3.2787	200	0.5967	0.2189	0.5967	0.7724
No log	3.3115	202	0.7016	0.2746	0.7016	0.8376
No log	3.3443	204	0.6424	0.3231	0.6424	0.8015
No log	3.3770	206	0.5772	0.3000	0.5772	0.7598
No log	3.4098	208	0.5538	0.2707	0.5538	0.7442
No log	3.4426	210	0.5375	0.2471	0.5375	0.7331
No log	3.4754	212	0.5875	0.3295	0.5875	0.7665
No log	3.5082	214	0.5149	0.3418	0.5149	0.7176
No log	3.5410	216	0.6055	0.2986	0.6055	0.7781
No log	3.5738	218	0.5127	0.3171	0.5127	0.7161
No log	3.6066	220	0.4825	0.4074	0.4825	0.6946
No log	3.6393	222	0.5364	0.2485	0.5364	0.7324
No log	3.6721	224	0.5696	0.2444	0.5696	0.7547
No log	3.7049	226	0.5208	0.3000	0.5208	0.7216
No log	3.7377	228	0.5064	0.4286	0.5064	0.7116
No log	3.7705	230	0.6872	0.28	0.6872	0.8290
No log	3.8033	232	0.6749	0.2990	0.6749	0.8215
No log	3.8361	234	0.5281	0.3898	0.5281	0.7267
No log	3.8689	236	0.7272	0.3514	0.7272	0.8528
No log	3.9016	238	0.6082	0.36	0.6082	0.7799
No log	3.9344	240	0.4863	0.3054	0.4863	0.6974
No log	3.9672	242	0.5834	0.3299	0.5834	0.7638
No log	4.0	244	0.5033	0.3103	0.5033	0.7094
No log	4.0328	246	0.4363	0.3377	0.4363	0.6605
No log	4.0656	248	0.4328	0.3377	0.4328	0.6579
No log	4.0984	250	0.4327	0.2941	0.4327	0.6578
No log	4.1311	252	0.4798	0.3086	0.4798	0.6927
No log	4.1639	254	0.4712	0.3333	0.4712	0.6864
No log	4.1967	256	0.4708	0.4227	0.4708	0.6861
No log	4.2295	258	0.4791	0.3927	0.4791	0.6922
No log	4.2623	260	0.4793	0.3412	0.4793	0.6923
No log	4.2951	262	0.5222	0.4105	0.5222	0.7226
No log	4.3279	264	0.4540	0.3374	0.4540	0.6738
No log	4.3607	266	0.4620	0.3846	0.4620	0.6797
No log	4.3934	268	0.4657	0.4917	0.4657	0.6824
No log	4.4262	270	0.4946	0.3778	0.4946	0.7033
No log	4.4590	272	0.5850	0.36	0.5850	0.7648
No log	4.4918	274	0.4994	0.3295	0.4994	0.7067
No log	4.5246	276	0.4787	0.3136	0.4787	0.6919
No log	4.5574	278	0.4827	0.3374	0.4827	0.6947
No log	4.5902	280	0.5165	0.2941	0.5165	0.7187
No log	4.6230	282	0.4857	0.3374	0.4857	0.6969
No log	4.6557	284	0.4874	0.3374	0.4874	0.6982
No log	4.6885	286	0.4876	0.3374	0.4876	0.6983
No log	4.7213	288	0.5362	0.4227	0.5362	0.7323
No log	4.7541	290	0.5915	0.4343	0.5915	0.7691
No log	4.7869	292	0.5041	0.2809	0.5041	0.7100
No log	4.8197	294	0.5801	0.3778	0.5801	0.7617
No log	4.8525	296	0.5877	0.3778	0.5877	0.7666
No log	4.8852	298	0.5144	0.2889	0.5144	0.7172
No log	4.9180	300	0.6045	0.4118	0.6045	0.7775
No log	4.9508	302	0.5585	0.3641	0.5585	0.7473
No log	4.9836	304	0.5402	0.2865	0.5402	0.7350
No log	5.0164	306	0.5393	0.2670	0.5393	0.7344
No log	5.0492	308	0.5444	0.3520	0.5444	0.7378
No log	5.0820	310	0.5924	0.2889	0.5924	0.7697
No log	5.1148	312	0.5468	0.3182	0.5468	0.7394
No log	5.1475	314	0.5217	0.3966	0.5217	0.7223
No log	5.1803	316	0.5588	0.4563	0.5588	0.7475
No log	5.2131	318	0.4922	0.3966	0.4922	0.7015
No log	5.2459	320	0.4931	0.3913	0.4931	0.7022
No log	5.2787	322	0.5215	0.3829	0.5215	0.7221
No log	5.3115	324	0.4680	0.4884	0.4680	0.6841
No log	5.3443	326	0.5945	0.3769	0.5945	0.7710
No log	5.3770	328	0.7647	0.2548	0.7647	0.8745
No log	5.4098	330	0.6925	0.2566	0.6925	0.8322
No log	5.4426	332	0.5003	0.4222	0.5003	0.7073
No log	5.4754	334	0.4778	0.4	0.4778	0.6913
No log	5.5082	336	0.4851	0.3580	0.4851	0.6965
No log	5.5410	338	0.4883	0.3533	0.4883	0.6988
No log	5.5738	340	0.4561	0.2432	0.4561	0.6753
No log	5.6066	342	0.4755	0.3631	0.4755	0.6896
No log	5.6393	344	0.5807	0.4098	0.5807	0.7620
No log	5.6721	346	0.6192	0.3498	0.6192	0.7869
No log	5.7049	348	0.5242	0.3846	0.5242	0.7240
No log	5.7377	350	0.4609	0.2432	0.4609	0.6789
No log	5.7705	352	0.4606	0.3548	0.4606	0.6787
No log	5.8033	354	0.4655	0.3548	0.4655	0.6823
No log	5.8361	356	0.4693	0.2848	0.4693	0.6851
No log	5.8689	358	0.5269	0.2273	0.5269	0.7259
No log	5.9016	360	0.5205	0.2914	0.5205	0.7214
No log	5.9344	362	0.4695	0.2941	0.4695	0.6852
No log	5.9672	364	0.5113	0.3412	0.5113	0.7151
No log	6.0	366	0.5657	0.3953	0.5657	0.7522
No log	6.0328	368	0.5299	0.3953	0.5299	0.7279
No log	6.0656	370	0.4768	0.35	0.4768	0.6905
No log	6.0984	372	0.4957	0.3103	0.4957	0.7041
No log	6.1311	374	0.5247	0.3371	0.5247	0.7244
No log	6.1639	376	0.4808	0.3939	0.4808	0.6934
No log	6.1967	378	0.4600	0.3374	0.4600	0.6782
No log	6.2295	380	0.4716	0.3939	0.4716	0.6867
No log	6.2623	382	0.4507	0.3810	0.4507	0.6713
No log	6.2951	384	0.4347	0.4556	0.4347	0.6593
No log	6.3279	386	0.4429	0.4620	0.4429	0.6655
No log	6.3607	388	0.4646	0.4943	0.4646	0.6816
No log	6.3934	390	0.4453	0.4860	0.4453	0.6673
No log	6.4262	392	0.4147	0.4667	0.4147	0.6439
No log	6.4590	394	0.4986	0.4652	0.4986	0.7061
No log	6.4918	396	0.5220	0.4227	0.5220	0.7225
No log	6.5246	398	0.4431	0.4157	0.4431	0.6656
No log	6.5574	400	0.4051	0.4667	0.4051	0.6364
No log	6.5902	402	0.4216	0.4091	0.4216	0.6493
No log	6.6230	404	0.4519	0.4943	0.4519	0.6722
No log	6.6557	406	0.4333	0.4091	0.4333	0.6583
No log	6.6885	408	0.4245	0.4884	0.4245	0.6516
No log	6.7213	410	0.4390	0.3757	0.4390	0.6626
No log	6.7541	412	0.4561	0.3708	0.4561	0.6753
No log	6.7869	414	0.4726	0.3708	0.4726	0.6875
No log	6.8197	416	0.4717	0.4475	0.4717	0.6868
No log	6.8525	418	0.4517	0.4894	0.4517	0.6721
No log	6.8852	420	0.4540	0.4409	0.4540	0.6738
No log	6.9180	422	0.4643	0.5080	0.4643	0.6814
No log	6.9508	424	0.4547	0.4348	0.4547	0.6743
No log	6.9836	426	0.4449	0.4819	0.4449	0.6670
No log	7.0164	428	0.4768	0.3708	0.4768	0.6905
No log	7.0492	430	0.4930	0.3778	0.4930	0.7021
No log	7.0820	432	0.4761	0.3829	0.4761	0.6900
No log	7.1148	434	0.4471	0.4475	0.4471	0.6687
No log	7.1475	436	0.4395	0.5165	0.4395	0.6629
No log	7.1803	438	0.4365	0.4222	0.4365	0.6607
No log	7.2131	440	0.4404	0.5080	0.4404	0.6636
No log	7.2459	442	0.4382	0.5165	0.4382	0.6620
No log	7.2787	444	0.4360	0.4468	0.4360	0.6603
No log	7.3115	446	0.4352	0.4098	0.4352	0.6597
No log	7.3443	448	0.4458	0.4783	0.4458	0.6676
No log	7.3770	450	0.4547	0.4033	0.4547	0.6743
No log	7.4098	452	0.4413	0.4667	0.4413	0.6643
No log	7.4426	454	0.4502	0.4348	0.4502	0.6710
No log	7.4754	456	0.4469	0.4348	0.4469	0.6685
No log	7.5082	458	0.4464	0.4595	0.4464	0.6681
No log	7.5410	460	0.4497	0.4652	0.4497	0.6706
No log	7.5738	462	0.4499	0.4725	0.4499	0.6707
No log	7.6066	464	0.4555	0.4783	0.4555	0.6749
No log	7.6393	466	0.4535	0.4783	0.4535	0.6734
No log	7.6721	468	0.4559	0.4783	0.4559	0.6752
No log	7.7049	470	0.4590	0.4033	0.4590	0.6775
No log	7.7377	472	0.4560	0.5056	0.4560	0.6753
No log	7.7705	474	0.4738	0.4348	0.4738	0.6883
No log	7.8033	476	0.4830	0.4348	0.4830	0.6950
No log	7.8361	478	0.4622	0.4286	0.4622	0.6798
No log	7.8689	480	0.4711	0.4348	0.4711	0.6864
No log	7.9016	482	0.5371	0.3730	0.5371	0.7329
No log	7.9344	484	0.5739	0.3267	0.5739	0.7576
No log	7.9672	486	0.5424	0.4105	0.5424	0.7365
No log	8.0	488	0.4812	0.4033	0.4812	0.6937
No log	8.0328	490	0.4538	0.4536	0.4538	0.6737
No log	8.0656	492	0.4563	0.4348	0.4563	0.6755
No log	8.0984	494	0.4652	0.4348	0.4652	0.6821
No log	8.1311	496	0.4629	0.4348	0.4629	0.6804
No log	8.1639	498	0.4577	0.4348	0.4577	0.6765
0.3761	8.1967	500	0.4486	0.4536	0.4486	0.6698
0.3761	8.2295	502	0.4560	0.4348	0.4560	0.6753
0.3761	8.2623	504	0.4535	0.4413	0.4535	0.6734
0.3761	8.2951	506	0.4495	0.3846	0.4495	0.6704
0.3761	8.3279	508	0.4464	0.4536	0.4464	0.6681
0.3761	8.3607	510	0.4481	0.4348	0.4481	0.6694
0.3761	8.3934	512	0.4653	0.5080	0.4653	0.6822
0.3761	8.4262	514	0.4642	0.5080	0.4642	0.6813
0.3761	8.4590	516	0.4514	0.4286	0.4514	0.6719
0.3761	8.4918	518	0.4518	0.4409	0.4518	0.6721
0.3761	8.5246	520	0.4561	0.4894	0.4561	0.6754
0.3761	8.5574	522	0.4571	0.4894	0.4571	0.6761
0.3761	8.5902	524	0.4578	0.4894	0.4578	0.6766
0.3761	8.6230	526	0.4647	0.4819	0.4647	0.6817
0.3761	8.6557	528	0.4699	0.3797	0.4699	0.6855
0.3761	8.6885	530	0.4622	0.4819	0.4622	0.6798
0.3761	8.7213	532	0.4561	0.4894	0.4561	0.6754
0.3761	8.7541	534	0.4517	0.4286	0.4517	0.6721
0.3761	8.7869	536	0.4517	0.4286	0.4517	0.6721
0.3761	8.8197	538	0.4524	0.4286	0.4524	0.6726
0.3761	8.8525	540	0.4526	0.4348	0.4526	0.6727
0.3761	8.8852	542	0.4497	0.4348	0.4497	0.6706
0.3761	8.9180	544	0.4487	0.4286	0.4487	0.6698
0.3761	8.9508	546	0.4504	0.4286	0.4504	0.6711
0.3761	8.9836	548	0.4520	0.4286	0.4520	0.6723
0.3761	9.0164	550	0.4563	0.4348	0.4563	0.6755
0.3761	9.0492	552	0.4681	0.5080	0.4681	0.6842
0.3761	9.0820	554	0.4834	0.5080	0.4834	0.6953
0.3761	9.1148	556	0.4893	0.5080	0.4893	0.6995
0.3761	9.1475	558	0.4820	0.5080	0.4820	0.6942
0.3761	9.1803	560	0.4737	0.5080	0.4737	0.6883
0.3761	9.2131	562	0.4630	0.4348	0.4630	0.6804
0.3761	9.2459	564	0.4584	0.4409	0.4584	0.6770
0.3761	9.2787	566	0.4621	0.3446	0.4621	0.6798
0.3761	9.3115	568	0.4717	0.3966	0.4717	0.6868
0.3761	9.3443	570	0.4741	0.4348	0.4741	0.6885
0.3761	9.3770	572	0.4694	0.4023	0.4694	0.6851
0.3761	9.4098	574	0.4664	0.4023	0.4664	0.6829
0.3761	9.4426	576	0.4623	0.3446	0.4623	0.6799
0.3761	9.4754	578	0.4605	0.4409	0.4605	0.6786
0.3761	9.5082	580	0.4620	0.4286	0.4620	0.6797
0.3761	9.5410	582	0.4658	0.4348	0.4658	0.6825
0.3761	9.5738	584	0.4709	0.4348	0.4709	0.6862
0.3761	9.6066	586	0.4731	0.4348	0.4731	0.6878
0.3761	9.6393	588	0.4753	0.4348	0.4753	0.6894
0.3761	9.6721	590	0.4735	0.4348	0.4735	0.6881
0.3761	9.7049	592	0.4688	0.4348	0.4688	0.6847
0.3761	9.7377	594	0.4648	0.4348	0.4648	0.6818
0.3761	9.7705	596	0.4622	0.4286	0.4622	0.6798
0.3761	9.8033	598	0.4607	0.4286	0.4607	0.6788
0.3761	9.8361	600	0.4601	0.4409	0.4601	0.6783
0.3761	9.8689	602	0.4597	0.4409	0.4597	0.6780
0.3761	9.9016	604	0.4597	0.4409	0.4597	0.6780
0.3761	9.9344	606	0.4597	0.4409	0.4597	0.6780
0.3761	9.9672	608	0.4597	0.4536	0.4597	0.6780
0.3761	10.0	610	0.4598	0.4536	0.4598	0.6781

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1