ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k3_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5025
• Qwk: 0.5386
• Mse: 0.5025
• Rmse: 0.7089

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	2.4708	-0.0109	2.4708	1.5719
No log	0.2667	4	1.1231	0.1573	1.1231	1.0598
No log	0.4	6	0.8510	0.0535	0.8510	0.9225
No log	0.5333	8	0.7665	0.2692	0.7665	0.8755
No log	0.6667	10	0.9811	0.2589	0.9811	0.9905
No log	0.8	12	0.9755	0.2782	0.9755	0.9877
No log	0.9333	14	0.8124	0.1409	0.8124	0.9013
No log	1.0667	16	0.7463	0.0804	0.7463	0.8639
No log	1.2	18	0.7116	0.0851	0.7116	0.8436
No log	1.3333	20	0.7042	0.4076	0.7042	0.8391
No log	1.4667	22	0.8303	0.3473	0.8303	0.9112
No log	1.6	24	0.7570	0.3302	0.7570	0.8701
No log	1.7333	26	0.6766	0.3737	0.6766	0.8225
No log	1.8667	28	0.6412	0.1988	0.6412	0.8008
No log	2.0	30	0.6403	0.3572	0.6403	0.8002
No log	2.1333	32	0.6214	0.3398	0.6214	0.7883
No log	2.2667	34	0.6775	0.2768	0.6775	0.8231
No log	2.4	36	0.7042	0.3367	0.7042	0.8392
No log	2.5333	38	0.6201	0.2777	0.6201	0.7875
No log	2.6667	40	0.5912	0.4019	0.5912	0.7689
No log	2.8	42	0.5787	0.3089	0.5787	0.7607
No log	2.9333	44	0.5927	0.4575	0.5927	0.7699
No log	3.0667	46	0.5791	0.4058	0.5791	0.7610
No log	3.2	48	0.5108	0.4934	0.5108	0.7147
No log	3.3333	50	0.6278	0.5342	0.6278	0.7923
No log	3.4667	52	0.6074	0.4735	0.6074	0.7793
No log	3.6	54	0.5127	0.4555	0.5127	0.7160
No log	3.7333	56	0.5289	0.5702	0.5289	0.7273
No log	3.8667	58	0.5349	0.5195	0.5349	0.7314
No log	4.0	60	0.4996	0.4829	0.4996	0.7068
No log	4.1333	62	0.5230	0.5385	0.5230	0.7232
No log	4.2667	64	0.5760	0.5048	0.5760	0.7589
No log	4.4	66	0.5115	0.4591	0.5115	0.7152
No log	4.5333	68	0.6317	0.4182	0.6317	0.7948
No log	4.6667	70	0.5552	0.4960	0.5552	0.7451
No log	4.8	72	0.5066	0.5386	0.5066	0.7117
No log	4.9333	74	0.5288	0.5104	0.5288	0.7272
No log	5.0667	76	0.5391	0.5452	0.5391	0.7342
No log	5.2	78	0.5511	0.5663	0.5511	0.7423
No log	5.3333	80	0.5241	0.5831	0.5241	0.7239
No log	5.4667	82	0.5523	0.5345	0.5523	0.7432
No log	5.6	84	0.5168	0.5089	0.5168	0.7189
No log	5.7333	86	0.5604	0.5512	0.5604	0.7486
No log	5.8667	88	0.5361	0.5718	0.5361	0.7322
No log	6.0	90	0.5116	0.5627	0.5116	0.7153
No log	6.1333	92	0.5135	0.5580	0.5135	0.7166
No log	6.2667	94	0.5234	0.6503	0.5234	0.7235
No log	6.4	96	0.5774	0.5616	0.5774	0.7599
No log	6.5333	98	0.5272	0.5751	0.5272	0.7261
No log	6.6667	100	0.5236	0.6407	0.5236	0.7236
No log	6.8	102	0.5254	0.6407	0.5254	0.7248
No log	6.9333	104	0.5170	0.6289	0.5170	0.7190
No log	7.0667	106	0.5092	0.6364	0.5092	0.7136
No log	7.2	108	0.5787	0.5513	0.5787	0.7608
No log	7.3333	110	0.5921	0.5249	0.5921	0.7694
No log	7.4667	112	0.4963	0.5875	0.4963	0.7045
No log	7.6	114	0.5073	0.6024	0.5073	0.7123
No log	7.7333	116	0.5155	0.6171	0.5155	0.7180
No log	7.8667	118	0.5326	0.6210	0.5326	0.7298
No log	8.0	120	0.5890	0.5552	0.5890	0.7675
No log	8.1333	122	0.7864	0.4462	0.7864	0.8868
No log	8.2667	124	0.8638	0.4074	0.8638	0.9294
No log	8.4	126	0.6259	0.5116	0.6259	0.7911
No log	8.5333	128	0.5910	0.4943	0.5910	0.7688
No log	8.6667	130	0.6690	0.5251	0.6690	0.8179
No log	8.8	132	0.5740	0.4997	0.5740	0.7576
No log	8.9333	134	0.5322	0.6620	0.5322	0.7296
No log	9.0667	136	0.5835	0.5849	0.5835	0.7639
No log	9.2	138	0.5082	0.6223	0.5082	0.7129
No log	9.3333	140	0.6136	0.5096	0.6136	0.7833
No log	9.4667	142	0.7832	0.4859	0.7832	0.8850
No log	9.6	144	0.7205	0.4925	0.7205	0.8488
No log	9.7333	146	0.5371	0.5015	0.5371	0.7329
No log	9.8667	148	0.5024	0.6127	0.5024	0.7088
No log	10.0	150	0.6397	0.5702	0.6397	0.7998
No log	10.1333	152	0.6797	0.4287	0.6797	0.8244
No log	10.2667	154	0.5708	0.4908	0.5708	0.7555
No log	10.4	156	0.5032	0.4983	0.5032	0.7093
No log	10.5333	158	0.5396	0.4414	0.5396	0.7345
No log	10.6667	160	0.5038	0.4729	0.5038	0.7098
No log	10.8	162	0.4990	0.4946	0.4990	0.7064
No log	10.9333	164	0.4878	0.5348	0.4878	0.6984
No log	11.0667	166	0.4840	0.5056	0.4840	0.6957
No log	11.2	168	0.4849	0.5056	0.4849	0.6963
No log	11.3333	170	0.4842	0.4847	0.4842	0.6959
No log	11.4667	172	0.4957	0.4314	0.4957	0.7040
No log	11.6	174	0.5074	0.4561	0.5074	0.7123
No log	11.7333	176	0.4850	0.5539	0.4850	0.6964
No log	11.8667	178	0.4864	0.5203	0.4864	0.6975
No log	12.0	180	0.4822	0.5451	0.4822	0.6944
No log	12.1333	182	0.4875	0.5228	0.4875	0.6982
No log	12.2667	184	0.5270	0.4929	0.5270	0.7260
No log	12.4	186	0.4859	0.5104	0.4859	0.6971
No log	12.5333	188	0.4623	0.5488	0.4623	0.6799
No log	12.6667	190	0.4787	0.6404	0.4787	0.6919
No log	12.8	192	0.4853	0.5954	0.4853	0.6966
No log	12.9333	194	0.4768	0.6606	0.4768	0.6905
No log	13.0667	196	0.4825	0.6609	0.4825	0.6946
No log	13.2	198	0.4716	0.6609	0.4716	0.6867
No log	13.3333	200	0.4567	0.6772	0.4567	0.6758
No log	13.4667	202	0.4449	0.6197	0.4449	0.6670
No log	13.6	204	0.4659	0.6880	0.4659	0.6826
No log	13.7333	206	0.4963	0.6537	0.4963	0.7045
No log	13.8667	208	0.4530	0.6407	0.4530	0.6730
No log	14.0	210	0.4350	0.6060	0.4350	0.6595
No log	14.1333	212	0.4866	0.5534	0.4866	0.6976
No log	14.2667	214	0.4966	0.5509	0.4966	0.7047
No log	14.4	216	0.4639	0.6015	0.4639	0.6811
No log	14.5333	218	0.4532	0.6143	0.4532	0.6732
No log	14.6667	220	0.5254	0.6294	0.5254	0.7249
No log	14.8	222	0.5791	0.5862	0.5791	0.7610
No log	14.9333	224	0.5011	0.5855	0.5011	0.7079
No log	15.0667	226	0.4571	0.5633	0.4571	0.6761
No log	15.2	228	0.4511	0.5326	0.4511	0.6717
No log	15.3333	230	0.4519	0.5533	0.4519	0.6722
No log	15.4667	232	0.4530	0.5463	0.4530	0.6731
No log	15.6	234	0.4964	0.5855	0.4964	0.7045
No log	15.7333	236	0.4648	0.5195	0.4648	0.6817
No log	15.8667	238	0.4493	0.5286	0.4493	0.6703
No log	16.0	240	0.4763	0.6300	0.4763	0.6901
No log	16.1333	242	0.5064	0.5624	0.5064	0.7116
No log	16.2667	244	0.4921	0.5214	0.4921	0.7015
No log	16.4	246	0.4848	0.5587	0.4848	0.6963
No log	16.5333	248	0.4984	0.5345	0.4984	0.7060
No log	16.6667	250	0.4851	0.6171	0.4851	0.6965
No log	16.8	252	0.4717	0.5703	0.4717	0.6868
No log	16.9333	254	0.4781	0.5738	0.4781	0.6914
No log	17.0667	256	0.4789	0.5662	0.4789	0.6920
No log	17.2	258	0.4940	0.5047	0.4940	0.7028
No log	17.3333	260	0.5202	0.5499	0.5202	0.7213
No log	17.4667	262	0.5169	0.5528	0.5169	0.7190
No log	17.6	264	0.5026	0.5457	0.5026	0.7090
No log	17.7333	266	0.4763	0.5662	0.4763	0.6902
No log	17.8667	268	0.4705	0.6078	0.4705	0.6859
No log	18.0	270	0.4653	0.6234	0.4653	0.6821
No log	18.1333	272	0.4736	0.6345	0.4736	0.6882
No log	18.2667	274	0.4574	0.6234	0.4574	0.6763
No log	18.4	276	0.4575	0.5974	0.4575	0.6764
No log	18.5333	278	0.4588	0.6200	0.4588	0.6773
No log	18.6667	280	0.4795	0.6389	0.4795	0.6925
No log	18.8	282	0.5069	0.5017	0.5069	0.7120
No log	18.9333	284	0.5298	0.4749	0.5298	0.7279
No log	19.0667	286	0.5153	0.5448	0.5153	0.7178
No log	19.2	288	0.4955	0.5228	0.4955	0.7039
No log	19.3333	290	0.5105	0.6073	0.5105	0.7145
No log	19.4667	292	0.5716	0.4937	0.5716	0.7560
No log	19.6	294	0.5844	0.4937	0.5844	0.7644
No log	19.7333	296	0.5033	0.5308	0.5033	0.7095
No log	19.8667	298	0.4643	0.5522	0.4643	0.6814
No log	20.0	300	0.4770	0.5283	0.4770	0.6906
No log	20.1333	302	0.4809	0.4960	0.4809	0.6935
No log	20.2667	304	0.4846	0.5061	0.4846	0.6961
No log	20.4	306	0.4876	0.5985	0.4876	0.6983
No log	20.5333	308	0.4949	0.5195	0.4949	0.7035
No log	20.6667	310	0.4979	0.4527	0.4979	0.7056
No log	20.8	312	0.5111	0.4367	0.5111	0.7149
No log	20.9333	314	0.5109	0.4249	0.5109	0.7148
No log	21.0667	316	0.5366	0.4267	0.5366	0.7325
No log	21.2	318	0.6038	0.4774	0.6038	0.7770
No log	21.3333	320	0.6757	0.4315	0.6757	0.8220
No log	21.4667	322	0.6594	0.4404	0.6594	0.8121
No log	21.6	324	0.5700	0.4945	0.5700	0.7550
No log	21.7333	326	0.5061	0.5248	0.5061	0.7114
No log	21.8667	328	0.5091	0.5212	0.5091	0.7135
No log	22.0	330	0.5199	0.5528	0.5199	0.7210
No log	22.1333	332	0.4893	0.5554	0.4893	0.6995
No log	22.2667	334	0.4846	0.5725	0.4846	0.6961
No log	22.4	336	0.5107	0.5867	0.5107	0.7147
No log	22.5333	338	0.5100	0.5867	0.5100	0.7141
No log	22.6667	340	0.4982	0.5867	0.4982	0.7058
No log	22.8	342	0.4714	0.5915	0.4714	0.6866
No log	22.9333	344	0.4754	0.5554	0.4754	0.6895
No log	23.0667	346	0.4765	0.5751	0.4765	0.6903
No log	23.2	348	0.4917	0.5674	0.4917	0.7012
No log	23.3333	350	0.5160	0.5653	0.5160	0.7184
No log	23.4667	352	0.5134	0.5934	0.5134	0.7165
No log	23.6	354	0.5001	0.5533	0.5001	0.7072
No log	23.7333	356	0.4779	0.4657	0.4779	0.6913
No log	23.8667	358	0.4779	0.4497	0.4779	0.6913
No log	24.0	360	0.4801	0.5335	0.4801	0.6929
No log	24.1333	362	0.4868	0.5127	0.4868	0.6977
No log	24.2667	364	0.4894	0.5904	0.4894	0.6995
No log	24.4	366	0.5077	0.5538	0.5077	0.7125
No log	24.5333	368	0.5291	0.5511	0.5291	0.7274
No log	24.6667	370	0.5120	0.5433	0.5120	0.7155
No log	24.8	372	0.5054	0.5816	0.5054	0.7109
No log	24.9333	374	0.5036	0.5003	0.5036	0.7097
No log	25.0667	376	0.5022	0.4929	0.5022	0.7086
No log	25.2	378	0.4960	0.5177	0.4960	0.7043
No log	25.3333	380	0.4973	0.5177	0.4973	0.7052
No log	25.4667	382	0.4931	0.4923	0.4931	0.7022
No log	25.6	384	0.4975	0.4942	0.4975	0.7053
No log	25.7333	386	0.4958	0.5304	0.4958	0.7041
No log	25.8667	388	0.5184	0.4984	0.5184	0.7200
No log	26.0	390	0.5735	0.5275	0.5735	0.7573
No log	26.1333	392	0.6030	0.5190	0.6030	0.7765
No log	26.2667	394	0.5777	0.4749	0.5777	0.7600
No log	26.4	396	0.5221	0.4808	0.5221	0.7226
No log	26.5333	398	0.4811	0.5463	0.4811	0.6936
No log	26.6667	400	0.5006	0.6248	0.5006	0.7075
No log	26.8	402	0.5250	0.6442	0.5250	0.7246
No log	26.9333	404	0.5457	0.5997	0.5457	0.7387
No log	27.0667	406	0.5481	0.5997	0.5481	0.7404
No log	27.2	408	0.5026	0.6047	0.5026	0.7090
No log	27.3333	410	0.4687	0.5687	0.4687	0.6846
No log	27.4667	412	0.5200	0.5639	0.5200	0.7211
No log	27.6	414	0.5673	0.5293	0.5673	0.7532
No log	27.7333	416	0.5437	0.4534	0.5437	0.7374
No log	27.8667	418	0.5121	0.4354	0.5121	0.7156
No log	28.0	420	0.5001	0.4825	0.5001	0.7072
No log	28.1333	422	0.4977	0.5101	0.4977	0.7055
No log	28.2667	424	0.4932	0.5286	0.4932	0.7023
No log	28.4	426	0.5036	0.5159	0.5036	0.7097
No log	28.5333	428	0.5297	0.5098	0.5297	0.7278
No log	28.6667	430	0.5317	0.5428	0.5317	0.7291
No log	28.8	432	0.5120	0.5184	0.5120	0.7156
No log	28.9333	434	0.5092	0.6053	0.5092	0.7135
No log	29.0667	436	0.5140	0.5352	0.5140	0.7169
No log	29.2	438	0.5083	0.5854	0.5083	0.7129
No log	29.3333	440	0.5122	0.6071	0.5122	0.7157
No log	29.4667	442	0.5087	0.5070	0.5087	0.7133
No log	29.6	444	0.5020	0.5201	0.5020	0.7085
No log	29.7333	446	0.4954	0.5617	0.4954	0.7038
No log	29.8667	448	0.4956	0.5326	0.4956	0.7040
No log	30.0	450	0.5044	0.4888	0.5044	0.7102
No log	30.1333	452	0.5289	0.4888	0.5289	0.7272
No log	30.2667	454	0.5639	0.5177	0.5639	0.7509
No log	30.4	456	0.5720	0.5586	0.5720	0.7563
No log	30.5333	458	0.5609	0.5802	0.5609	0.7489
No log	30.6667	460	0.5402	0.5528	0.5402	0.7350
No log	30.8	462	0.5081	0.5609	0.5081	0.7128
No log	30.9333	464	0.4916	0.5719	0.4916	0.7012
No log	31.0667	466	0.4866	0.5930	0.4866	0.6976
No log	31.2	468	0.4909	0.5698	0.4909	0.7007
No log	31.3333	470	0.4974	0.5367	0.4974	0.7053
No log	31.4667	472	0.5054	0.5170	0.5054	0.7109
No log	31.6	474	0.4992	0.5815	0.4992	0.7065
No log	31.7333	476	0.4980	0.5797	0.4980	0.7057
No log	31.8667	478	0.5015	0.5234	0.5015	0.7082
No log	32.0	480	0.5196	0.5352	0.5196	0.7208
No log	32.1333	482	0.5259	0.5352	0.5259	0.7252
No log	32.2667	484	0.5008	0.5127	0.5008	0.7077
No log	32.4	486	0.5016	0.5404	0.5016	0.7083
No log	32.5333	488	0.5676	0.5278	0.5676	0.7534
No log	32.6667	490	0.5836	0.5457	0.5836	0.7639
No log	32.8	492	0.5461	0.5659	0.5461	0.7390
No log	32.9333	494	0.4966	0.5631	0.4966	0.7047
No log	33.0667	496	0.4825	0.5648	0.4825	0.6946
No log	33.2	498	0.4749	0.5379	0.4749	0.6891
0.2571	33.3333	500	0.4743	0.5538	0.4743	0.6887
0.2571	33.4667	502	0.4737	0.5522	0.4737	0.6883
0.2571	33.6	504	0.4722	0.5492	0.4722	0.6872
0.2571	33.7333	506	0.4719	0.5692	0.4719	0.6870
0.2571	33.8667	508	0.4844	0.6414	0.4844	0.6960
0.2571	34.0	510	0.5190	0.5744	0.5190	0.7204
0.2571	34.1333	512	0.5390	0.5354	0.5390	0.7342
0.2571	34.2667	514	0.5159	0.5206	0.5158	0.7182
0.2571	34.4	516	0.4773	0.5786	0.4773	0.6908
0.2571	34.5333	518	0.4537	0.6087	0.4537	0.6736
0.2571	34.6667	520	0.4711	0.5554	0.4711	0.6864
0.2571	34.8	522	0.4888	0.5765	0.4888	0.6991
0.2571	34.9333	524	0.4854	0.5765	0.4854	0.6967
0.2571	35.0667	526	0.4693	0.6222	0.4693	0.6851
0.2571	35.2	528	0.4742	0.5965	0.4742	0.6886
0.2571	35.3333	530	0.4817	0.5831	0.4817	0.6941
0.2571	35.4667	532	0.4759	0.6096	0.4759	0.6899
0.2571	35.6	534	0.4782	0.5367	0.4782	0.6915
0.2571	35.7333	536	0.4830	0.4492	0.4830	0.6950
0.2571	35.8667	538	0.4848	0.5587	0.4848	0.6963
0.2571	36.0	540	0.5056	0.5386	0.5056	0.7110
0.2571	36.1333	542	0.5433	0.5123	0.5433	0.7371
0.2571	36.2667	544	0.5341	0.4966	0.5341	0.7308
0.2571	36.4	546	0.4951	0.5923	0.4951	0.7036
0.2571	36.5333	548	0.4703	0.6105	0.4703	0.6858
0.2571	36.6667	550	0.4900	0.5554	0.4900	0.7000
0.2571	36.8	552	0.5083	0.5569	0.5083	0.7130
0.2571	36.9333	554	0.4968	0.5554	0.4968	0.7048
0.2571	37.0667	556	0.4709	0.5554	0.4709	0.6863
0.2571	37.2	558	0.4716	0.6228	0.4716	0.6867
0.2571	37.3333	560	0.4835	0.5687	0.4835	0.6953
0.2571	37.4667	562	0.4798	0.5784	0.4798	0.6927
0.2571	37.6	564	0.4759	0.5800	0.4759	0.6898
0.2571	37.7333	566	0.4763	0.5208	0.4763	0.6902
0.2571	37.8667	568	0.4790	0.5208	0.4790	0.6921
0.2571	38.0	570	0.4813	0.4949	0.4813	0.6937
0.2571	38.1333	572	0.4870	0.4681	0.4870	0.6979
0.2571	38.2667	574	0.5025	0.5386	0.5025	0.7089

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1