ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k2_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5431
• Qwk: 0.5414
• Mse: 0.5431
• Rmse: 0.7369

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	2.5532	0.0231	2.5532	1.5979
No log	0.4444	4	1.2769	0.0750	1.2769	1.1300
No log	0.6667	6	0.8505	0.0944	0.8505	0.9222
No log	0.8889	8	0.7176	0.0889	0.7176	0.8471
No log	1.1111	10	0.6907	0.0898	0.6907	0.8311
No log	1.3333	12	0.6718	0.1315	0.6718	0.8196
No log	1.5556	14	0.6262	0.0810	0.6262	0.7913
No log	1.7778	16	0.6186	0.1700	0.6186	0.7865
No log	2.0	18	0.6140	0.1700	0.6140	0.7836
No log	2.2222	20	0.6039	0.1267	0.6039	0.7771
No log	2.4444	22	0.6191	0.1633	0.6191	0.7869
No log	2.6667	24	0.7428	0.0535	0.7428	0.8619
No log	2.8889	26	0.7996	0.2087	0.7996	0.8942
No log	3.1111	28	0.7181	0.2087	0.7181	0.8474
No log	3.3333	30	0.6703	0.2341	0.6703	0.8187
No log	3.5556	32	0.6082	0.3831	0.6082	0.7799
No log	3.7778	34	0.5927	0.4307	0.5927	0.7698
No log	4.0	36	0.5980	0.4193	0.5980	0.7733
No log	4.2222	38	0.5624	0.4555	0.5624	0.7500
No log	4.4444	40	0.5557	0.4402	0.5557	0.7455
No log	4.6667	42	0.6168	0.5211	0.6168	0.7854
No log	4.8889	44	0.5416	0.5725	0.5416	0.7360
No log	5.1111	46	0.6155	0.5498	0.6155	0.7845
No log	5.3333	48	0.7076	0.4261	0.7076	0.8412
No log	5.5556	50	0.8079	0.3845	0.8079	0.8988
No log	5.7778	52	0.5847	0.4935	0.5847	0.7647
No log	6.0	54	0.6084	0.5293	0.6084	0.7800
No log	6.2222	56	0.5565	0.5214	0.5565	0.7460
No log	6.4444	58	0.5861	0.4448	0.5861	0.7655
No log	6.6667	60	0.5651	0.4444	0.5651	0.7517
No log	6.8889	62	0.7047	0.4496	0.7047	0.8395
No log	7.1111	64	0.7583	0.5139	0.7583	0.8708
No log	7.3333	66	0.5842	0.5442	0.5842	0.7644
No log	7.5556	68	0.5345	0.5815	0.5345	0.7311
No log	7.7778	70	0.5890	0.4580	0.5890	0.7674
No log	8.0	72	0.5853	0.4892	0.5853	0.7651
No log	8.2222	74	0.5618	0.4118	0.5618	0.7495
No log	8.4444	76	0.5505	0.5639	0.5505	0.7420
No log	8.6667	78	0.7246	0.5402	0.7246	0.8512
No log	8.8889	80	0.8060	0.5043	0.8060	0.8978
No log	9.1111	82	0.6126	0.5758	0.6126	0.7827
No log	9.3333	84	0.5758	0.4425	0.5758	0.7588
No log	9.5556	86	0.7671	0.4830	0.7671	0.8758
No log	9.7778	88	0.6627	0.4032	0.6627	0.8140
No log	10.0	90	0.4962	0.5951	0.4962	0.7044
No log	10.2222	92	0.7324	0.4940	0.7324	0.8558
No log	10.4444	94	0.8149	0.4039	0.8149	0.9027
No log	10.6667	96	0.5922	0.4925	0.5922	0.7696
No log	10.8889	98	0.5526	0.3675	0.5526	0.7434
No log	11.1111	100	0.5979	0.3934	0.5979	0.7733
No log	11.3333	102	0.5793	0.3988	0.5793	0.7611
No log	11.5556	104	0.5692	0.5195	0.5692	0.7545
No log	11.7778	106	0.5559	0.4639	0.5559	0.7456
No log	12.0	108	0.5429	0.4659	0.5429	0.7368
No log	12.2222	110	0.6223	0.5085	0.6223	0.7889
No log	12.4444	112	0.7050	0.3988	0.7050	0.8396
No log	12.6667	114	0.7136	0.4204	0.7136	0.8447
No log	12.8889	116	0.5628	0.5286	0.5628	0.7502
No log	13.1111	118	0.5769	0.5758	0.5769	0.7595
No log	13.3333	120	0.5422	0.6058	0.5422	0.7363
No log	13.5556	122	0.5678	0.5348	0.5678	0.7535
No log	13.7778	124	0.7728	0.4277	0.7728	0.8791
No log	14.0	126	0.7211	0.4367	0.7211	0.8492
No log	14.2222	128	0.5503	0.4879	0.5503	0.7418
No log	14.4444	130	0.5384	0.6348	0.5384	0.7338
No log	14.6667	132	0.5641	0.6333	0.5641	0.7511
No log	14.8889	134	0.5756	0.6122	0.5756	0.7587
No log	15.1111	136	0.5283	0.6242	0.5283	0.7269
No log	15.3333	138	0.5555	0.4302	0.5555	0.7453
No log	15.5556	140	0.5459	0.5797	0.5459	0.7389
No log	15.7778	142	0.5420	0.5170	0.5420	0.7362
No log	16.0	144	0.5604	0.5228	0.5604	0.7486
No log	16.2222	146	0.6050	0.4513	0.6050	0.7778
No log	16.4444	148	0.5495	0.5648	0.5495	0.7413
No log	16.6667	150	0.5732	0.5212	0.5732	0.7571
No log	16.8889	152	0.5980	0.4616	0.5980	0.7733
No log	17.1111	154	0.5349	0.5505	0.5349	0.7314
No log	17.3333	156	0.5954	0.6122	0.5954	0.7716
No log	17.5556	158	0.5910	0.6122	0.5910	0.7688
No log	17.7778	160	0.5404	0.6353	0.5404	0.7351
No log	18.0	162	0.5463	0.6353	0.5463	0.7391
No log	18.2222	164	0.5808	0.6239	0.5808	0.7621
No log	18.4444	166	0.6402	0.5470	0.6402	0.8001
No log	18.6667	168	0.6551	0.5326	0.6551	0.8094
No log	18.8889	170	0.5974	0.5426	0.5974	0.7729
No log	19.1111	172	0.5485	0.5533	0.5485	0.7406
No log	19.3333	174	0.5427	0.5396	0.5427	0.7367
No log	19.5556	176	0.5516	0.5289	0.5516	0.7427
No log	19.7778	178	0.5747	0.5195	0.5747	0.7581
No log	20.0	180	0.5679	0.5437	0.5679	0.7536
No log	20.2222	182	0.5624	0.5572	0.5624	0.7499
No log	20.4444	184	0.6992	0.4836	0.6992	0.8362
No log	20.6667	186	0.8940	0.4277	0.8940	0.9455
No log	20.8889	188	0.8628	0.4074	0.8628	0.9289
No log	21.1111	190	0.6797	0.4462	0.6797	0.8244
No log	21.3333	192	0.5456	0.4752	0.5456	0.7386
No log	21.5556	194	0.5646	0.5228	0.5646	0.7514
No log	21.7778	196	0.7163	0.4552	0.7163	0.8464
No log	22.0	198	0.7092	0.4592	0.7092	0.8422
No log	22.2222	200	0.6044	0.4592	0.6044	0.7774
No log	22.4444	202	0.5643	0.4847	0.5643	0.7512
No log	22.6667	204	0.6131	0.4507	0.6131	0.7830
No log	22.8889	206	0.6479	0.4556	0.6479	0.8049
No log	23.1111	208	0.5945	0.5106	0.5945	0.7710
No log	23.3333	210	0.5330	0.5868	0.5330	0.7301
No log	23.5556	212	0.5212	0.6174	0.5212	0.7220
No log	23.7778	214	0.5256	0.6463	0.5256	0.7250
No log	24.0	216	0.5231	0.5916	0.5231	0.7233
No log	24.2222	218	0.5644	0.5599	0.5644	0.7513
No log	24.4444	220	0.6258	0.5032	0.6258	0.7911
No log	24.6667	222	0.6079	0.4651	0.6079	0.7797
No log	24.8889	224	0.5008	0.5718	0.5008	0.7077
No log	25.1111	226	0.4630	0.5732	0.4630	0.6805
No log	25.3333	228	0.4864	0.5131	0.4864	0.6974
No log	25.5556	230	0.4663	0.5995	0.4663	0.6829
No log	25.7778	232	0.4598	0.6667	0.4598	0.6781
No log	26.0	234	0.4739	0.7101	0.4739	0.6884
No log	26.2222	236	0.4870	0.5729	0.4870	0.6978
No log	26.4444	238	0.5511	0.5683	0.5511	0.7424
No log	26.6667	240	0.5425	0.5732	0.5425	0.7366
No log	26.8889	242	0.5098	0.6160	0.5098	0.7140
No log	27.1111	244	0.5257	0.5237	0.5257	0.7250
No log	27.3333	246	0.5629	0.5486	0.5629	0.7503
No log	27.5556	248	0.5414	0.5368	0.5414	0.7358
No log	27.7778	250	0.5177	0.5057	0.5177	0.7195
No log	28.0	252	0.5162	0.4991	0.5162	0.7185
No log	28.2222	254	0.5073	0.5286	0.5073	0.7122
No log	28.4444	256	0.5048	0.5815	0.5048	0.7105
No log	28.6667	258	0.5077	0.5143	0.5077	0.7125
No log	28.8889	260	0.5407	0.5498	0.5407	0.7353
No log	29.1111	262	0.5835	0.5046	0.5835	0.7639
No log	29.3333	264	0.5694	0.5168	0.5694	0.7546
No log	29.5556	266	0.5075	0.5854	0.5075	0.7124
No log	29.7778	268	0.5001	0.5488	0.5001	0.7071
No log	30.0	270	0.5252	0.5894	0.5252	0.7247
No log	30.2222	272	0.5380	0.5867	0.5380	0.7335
No log	30.4444	274	0.5157	0.5076	0.5157	0.7181
No log	30.6667	276	0.5354	0.5812	0.5354	0.7317
No log	30.8889	278	0.5581	0.5200	0.5581	0.7471
No log	31.1111	280	0.5299	0.5368	0.5299	0.7280
No log	31.3333	282	0.5193	0.5941	0.5193	0.7206
No log	31.5556	284	0.5272	0.5723	0.5272	0.7261
No log	31.7778	286	0.5232	0.5909	0.5232	0.7233
No log	32.0	288	0.5038	0.6530	0.5038	0.7098
No log	32.2222	290	0.5013	0.5993	0.5013	0.7081
No log	32.4444	292	0.4954	0.5915	0.4954	0.7038
No log	32.6667	294	0.5124	0.5868	0.5124	0.7158
No log	32.8889	296	0.5614	0.4690	0.5614	0.7493
No log	33.1111	298	0.5589	0.4634	0.5589	0.7476
No log	33.3333	300	0.5741	0.4794	0.5741	0.7577
No log	33.5556	302	0.6015	0.4890	0.6015	0.7756
No log	33.7778	304	0.5802	0.5166	0.5802	0.7617
No log	34.0	306	0.5517	0.5560	0.5517	0.7428
No log	34.2222	308	0.5136	0.6686	0.5136	0.7167
No log	34.4444	310	0.5011	0.6593	0.5011	0.7079
No log	34.6667	312	0.4965	0.6333	0.4965	0.7046
No log	34.8889	314	0.5309	0.5315	0.5309	0.7286
No log	35.1111	316	0.5513	0.5528	0.5513	0.7425
No log	35.3333	318	0.5538	0.5184	0.5538	0.7442
No log	35.5556	320	0.5852	0.4851	0.5852	0.7650
No log	35.7778	322	0.5561	0.5184	0.5561	0.7457
No log	36.0	324	0.5031	0.6672	0.5031	0.7093
No log	36.2222	326	0.5177	0.6730	0.5177	0.7195
No log	36.4444	328	0.5164	0.6730	0.5164	0.7186
No log	36.6667	330	0.5081	0.6753	0.5081	0.7128
No log	36.8889	332	0.5502	0.5407	0.5502	0.7417
No log	37.1111	334	0.5831	0.4794	0.5831	0.7636
No log	37.3333	336	0.5470	0.4969	0.5470	0.7396
No log	37.5556	338	0.5093	0.6289	0.5093	0.7137
No log	37.7778	340	0.5209	0.5218	0.5209	0.7217
No log	38.0	342	0.5305	0.5488	0.5305	0.7283
No log	38.2222	344	0.5217	0.6564	0.5217	0.7223
No log	38.4444	346	0.5317	0.5916	0.5317	0.7291
No log	38.6667	348	0.5397	0.5809	0.5397	0.7346
No log	38.8889	350	0.5313	0.6257	0.5313	0.7289
No log	39.1111	352	0.5246	0.6146	0.5246	0.7243
No log	39.3333	354	0.5237	0.5373	0.5237	0.7237
No log	39.5556	356	0.5281	0.5961	0.5281	0.7267
No log	39.7778	358	0.5213	0.5770	0.5213	0.7220
No log	40.0	360	0.5166	0.5956	0.5166	0.7187
No log	40.2222	362	0.5143	0.5956	0.5143	0.7171
No log	40.4444	364	0.5081	0.5956	0.5081	0.7128
No log	40.6667	366	0.5041	0.6351	0.5041	0.7100
No log	40.8889	368	0.5028	0.5860	0.5028	0.7091
No log	41.1111	370	0.5026	0.5782	0.5026	0.7089
No log	41.3333	372	0.5015	0.6018	0.5015	0.7082
No log	41.5556	374	0.5046	0.6018	0.5046	0.7104
No log	41.7778	376	0.5023	0.5687	0.5023	0.7087
No log	42.0	378	0.5268	0.4895	0.5268	0.7258
No log	42.2222	380	0.5621	0.4765	0.5621	0.7497
No log	42.4444	382	0.5577	0.4429	0.5577	0.7468
No log	42.6667	384	0.5222	0.5449	0.5222	0.7227
No log	42.8889	386	0.4858	0.6439	0.4858	0.6970
No log	43.1111	388	0.4928	0.6214	0.4928	0.7020
No log	43.3333	390	0.5045	0.6087	0.5045	0.7103
No log	43.5556	392	0.5261	0.5894	0.5261	0.7253
No log	43.7778	394	0.5190	0.6214	0.5190	0.7204
No log	44.0	396	0.5207	0.6563	0.5207	0.7216
No log	44.2222	398	0.5645	0.5344	0.5645	0.7513
No log	44.4444	400	0.5824	0.4843	0.5824	0.7632
No log	44.6667	402	0.5591	0.4935	0.5591	0.7477
No log	44.8889	404	0.5292	0.5125	0.5292	0.7275
No log	45.1111	406	0.5302	0.6087	0.5302	0.7281
No log	45.3333	408	0.5458	0.5639	0.5458	0.7388
No log	45.5556	410	0.5362	0.5420	0.5362	0.7323
No log	45.7778	412	0.5267	0.5289	0.5267	0.7257
No log	46.0	414	0.5143	0.5533	0.5143	0.7171
No log	46.2222	416	0.5074	0.6010	0.5074	0.7123
No log	46.4444	418	0.5114	0.6060	0.5114	0.7151
No log	46.6667	420	0.5399	0.4997	0.5399	0.7348
No log	46.8889	422	0.5577	0.5363	0.5577	0.7468
No log	47.1111	424	0.5404	0.5692	0.5404	0.7351
No log	47.3333	426	0.5119	0.5809	0.5119	0.7155
No log	47.5556	428	0.4990	0.5939	0.4990	0.7064
No log	47.7778	430	0.4975	0.6111	0.4975	0.7054
No log	48.0	432	0.5018	0.5732	0.5018	0.7083
No log	48.2222	434	0.5057	0.5485	0.5057	0.7111
No log	48.4444	436	0.5049	0.5485	0.5049	0.7105
No log	48.6667	438	0.5094	0.5485	0.5094	0.7137
No log	48.8889	440	0.5355	0.5516	0.5355	0.7318
No log	49.1111	442	0.5386	0.5271	0.5386	0.7339
No log	49.3333	444	0.5052	0.5768	0.5052	0.7108
No log	49.5556	446	0.4925	0.6435	0.4925	0.7018
No log	49.7778	448	0.5191	0.4869	0.5191	0.7205
No log	50.0	450	0.5461	0.4389	0.5461	0.7390
No log	50.2222	452	0.5371	0.4584	0.5371	0.7328
No log	50.4444	454	0.5104	0.4657	0.5104	0.7144
No log	50.6667	456	0.5003	0.5182	0.5003	0.7073
No log	50.8889	458	0.5056	0.5467	0.5056	0.7110
No log	51.1111	460	0.5114	0.5036	0.5114	0.7151
No log	51.3333	462	0.5042	0.5467	0.5042	0.7101
No log	51.5556	464	0.5082	0.5305	0.5082	0.7129
No log	51.7778	466	0.5509	0.4908	0.5509	0.7422
No log	52.0	468	0.5990	0.4321	0.5990	0.7740
No log	52.2222	470	0.5817	0.4949	0.5817	0.7627
No log	52.4444	472	0.5448	0.5153	0.5448	0.7381
No log	52.6667	474	0.5205	0.5182	0.5205	0.7214
No log	52.8889	476	0.5070	0.5503	0.5070	0.7121
No log	53.1111	478	0.5146	0.5467	0.5146	0.7173
No log	53.3333	480	0.5245	0.5036	0.5245	0.7242
No log	53.5556	482	0.5140	0.5036	0.5140	0.7169
No log	53.7778	484	0.5057	0.5326	0.5057	0.7112
No log	54.0	486	0.5193	0.5538	0.5193	0.7206
No log	54.2222	488	0.5314	0.5283	0.5314	0.7290
No log	54.4444	490	0.5384	0.4821	0.5384	0.7338
No log	54.6667	492	0.5332	0.5046	0.5332	0.7302
No log	54.8889	494	0.5141	0.5765	0.5141	0.7170
No log	55.1111	496	0.5050	0.6620	0.5050	0.7106
No log	55.3333	498	0.5158	0.6004	0.5158	0.7182
0.2286	55.5556	500	0.5303	0.5867	0.5303	0.7282
0.2286	55.7778	502	0.5269	0.5639	0.5269	0.7259
0.2286	56.0	504	0.5135	0.6087	0.5135	0.7166
0.2286	56.2222	506	0.5022	0.6201	0.5022	0.7087
0.2286	56.4444	508	0.5106	0.5507	0.5106	0.7146
0.2286	56.6667	510	0.5499	0.5414	0.5499	0.7415
0.2286	56.8889	512	0.5763	0.4952	0.5763	0.7592
0.2286	57.1111	514	0.5733	0.4952	0.5733	0.7572
0.2286	57.3333	516	0.5431	0.5414	0.5431	0.7369

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1