ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k20_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5451
• Qwk: 0.5233
• Mse: 0.5451
• Rmse: 0.7383

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0294	2	2.5490	-0.0788	2.5490	1.5966
No log	0.0588	4	1.3319	0.0686	1.3319	1.1541
No log	0.0882	6	1.1673	-0.0970	1.1673	1.0804
No log	0.1176	8	0.9478	-0.0128	0.9478	0.9736
No log	0.1471	10	0.7642	0.1903	0.7642	0.8742
No log	0.1765	12	0.7491	-0.0054	0.7491	0.8655
No log	0.2059	14	0.7707	0.0	0.7707	0.8779
No log	0.2353	16	0.8352	0.0	0.8352	0.9139
No log	0.2647	18	0.8096	0.0	0.8096	0.8998
No log	0.2941	20	0.7615	-0.0027	0.7615	0.8726
No log	0.3235	22	0.7497	0.0798	0.7497	0.8659
No log	0.3529	24	0.7363	0.1187	0.7363	0.8581
No log	0.3824	26	0.7213	0.1139	0.7213	0.8493
No log	0.4118	28	0.7364	0.0	0.7364	0.8581
No log	0.4412	30	0.7944	0.2181	0.7944	0.8913
No log	0.4706	32	1.0174	0.1581	1.0174	1.0087
No log	0.5	34	1.1106	0.1274	1.1106	1.0539
No log	0.5294	36	1.0201	0.2008	1.0201	1.0100
No log	0.5588	38	0.8764	0.1372	0.8764	0.9362
No log	0.5882	40	0.8308	0.1372	0.8308	0.9115
No log	0.6176	42	0.7582	0.0481	0.7582	0.8707
No log	0.6471	44	0.7107	-0.0027	0.7107	0.8430
No log	0.6765	46	0.7135	0.1232	0.7135	0.8447
No log	0.7059	48	0.7076	0.1138	0.7076	0.8412
No log	0.7353	50	0.6910	0.1863	0.6910	0.8313
No log	0.7647	52	0.6877	0.2336	0.6877	0.8293
No log	0.7941	54	0.7166	0.2046	0.7166	0.8465
No log	0.8235	56	0.7105	0.1752	0.7105	0.8429
No log	0.8529	58	0.7128	0.2787	0.7128	0.8443
No log	0.8824	60	0.7318	0.3312	0.7318	0.8555
No log	0.9118	62	0.7651	0.2883	0.7651	0.8747
No log	0.9412	64	0.8106	0.3746	0.8106	0.9003
No log	0.9706	66	0.8587	0.3287	0.8587	0.9267
No log	1.0	68	0.7859	0.3294	0.7859	0.8865
No log	1.0294	70	0.6757	0.2407	0.6757	0.8220
No log	1.0588	72	0.6982	0.1744	0.6982	0.8356
No log	1.0882	74	0.8039	0.2066	0.8039	0.8966
No log	1.1176	76	0.8480	0.3595	0.8480	0.9209
No log	1.1471	78	0.8417	0.2132	0.8417	0.9175
No log	1.1765	80	0.7550	0.1372	0.7550	0.8689
No log	1.2059	82	0.6720	0.0798	0.6720	0.8198
No log	1.2353	84	0.6611	0.2206	0.6611	0.8131
No log	1.2647	86	0.6685	0.2407	0.6685	0.8176
No log	1.2941	88	0.6643	0.1456	0.6643	0.8150
No log	1.3235	90	0.6636	0.2206	0.6636	0.8146
No log	1.3529	92	0.6850	0.1752	0.6850	0.8277
No log	1.3824	94	0.7109	0.1972	0.7109	0.8431
No log	1.4118	96	0.7158	0.1972	0.7158	0.8461
No log	1.4412	98	0.7151	0.2379	0.7151	0.8457
No log	1.4706	100	0.7607	0.2072	0.7607	0.8722
No log	1.5	102	0.8125	0.1538	0.8125	0.9014
No log	1.5294	104	0.6973	0.1887	0.6973	0.8351
No log	1.5588	106	0.6527	0.2308	0.6527	0.8079
No log	1.5882	108	0.6807	0.1922	0.6807	0.8250
No log	1.6176	110	0.6946	0.2024	0.6946	0.8334
No log	1.6471	112	0.7115	0.3166	0.7115	0.8435
No log	1.6765	114	0.7866	0.2843	0.7866	0.8869
No log	1.7059	116	0.8035	0.3169	0.8035	0.8964
No log	1.7353	118	0.7532	0.3042	0.7532	0.8679
No log	1.7647	120	0.6517	0.3341	0.6517	0.8073
No log	1.7941	122	0.6494	0.3675	0.6494	0.8059
No log	1.8235	124	0.6998	0.4014	0.6998	0.8365
No log	1.8529	126	0.7821	0.4154	0.7821	0.8844
No log	1.8824	128	0.8904	0.3869	0.8904	0.9436
No log	1.9118	130	1.1027	0.3538	1.1027	1.0501
No log	1.9412	132	1.0086	0.4013	1.0086	1.0043
No log	1.9706	134	0.8001	0.3709	0.8001	0.8945
No log	2.0	136	0.6189	0.3918	0.6189	0.7867
No log	2.0294	138	0.6229	0.3032	0.6229	0.7893
No log	2.0588	140	0.6394	0.3032	0.6394	0.7996
No log	2.0882	142	0.6790	0.2409	0.6790	0.8240
No log	2.1176	144	0.6621	0.2285	0.6621	0.8137
No log	2.1471	146	0.6437	0.2621	0.6437	0.8023
No log	2.1765	148	0.6345	0.4345	0.6345	0.7965
No log	2.2059	150	0.5968	0.4345	0.5968	0.7725
No log	2.2353	152	0.5870	0.4590	0.5870	0.7662
No log	2.2647	154	0.6018	0.4257	0.6018	0.7757
No log	2.2941	156	0.6202	0.3990	0.6202	0.7875
No log	2.3235	158	0.6262	0.3452	0.6262	0.7913
No log	2.3529	160	0.6119	0.4147	0.6119	0.7822
No log	2.3824	162	0.6104	0.3865	0.6104	0.7813
No log	2.4118	164	0.6082	0.3865	0.6082	0.7799
No log	2.4412	166	0.7346	0.4366	0.7346	0.8571
No log	2.4706	168	0.7550	0.4247	0.7550	0.8689
No log	2.5	170	0.6338	0.4212	0.6338	0.7961
No log	2.5294	172	0.6183	0.4307	0.6183	0.7863
No log	2.5588	174	0.6728	0.4335	0.6728	0.8203
No log	2.5882	176	0.6432	0.4913	0.6432	0.8020
No log	2.6176	178	0.6039	0.5589	0.6039	0.7771
No log	2.6471	180	0.6492	0.4997	0.6492	0.8057
No log	2.6765	182	0.6300	0.4948	0.6300	0.7937
No log	2.7059	184	0.5999	0.4535	0.5999	0.7745
No log	2.7353	186	0.6348	0.4051	0.6348	0.7967
No log	2.7647	188	0.6402	0.3556	0.6402	0.8001
No log	2.7941	190	0.6460	0.4100	0.6460	0.8037
No log	2.8235	192	0.7630	0.4275	0.7630	0.8735
No log	2.8529	194	0.8102	0.2781	0.8102	0.9001
No log	2.8824	196	0.8093	0.3799	0.8093	0.8996
No log	2.9118	198	0.7405	0.4197	0.7405	0.8605
No log	2.9412	200	0.6631	0.4036	0.6631	0.8143
No log	2.9706	202	0.6545	0.4300	0.6545	0.8090
No log	3.0	204	0.6483	0.4036	0.6483	0.8052
No log	3.0294	206	0.6742	0.3519	0.6742	0.8211
No log	3.0588	208	0.6828	0.4089	0.6828	0.8263
No log	3.0882	210	0.6528	0.4451	0.6528	0.8080
No log	3.1176	212	0.6276	0.4788	0.6276	0.7922
No log	3.1471	214	0.6282	0.3530	0.6282	0.7926
No log	3.1765	216	0.6061	0.4179	0.6061	0.7785
No log	3.2059	218	0.6130	0.3549	0.6130	0.7830
No log	3.2353	220	0.6267	0.4147	0.6267	0.7916
No log	3.2647	222	0.6560	0.3863	0.6560	0.8099
No log	3.2941	224	0.6737	0.4732	0.6737	0.8208
No log	3.3235	226	0.6886	0.4732	0.6886	0.8298
No log	3.3529	228	0.6428	0.4678	0.6428	0.8017
No log	3.3824	230	0.6465	0.48	0.6465	0.8041
No log	3.4118	232	0.6556	0.5332	0.6556	0.8097
No log	3.4412	234	0.6074	0.4488	0.6074	0.7793
No log	3.4706	236	0.6083	0.5063	0.6083	0.7799
No log	3.5	238	0.6100	0.4227	0.6100	0.7810
No log	3.5294	240	0.5859	0.4051	0.5859	0.7655
No log	3.5588	242	0.5555	0.4617	0.5555	0.7453
No log	3.5882	244	0.5444	0.4380	0.5444	0.7378
No log	3.6176	246	0.5421	0.4484	0.5421	0.7363
No log	3.6471	248	0.5554	0.4575	0.5554	0.7453
No log	3.6765	250	0.5656	0.4190	0.5656	0.7521
No log	3.7059	252	0.5767	0.4377	0.5767	0.7594
No log	3.7353	254	0.6168	0.4576	0.6168	0.7853
No log	3.7647	256	0.6644	0.4230	0.6644	0.8151
No log	3.7941	258	0.6325	0.4491	0.6325	0.7953
No log	3.8235	260	0.5871	0.4782	0.5871	0.7662
No log	3.8529	262	0.6023	0.5075	0.6023	0.7761
No log	3.8824	264	0.6027	0.5075	0.6027	0.7763
No log	3.9118	266	0.6002	0.3787	0.6002	0.7747
No log	3.9412	268	0.6830	0.4036	0.6830	0.8264
No log	3.9706	270	0.7791	0.3346	0.7791	0.8827
No log	4.0	272	0.7620	0.4018	0.7620	0.8729
No log	4.0294	274	0.6539	0.3544	0.6539	0.8087
No log	4.0588	276	0.6020	0.4535	0.6020	0.7759
No log	4.0882	278	0.6223	0.4655	0.6223	0.7888
No log	4.1176	280	0.6233	0.4795	0.6233	0.7895
No log	4.1471	282	0.6054	0.5021	0.6054	0.7781
No log	4.1765	284	0.6054	0.5457	0.6054	0.7781
No log	4.2059	286	0.6033	0.5418	0.6033	0.7767
No log	4.2353	288	0.5675	0.5289	0.5675	0.7533
No log	4.2647	290	0.5632	0.5319	0.5632	0.7505
No log	4.2941	292	0.6320	0.4340	0.6320	0.7950
No log	4.3235	294	0.6156	0.4444	0.6156	0.7846
No log	4.3529	296	0.5632	0.5750	0.5632	0.7505
No log	4.3824	298	0.5827	0.5396	0.5827	0.7633
No log	4.4118	300	0.6095	0.5488	0.6095	0.7807
No log	4.4412	302	0.6153	0.5488	0.6153	0.7844
No log	4.4706	304	0.6216	0.5488	0.6216	0.7884
No log	4.5	306	0.6320	0.5488	0.6320	0.7950
No log	4.5294	308	0.6902	0.4354	0.6902	0.8308
No log	4.5588	310	0.7263	0.4755	0.7263	0.8522
No log	4.5882	312	0.6348	0.5133	0.6348	0.7967
No log	4.6176	314	0.5792	0.5039	0.5792	0.7611
No log	4.6471	316	0.6054	0.4980	0.6054	0.7781
No log	4.6765	318	0.6023	0.4675	0.6023	0.7761
No log	4.7059	320	0.5863	0.5021	0.5863	0.7657
No log	4.7353	322	0.6223	0.4661	0.6223	0.7889
No log	4.7647	324	0.6922	0.4486	0.6922	0.8320
No log	4.7941	326	0.7103	0.4486	0.7103	0.8428
No log	4.8235	328	0.6520	0.4448	0.6520	0.8075
No log	4.8529	330	0.6141	0.5518	0.6141	0.7836
No log	4.8824	332	0.6209	0.5352	0.6209	0.7880
No log	4.9118	334	0.6288	0.5436	0.6288	0.7929
No log	4.9412	336	0.6118	0.5436	0.6118	0.7822
No log	4.9706	338	0.5740	0.5956	0.5740	0.7576
No log	5.0	340	0.5697	0.5956	0.5697	0.7548
No log	5.0294	342	0.5734	0.5750	0.5734	0.7572
No log	5.0588	344	0.5561	0.5306	0.5561	0.7457
No log	5.0882	346	0.5781	0.4473	0.5781	0.7603
No log	5.1176	348	0.5911	0.4642	0.5911	0.7688
No log	5.1471	350	0.5849	0.5625	0.5849	0.7648
No log	5.1765	352	0.6350	0.4241	0.6350	0.7969
No log	5.2059	354	0.6481	0.4037	0.6481	0.8051
No log	5.2353	356	0.6059	0.4945	0.6059	0.7784
No log	5.2647	358	0.5996	0.5528	0.5996	0.7744
No log	5.2941	360	0.6145	0.5619	0.6145	0.7839
No log	5.3235	362	0.6009	0.5583	0.6009	0.7752
No log	5.3529	364	0.5765	0.6032	0.5765	0.7593
No log	5.3824	366	0.5825	0.4960	0.5825	0.7632
No log	5.4118	368	0.6009	0.4674	0.6009	0.7752
No log	5.4412	370	0.5782	0.5110	0.5782	0.7604
No log	5.4706	372	0.5472	0.5118	0.5472	0.7397
No log	5.5	374	0.5720	0.5577	0.5720	0.7563
No log	5.5294	376	0.6084	0.5712	0.6084	0.7800
No log	5.5588	378	0.5726	0.5289	0.5726	0.7567
No log	5.5882	380	0.5369	0.5252	0.5369	0.7327
No log	5.6176	382	0.5484	0.6007	0.5484	0.7405
No log	5.6471	384	0.5671	0.6197	0.5671	0.7531
No log	5.6765	386	0.5768	0.5781	0.5768	0.7594
No log	5.7059	388	0.5607	0.5413	0.5607	0.7488
No log	5.7353	390	0.5582	0.4660	0.5582	0.7471
No log	5.7647	392	0.6103	0.4352	0.6103	0.7812
No log	5.7941	394	0.6239	0.4350	0.6239	0.7899
No log	5.8235	396	0.5734	0.4352	0.5734	0.7572
No log	5.8529	398	0.5509	0.5089	0.5509	0.7422
No log	5.8824	400	0.5805	0.5160	0.5805	0.7619
No log	5.9118	402	0.5940	0.5319	0.5940	0.7707
No log	5.9412	404	0.5715	0.5492	0.5715	0.7560
No log	5.9706	406	0.5633	0.5476	0.5633	0.7505
No log	6.0	408	0.5802	0.5324	0.5802	0.7617
No log	6.0294	410	0.5768	0.5324	0.5768	0.7594
No log	6.0588	412	0.5501	0.5723	0.5501	0.7417
No log	6.0882	414	0.5294	0.5899	0.5294	0.7276
No log	6.1176	416	0.5361	0.5304	0.5361	0.7322
No log	6.1471	418	0.5341	0.5522	0.5341	0.7308
No log	6.1765	420	0.5264	0.5912	0.5264	0.7255
No log	6.2059	422	0.5737	0.5632	0.5737	0.7574
No log	6.2353	424	0.5798	0.5632	0.5798	0.7614
No log	6.2647	426	0.5556	0.5784	0.5556	0.7454
No log	6.2941	428	0.5595	0.5831	0.5595	0.7480
No log	6.3235	430	0.5679	0.5609	0.5679	0.7536
No log	6.3529	432	0.5936	0.4875	0.5936	0.7704
No log	6.3824	434	0.6089	0.4704	0.6089	0.7803
No log	6.4118	436	0.6007	0.4875	0.6007	0.7751
No log	6.4412	438	0.5800	0.4875	0.5800	0.7616
No log	6.4706	440	0.5819	0.4875	0.5819	0.7628
No log	6.5	442	0.5641	0.5362	0.5641	0.7511
No log	6.5294	444	0.5394	0.5831	0.5394	0.7344
No log	6.5588	446	0.5469	0.5054	0.5469	0.7396
No log	6.5882	448	0.5545	0.5368	0.5545	0.7447
No log	6.6176	450	0.5450	0.5797	0.5450	0.7383
No log	6.6471	452	0.5259	0.5753	0.5259	0.7252
No log	6.6765	454	0.5286	0.5533	0.5286	0.7270
No log	6.7059	456	0.5354	0.5738	0.5354	0.7317
No log	6.7353	458	0.5322	0.5738	0.5322	0.7295
No log	6.7647	460	0.5336	0.5662	0.5336	0.7305
No log	6.7941	462	0.5371	0.4910	0.5371	0.7329
No log	6.8235	464	0.5509	0.5373	0.5509	0.7422
No log	6.8529	466	0.5458	0.4991	0.5458	0.7388
No log	6.8824	468	0.5502	0.5472	0.5502	0.7417
No log	6.9118	470	0.5882	0.5442	0.5882	0.7670
No log	6.9412	472	0.5797	0.5484	0.5797	0.7614
No log	6.9706	474	0.5364	0.5597	0.5364	0.7324
No log	7.0	476	0.5288	0.5812	0.5288	0.7272
No log	7.0294	478	0.5727	0.5438	0.5727	0.7568
No log	7.0588	480	0.6144	0.4652	0.6144	0.7838
No log	7.0882	482	0.5884	0.5438	0.5884	0.7671
No log	7.1176	484	0.5407	0.5736	0.5407	0.7353
No log	7.1471	486	0.5286	0.5548	0.5286	0.7271
No log	7.1765	488	0.5412	0.5523	0.5412	0.7357
No log	7.2059	490	0.5455	0.5507	0.5455	0.7386
No log	7.2353	492	0.5524	0.5507	0.5524	0.7432
No log	7.2647	494	0.5577	0.4975	0.5577	0.7468
No log	7.2941	496	0.5709	0.5288	0.5709	0.7556
No log	7.3235	498	0.5884	0.5119	0.5884	0.7671
0.3506	7.3529	500	0.5785	0.5288	0.5785	0.7606
0.3506	7.3824	502	0.5718	0.5826	0.5718	0.7561
0.3506	7.4118	504	0.5663	0.5782	0.5663	0.7525
0.3506	7.4412	506	0.5577	0.5782	0.5577	0.7468
0.3506	7.4706	508	0.5515	0.5812	0.5515	0.7426
0.3506	7.5	510	0.5678	0.5612	0.5678	0.7535
0.3506	7.5294	512	0.5989	0.5572	0.5989	0.7739
0.3506	7.5588	514	0.6059	0.5410	0.6059	0.7784
0.3506	7.5882	516	0.5857	0.5749	0.5857	0.7653
0.3506	7.6176	518	0.5580	0.5798	0.5580	0.7470
0.3506	7.6471	520	0.5362	0.5476	0.5362	0.7322
0.3506	7.6765	522	0.5298	0.6052	0.5298	0.7279
0.3506	7.7059	524	0.5260	0.6052	0.5260	0.7253
0.3506	7.7353	526	0.5319	0.6052	0.5319	0.7293
0.3506	7.7647	528	0.5485	0.5628	0.5485	0.7406
0.3506	7.7941	530	0.5298	0.6052	0.5298	0.7279
0.3506	7.8235	532	0.5430	0.5979	0.5430	0.7369
0.3506	7.8529	534	0.5738	0.5486	0.5738	0.7575
0.3506	7.8824	536	0.5504	0.5524	0.5504	0.7419
0.3506	7.9118	538	0.5159	0.5619	0.5159	0.7183
0.3506	7.9412	540	0.5227	0.5455	0.5227	0.7230
0.3506	7.9706	542	0.5393	0.5272	0.5393	0.7344
0.3506	8.0	544	0.5628	0.5034	0.5628	0.7502
0.3506	8.0294	546	0.5849	0.5322	0.5849	0.7648
0.3506	8.0588	548	0.5706	0.4777	0.5706	0.7554
0.3506	8.0882	550	0.5730	0.4586	0.5730	0.7570
0.3506	8.1176	552	0.5673	0.4992	0.5673	0.7532
0.3506	8.1471	554	0.5588	0.5509	0.5588	0.7475
0.3506	8.1765	556	0.5423	0.5509	0.5423	0.7364
0.3506	8.2059	558	0.5496	0.5399	0.5496	0.7413
0.3506	8.2353	560	0.5449	0.4918	0.5449	0.7382
0.3506	8.2647	562	0.5339	0.5237	0.5339	0.7307
0.3506	8.2941	564	0.5257	0.5301	0.5257	0.7250
0.3506	8.3235	566	0.5312	0.5840	0.5312	0.7288
0.3506	8.3529	568	0.5529	0.6112	0.5529	0.7436
0.3506	8.3824	570	0.5515	0.5840	0.5515	0.7426
0.3506	8.4118	572	0.5484	0.5136	0.5484	0.7405
0.3506	8.4412	574	0.5561	0.5469	0.5561	0.7457
0.3506	8.4706	576	0.5498	0.5185	0.5498	0.7415
0.3506	8.5	578	0.5410	0.5048	0.5410	0.7355
0.3506	8.5294	580	0.5558	0.5674	0.5558	0.7455
0.3506	8.5588	582	0.5795	0.6355	0.5795	0.7612
0.3506	8.5882	584	0.5473	0.5958	0.5473	0.7398
0.3506	8.6176	586	0.5282	0.5440	0.5282	0.7268
0.3506	8.6471	588	0.5270	0.5210	0.5270	0.7259
0.3506	8.6765	590	0.5376	0.5283	0.5376	0.7332
0.3506	8.7059	592	0.5450	0.5078	0.5450	0.7383
0.3506	8.7353	594	0.5566	0.5168	0.5566	0.7461
0.3506	8.7647	596	0.5451	0.5233	0.5451	0.7383

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1