ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5532
• Qwk: 0.7573
• Mse: 0.5532
• Rmse: 0.7438

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	4.9574	-0.0005	4.9574	2.2265
No log	0.0851	4	3.3197	0.0811	3.3197	1.8220
No log	0.1277	6	1.8979	0.1399	1.8979	1.3776
No log	0.1702	8	1.4263	0.0942	1.4263	1.1943
No log	0.2128	10	1.1858	0.3094	1.1858	1.0890
No log	0.2553	12	1.1402	0.2299	1.1402	1.0678
No log	0.2979	14	1.1142	0.2612	1.1142	1.0556
No log	0.3404	16	1.0972	0.2511	1.0972	1.0475
No log	0.3830	18	1.0546	0.2998	1.0546	1.0269
No log	0.4255	20	1.0744	0.2707	1.0744	1.0366
No log	0.4681	22	1.0340	0.3347	1.0340	1.0168
No log	0.5106	24	0.9974	0.2960	0.9974	0.9987
No log	0.5532	26	1.0612	0.4078	1.0612	1.0301
No log	0.5957	28	1.2361	0.2440	1.2361	1.1118
No log	0.6383	30	1.0214	0.3901	1.0214	1.0106
No log	0.6809	32	1.0252	0.3686	1.0252	1.0125
No log	0.7234	34	1.1308	0.3713	1.1308	1.0634
No log	0.7660	36	0.9997	0.4218	0.9997	0.9998
No log	0.8085	38	0.7852	0.5615	0.7852	0.8861
No log	0.8511	40	0.7917	0.6011	0.7917	0.8898
No log	0.8936	42	0.9155	0.5678	0.9155	0.9568
No log	0.9362	44	1.5294	0.3680	1.5294	1.2367
No log	0.9787	46	1.7842	0.3406	1.7842	1.3358
No log	1.0213	48	1.2104	0.4688	1.2104	1.1002
No log	1.0638	50	0.7233	0.6956	0.7233	0.8504
No log	1.1064	52	0.6372	0.7201	0.6372	0.7982
No log	1.1489	54	0.6533	0.7038	0.6533	0.8083
No log	1.1915	56	0.8529	0.6043	0.8529	0.9235
No log	1.2340	58	1.4145	0.4206	1.4145	1.1893
No log	1.2766	60	1.5596	0.3917	1.5596	1.2488
No log	1.3191	62	1.1609	0.4828	1.1609	1.0775
No log	1.3617	64	0.6303	0.7332	0.6303	0.7939
No log	1.4043	66	0.5732	0.7262	0.5732	0.7571
No log	1.4468	68	0.5723	0.7244	0.5723	0.7565
No log	1.4894	70	0.6247	0.6922	0.6247	0.7904
No log	1.5319	72	0.9843	0.5404	0.9843	0.9921
No log	1.5745	74	1.1105	0.5188	1.1105	1.0538
No log	1.6170	76	0.9382	0.5914	0.9382	0.9686
No log	1.6596	78	0.6476	0.6977	0.6476	0.8048
No log	1.7021	80	0.5944	0.7409	0.5944	0.7710
No log	1.7447	82	0.6012	0.7337	0.6012	0.7753
No log	1.7872	84	0.6058	0.7191	0.6058	0.7783
No log	1.8298	86	0.6809	0.6837	0.6809	0.8252
No log	1.8723	88	0.7827	0.6574	0.7827	0.8847
No log	1.9149	90	0.7514	0.6884	0.7514	0.8668
No log	1.9574	92	0.6672	0.7378	0.6672	0.8168
No log	2.0	94	0.6559	0.7438	0.6559	0.8099
No log	2.0426	96	0.6538	0.7567	0.6538	0.8086
No log	2.0851	98	0.6548	0.7490	0.6548	0.8092
No log	2.1277	100	0.7779	0.7010	0.7779	0.8820
No log	2.1702	102	0.8255	0.6731	0.8255	0.9086
No log	2.2128	104	0.6702	0.7338	0.6702	0.8186
No log	2.2553	106	0.6021	0.7335	0.6021	0.7760
No log	2.2979	108	0.5976	0.7666	0.5976	0.7730
No log	2.3404	110	0.5938	0.7639	0.5938	0.7706
No log	2.3830	112	0.6148	0.7352	0.6148	0.7841
No log	2.4255	114	0.6324	0.7169	0.6324	0.7953
No log	2.4681	116	0.6323	0.7443	0.6323	0.7952
No log	2.5106	118	0.6527	0.7416	0.6527	0.8079
No log	2.5532	120	0.6943	0.6985	0.6943	0.8332
No log	2.5957	122	0.7261	0.6953	0.7261	0.8521
No log	2.6383	124	0.6570	0.6941	0.6570	0.8106
No log	2.6809	126	0.5862	0.7531	0.5862	0.7656
No log	2.7234	128	0.5868	0.7525	0.5868	0.7660
No log	2.7660	130	0.5917	0.7150	0.5917	0.7692
No log	2.8085	132	0.6242	0.6921	0.6242	0.7900
No log	2.8511	134	0.6144	0.6841	0.6144	0.7839
No log	2.8936	136	0.5780	0.7474	0.5780	0.7602
No log	2.9362	138	0.5999	0.7279	0.5999	0.7745
No log	2.9787	140	0.6094	0.7248	0.6094	0.7807
No log	3.0213	142	0.6508	0.6943	0.6508	0.8067
No log	3.0638	144	0.5999	0.7285	0.5999	0.7745
No log	3.1064	146	0.5575	0.7728	0.5575	0.7466
No log	3.1489	148	0.5469	0.7614	0.5469	0.7395
No log	3.1915	150	0.5417	0.7831	0.5417	0.7360
No log	3.2340	152	0.5412	0.7908	0.5412	0.7356
No log	3.2766	154	0.5532	0.7742	0.5532	0.7438
No log	3.3191	156	0.5571	0.7560	0.5571	0.7464
No log	3.3617	158	0.6110	0.7383	0.6110	0.7816
No log	3.4043	160	0.6810	0.7233	0.6810	0.8252
No log	3.4468	162	0.6136	0.7394	0.6136	0.7833
No log	3.4894	164	0.6062	0.7327	0.6062	0.7786
No log	3.5319	166	0.6832	0.6746	0.6832	0.8266
No log	3.5745	168	0.6035	0.7435	0.6035	0.7769
No log	3.6170	170	0.5494	0.7489	0.5494	0.7412
No log	3.6596	172	0.5433	0.7676	0.5433	0.7371
No log	3.7021	174	0.5591	0.7768	0.5591	0.7477
No log	3.7447	176	0.5606	0.7822	0.5606	0.7487
No log	3.7872	178	0.5523	0.7614	0.5523	0.7431
No log	3.8298	180	0.5520	0.7478	0.5520	0.7429
No log	3.8723	182	0.5570	0.7560	0.5570	0.7463
No log	3.9149	184	0.5821	0.7587	0.5821	0.7630
No log	3.9574	186	0.6073	0.7368	0.6073	0.7793
No log	4.0	188	0.5890	0.7406	0.5890	0.7674
No log	4.0426	190	0.7053	0.7587	0.7053	0.8398
No log	4.0851	192	0.8529	0.6669	0.8529	0.9235
No log	4.1277	194	0.7845	0.7027	0.7845	0.8857
No log	4.1702	196	0.6225	0.7336	0.6225	0.7890
No log	4.2128	198	0.6241	0.7085	0.6241	0.7900
No log	4.2553	200	0.7183	0.7025	0.7183	0.8475
No log	4.2979	202	0.6769	0.6881	0.6769	0.8228
No log	4.3404	204	0.5853	0.6965	0.5853	0.7650
No log	4.3830	206	0.5858	0.7352	0.5858	0.7654
No log	4.4255	208	0.6289	0.7479	0.6289	0.7931
No log	4.4681	210	0.6180	0.7479	0.6180	0.7861
No log	4.5106	212	0.5557	0.7555	0.5557	0.7455
No log	4.5532	214	0.5885	0.7282	0.5885	0.7671
No log	4.5957	216	0.5848	0.7338	0.5848	0.7647
No log	4.6383	218	0.5540	0.7678	0.5540	0.7443
No log	4.6809	220	0.5993	0.7635	0.5993	0.7742
No log	4.7234	222	0.6057	0.7375	0.6057	0.7782
No log	4.7660	224	0.5916	0.7493	0.5916	0.7691
No log	4.8085	226	0.5545	0.7287	0.5545	0.7446
No log	4.8511	228	0.5565	0.7282	0.5565	0.7460
No log	4.8936	230	0.5676	0.7081	0.5676	0.7534
No log	4.9362	232	0.5779	0.7181	0.5779	0.7602
No log	4.9787	234	0.5818	0.7071	0.5818	0.7628
No log	5.0213	236	0.5856	0.7272	0.5856	0.7652
No log	5.0638	238	0.6427	0.6846	0.6427	0.8017
No log	5.1064	240	0.6416	0.6816	0.6416	0.8010
No log	5.1489	242	0.6039	0.7189	0.6039	0.7771
No log	5.1915	244	0.5827	0.7312	0.5827	0.7634
No log	5.2340	246	0.5796	0.7433	0.5796	0.7613
No log	5.2766	248	0.5766	0.7214	0.5766	0.7593
No log	5.3191	250	0.5744	0.7465	0.5744	0.7579
No log	5.3617	252	0.5853	0.7718	0.5853	0.7650
No log	5.4043	254	0.5909	0.7456	0.5909	0.7687
No log	5.4468	256	0.6117	0.7443	0.6117	0.7821
No log	5.4894	258	0.6416	0.7467	0.6416	0.8010
No log	5.5319	260	0.6678	0.7377	0.6678	0.8172
No log	5.5745	262	0.6233	0.7552	0.6233	0.7895
No log	5.6170	264	0.5793	0.7562	0.5793	0.7611
No log	5.6596	266	0.5631	0.7676	0.5631	0.7504
No log	5.7021	268	0.5706	0.7705	0.5706	0.7554
No log	5.7447	270	0.5766	0.7780	0.5766	0.7594
No log	5.7872	272	0.6110	0.7604	0.6110	0.7816
No log	5.8298	274	0.6688	0.7391	0.6688	0.8178
No log	5.8723	276	0.6554	0.7392	0.6554	0.8095
No log	5.9149	278	0.6076	0.7456	0.6076	0.7795
No log	5.9574	280	0.5770	0.7610	0.5770	0.7596
No log	6.0	282	0.5787	0.7836	0.5787	0.7607
No log	6.0426	284	0.5786	0.7673	0.5786	0.7606
No log	6.0851	286	0.5758	0.7385	0.5758	0.7588
No log	6.1277	288	0.5801	0.7432	0.5801	0.7616
No log	6.1702	290	0.6022	0.7233	0.6022	0.7760
No log	6.2128	292	0.6117	0.7251	0.6117	0.7821
No log	6.2553	294	0.5865	0.7548	0.5865	0.7658
No log	6.2979	296	0.5839	0.7394	0.5839	0.7641
No log	6.3404	298	0.6016	0.7286	0.6016	0.7756
No log	6.3830	300	0.6147	0.6978	0.6147	0.7840
No log	6.4255	302	0.6275	0.7033	0.6275	0.7921
No log	6.4681	304	0.6051	0.7217	0.6051	0.7779
No log	6.5106	306	0.5796	0.7209	0.5796	0.7613
No log	6.5532	308	0.6145	0.7078	0.6145	0.7839
No log	6.5957	310	0.6444	0.7055	0.6444	0.8027
No log	6.6383	312	0.6495	0.7093	0.6495	0.8059
No log	6.6809	314	0.6036	0.7213	0.6036	0.7769
No log	6.7234	316	0.5678	0.7288	0.5678	0.7535
No log	6.7660	318	0.5603	0.7377	0.5603	0.7485
No log	6.8085	320	0.5581	0.7377	0.5581	0.7471
No log	6.8511	322	0.5641	0.7460	0.5641	0.7511
No log	6.8936	324	0.5756	0.7475	0.5756	0.7587
No log	6.9362	326	0.6152	0.7329	0.6152	0.7843
No log	6.9787	328	0.6516	0.7080	0.6516	0.8072
No log	7.0213	330	0.6583	0.7061	0.6583	0.8114
No log	7.0638	332	0.6123	0.7329	0.6123	0.7825
No log	7.1064	334	0.5705	0.7488	0.5705	0.7553
No log	7.1489	336	0.5558	0.7496	0.5558	0.7455
No log	7.1915	338	0.5692	0.7530	0.5692	0.7545
No log	7.2340	340	0.5707	0.7562	0.5707	0.7554
No log	7.2766	342	0.5586	0.7668	0.5586	0.7474
No log	7.3191	344	0.5494	0.7553	0.5494	0.7412
No log	7.3617	346	0.5562	0.7579	0.5562	0.7458
No log	7.4043	348	0.5660	0.7707	0.5660	0.7523
No log	7.4468	350	0.5780	0.7598	0.5780	0.7602
No log	7.4894	352	0.5769	0.7673	0.5769	0.7595
No log	7.5319	354	0.5678	0.7803	0.5678	0.7535
No log	7.5745	356	0.5774	0.7685	0.5774	0.7599
No log	7.6170	358	0.5987	0.7529	0.5987	0.7738
No log	7.6596	360	0.5905	0.7461	0.5905	0.7684
No log	7.7021	362	0.5959	0.7345	0.5959	0.7720
No log	7.7447	364	0.5903	0.7309	0.5903	0.7683
No log	7.7872	366	0.5704	0.7518	0.5704	0.7552
No log	7.8298	368	0.5502	0.7675	0.5502	0.7418
No log	7.8723	370	0.5446	0.7598	0.5446	0.7379
No log	7.9149	372	0.5474	0.7598	0.5474	0.7398
No log	7.9574	374	0.5626	0.7607	0.5626	0.7501
No log	8.0	376	0.5927	0.7179	0.5927	0.7699
No log	8.0426	378	0.6193	0.7181	0.6193	0.7870
No log	8.0851	380	0.6193	0.7181	0.6193	0.7869
No log	8.1277	382	0.6115	0.7181	0.6115	0.7820
No log	8.1702	384	0.5968	0.7269	0.5968	0.7725
No log	8.2128	386	0.6016	0.7181	0.6016	0.7756
No log	8.2553	388	0.6068	0.7181	0.6068	0.7790
No log	8.2979	390	0.6196	0.7181	0.6196	0.7871
No log	8.3404	392	0.6371	0.7279	0.6371	0.7982
No log	8.3830	394	0.6395	0.7236	0.6395	0.7997
No log	8.4255	396	0.6264	0.7196	0.6264	0.7915
No log	8.4681	398	0.6000	0.7245	0.6000	0.7746
No log	8.5106	400	0.5822	0.7445	0.5822	0.7630
No log	8.5532	402	0.5627	0.7500	0.5627	0.7501
No log	8.5957	404	0.5537	0.7535	0.5537	0.7441
No log	8.6383	406	0.5493	0.7540	0.5493	0.7412
No log	8.6809	408	0.5483	0.7526	0.5483	0.7405
No log	8.7234	410	0.5481	0.7526	0.5481	0.7403
No log	8.7660	412	0.5490	0.7584	0.5490	0.7410
No log	8.8085	414	0.5478	0.7466	0.5478	0.7401
No log	8.8511	416	0.5470	0.7619	0.5470	0.7396
No log	8.8936	418	0.5457	0.7619	0.5457	0.7387
No log	8.9362	420	0.5431	0.7643	0.5431	0.7370
No log	8.9787	422	0.5413	0.7598	0.5413	0.7357
No log	9.0213	424	0.5424	0.7632	0.5424	0.7365
No log	9.0638	426	0.5493	0.7553	0.5493	0.7411
No log	9.1064	428	0.5596	0.7524	0.5596	0.7481
No log	9.1489	430	0.5718	0.7308	0.5718	0.7562
No log	9.1915	432	0.5803	0.7402	0.5803	0.7618
No log	9.2340	434	0.5838	0.7402	0.5838	0.7641
No log	9.2766	436	0.5821	0.7402	0.5821	0.7629
No log	9.3191	438	0.5752	0.7308	0.5752	0.7584
No log	9.3617	440	0.5669	0.7292	0.5669	0.7529
No log	9.4043	442	0.5597	0.7485	0.5597	0.7481
No log	9.4468	444	0.5554	0.7449	0.5554	0.7453
No log	9.4894	446	0.5520	0.7449	0.5520	0.7430
No log	9.5319	448	0.5501	0.7410	0.5501	0.7417
No log	9.5745	450	0.5484	0.7691	0.5484	0.7405
No log	9.6170	452	0.5480	0.7691	0.5480	0.7403
No log	9.6596	454	0.5483	0.7583	0.5483	0.7405
No log	9.7021	456	0.5481	0.7583	0.5481	0.7403
No log	9.7447	458	0.5485	0.7583	0.5485	0.7406
No log	9.7872	460	0.5491	0.7583	0.5491	0.7410
No log	9.8298	462	0.5502	0.7559	0.5502	0.7418
No log	9.8723	464	0.5513	0.7514	0.5513	0.7425
No log	9.9149	466	0.5520	0.7514	0.5520	0.7430
No log	9.9574	468	0.5528	0.7573	0.5528	0.7435
No log	10.0	470	0.5532	0.7573	0.5532	0.7438

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1