ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k14_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7008
• Qwk: 0.3365
• Mse: 0.7008
• Rmse: 0.8372

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	3.3003	-0.0066	3.3003	1.8167
No log	0.0656	4	1.7139	-0.0070	1.7139	1.3092
No log	0.0984	6	1.0507	0.0345	1.0507	1.0250
No log	0.1311	8	0.6637	0.1556	0.6637	0.8147
No log	0.1639	10	0.5445	0.0638	0.5445	0.7379
No log	0.1967	12	0.5613	0.0569	0.5613	0.7492
No log	0.2295	14	0.5442	0.1206	0.5442	0.7377
No log	0.2623	16	0.9392	0.1111	0.9392	0.9691
No log	0.2951	18	0.6971	0.2464	0.6971	0.8349
No log	0.3279	20	0.5688	0.0	0.5688	0.7542
No log	0.3607	22	0.6114	-0.0732	0.6114	0.7819
No log	0.3934	24	0.5876	0.0	0.5876	0.7666
No log	0.4262	26	0.5816	0.0	0.5816	0.7626
No log	0.4590	28	0.5606	0.0677	0.5606	0.7487
No log	0.4918	30	0.5519	0.1678	0.5519	0.7429
No log	0.5246	32	0.6390	0.3161	0.6390	0.7994
No log	0.5574	34	0.8727	0.2356	0.8727	0.9342
No log	0.5902	36	0.6047	0.0877	0.6047	0.7776
No log	0.6230	38	0.5543	-0.0081	0.5543	0.7445
No log	0.6557	40	0.6637	0.0	0.6637	0.8147
No log	0.6885	42	0.5977	0.0	0.5977	0.7731
No log	0.7213	44	0.5244	0.0	0.5244	0.7241
No log	0.7541	46	0.5398	0.0725	0.5398	0.7347
No log	0.7869	48	0.5281	0.0	0.5281	0.7267
No log	0.8197	50	0.5562	0.0	0.5562	0.7458
No log	0.8525	52	0.7357	0.1515	0.7357	0.8577
No log	0.8852	54	0.9700	0.2000	0.9700	0.9849
No log	0.9180	56	0.8313	0.2000	0.8313	0.9118
No log	0.9508	58	0.6374	0.2457	0.6374	0.7984
No log	0.9836	60	0.5132	0.2418	0.5132	0.7164
No log	1.0164	62	1.0313	0.0977	1.0313	1.0155
No log	1.0492	64	0.8507	0.1795	0.8507	0.9223
No log	1.0820	66	0.4692	0.2571	0.4692	0.6850
No log	1.1148	68	0.7220	0.2000	0.7220	0.8497
No log	1.1475	70	0.9860	0.0367	0.9860	0.9930
No log	1.1803	72	0.6583	0.1461	0.6583	0.8114
No log	1.2131	74	0.5295	0.2405	0.5295	0.7277
No log	1.2459	76	0.5706	0.2787	0.5706	0.7554
No log	1.2787	78	0.5372	0.2683	0.5372	0.7329
No log	1.3115	80	0.9389	0.0609	0.9389	0.9690
No log	1.3443	82	0.9995	0.1059	0.9995	0.9997
No log	1.3770	84	0.6376	0.2340	0.6376	0.7985
No log	1.4098	86	0.5023	0.3103	0.5023	0.7087
No log	1.4426	88	0.5644	0.2707	0.5644	0.7513
No log	1.4754	90	0.5166	0.3797	0.5166	0.7187
No log	1.5082	92	0.5212	0.3684	0.5212	0.7219
No log	1.5410	94	0.6619	0.3237	0.6619	0.8136
No log	1.5738	96	1.5397	0.1231	1.5397	1.2408
No log	1.6066	98	1.7950	0.0824	1.7950	1.3398
No log	1.6393	100	1.3725	0.1738	1.3725	1.1715
No log	1.6721	102	1.0594	0.1709	1.0594	1.0293
No log	1.7049	104	0.7553	0.3077	0.7553	0.8691
No log	1.7377	106	0.9226	0.2000	0.9226	0.9605
No log	1.7705	108	0.6116	0.3878	0.6116	0.7821
No log	1.8033	110	0.4560	0.3797	0.4560	0.6753
No log	1.8361	112	0.4892	0.4162	0.4892	0.6994
No log	1.8689	114	1.0421	0.2000	1.0421	1.0208
No log	1.9016	116	1.6115	0.0595	1.6115	1.2694
No log	1.9344	118	1.1342	0.2281	1.1342	1.0650
No log	1.9672	120	0.4251	0.3829	0.4251	0.6520
No log	2.0	122	0.4639	0.3913	0.4639	0.6811
No log	2.0328	124	0.4584	0.4105	0.4584	0.6770
No log	2.0656	126	0.4366	0.4747	0.4366	0.6607
No log	2.0984	128	1.0513	0.2239	1.0513	1.0253
No log	2.1311	130	1.3055	0.2611	1.3055	1.1426
No log	2.1639	132	1.1091	0.2862	1.1091	1.0531
No log	2.1967	134	0.5803	0.4483	0.5803	0.7617
No log	2.2295	136	0.5949	0.4236	0.5949	0.7713
No log	2.2623	138	0.9966	0.3191	0.9966	0.9983
No log	2.2951	140	2.2000	0.0927	2.2000	1.4832
No log	2.3279	142	2.1766	0.0769	2.1766	1.4753
No log	2.3607	144	1.3415	0.2303	1.3415	1.1582
No log	2.3934	146	0.6729	0.3388	0.6729	0.8203
No log	2.4262	148	0.7331	0.3418	0.7331	0.8562
No log	2.4590	150	1.2834	0.2162	1.2834	1.1329
No log	2.4918	152	1.4024	0.1226	1.4024	1.1842
No log	2.5246	154	0.9372	0.2177	0.9372	0.9681
No log	2.5574	156	0.6912	0.4185	0.6912	0.8314
No log	2.5902	158	0.7868	0.2863	0.7868	0.8870
No log	2.6230	160	1.2758	0.1418	1.2758	1.1295
No log	2.6557	162	1.5590	0.0541	1.5590	1.2486
No log	2.6885	164	1.3639	0.0897	1.3639	1.1679
No log	2.7213	166	1.1666	0.1939	1.1666	1.0801
No log	2.7541	168	1.0899	0.2558	1.0899	1.0440
No log	2.7869	170	0.9142	0.2605	0.9142	0.9561
No log	2.8197	172	0.8943	0.2863	0.8943	0.9456
No log	2.8525	174	1.0157	0.2258	1.0157	1.0078
No log	2.8852	176	0.9880	0.2258	0.9880	0.9940
No log	2.9180	178	0.6358	0.3641	0.6358	0.7974
No log	2.9508	180	0.5397	0.2258	0.5397	0.7347
No log	2.9836	182	0.5868	0.3191	0.5868	0.7660
No log	3.0164	184	0.7208	0.3242	0.7208	0.8490
No log	3.0492	186	0.8000	0.3004	0.8000	0.8944
No log	3.0820	188	0.8227	0.2982	0.8227	0.9070
No log	3.1148	190	0.6121	0.2941	0.6121	0.7824
No log	3.1475	192	0.6364	0.2917	0.6364	0.7978
No log	3.1803	194	1.0045	0.2490	1.0045	1.0022
No log	3.2131	196	1.5447	0.1006	1.5447	1.2429
No log	3.2459	198	1.3936	0.0891	1.3936	1.1805
No log	3.2787	200	0.8442	0.1933	0.8442	0.9188
No log	3.3115	202	0.6718	0.3061	0.6718	0.8196
No log	3.3443	204	0.7929	0.1931	0.7929	0.8905
No log	3.3770	206	1.1289	0.1594	1.1289	1.0625
No log	3.4098	208	1.4161	0.1338	1.4161	1.1900
No log	3.4426	210	1.4767	0.1810	1.4767	1.2152
No log	3.4754	212	0.9774	0.2581	0.9774	0.9887
No log	3.5082	214	0.6525	0.4128	0.6525	0.8077
No log	3.5410	216	0.7148	0.3846	0.7148	0.8455
No log	3.5738	218	1.1010	0.2109	1.1010	1.0493
No log	3.6066	220	1.4796	0.1778	1.4796	1.2164
No log	3.6393	222	1.2429	0.1358	1.2429	1.1149
No log	3.6721	224	0.8524	0.3821	0.8524	0.9232
No log	3.7049	226	0.7171	0.3846	0.7171	0.8468
No log	3.7377	228	0.6861	0.3628	0.6861	0.8283
No log	3.7705	230	0.8078	0.2605	0.8078	0.8988
No log	3.8033	232	0.7617	0.3593	0.7617	0.8728
No log	3.8361	234	0.7923	0.3593	0.7923	0.8901
No log	3.8689	236	1.0051	0.2664	1.0051	1.0025
No log	3.9016	238	1.0425	0.3151	1.0425	1.0210
No log	3.9344	240	0.9486	0.4036	0.9486	0.9740
No log	3.9672	242	0.8454	0.4154	0.8454	0.9194
No log	4.0	244	0.7635	0.4	0.7635	0.8738
No log	4.0328	246	0.5962	0.3846	0.5962	0.7721
No log	4.0656	248	0.5233	0.3231	0.5233	0.7234
No log	4.0984	250	0.5060	0.4872	0.5060	0.7113
No log	4.1311	252	0.6673	0.4123	0.6673	0.8169
No log	4.1639	254	0.9488	0.1938	0.9488	0.9741
No log	4.1967	256	0.8538	0.1935	0.8538	0.9240
No log	4.2295	258	0.5700	0.4225	0.5700	0.7550
No log	4.2623	260	0.5048	0.3953	0.5048	0.7105
No log	4.2951	262	0.5107	0.3708	0.5107	0.7147
No log	4.3279	264	0.5804	0.4105	0.5804	0.7618
No log	4.3607	266	0.8473	0.2605	0.8473	0.9205
No log	4.3934	268	0.8275	0.2632	0.8275	0.9097
No log	4.4262	270	0.6855	0.3398	0.6855	0.8280
No log	4.4590	272	0.6551	0.3561	0.6551	0.8094
No log	4.4918	274	0.6747	0.3237	0.6747	0.8214
No log	4.5246	276	0.9259	0.2258	0.9259	0.9622
No log	4.5574	278	1.3534	0.2097	1.3534	1.1633
No log	4.5902	280	1.3501	0.2046	1.3501	1.1619
No log	4.6230	282	0.9497	0.2174	0.9497	0.9745
No log	4.6557	284	0.8928	0.2124	0.8928	0.9449
No log	4.6885	286	1.0350	0.2174	1.0350	1.0174
No log	4.7213	288	0.9510	0.2253	0.9510	0.9752
No log	4.7541	290	0.8132	0.2863	0.8132	0.9018
No log	4.7869	292	0.6711	0.3818	0.6711	0.8192
No log	4.8197	294	0.5668	0.4229	0.5668	0.7529
No log	4.8525	296	0.5525	0.4229	0.5525	0.7433
No log	4.8852	298	0.6301	0.4386	0.6301	0.7938
No log	4.9180	300	0.5748	0.4554	0.5748	0.7582
No log	4.9508	302	0.5207	0.4229	0.5207	0.7216
No log	4.9836	304	0.5004	0.3297	0.5004	0.7074
No log	5.0164	306	0.5095	0.3299	0.5095	0.7138
No log	5.0492	308	0.6553	0.4286	0.6553	0.8095
No log	5.0820	310	0.7827	0.4240	0.7827	0.8847
No log	5.1148	312	0.7614	0.3968	0.7614	0.8726
No log	5.1475	314	0.6258	0.4439	0.6258	0.7911
No log	5.1803	316	0.6219	0.4439	0.6219	0.7886
No log	5.2131	318	0.5708	0.4751	0.5708	0.7555
No log	5.2459	320	0.5626	0.4815	0.5626	0.7501
No log	5.2787	322	0.5679	0.4751	0.5679	0.7536
No log	5.3115	324	0.7124	0.3719	0.7124	0.8441
No log	5.3443	326	0.9721	0.2868	0.9721	0.9859
No log	5.3770	328	0.9350	0.2868	0.9350	0.9669
No log	5.4098	330	0.7137	0.3651	0.7137	0.8448
No log	5.4426	332	0.5970	0.4336	0.5970	0.7727
No log	5.4754	334	0.6881	0.392	0.6881	0.8295
No log	5.5082	336	0.7293	0.3834	0.7293	0.8540
No log	5.5410	338	0.6657	0.3821	0.6657	0.8159
No log	5.5738	340	0.7241	0.3834	0.7241	0.8509
No log	5.6066	342	0.8547	0.3481	0.8547	0.9245
No log	5.6393	344	0.7954	0.3798	0.7954	0.8919
No log	5.6721	346	0.7162	0.3871	0.7162	0.8463
No log	5.7049	348	0.7391	0.3834	0.7391	0.8597
No log	5.7377	350	0.7111	0.3991	0.7111	0.8433
No log	5.7705	352	0.7084	0.4237	0.7084	0.8416
No log	5.8033	354	0.6709	0.4430	0.6709	0.8191
No log	5.8361	356	0.7159	0.4386	0.7159	0.8461
No log	5.8689	358	0.8206	0.3231	0.8206	0.9059
No log	5.9016	360	0.7851	0.3834	0.7851	0.8860
No log	5.9344	362	0.6436	0.4050	0.6436	0.8022
No log	5.9672	364	0.6474	0.4050	0.6474	0.8046
No log	6.0	366	0.6602	0.4050	0.6602	0.8126
No log	6.0328	368	0.6010	0.4333	0.6010	0.7753
No log	6.0656	370	0.5475	0.4489	0.5475	0.7400
No log	6.0984	372	0.6167	0.4690	0.6167	0.7853
No log	6.1311	374	0.8853	0.3558	0.8853	0.9409
No log	6.1639	376	1.1701	0.1892	1.1701	1.0817
No log	6.1967	378	1.1641	0.1892	1.1641	1.0789
No log	6.2295	380	0.8652	0.2756	0.8652	0.9301
No log	6.2623	382	0.6087	0.4333	0.6087	0.7802
No log	6.2951	384	0.5839	0.4435	0.5839	0.7641
No log	6.3279	386	0.6409	0.3719	0.6409	0.8005
No log	6.3607	388	0.8215	0.2520	0.8215	0.9064
No log	6.3934	390	0.8646	0.2188	0.8646	0.9299
No log	6.4262	392	0.8296	0.2531	0.8296	0.9108
No log	6.4590	394	0.6809	0.3833	0.6809	0.8251
No log	6.4918	396	0.6514	0.4489	0.6514	0.8071
No log	6.5246	398	0.6750	0.4087	0.6750	0.8216
No log	6.5574	400	0.6449	0.4133	0.6449	0.8031
No log	6.5902	402	0.6794	0.4087	0.6794	0.8243
No log	6.6230	404	0.7966	0.2960	0.7966	0.8925
No log	6.6557	406	0.8064	0.2941	0.8064	0.8980
No log	6.6885	408	0.7060	0.4	0.7060	0.8402
No log	6.7213	410	0.5583	0.4703	0.5583	0.7472
No log	6.7541	412	0.5001	0.4605	0.5001	0.7072
No log	6.7869	414	0.5123	0.4489	0.5123	0.7158
No log	6.8197	416	0.6384	0.4798	0.6384	0.7990
No log	6.8525	418	0.7947	0.3386	0.7947	0.8914
No log	6.8852	420	0.8776	0.2741	0.8776	0.9368
No log	6.9180	422	0.8151	0.3443	0.8151	0.9028
No log	6.9508	424	0.6461	0.4798	0.6461	0.8038
No log	6.9836	426	0.5704	0.4435	0.5704	0.7552
No log	7.0164	428	0.5585	0.4489	0.5585	0.7473
No log	7.0492	430	0.5764	0.4489	0.5764	0.7592
No log	7.0820	432	0.6754	0.3874	0.6754	0.8218
No log	7.1148	434	0.8014	0.3195	0.8014	0.8952
No log	7.1475	436	0.7540	0.3886	0.7540	0.8683
No log	7.1803	438	0.7240	0.3929	0.7240	0.8509
No log	7.2131	440	0.6173	0.4396	0.6173	0.7857
No log	7.2459	442	0.5709	0.3641	0.5709	0.7556
No log	7.2787	444	0.5537	0.3730	0.5537	0.7441
No log	7.3115	446	0.6017	0.4573	0.6017	0.7757
No log	7.3443	448	0.6463	0.3831	0.6463	0.8039
No log	7.3770	450	0.6406	0.3831	0.6406	0.8004
No log	7.4098	452	0.6606	0.3786	0.6606	0.8128
No log	7.4426	454	0.6880	0.3333	0.6880	0.8295
No log	7.4754	456	0.7953	0.2605	0.7953	0.8918
No log	7.5082	458	0.8353	0.2605	0.8353	0.9139
No log	7.5410	460	0.7528	0.2920	0.7528	0.8676
No log	7.5738	462	0.6592	0.4450	0.6592	0.8119
No log	7.6066	464	0.6177	0.4396	0.6177	0.7860
No log	7.6393	466	0.6429	0.4396	0.6429	0.8018
No log	7.6721	468	0.7417	0.2920	0.7417	0.8612
No log	7.7049	470	0.8359	0.2846	0.8359	0.9143
No log	7.7377	472	0.9271	0.2569	0.9271	0.9629
No log	7.7705	474	0.9282	0.2569	0.9282	0.9634
No log	7.8033	476	0.8796	0.2829	0.8796	0.9379
No log	7.8361	478	0.7340	0.2920	0.7340	0.8567
No log	7.8689	480	0.5963	0.4455	0.5963	0.7722
No log	7.9016	482	0.5467	0.4346	0.5467	0.7394
No log	7.9344	484	0.5244	0.3535	0.5244	0.7242
No log	7.9672	486	0.5348	0.4400	0.5348	0.7313
No log	8.0	488	0.5958	0.4112	0.5958	0.7719
No log	8.0328	490	0.6526	0.4450	0.6526	0.8079
No log	8.0656	492	0.6731	0.3786	0.6731	0.8204
No log	8.0984	494	0.6661	0.3786	0.6661	0.8162
No log	8.1311	496	0.6481	0.3786	0.6481	0.8050
No log	8.1639	498	0.6479	0.3786	0.6479	0.8049
0.4756	8.1967	500	0.7137	0.3303	0.7137	0.8448
0.4756	8.2295	502	0.7816	0.2269	0.7816	0.8841
0.4756	8.2623	504	0.8086	0.2269	0.8086	0.8992
0.4756	8.2951	506	0.8262	0.2269	0.8262	0.9089
0.4756	8.3279	508	0.8319	0.2269	0.8319	0.9121
0.4756	8.3607	510	0.7868	0.2632	0.7868	0.8870
0.4756	8.3934	512	0.7045	0.3744	0.7045	0.8394
0.4756	8.4262	514	0.6899	0.3744	0.6899	0.8306
0.4756	8.4590	516	0.7152	0.3333	0.7152	0.8457
0.4756	8.4918	518	0.7454	0.2920	0.7454	0.8634
0.4756	8.5246	520	0.8118	0.2881	0.8118	0.9010
0.4756	8.5574	522	0.7938	0.2881	0.7938	0.8909
0.4756	8.5902	524	0.7575	0.2920	0.7575	0.8703
0.4756	8.6230	526	0.7323	0.3303	0.7323	0.8558
0.4756	8.6557	528	0.7285	0.3333	0.7285	0.8535
0.4756	8.6885	530	0.7374	0.3303	0.7374	0.8587
0.4756	8.7213	532	0.7316	0.3333	0.7316	0.8553
0.4756	8.7541	534	0.7351	0.3333	0.7351	0.8574
0.4756	8.7869	536	0.7048	0.3365	0.7048	0.8395
0.4756	8.8197	538	0.6844	0.3365	0.6844	0.8273
0.4756	8.8525	540	0.6846	0.3365	0.6846	0.8274
0.4756	8.8852	542	0.6962	0.3365	0.6962	0.8344
0.4756	8.9180	544	0.7437	0.3028	0.7437	0.8624
0.4756	8.9508	546	0.7514	0.3004	0.7514	0.8668
0.4756	8.9836	548	0.7119	0.3077	0.7119	0.8437
0.4756	9.0164	550	0.6558	0.3433	0.6558	0.8098
0.4756	9.0492	552	0.6213	0.3508	0.6213	0.7882
0.4756	9.0820	554	0.6135	0.4112	0.6135	0.7833
0.4756	9.1148	556	0.6164	0.4112	0.6164	0.7851
0.4756	9.1475	558	0.6306	0.4171	0.6306	0.7941
0.4756	9.1803	560	0.6426	0.4450	0.6426	0.8016
0.4756	9.2131	562	0.6588	0.4450	0.6588	0.8117
0.4756	9.2459	564	0.6772	0.3365	0.6772	0.8229
0.4756	9.2787	566	0.6943	0.3365	0.6943	0.8332
0.4756	9.3115	568	0.7256	0.3333	0.7256	0.8518
0.4756	9.3443	570	0.7299	0.3333	0.7299	0.8544
0.4756	9.3770	572	0.7398	0.3333	0.7398	0.8601
0.4756	9.4098	574	0.7230	0.3365	0.7230	0.8503
0.4756	9.4426	576	0.6928	0.3365	0.6928	0.8324
0.4756	9.4754	578	0.6724	0.4019	0.6724	0.8200
0.4756	9.5082	580	0.6698	0.4019	0.6698	0.8184
0.4756	9.5410	582	0.6690	0.4019	0.6690	0.8179
0.4756	9.5738	584	0.6744	0.4019	0.6744	0.8212
0.4756	9.6066	586	0.6739	0.4019	0.6739	0.8209
0.4756	9.6393	588	0.6687	0.4019	0.6687	0.8177
0.4756	9.6721	590	0.6724	0.4019	0.6724	0.8200
0.4756	9.7049	592	0.6740	0.4019	0.6740	0.8210
0.4756	9.7377	594	0.6828	0.3365	0.6828	0.8263
0.4756	9.7705	596	0.6906	0.3365	0.6906	0.8310
0.4756	9.8033	598	0.7002	0.3365	0.7002	0.8368
0.4756	9.8361	600	0.7014	0.3365	0.7014	0.8375
0.4756	9.8689	602	0.7034	0.3365	0.7034	0.8387
0.4756	9.9016	604	0.7025	0.3365	0.7025	0.8381
0.4756	9.9344	606	0.7013	0.3365	0.7013	0.8375
0.4756	9.9672	608	0.7011	0.3365	0.7011	0.8373
0.4756	10.0	610	0.7008	0.3365	0.7008	0.8372

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1