ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9811
• Qwk: 0.6533
• Mse: 0.9811
• Rmse: 0.9905

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	2.1799	0.0285	2.1799	1.4765
No log	0.0976	4	1.4369	0.2827	1.4369	1.1987
No log	0.1463	6	1.4015	0.1471	1.4015	1.1839
No log	0.1951	8	1.6086	0.1809	1.6086	1.2683
No log	0.2439	10	1.5613	0.2494	1.5613	1.2495
No log	0.2927	12	1.6141	0.3236	1.6141	1.2705
No log	0.3415	14	1.6965	0.3105	1.6965	1.3025
No log	0.3902	16	1.5919	0.3289	1.5919	1.2617
No log	0.4390	18	1.3871	0.2519	1.3871	1.1777
No log	0.4878	20	1.2861	0.1842	1.2861	1.1340
No log	0.5366	22	1.2440	0.2226	1.2440	1.1153
No log	0.5854	24	1.2651	0.3093	1.2651	1.1248
No log	0.6341	26	1.3292	0.3825	1.3292	1.1529
No log	0.6829	28	1.3344	0.4007	1.3344	1.1551
No log	0.7317	30	1.2502	0.3691	1.2502	1.1181
No log	0.7805	32	1.2191	0.4190	1.2191	1.1041
No log	0.8293	34	1.2682	0.4893	1.2682	1.1262
No log	0.8780	36	1.1640	0.5028	1.1640	1.0789
No log	0.9268	38	1.1267	0.5097	1.1267	1.0614
No log	0.9756	40	1.0431	0.4829	1.0431	1.0213
No log	1.0244	42	1.0790	0.4902	1.0790	1.0387
No log	1.0732	44	1.0074	0.4728	1.0074	1.0037
No log	1.1220	46	1.0202	0.4880	1.0202	1.0100
No log	1.1707	48	1.2177	0.4813	1.2177	1.1035
No log	1.2195	50	1.3181	0.4396	1.3181	1.1481
No log	1.2683	52	1.2450	0.4406	1.2450	1.1158
No log	1.3171	54	1.1845	0.4378	1.1845	1.0883
No log	1.3659	56	1.2070	0.4503	1.2070	1.0986
No log	1.4146	58	1.2292	0.4763	1.2292	1.1087
No log	1.4634	60	1.0515	0.5275	1.0515	1.0254
No log	1.5122	62	0.9413	0.5447	0.9413	0.9702
No log	1.5610	64	0.9733	0.5580	0.9733	0.9865
No log	1.6098	66	1.0916	0.5609	1.0916	1.0448
No log	1.6585	68	1.2281	0.5704	1.2281	1.1082
No log	1.7073	70	1.0803	0.5999	1.0803	1.0394
No log	1.7561	72	0.9826	0.6316	0.9826	0.9913
No log	1.8049	74	0.8257	0.6701	0.8257	0.9087
No log	1.8537	76	0.8183	0.6830	0.8183	0.9046
No log	1.9024	78	1.1087	0.6221	1.1087	1.0529
No log	1.9512	80	1.5302	0.5230	1.5302	1.2370
No log	2.0	82	1.5118	0.5033	1.5118	1.2296
No log	2.0488	84	1.3105	0.5725	1.3105	1.1448
No log	2.0976	86	1.0714	0.6508	1.0714	1.0351
No log	2.1463	88	0.9433	0.6598	0.9433	0.9712
No log	2.1951	90	1.0201	0.6664	1.0201	1.0100
No log	2.2439	92	1.2317	0.6239	1.2317	1.1098
No log	2.2927	94	1.3925	0.5866	1.3925	1.1800
No log	2.3415	96	1.3946	0.5815	1.3946	1.1809
No log	2.3902	98	1.1024	0.6490	1.1024	1.0500
No log	2.4390	100	0.8490	0.6702	0.8490	0.9214
No log	2.4878	102	0.8923	0.6587	0.8923	0.9446
No log	2.5366	104	1.1336	0.6306	1.1336	1.0647
No log	2.5854	106	1.2900	0.5608	1.2900	1.1358
No log	2.6341	108	1.3347	0.5627	1.3347	1.1553
No log	2.6829	110	1.0887	0.6033	1.0887	1.0434
No log	2.7317	112	0.8781	0.6704	0.8781	0.9371
No log	2.7805	114	0.8358	0.6767	0.8358	0.9142
No log	2.8293	116	0.8717	0.6867	0.8717	0.9337
No log	2.8780	118	1.2499	0.6130	1.2499	1.1180
No log	2.9268	120	1.4367	0.5830	1.4367	1.1986
No log	2.9756	122	1.2622	0.6326	1.2622	1.1235
No log	3.0244	124	1.0298	0.6611	1.0298	1.0148
No log	3.0732	126	1.0128	0.6557	1.0128	1.0064
No log	3.1220	128	1.1312	0.6444	1.1312	1.0636
No log	3.1707	130	1.4569	0.5981	1.4569	1.2070
No log	3.2195	132	1.5942	0.5684	1.5942	1.2626
No log	3.2683	134	1.3826	0.5845	1.3826	1.1758
No log	3.3171	136	0.9913	0.6318	0.9913	0.9956
No log	3.3659	138	0.8398	0.6640	0.8398	0.9164
No log	3.4146	140	0.8946	0.6379	0.8946	0.9458
No log	3.4634	142	1.0990	0.6208	1.0990	1.0483
No log	3.5122	144	1.3552	0.5754	1.3552	1.1641
No log	3.5610	146	1.4611	0.5800	1.4611	1.2088
No log	3.6098	148	1.4861	0.5773	1.4861	1.2190
No log	3.6585	150	1.3672	0.5957	1.3672	1.1693
No log	3.7073	152	1.2717	0.5978	1.2717	1.1277
No log	3.7561	154	1.0512	0.6401	1.0512	1.0253
No log	3.8049	156	0.8251	0.6526	0.8251	0.9083
No log	3.8537	158	0.7938	0.6388	0.7938	0.8909
No log	3.9024	160	0.9058	0.6463	0.9058	0.9518
No log	3.9512	162	1.2007	0.5994	1.2007	1.0957
No log	4.0	164	1.3709	0.5820	1.3709	1.1709
No log	4.0488	166	1.2689	0.5877	1.2689	1.1265
No log	4.0976	168	0.9328	0.6704	0.9328	0.9658
No log	4.1463	170	0.7476	0.6712	0.7476	0.8646
No log	4.1951	172	0.7213	0.6682	0.7213	0.8493
No log	4.2439	174	0.8118	0.6702	0.8118	0.9010
No log	4.2927	176	0.9484	0.6604	0.9484	0.9739
No log	4.3415	178	1.1132	0.6534	1.1132	1.0551
No log	4.3902	180	1.0329	0.6788	1.0329	1.0163
No log	4.4390	182	1.0147	0.6818	1.0147	1.0073
No log	4.4878	184	0.9825	0.6850	0.9825	0.9912
No log	4.5366	186	0.9130	0.6845	0.9130	0.9555
No log	4.5854	188	0.9656	0.6686	0.9656	0.9826
No log	4.6341	190	1.0124	0.6202	1.0124	1.0062
No log	4.6829	192	0.9655	0.6275	0.9655	0.9826
No log	4.7317	194	1.0112	0.6161	1.0112	1.0056
No log	4.7805	196	1.0974	0.6288	1.0974	1.0476
No log	4.8293	198	1.2423	0.6280	1.2423	1.1146
No log	4.8780	200	1.2419	0.6280	1.2419	1.1144
No log	4.9268	202	1.0444	0.6486	1.0444	1.0219
No log	4.9756	204	0.9306	0.6635	0.9306	0.9647
No log	5.0244	206	0.9375	0.6540	0.9375	0.9682
No log	5.0732	208	0.8956	0.6545	0.8956	0.9463
No log	5.1220	210	0.9034	0.6619	0.9034	0.9505
No log	5.1707	212	0.9751	0.6190	0.9751	0.9874
No log	5.2195	214	0.9992	0.6367	0.9992	0.9996
No log	5.2683	216	0.9201	0.6303	0.9200	0.9592
No log	5.3171	218	0.8875	0.6788	0.8875	0.9421
No log	5.3659	220	0.8578	0.6813	0.8578	0.9262
No log	5.4146	222	0.9940	0.6559	0.9940	0.9970
No log	5.4634	224	1.0439	0.6507	1.0439	1.0217
No log	5.5122	226	1.1492	0.6479	1.1492	1.0720
No log	5.5610	228	1.1507	0.6336	1.1507	1.0727
No log	5.6098	230	1.0062	0.6402	1.0062	1.0031
No log	5.6585	232	0.9315	0.6458	0.9315	0.9651
No log	5.7073	234	0.9389	0.6458	0.9389	0.9690
No log	5.7561	236	1.0420	0.6084	1.0420	1.0208
No log	5.8049	238	1.1871	0.6036	1.1871	1.0896
No log	5.8537	240	1.3816	0.5442	1.3816	1.1754
No log	5.9024	242	1.4245	0.5385	1.4245	1.1935
No log	5.9512	244	1.3313	0.5394	1.3313	1.1538
No log	6.0	246	1.1939	0.5979	1.1939	1.0927
No log	6.0488	248	1.1400	0.5977	1.1400	1.0677
No log	6.0976	250	1.2199	0.6052	1.2199	1.1045
No log	6.1463	252	1.4272	0.5719	1.4272	1.1947
No log	6.1951	254	1.5127	0.5356	1.5127	1.2299
No log	6.2439	256	1.4092	0.5823	1.4092	1.1871
No log	6.2927	258	1.2026	0.6190	1.2026	1.0966
No log	6.3415	260	1.0857	0.6170	1.0857	1.0420
No log	6.3902	262	1.1125	0.6157	1.1125	1.0548
No log	6.4390	264	1.1331	0.6189	1.1331	1.0645
No log	6.4878	266	1.1741	0.6106	1.1741	1.0835
No log	6.5366	268	1.1669	0.6050	1.1669	1.0802
No log	6.5854	270	1.1311	0.6106	1.1311	1.0635
No log	6.6341	272	1.0832	0.6258	1.0832	1.0408
No log	6.6829	274	1.0249	0.6321	1.0249	1.0124
No log	6.7317	276	0.9845	0.6591	0.9845	0.9922
No log	6.7805	278	0.9562	0.6606	0.9562	0.9778
No log	6.8293	280	0.9791	0.6672	0.9791	0.9895
No log	6.8780	282	1.0628	0.6250	1.0628	1.0309
No log	6.9268	284	1.1903	0.6311	1.1903	1.0910
No log	6.9756	286	1.3143	0.6038	1.3143	1.1465
No log	7.0244	288	1.2926	0.6112	1.2926	1.1369
No log	7.0732	290	1.1665	0.6263	1.1665	1.0800
No log	7.1220	292	1.0252	0.6402	1.0252	1.0125
No log	7.1707	294	1.0096	0.6549	1.0096	1.0048
No log	7.2195	296	1.0522	0.6331	1.0522	1.0258
No log	7.2683	298	1.0997	0.6331	1.0997	1.0487
No log	7.3171	300	1.1325	0.6280	1.1325	1.0642
No log	7.3659	302	1.0809	0.6362	1.0809	1.0396
No log	7.4146	304	0.9968	0.6243	0.9968	0.9984
No log	7.4634	306	0.9172	0.6589	0.9172	0.9577
No log	7.5122	308	0.9158	0.6589	0.9158	0.9570
No log	7.5610	310	0.9654	0.6444	0.9654	0.9826
No log	7.6098	312	1.0497	0.6383	1.0497	1.0246
No log	7.6585	314	1.0847	0.6383	1.0847	1.0415
No log	7.7073	316	1.0418	0.6218	1.0418	1.0207
No log	7.7561	318	0.9598	0.6535	0.9598	0.9797
No log	7.8049	320	0.9060	0.6819	0.9060	0.9518
No log	7.8537	322	0.8684	0.6652	0.8684	0.9319
No log	7.9024	324	0.8878	0.6830	0.8878	0.9422
No log	7.9512	326	0.9658	0.6535	0.9658	0.9827
No log	8.0	328	1.0867	0.6462	1.0867	1.0424
No log	8.0488	330	1.1561	0.6158	1.1561	1.0752
No log	8.0976	332	1.2159	0.6124	1.2159	1.1027
No log	8.1463	334	1.1869	0.6158	1.1869	1.0895
No log	8.1951	336	1.0964	0.6381	1.0964	1.0471
No log	8.2439	338	1.0033	0.6581	1.0033	1.0016
No log	8.2927	340	0.9676	0.6521	0.9676	0.9837
No log	8.3415	342	0.9794	0.6516	0.9794	0.9896
No log	8.3902	344	1.0176	0.6673	1.0176	1.0088
No log	8.4390	346	1.0774	0.6343	1.0774	1.0380
No log	8.4878	348	1.1445	0.6158	1.1445	1.0698
No log	8.5366	350	1.1753	0.6083	1.1753	1.0841
No log	8.5854	352	1.1787	0.6045	1.1787	1.0857
No log	8.6341	354	1.1564	0.6053	1.1564	1.0753
No log	8.6829	356	1.1143	0.6196	1.1143	1.0556
No log	8.7317	358	1.0766	0.6449	1.0766	1.0376
No log	8.7805	360	1.0400	0.6452	1.0400	1.0198
No log	8.8293	362	1.0040	0.6430	1.0040	1.0020
No log	8.8780	364	0.9666	0.6470	0.9666	0.9832
No log	8.9268	366	0.9518	0.6745	0.9518	0.9756
No log	8.9756	368	0.9524	0.6680	0.9524	0.9759
No log	9.0244	370	0.9674	0.6743	0.9674	0.9836
No log	9.0732	372	1.0031	0.6538	1.0031	1.0016
No log	9.1220	374	1.0389	0.6530	1.0389	1.0192
No log	9.1707	376	1.0843	0.6449	1.0843	1.0413
No log	9.2195	378	1.1164	0.6301	1.1164	1.0566
No log	9.2683	380	1.1209	0.6301	1.1209	1.0587
No log	9.3171	382	1.1256	0.6301	1.1256	1.0609
No log	9.3659	384	1.1265	0.6301	1.1265	1.0614
No log	9.4146	386	1.1059	0.6449	1.1059	1.0516
No log	9.4634	388	1.0890	0.6449	1.0890	1.0436
No log	9.5122	390	1.0692	0.6449	1.0692	1.0340
No log	9.5610	392	1.0479	0.6452	1.0479	1.0237
No log	9.6098	394	1.0290	0.6452	1.0290	1.0144
No log	9.6585	396	1.0197	0.6371	1.0197	1.0098
No log	9.7073	398	1.0068	0.6564	1.0068	1.0034
No log	9.7561	400	1.0011	0.6533	1.0011	1.0005
No log	9.8049	402	0.9945	0.6533	0.9945	0.9972
No log	9.8537	404	0.9887	0.6533	0.9887	0.9944
No log	9.9024	406	0.9837	0.6533	0.9837	0.9918
No log	9.9512	408	0.9812	0.6533	0.9812	0.9905
No log	10.0	410	0.9811	0.6533	0.9811	0.9905

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1