ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1363
• Qwk: 0.6188
• Mse: 1.1363
• Rmse: 1.0660

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	2.4641	0.0186	2.4641	1.5697
No log	0.0909	4	1.5949	0.1643	1.5949	1.2629
No log	0.1364	6	1.3693	0.1779	1.3693	1.1702
No log	0.1818	8	1.5068	0.2475	1.5068	1.2275
No log	0.2273	10	1.4383	0.2339	1.4383	1.1993
No log	0.2727	12	1.3107	0.1555	1.3107	1.1449
No log	0.3182	14	1.2842	0.1555	1.2842	1.1332
No log	0.3636	16	1.2847	0.1833	1.2847	1.1334
No log	0.4091	18	1.3401	0.3480	1.3401	1.1576
No log	0.4545	20	1.3911	0.3717	1.3911	1.1794
No log	0.5	22	1.4786	0.3304	1.4786	1.2160
No log	0.5455	24	1.5013	0.3401	1.5013	1.2253
No log	0.5909	26	1.5227	0.3600	1.5227	1.2340
No log	0.6364	28	1.3186	0.3394	1.3186	1.1483
No log	0.6818	30	1.2236	0.3861	1.2236	1.1062
No log	0.7273	32	1.1536	0.4557	1.1536	1.0740
No log	0.7727	34	1.2077	0.4120	1.2077	1.0989
No log	0.8182	36	1.3437	0.4125	1.3437	1.1592
No log	0.8636	38	1.4406	0.4106	1.4406	1.2002
No log	0.9091	40	1.3232	0.3677	1.3232	1.1503
No log	0.9545	42	1.1804	0.3668	1.1804	1.0865
No log	1.0	44	1.1114	0.4168	1.1114	1.0542
No log	1.0455	46	1.1176	0.4202	1.1176	1.0572
No log	1.0909	48	1.0738	0.4790	1.0738	1.0363
No log	1.1364	50	1.1708	0.4596	1.1708	1.0820
No log	1.1818	52	1.3731	0.5094	1.3731	1.1718
No log	1.2273	54	1.2613	0.4598	1.2613	1.1231
No log	1.2727	56	1.1930	0.4653	1.1930	1.0923
No log	1.3182	58	1.1240	0.4742	1.1240	1.0602
No log	1.3636	60	1.0416	0.4613	1.0416	1.0206
No log	1.4091	62	1.0432	0.4689	1.0432	1.0214
No log	1.4545	64	1.0915	0.4764	1.0915	1.0447
No log	1.5	66	1.2129	0.4863	1.2129	1.1013
No log	1.5455	68	1.2226	0.4987	1.2226	1.1057
No log	1.5909	70	1.1065	0.4684	1.1065	1.0519
No log	1.6364	72	1.0898	0.4796	1.0898	1.0440
No log	1.6818	74	1.2622	0.5320	1.2622	1.1235
No log	1.7273	76	1.4640	0.4735	1.4640	1.2099
No log	1.7727	78	1.4100	0.4831	1.4100	1.1875
No log	1.8182	80	1.2963	0.5220	1.2963	1.1386
No log	1.8636	82	1.0196	0.5236	1.0196	1.0098
No log	1.9091	84	1.0179	0.5269	1.0179	1.0089
No log	1.9545	86	1.2762	0.5430	1.2762	1.1297
No log	2.0	88	1.8527	0.4632	1.8527	1.3611
No log	2.0455	90	1.9765	0.4282	1.9765	1.4059
No log	2.0909	92	1.7756	0.4659	1.7756	1.3325
No log	2.1364	94	1.6433	0.4781	1.6433	1.2819
No log	2.1818	96	1.5138	0.4886	1.5138	1.2304
No log	2.2273	98	1.3993	0.5205	1.3993	1.1829
No log	2.2727	100	1.2437	0.5390	1.2437	1.1152
No log	2.3182	102	1.1276	0.5199	1.1276	1.0619
No log	2.3636	104	1.0752	0.4988	1.0752	1.0369
No log	2.4091	106	1.0522	0.5033	1.0522	1.0257
No log	2.4545	108	1.2086	0.5624	1.2086	1.0994
No log	2.5	110	1.4256	0.5441	1.4256	1.1940
No log	2.5455	112	1.6089	0.4795	1.6089	1.2684
No log	2.5909	114	1.4876	0.5189	1.4876	1.2197
No log	2.6364	116	1.2647	0.5552	1.2647	1.1246
No log	2.6818	118	1.1647	0.5928	1.1647	1.0792
No log	2.7273	120	1.0468	0.6086	1.0468	1.0231
No log	2.7727	122	1.1757	0.6283	1.1757	1.0843
No log	2.8182	124	1.3425	0.6419	1.3425	1.1586
No log	2.8636	126	1.4706	0.5939	1.4706	1.2127
No log	2.9091	128	1.2624	0.6279	1.2624	1.1236
No log	2.9545	130	1.0245	0.6647	1.0245	1.0122
No log	3.0	132	0.9732	0.6661	0.9732	0.9865
No log	3.0455	134	1.2036	0.6440	1.2036	1.0971
No log	3.0909	136	1.7142	0.5583	1.7142	1.3093
No log	3.1364	138	1.7814	0.5383	1.7814	1.3347
No log	3.1818	140	1.4119	0.5899	1.4119	1.1882
No log	3.2273	142	1.1704	0.6183	1.1704	1.0819
No log	3.2727	144	1.1867	0.6009	1.1867	1.0894
No log	3.3182	146	1.3752	0.5815	1.3752	1.1727
No log	3.3636	148	1.6379	0.5553	1.6379	1.2798
No log	3.4091	150	1.4462	0.5963	1.4462	1.2026
No log	3.4545	152	1.1760	0.6153	1.1760	1.0844
No log	3.5	154	1.2243	0.6089	1.2243	1.1065
No log	3.5455	156	1.4210	0.5975	1.4210	1.1921
No log	3.5909	158	1.5107	0.6080	1.5107	1.2291
No log	3.6364	160	1.3313	0.6318	1.3313	1.1538
No log	3.6818	162	1.0924	0.6210	1.0924	1.0452
No log	3.7273	164	1.1188	0.6185	1.1188	1.0578
No log	3.7727	166	1.3007	0.6371	1.3007	1.1405
No log	3.8182	168	1.3179	0.6298	1.3179	1.1480
No log	3.8636	170	1.1688	0.6326	1.1688	1.0811
No log	3.9091	172	1.1337	0.6489	1.1337	1.0647
No log	3.9545	174	1.3098	0.6296	1.3098	1.1444
No log	4.0	176	1.2976	0.6308	1.2976	1.1391
No log	4.0455	178	1.0808	0.6467	1.0808	1.0396
No log	4.0909	180	0.9509	0.6852	0.9509	0.9752
No log	4.1364	182	0.8699	0.6682	0.8699	0.9327
No log	4.1818	184	0.9014	0.6808	0.9014	0.9494
No log	4.2273	186	0.9956	0.6363	0.9956	0.9978
No log	4.2727	188	1.0162	0.6363	1.0162	1.0081
No log	4.3182	190	1.1162	0.6164	1.1162	1.0565
No log	4.3636	192	1.0618	0.6269	1.0618	1.0304
No log	4.4091	194	1.0265	0.6336	1.0265	1.0131
No log	4.4545	196	0.9500	0.6422	0.9500	0.9747
No log	4.5	198	0.9512	0.6350	0.9512	0.9753
No log	4.5455	200	1.0988	0.6192	1.0988	1.0482
No log	4.5909	202	1.4438	0.6032	1.4438	1.2016
No log	4.6364	204	1.9391	0.5286	1.9391	1.3925
No log	4.6818	206	2.0358	0.5028	2.0358	1.4268
No log	4.7273	208	1.8404	0.5395	1.8404	1.3566
No log	4.7727	210	1.5131	0.5952	1.5131	1.2301
No log	4.8182	212	1.2392	0.6032	1.2392	1.1132
No log	4.8636	214	1.2955	0.5994	1.2955	1.1382
No log	4.9091	216	1.3510	0.5916	1.3510	1.1623
No log	4.9545	218	1.5277	0.5925	1.5277	1.2360
No log	5.0	220	1.5695	0.5752	1.5695	1.2528
No log	5.0455	222	1.4986	0.5793	1.4986	1.2242
No log	5.0909	224	1.3032	0.6028	1.3032	1.1416
No log	5.1364	226	0.9862	0.6614	0.9862	0.9931
No log	5.1818	228	0.9085	0.6666	0.9085	0.9531
No log	5.2273	230	0.9799	0.6629	0.9799	0.9899
No log	5.2727	232	1.1801	0.6252	1.1801	1.0863
No log	5.3182	234	1.3153	0.6013	1.3153	1.1468
No log	5.3636	236	1.2135	0.6208	1.2135	1.1016
No log	5.4091	238	1.0581	0.6044	1.0581	1.0287
No log	5.4545	240	1.0804	0.6114	1.0804	1.0394
No log	5.5	242	1.2559	0.6110	1.2559	1.1206
No log	5.5455	244	1.6068	0.5865	1.6068	1.2676
No log	5.5909	246	1.7425	0.5745	1.7425	1.3201
No log	5.6364	248	1.6067	0.5805	1.6067	1.2676
No log	5.6818	250	1.3100	0.6065	1.3100	1.1445
No log	5.7273	252	1.0395	0.6143	1.0395	1.0196
No log	5.7727	254	0.9748	0.6108	0.9748	0.9873
No log	5.8182	256	1.0143	0.6143	1.0143	1.0071
No log	5.8636	258	1.1002	0.6063	1.1002	1.0489
No log	5.9091	260	1.1169	0.6162	1.1169	1.0569
No log	5.9545	262	1.2648	0.6274	1.2648	1.1246
No log	6.0	264	1.3496	0.6291	1.3496	1.1617
No log	6.0455	266	1.3635	0.6326	1.3635	1.1677
No log	6.0909	268	1.2115	0.6245	1.2115	1.1007
No log	6.1364	270	1.1376	0.6269	1.1376	1.0666
No log	6.1818	272	1.1677	0.6257	1.1677	1.0806
No log	6.2273	274	1.2113	0.6182	1.2113	1.1006
No log	6.2727	276	1.2478	0.6151	1.2478	1.1170
No log	6.3182	278	1.3827	0.6159	1.3827	1.1759
No log	6.3636	280	1.4340	0.5947	1.4340	1.1975
No log	6.4091	282	1.5130	0.5818	1.5130	1.2301
No log	6.4545	284	1.4818	0.5990	1.4818	1.2173
No log	6.5	286	1.5192	0.5737	1.5192	1.2325
No log	6.5455	288	1.4644	0.5829	1.4644	1.2101
No log	6.5909	290	1.4162	0.6020	1.4162	1.1900
No log	6.6364	292	1.3293	0.6128	1.3293	1.1530
No log	6.6818	294	1.3728	0.6128	1.3728	1.1717
No log	6.7273	296	1.4006	0.6128	1.4006	1.1835
No log	6.7727	298	1.3680	0.6164	1.3680	1.1696
No log	6.8182	300	1.2753	0.6084	1.2753	1.1293
No log	6.8636	302	1.2181	0.6084	1.2181	1.1037
No log	6.9091	304	1.1780	0.6040	1.1780	1.0854
No log	6.9545	306	1.0965	0.6201	1.0965	1.0471
No log	7.0	308	1.0746	0.6372	1.0746	1.0366
No log	7.0455	310	1.1266	0.6105	1.1266	1.0614
No log	7.0909	312	1.1557	0.6186	1.1557	1.0750
No log	7.1364	314	1.2138	0.6221	1.2138	1.1017
No log	7.1818	316	1.1876	0.6221	1.1876	1.0898
No log	7.2273	318	1.1124	0.6062	1.1124	1.0547
No log	7.2727	320	1.0931	0.6193	1.0931	1.0455
No log	7.3182	322	1.1607	0.6024	1.1607	1.0774
No log	7.3636	324	1.3187	0.6164	1.3187	1.1483
No log	7.4091	326	1.4744	0.5735	1.4744	1.2143
No log	7.4545	328	1.5117	0.5788	1.5117	1.2295
No log	7.5	330	1.4319	0.6083	1.4319	1.1966
No log	7.5455	332	1.2675	0.6201	1.2675	1.1258
No log	7.5909	334	1.0805	0.6109	1.0805	1.0395
No log	7.6364	336	0.9867	0.6418	0.9867	0.9933
No log	7.6818	338	0.9674	0.6447	0.9674	0.9836
No log	7.7273	340	1.0119	0.6277	1.0119	1.0059
No log	7.7727	342	1.1240	0.6190	1.1240	1.0602
No log	7.8182	344	1.3167	0.6186	1.3167	1.1475
No log	7.8636	346	1.4407	0.6132	1.4407	1.2003
No log	7.9091	348	1.4512	0.6013	1.4512	1.2047
No log	7.9545	350	1.3920	0.6126	1.3920	1.1798
No log	8.0	352	1.2701	0.6238	1.2701	1.1270
No log	8.0455	354	1.1472	0.6265	1.1472	1.0711
No log	8.0909	356	1.0892	0.6171	1.0892	1.0436
No log	8.1364	358	1.0555	0.6248	1.0555	1.0274
No log	8.1818	360	1.0791	0.6108	1.0791	1.0388
No log	8.2273	362	1.1586	0.6233	1.1586	1.0764
No log	8.2727	364	1.2639	0.6238	1.2639	1.1242
No log	8.3182	366	1.3583	0.6218	1.3583	1.1654
No log	8.3636	368	1.3802	0.6256	1.3802	1.1748
No log	8.4091	370	1.3667	0.6255	1.3667	1.1691
No log	8.4545	372	1.3645	0.6271	1.3645	1.1681
No log	8.5	374	1.3321	0.6218	1.3321	1.1542
No log	8.5455	376	1.3029	0.6255	1.3029	1.1414
No log	8.5909	378	1.2457	0.6201	1.2457	1.1161
No log	8.6364	380	1.2327	0.6201	1.2327	1.1103
No log	8.6818	382	1.2095	0.6233	1.2095	1.0998
No log	8.7273	384	1.1550	0.6265	1.1550	1.0747
No log	8.7727	386	1.1285	0.6249	1.1285	1.0623
No log	8.8182	388	1.1350	0.6249	1.1350	1.0654
No log	8.8636	390	1.1545	0.6249	1.1545	1.0745
No log	8.9091	392	1.1566	0.6249	1.1566	1.0754
No log	8.9545	394	1.1555	0.6249	1.1555	1.0749
No log	9.0	396	1.1410	0.6249	1.1410	1.0682
No log	9.0455	398	1.1153	0.6249	1.1153	1.0561
No log	9.0909	400	1.1051	0.6249	1.1051	1.0512
No log	9.1364	402	1.0996	0.6174	1.0996	1.0486
No log	9.1818	404	1.1199	0.6188	1.1199	1.0583
No log	9.2273	406	1.1341	0.6188	1.1341	1.0650
No log	9.2727	408	1.1525	0.6188	1.1525	1.0735
No log	9.3182	410	1.1791	0.6126	1.1791	1.0859
No log	9.3636	412	1.2004	0.6126	1.2004	1.0956
No log	9.4091	414	1.2050	0.6126	1.2050	1.0977
No log	9.4545	416	1.1919	0.6126	1.1919	1.0918
No log	9.5	418	1.1848	0.6126	1.1848	1.0885
No log	9.5455	420	1.1687	0.6112	1.1687	1.0810
No log	9.5909	422	1.1662	0.6126	1.1662	1.0799
No log	9.6364	424	1.1600	0.6126	1.1600	1.0771
No log	9.6818	426	1.1594	0.6126	1.1594	1.0767
No log	9.7273	428	1.1538	0.6126	1.1538	1.0742
No log	9.7727	430	1.1480	0.6126	1.1480	1.0715
No log	9.8182	432	1.1418	0.6126	1.1418	1.0685
No log	9.8636	434	1.1385	0.6126	1.1385	1.0670
No log	9.9091	436	1.1364	0.6188	1.1364	1.0660
No log	9.9545	438	1.1360	0.6188	1.1360	1.0659
No log	10.0	440	1.1363	0.6188	1.1363	1.0660

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1