ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2256
• Qwk: 0.5681
• Mse: 1.2256
• Rmse: 1.1071

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0339	2	2.1933	-0.0076	2.1933	1.4810
No log	0.0678	4	1.4515	0.1989	1.4515	1.2048
No log	0.1017	6	1.3901	0.2133	1.3901	1.1790
No log	0.1356	8	1.9283	0.2288	1.9283	1.3886
No log	0.1695	10	2.5867	0.1012	2.5867	1.6083
No log	0.2034	12	2.6231	0.0603	2.6231	1.6196
No log	0.2373	14	2.2366	-0.0021	2.2366	1.4955
No log	0.2712	16	2.2696	0.0274	2.2696	1.5065
No log	0.3051	18	2.5085	0.1548	2.5085	1.5838
No log	0.3390	20	2.1416	0.1655	2.1416	1.4634
No log	0.3729	22	1.7034	0.0814	1.7034	1.3051
No log	0.4068	24	1.5855	0.1648	1.5855	1.2592
No log	0.4407	26	1.5357	0.1539	1.5357	1.2392
No log	0.4746	28	1.7367	0.2144	1.7367	1.3179
No log	0.5085	30	2.4037	0.2744	2.4037	1.5504
No log	0.5424	32	2.5518	0.2957	2.5518	1.5974
No log	0.5763	34	2.0106	0.3239	2.0106	1.4180
No log	0.6102	36	1.4807	0.2273	1.4807	1.2168
No log	0.6441	38	1.4658	0.2444	1.4658	1.2107
No log	0.6780	40	1.5814	0.2781	1.5814	1.2575
No log	0.7119	42	1.6270	0.3102	1.6270	1.2756
No log	0.7458	44	1.5405	0.3303	1.5405	1.2412
No log	0.7797	46	1.5063	0.3375	1.5063	1.2273
No log	0.8136	48	1.3733	0.3986	1.3733	1.1719
No log	0.8475	50	1.7236	0.4293	1.7236	1.3129
No log	0.8814	52	2.1380	0.3931	2.1380	1.4622
No log	0.9153	54	2.2197	0.3797	2.2197	1.4899
No log	0.9492	56	1.8621	0.4291	1.8621	1.3646
No log	0.9831	58	1.7198	0.4272	1.7198	1.3114
No log	1.0169	60	1.3968	0.4209	1.3968	1.1819
No log	1.0508	62	1.5384	0.4001	1.5384	1.2403
No log	1.0847	64	1.9652	0.3265	1.9652	1.4019
No log	1.1186	66	2.1672	0.3025	2.1672	1.4721
No log	1.1525	68	1.5967	0.4196	1.5967	1.2636
No log	1.1864	70	1.4908	0.4099	1.4908	1.2210
No log	1.2203	72	1.2868	0.4278	1.2868	1.1344
No log	1.2542	74	1.4751	0.4114	1.4751	1.2145
No log	1.2881	76	2.6299	0.3437	2.6299	1.6217
No log	1.3220	78	3.2255	0.3196	3.2255	1.7960
No log	1.3559	80	2.5825	0.3505	2.5825	1.6070
No log	1.3898	82	1.4909	0.4133	1.4909	1.2210
No log	1.4237	84	1.1964	0.4268	1.1964	1.0938
No log	1.4576	86	1.2139	0.4535	1.2139	1.1018
No log	1.4915	88	1.6462	0.4617	1.6462	1.2830
No log	1.5254	90	2.1025	0.4126	2.1025	1.4500
No log	1.5593	92	2.5984	0.3603	2.5984	1.6120
No log	1.5932	94	2.3398	0.3849	2.3398	1.5296
No log	1.6271	96	2.3411	0.3816	2.3411	1.5301
No log	1.6610	98	1.8654	0.4339	1.8654	1.3658
No log	1.6949	100	1.8327	0.4339	1.8327	1.3538
No log	1.7288	102	2.4288	0.3599	2.4288	1.5585
No log	1.7627	104	2.5692	0.3589	2.5692	1.6029
No log	1.7966	106	1.9451	0.4570	1.9451	1.3947
No log	1.8305	108	1.8043	0.4754	1.8043	1.3432
No log	1.8644	110	2.2256	0.4106	2.2256	1.4918
No log	1.8983	112	2.3478	0.3922	2.3478	1.5323
No log	1.9322	114	2.5143	0.3738	2.5143	1.5857
No log	1.9661	116	1.8977	0.4541	1.8977	1.3776
No log	2.0	118	1.1834	0.5038	1.1834	1.0878
No log	2.0339	120	0.9571	0.5216	0.9571	0.9783
No log	2.0678	122	0.9482	0.5391	0.9482	0.9737
No log	2.1017	124	1.0449	0.5094	1.0449	1.0222
No log	2.1356	126	1.4213	0.4957	1.4213	1.1922
No log	2.1695	128	2.1350	0.4516	2.1350	1.4612
No log	2.2034	130	2.3378	0.3872	2.3378	1.5290
No log	2.2373	132	1.7812	0.4710	1.7812	1.3346
No log	2.2712	134	1.3520	0.4722	1.3520	1.1628
No log	2.3051	136	1.0510	0.5050	1.0510	1.0252
No log	2.3390	138	1.0509	0.4912	1.0509	1.0251
No log	2.3729	140	1.1084	0.5196	1.1084	1.0528
No log	2.4068	142	1.3466	0.5071	1.3466	1.1604
No log	2.4407	144	1.6621	0.5386	1.6621	1.2892
No log	2.4746	146	1.5678	0.5438	1.5678	1.2521
No log	2.5085	148	1.2582	0.5323	1.2582	1.1217
No log	2.5424	150	1.0473	0.5739	1.0473	1.0234
No log	2.5763	152	1.1577	0.5538	1.1577	1.0760
No log	2.6102	154	1.6874	0.5380	1.6874	1.2990
No log	2.6441	156	1.9048	0.4928	1.9048	1.3802
No log	2.6780	158	1.5020	0.5286	1.5020	1.2256
No log	2.7119	160	1.2869	0.5269	1.2869	1.1344
No log	2.7458	162	1.0979	0.5437	1.0979	1.0478
No log	2.7797	164	1.1937	0.5130	1.1937	1.0926
No log	2.8136	166	1.3953	0.5289	1.3953	1.1812
No log	2.8475	168	1.2244	0.5278	1.2244	1.1065
No log	2.8814	170	1.1041	0.5948	1.1041	1.0508
No log	2.9153	172	1.0405	0.5905	1.0405	1.0201
No log	2.9492	174	1.1290	0.5777	1.1290	1.0625
No log	2.9831	176	1.0812	0.5742	1.0812	1.0398
No log	3.0169	178	0.9469	0.5878	0.9469	0.9731
No log	3.0508	180	0.8703	0.6043	0.8703	0.9329
No log	3.0847	182	0.9235	0.5382	0.9235	0.9610
No log	3.1186	184	1.2631	0.4969	1.2631	1.1239
No log	3.1525	186	1.5307	0.5073	1.5307	1.2372
No log	3.1864	188	1.3855	0.4868	1.3855	1.1771
No log	3.2203	190	1.0473	0.5426	1.0473	1.0234
No log	3.2542	192	0.8775	0.6233	0.8775	0.9368
No log	3.2881	194	0.8672	0.6276	0.8672	0.9313
No log	3.3220	196	1.0221	0.5697	1.0221	1.0110
No log	3.3559	198	1.1680	0.5635	1.1680	1.0807
No log	3.3898	200	1.0389	0.5881	1.0389	1.0193
No log	3.4237	202	0.9365	0.6026	0.9365	0.9677
No log	3.4576	204	0.9072	0.6106	0.9072	0.9525
No log	3.4915	206	1.1096	0.6501	1.1096	1.0534
No log	3.5254	208	1.1265	0.6511	1.1265	1.0614
No log	3.5593	210	1.1949	0.6234	1.1949	1.0931
No log	3.5932	212	1.1871	0.5986	1.1871	1.0895
No log	3.6271	214	1.2236	0.5616	1.2236	1.1062
No log	3.6610	216	1.1472	0.5669	1.1472	1.0711
No log	3.6949	218	1.1498	0.5757	1.1498	1.0723
No log	3.7288	220	1.2642	0.5526	1.2642	1.1244
No log	3.7627	222	1.4303	0.5620	1.4303	1.1960
No log	3.7966	224	1.3511	0.5805	1.3511	1.1624
No log	3.8305	226	1.1795	0.6126	1.1795	1.0861
No log	3.8644	228	1.1725	0.5942	1.1725	1.0828
No log	3.8983	230	1.2592	0.5383	1.2592	1.1221
No log	3.9322	232	1.3605	0.5316	1.3605	1.1664
No log	3.9661	234	1.3923	0.5373	1.3923	1.1800
No log	4.0	236	1.2068	0.5979	1.2068	1.0985
No log	4.0339	238	1.2301	0.6013	1.2301	1.1091
No log	4.0678	240	1.0921	0.6310	1.0921	1.0450
No log	4.1017	242	1.0184	0.6408	1.0184	1.0092
No log	4.1356	244	1.1858	0.5865	1.1858	1.0889
No log	4.1695	246	1.2075	0.5553	1.2075	1.0988
No log	4.2034	248	1.0608	0.5612	1.0608	1.0299
No log	4.2373	250	1.0700	0.5444	1.0700	1.0344
No log	4.2712	252	1.1556	0.5529	1.1556	1.0750
No log	4.3051	254	1.4021	0.5405	1.4021	1.1841
No log	4.3390	256	1.5398	0.5553	1.5398	1.2409
No log	4.3729	258	1.3147	0.5638	1.3147	1.1466
No log	4.4068	260	1.0945	0.5895	1.0945	1.0462
No log	4.4407	262	1.1084	0.5649	1.1084	1.0528
No log	4.4746	264	1.2208	0.5599	1.2208	1.1049
No log	4.5085	266	1.3275	0.5270	1.3275	1.1522
No log	4.5424	268	1.2954	0.4881	1.2954	1.1382
No log	4.5763	270	1.2911	0.4846	1.2911	1.1363
No log	4.6102	272	1.3138	0.4846	1.3138	1.1462
No log	4.6441	274	1.2070	0.5072	1.2070	1.0987
No log	4.6780	276	1.1309	0.5045	1.1309	1.0634
No log	4.7119	278	1.2609	0.5230	1.2609	1.1229
No log	4.7458	280	1.5158	0.5215	1.5158	1.2312
No log	4.7797	282	1.5138	0.5162	1.5138	1.2304
No log	4.8136	284	1.4522	0.5245	1.4522	1.2051
No log	4.8475	286	1.2750	0.5194	1.2750	1.1292
No log	4.8814	288	1.3384	0.4953	1.3384	1.1569
No log	4.9153	290	1.4777	0.4979	1.4777	1.2156
No log	4.9492	292	1.4747	0.4979	1.4747	1.2144
No log	4.9831	294	1.3218	0.5135	1.3218	1.1497
No log	5.0169	296	1.3425	0.5215	1.3425	1.1587
No log	5.0508	298	1.3748	0.5100	1.3748	1.1725
No log	5.0847	300	1.5384	0.5111	1.5384	1.2403
No log	5.1186	302	1.4953	0.5188	1.4953	1.2228
No log	5.1525	304	1.3035	0.5354	1.3035	1.1417
No log	5.1864	306	1.0927	0.5654	1.0927	1.0453
No log	5.2203	308	1.0690	0.5654	1.0690	1.0339
No log	5.2542	310	1.2155	0.5573	1.2155	1.1025
No log	5.2881	312	1.3323	0.5226	1.3323	1.1543
No log	5.3220	314	1.3292	0.5226	1.3292	1.1529
No log	5.3559	316	1.1633	0.5568	1.1633	1.0786
No log	5.3898	318	1.0773	0.5485	1.0773	1.0379
No log	5.4237	320	1.1043	0.5219	1.1043	1.0509
No log	5.4576	322	1.2800	0.5304	1.2800	1.1314
No log	5.4915	324	1.4129	0.5022	1.4129	1.1886
No log	5.5254	326	1.3417	0.4931	1.3417	1.1583
No log	5.5593	328	1.2222	0.5234	1.2222	1.1055
No log	5.5932	330	1.2928	0.5182	1.2928	1.1370
No log	5.6271	332	1.4744	0.5094	1.4744	1.2142
No log	5.6610	334	1.4989	0.5094	1.4989	1.2243
No log	5.6949	336	1.3487	0.5158	1.3487	1.1614
No log	5.7288	338	1.1125	0.5575	1.1125	1.0547
No log	5.7627	340	1.0416	0.5623	1.0416	1.0206
No log	5.7966	342	1.0903	0.5640	1.0903	1.0442
No log	5.8305	344	1.2397	0.5446	1.2397	1.1134
No log	5.8644	346	1.4740	0.5185	1.4740	1.2141
No log	5.8983	348	1.5111	0.5185	1.5111	1.2293
No log	5.9322	350	1.3514	0.5040	1.3514	1.1625
No log	5.9661	352	1.1398	0.5430	1.1398	1.0676
No log	6.0	354	1.0554	0.5555	1.0554	1.0273
No log	6.0339	356	1.0905	0.5630	1.0905	1.0443
No log	6.0678	358	1.2397	0.5505	1.2397	1.1134
No log	6.1017	360	1.4367	0.5270	1.4367	1.1986
No log	6.1356	362	1.5635	0.5179	1.5635	1.2504
No log	6.1695	364	1.4938	0.5263	1.4938	1.2222
No log	6.2034	366	1.3554	0.5165	1.3554	1.1642
No log	6.2373	368	1.2187	0.5470	1.2187	1.1040
No log	6.2712	370	1.2330	0.5384	1.2330	1.1104
No log	6.3051	372	1.3208	0.5179	1.3208	1.1492
No log	6.3390	374	1.3866	0.5058	1.3866	1.1775
No log	6.3729	376	1.3315	0.5179	1.3315	1.1539
No log	6.4068	378	1.1991	0.5439	1.1991	1.0950
No log	6.4407	380	1.0859	0.5505	1.0859	1.0420
No log	6.4746	382	1.0207	0.5831	1.0207	1.0103
No log	6.5085	384	1.0373	0.5742	1.0373	1.0185
No log	6.5424	386	1.1539	0.5371	1.1539	1.0742
No log	6.5763	388	1.3035	0.5327	1.3035	1.1417
No log	6.6102	390	1.3527	0.5330	1.3527	1.1630
No log	6.6441	392	1.3998	0.5374	1.3998	1.1831
No log	6.6780	394	1.3825	0.5330	1.3825	1.1758
No log	6.7119	396	1.2781	0.5384	1.2781	1.1305
No log	6.7458	398	1.1014	0.5544	1.1014	1.0495
No log	6.7797	400	1.0344	0.5819	1.0344	1.0170
No log	6.8136	402	1.0641	0.5531	1.0641	1.0316
No log	6.8475	404	1.1803	0.5351	1.1803	1.0864
No log	6.8814	406	1.2309	0.5351	1.2309	1.1095
No log	6.9153	408	1.1972	0.5351	1.1972	1.0942
No log	6.9492	410	1.1751	0.5395	1.1751	1.0840
No log	6.9831	412	1.1444	0.5537	1.1444	1.0697
No log	7.0169	414	1.1078	0.5623	1.1078	1.0525
No log	7.0508	416	1.0800	0.5677	1.0800	1.0392
No log	7.0847	418	1.0970	0.5634	1.0970	1.0474
No log	7.1186	420	1.1343	0.5614	1.1343	1.0650
No log	7.1525	422	1.1138	0.5743	1.1138	1.0554
No log	7.1864	424	1.0761	0.5901	1.0761	1.0374
No log	7.2203	426	1.1196	0.5700	1.1196	1.0581
No log	7.2542	428	1.2459	0.5895	1.2459	1.1162
No log	7.2881	430	1.3040	0.5814	1.3040	1.1419
No log	7.3220	432	1.2804	0.5725	1.2804	1.1315
No log	7.3559	434	1.1905	0.5829	1.1905	1.0911
No log	7.3898	436	1.1519	0.5679	1.1519	1.0733
No log	7.4237	438	1.0888	0.5657	1.0888	1.0435
No log	7.4576	440	1.1083	0.5614	1.1083	1.0528
No log	7.4915	442	1.1604	0.5869	1.1604	1.0772
No log	7.5254	444	1.1851	0.5829	1.1851	1.0886
No log	7.5593	446	1.2790	0.5775	1.2790	1.1309
No log	7.5932	448	1.3898	0.5668	1.3898	1.1789
No log	7.6271	450	1.3649	0.5647	1.3649	1.1683
No log	7.6610	452	1.2404	0.5693	1.2404	1.1137
No log	7.6949	454	1.1191	0.5937	1.1191	1.0579
No log	7.7288	456	1.0684	0.5883	1.0684	1.0337
No log	7.7627	458	1.0375	0.6039	1.0375	1.0186
No log	7.7966	460	1.0815	0.5841	1.0815	1.0400
No log	7.8305	462	1.1326	0.5895	1.1326	1.0643
No log	7.8644	464	1.1875	0.5681	1.1875	1.0897
No log	7.8983	466	1.2105	0.5419	1.2105	1.1002
No log	7.9322	468	1.1848	0.5582	1.1848	1.0885
No log	7.9661	470	1.1419	0.5669	1.1419	1.0686
No log	8.0	472	1.1114	0.5746	1.1114	1.0542
No log	8.0339	474	1.0615	0.5790	1.0615	1.0303
No log	8.0678	476	1.0382	0.5905	1.0382	1.0189
No log	8.1017	478	1.0491	0.5905	1.0491	1.0243
No log	8.1356	480	1.0927	0.5746	1.0927	1.0453
No log	8.1695	482	1.1710	0.5669	1.1710	1.0821
No log	8.2034	484	1.2908	0.5510	1.2908	1.1361
No log	8.2373	486	1.3781	0.5412	1.3781	1.1739
No log	8.2712	488	1.3787	0.5507	1.3787	1.1742
No log	8.3051	490	1.3157	0.5558	1.3157	1.1470
No log	8.3390	492	1.2079	0.5529	1.2079	1.0990
No log	8.3729	494	1.0947	0.5768	1.0947	1.0463
No log	8.4068	496	1.0064	0.6021	1.0064	1.0032
No log	8.4407	498	0.9775	0.6095	0.9775	0.9887
0.3633	8.4746	500	0.9890	0.6021	0.9890	0.9945
0.3633	8.5085	502	1.0445	0.6042	1.0445	1.0220
0.3633	8.5424	504	1.1405	0.5928	1.1405	1.0679
0.3633	8.5763	506	1.2611	0.5705	1.2611	1.1230
0.3633	8.6102	508	1.3316	0.5736	1.3316	1.1539
0.3633	8.6441	510	1.3690	0.5638	1.3690	1.1700
0.3633	8.6780	512	1.3401	0.5786	1.3401	1.1576
0.3633	8.7119	514	1.2767	0.5705	1.2767	1.1299
0.3633	8.7458	516	1.2215	0.5777	1.2215	1.1052
0.3633	8.7797	518	1.1693	0.5724	1.1693	1.0813
0.3633	8.8136	520	1.0972	0.5810	1.0972	1.0475
0.3633	8.8475	522	1.0594	0.5955	1.0594	1.0293
0.3633	8.8814	524	1.0588	0.5955	1.0588	1.0290
0.3633	8.9153	526	1.0919	0.5855	1.0919	1.0450
0.3633	8.9492	528	1.1216	0.5626	1.1216	1.0591
0.3633	8.9831	530	1.1453	0.5626	1.1453	1.0702
0.3633	9.0169	532	1.1648	0.5505	1.1648	1.0792
0.3633	9.0508	534	1.1751	0.5505	1.1751	1.0840
0.3633	9.0847	536	1.1779	0.5426	1.1779	1.0853
0.3633	9.1186	538	1.1806	0.5426	1.1806	1.0865
0.3633	9.1525	540	1.1850	0.5426	1.1850	1.0886
0.3633	9.1864	542	1.1766	0.5505	1.1766	1.0847
0.3633	9.2203	544	1.1831	0.5505	1.1831	1.0877
0.3633	9.2542	546	1.2028	0.5505	1.2028	1.0967
0.3633	9.2881	548	1.2347	0.5340	1.2347	1.1112
0.3633	9.3220	550	1.2626	0.5443	1.2626	1.1237
0.3633	9.3559	552	1.2644	0.5443	1.2644	1.1244
0.3633	9.3898	554	1.2419	0.5521	1.2419	1.1144
0.3633	9.4237	556	1.2174	0.5606	1.2174	1.1034
0.3633	9.4576	558	1.2057	0.5681	1.2057	1.0980
0.3633	9.4915	560	1.1924	0.5583	1.1924	1.0920
0.3633	9.5254	562	1.1911	0.5681	1.1911	1.0914
0.3633	9.5593	564	1.1965	0.5681	1.1965	1.0939
0.3633	9.5932	566	1.2050	0.5681	1.2050	1.0977
0.3633	9.6271	568	1.2015	0.5724	1.2015	1.0961
0.3633	9.6610	570	1.1937	0.5724	1.1937	1.0926
0.3633	9.6949	572	1.1931	0.5724	1.1931	1.0923
0.3633	9.7288	574	1.1957	0.5724	1.1957	1.0935
0.3633	9.7627	576	1.2028	0.5724	1.2028	1.0967
0.3633	9.7966	578	1.2113	0.5724	1.2113	1.1006
0.3633	9.8305	580	1.2171	0.5724	1.2171	1.1032
0.3633	9.8644	582	1.2180	0.5724	1.2180	1.1036
0.3633	9.8983	584	1.2216	0.5724	1.2216	1.1052
0.3633	9.9322	586	1.2244	0.5681	1.2244	1.1065
0.3633	9.9661	588	1.2249	0.5681	1.2249	1.1067
0.3633	10.0	590	1.2256	0.5681	1.2256	1.1071

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1