ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0056
• Qwk: 0.6224
• Mse: 1.0056
• Rmse: 1.0028

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0339	2	2.3429	0.0485	2.3429	1.5307
No log	0.0678	4	1.4360	0.2320	1.4360	1.1983
No log	0.1017	6	1.4223	0.1601	1.4223	1.1926
No log	0.1356	8	1.4934	0.1804	1.4934	1.2221
No log	0.1695	10	1.6884	0.2888	1.6884	1.2994
No log	0.2034	12	2.0282	0.2687	2.0282	1.4241
No log	0.2373	14	2.2730	0.2088	2.2730	1.5076
No log	0.2712	16	1.7077	0.0718	1.7077	1.3068
No log	0.3051	18	1.6665	0.0447	1.6665	1.2909
No log	0.3390	20	1.8247	0.2976	1.8247	1.3508
No log	0.3729	22	2.1622	0.2855	2.1622	1.4704
No log	0.4068	24	2.1303	0.2905	2.1303	1.4595
No log	0.4407	26	1.7443	0.2800	1.7443	1.3207
No log	0.4746	28	1.4630	0.2633	1.4630	1.2095
No log	0.5085	30	1.3967	0.2471	1.3967	1.1818
No log	0.5424	32	1.5945	0.3851	1.5945	1.2627
No log	0.5763	34	1.5073	0.3379	1.5073	1.2277
No log	0.6102	36	1.2758	0.2661	1.2758	1.1295
No log	0.6441	38	1.2192	0.3034	1.2192	1.1042
No log	0.6780	40	1.1938	0.3034	1.1938	1.0926
No log	0.7119	42	1.1992	0.3412	1.1992	1.0951
No log	0.7458	44	1.3623	0.2866	1.3623	1.1672
No log	0.7797	46	1.7051	0.3562	1.7051	1.3058
No log	0.8136	48	1.7251	0.3618	1.7251	1.3134
No log	0.8475	50	1.3747	0.4291	1.3747	1.1725
No log	0.8814	52	1.0414	0.4716	1.0414	1.0205
No log	0.9153	54	1.0062	0.4814	1.0062	1.0031
No log	0.9492	56	0.9807	0.4829	0.9807	0.9903
No log	0.9831	58	1.0589	0.5244	1.0589	1.0290
No log	1.0169	60	1.1335	0.5106	1.1335	1.0647
No log	1.0508	62	1.0817	0.4534	1.0817	1.0400
No log	1.0847	64	0.9909	0.4823	0.9909	0.9955
No log	1.1186	66	0.9596	0.4734	0.9596	0.9796
No log	1.1525	68	1.0770	0.5151	1.0770	1.0378
No log	1.1864	70	1.6093	0.5206	1.6093	1.2686
No log	1.2203	72	1.5132	0.5483	1.5132	1.2301
No log	1.2542	74	0.9456	0.5984	0.9456	0.9724
No log	1.2881	76	0.8100	0.6452	0.8100	0.9000
No log	1.3220	78	0.8854	0.5631	0.8854	0.9410
No log	1.3559	80	0.8197	0.6138	0.8197	0.9054
No log	1.3898	82	0.8947	0.5499	0.8947	0.9459
No log	1.4237	84	1.0532	0.5664	1.0532	1.0263
No log	1.4576	86	1.2301	0.5798	1.2301	1.1091
No log	1.4915	88	1.0349	0.5732	1.0349	1.0173
No log	1.5254	90	0.7995	0.6231	0.7995	0.8942
No log	1.5593	92	0.8408	0.5757	0.8408	0.9169
No log	1.5932	94	0.8981	0.5315	0.8981	0.9477
No log	1.6271	96	0.8558	0.5482	0.8558	0.9251
No log	1.6610	98	0.9142	0.5819	0.9142	0.9561
No log	1.6949	100	1.5002	0.5363	1.5002	1.2248
No log	1.7288	102	1.7974	0.4523	1.7974	1.3407
No log	1.7627	104	1.4781	0.5108	1.4781	1.2158
No log	1.7966	106	1.0234	0.5536	1.0234	1.0117
No log	1.8305	108	0.9304	0.5543	0.9304	0.9646
No log	1.8644	110	0.9219	0.5533	0.9219	0.9601
No log	1.8983	112	1.0382	0.5766	1.0382	1.0189
No log	1.9322	114	1.5580	0.5012	1.5580	1.2482
No log	1.9661	116	1.8678	0.4785	1.8678	1.3667
No log	2.0	118	1.5794	0.5007	1.5794	1.2567
No log	2.0339	120	1.3054	0.5359	1.3054	1.1425
No log	2.0678	122	1.2931	0.5354	1.2931	1.1372
No log	2.1017	124	1.3468	0.5448	1.3468	1.1605
No log	2.1356	126	1.1225	0.5709	1.1225	1.0595
No log	2.1695	128	1.0792	0.5741	1.0792	1.0388
No log	2.2034	130	1.2657	0.5784	1.2657	1.1251
No log	2.2373	132	1.2927	0.5553	1.2927	1.1370
No log	2.2712	134	1.0822	0.5651	1.0822	1.0403
No log	2.3051	136	1.0546	0.5719	1.0546	1.0270
No log	2.3390	138	1.2703	0.5186	1.2703	1.1271
No log	2.3729	140	1.2692	0.4957	1.2692	1.1266
No log	2.4068	142	1.2236	0.4929	1.2236	1.1062
No log	2.4407	144	1.0804	0.5059	1.0804	1.0394
No log	2.4746	146	0.9243	0.5605	0.9243	0.9614
No log	2.5085	148	0.9189	0.5790	0.9189	0.9586
No log	2.5424	150	1.0971	0.5732	1.0971	1.0474
No log	2.5763	152	1.0873	0.6057	1.0873	1.0427
No log	2.6102	154	0.9777	0.6035	0.9777	0.9888
No log	2.6441	156	1.0155	0.6120	1.0155	1.0077
No log	2.6780	158	0.9368	0.6006	0.9368	0.9679
No log	2.7119	160	0.8842	0.6022	0.8842	0.9403
No log	2.7458	162	0.9636	0.6104	0.9636	0.9816
No log	2.7797	164	0.9810	0.5966	0.9810	0.9904
No log	2.8136	166	0.8414	0.6239	0.8414	0.9173
No log	2.8475	168	0.8242	0.6606	0.8242	0.9079
No log	2.8814	170	0.9756	0.5799	0.9756	0.9877
No log	2.9153	172	1.1556	0.5725	1.1556	1.0750
No log	2.9492	174	1.2305	0.5654	1.2305	1.1093
No log	2.9831	176	1.0502	0.5722	1.0502	1.0248
No log	3.0169	178	0.8962	0.6138	0.8962	0.9467
No log	3.0508	180	0.9346	0.6052	0.9346	0.9667
No log	3.0847	182	1.0677	0.5918	1.0677	1.0333
No log	3.1186	184	1.2927	0.5592	1.2927	1.1370
No log	3.1525	186	1.2823	0.5611	1.2823	1.1324
No log	3.1864	188	1.1185	0.6151	1.1185	1.0576
No log	3.2203	190	1.1326	0.6097	1.1326	1.0643
No log	3.2542	192	1.4147	0.5368	1.4147	1.1894
No log	3.2881	194	1.7691	0.4921	1.7691	1.3301
No log	3.3220	196	1.6444	0.5092	1.6444	1.2824
No log	3.3559	198	1.2467	0.5737	1.2467	1.1165
No log	3.3898	200	1.0130	0.6047	1.0130	1.0065
No log	3.4237	202	0.9363	0.6073	0.9363	0.9676
No log	3.4576	204	0.9692	0.5986	0.9692	0.9845
No log	3.4915	206	1.0744	0.5858	1.0744	1.0365
No log	3.5254	208	1.1665	0.6006	1.1665	1.0801
No log	3.5593	210	1.3688	0.5650	1.3688	1.1699
No log	3.5932	212	1.3045	0.5707	1.3045	1.1421
No log	3.6271	214	1.0092	0.6126	1.0092	1.0046
No log	3.6610	216	0.7728	0.6662	0.7728	0.8791
No log	3.6949	218	0.7385	0.6638	0.7385	0.8594
No log	3.7288	220	0.7425	0.6333	0.7425	0.8617
No log	3.7627	222	0.7630	0.6427	0.7630	0.8735
No log	3.7966	224	0.8530	0.6033	0.8530	0.9236
No log	3.8305	226	1.0058	0.5793	1.0058	1.0029
No log	3.8644	228	1.3068	0.5354	1.3068	1.1432
No log	3.8983	230	1.4772	0.5141	1.4772	1.2154
No log	3.9322	232	1.3633	0.5454	1.3633	1.1676
No log	3.9661	234	1.0926	0.6123	1.0926	1.0453
No log	4.0	236	0.8917	0.6199	0.8917	0.9443
No log	4.0339	238	0.8357	0.6386	0.8357	0.9142
No log	4.0678	240	0.8795	0.6305	0.8795	0.9378
No log	4.1017	242	0.9928	0.6309	0.9928	0.9964
No log	4.1356	244	1.2020	0.5937	1.2020	1.0963
No log	4.1695	246	1.2429	0.5673	1.2429	1.1149
No log	4.2034	248	1.0724	0.6154	1.0724	1.0356
No log	4.2373	250	0.8866	0.6345	0.8866	0.9416
No log	4.2712	252	0.8417	0.6254	0.8417	0.9174
No log	4.3051	254	0.8603	0.6345	0.8603	0.9275
No log	4.3390	256	0.9953	0.6449	0.9953	0.9976
No log	4.3729	258	1.1033	0.5982	1.1033	1.0504
No log	4.4068	260	1.1230	0.6049	1.1230	1.0597
No log	4.4407	262	1.0687	0.6002	1.0687	1.0338
No log	4.4746	264	0.9968	0.5933	0.9968	0.9984
No log	4.5085	266	0.9188	0.6204	0.9188	0.9586
No log	4.5424	268	0.9562	0.6244	0.9562	0.9779
No log	4.5763	270	1.0475	0.6248	1.0475	1.0235
No log	4.6102	272	1.1049	0.6069	1.1049	1.0511
No log	4.6441	274	1.1314	0.6056	1.1314	1.0637
No log	4.6780	276	1.0735	0.6269	1.0735	1.0361
No log	4.7119	278	1.0457	0.5990	1.0457	1.0226
No log	4.7458	280	1.0657	0.6013	1.0657	1.0323
No log	4.7797	282	1.1255	0.5933	1.1255	1.0609
No log	4.8136	284	1.0780	0.5862	1.0780	1.0383
No log	4.8475	286	0.9591	0.6077	0.9591	0.9793
No log	4.8814	288	0.9040	0.6289	0.9040	0.9508
No log	4.9153	290	0.9446	0.6004	0.9446	0.9719
No log	4.9492	292	0.9713	0.6077	0.9713	0.9856
No log	4.9831	294	1.0124	0.5884	1.0124	1.0062
No log	5.0169	296	1.0764	0.6112	1.0764	1.0375
No log	5.0508	298	1.1491	0.6034	1.1491	1.0720
No log	5.0847	300	1.1455	0.6077	1.1455	1.0703
No log	5.1186	302	1.0639	0.6065	1.0639	1.0315
No log	5.1525	304	1.0124	0.6019	1.0124	1.0062
No log	5.1864	306	0.9988	0.6019	0.9988	0.9994
No log	5.2203	308	0.9727	0.5994	0.9727	0.9862
No log	5.2542	310	0.9741	0.5994	0.9741	0.9869
No log	5.2881	312	1.1018	0.5992	1.1018	1.0497
No log	5.3220	314	1.2504	0.5439	1.2504	1.1182
No log	5.3559	316	1.2333	0.5422	1.2333	1.1105
No log	5.3898	318	1.1269	0.6014	1.1269	1.0616
No log	5.4237	320	1.0979	0.6057	1.0979	1.0478
No log	5.4576	322	0.9992	0.5890	0.9992	0.9996
No log	5.4915	324	0.9665	0.5791	0.9665	0.9831
No log	5.5254	326	0.9974	0.5939	0.9974	0.9987
No log	5.5593	328	1.0670	0.5993	1.0670	1.0330
No log	5.5932	330	1.0826	0.5993	1.0826	1.0405
No log	5.6271	332	1.0696	0.6073	1.0696	1.0342
No log	5.6610	334	1.0938	0.6072	1.0938	1.0459
No log	5.6949	336	1.1045	0.6072	1.1045	1.0510
No log	5.7288	338	1.1276	0.5889	1.1276	1.0619
No log	5.7627	340	1.1466	0.5833	1.1466	1.0708
No log	5.7966	342	1.0792	0.5938	1.0792	1.0389
No log	5.8305	344	1.1059	0.5928	1.1059	1.0516
No log	5.8644	346	1.2317	0.5559	1.2317	1.1098
No log	5.8983	348	1.3058	0.5208	1.3058	1.1427
No log	5.9322	350	1.3085	0.5259	1.3085	1.1439
No log	5.9661	352	1.2340	0.5646	1.2340	1.1109
No log	6.0	354	1.1907	0.5667	1.1907	1.0912
No log	6.0339	356	1.2383	0.5646	1.2383	1.1128
No log	6.0678	358	1.3637	0.5111	1.3637	1.1678
No log	6.1017	360	1.4486	0.4980	1.4486	1.2036
No log	6.1356	362	1.3814	0.4848	1.3814	1.1753
No log	6.1695	364	1.2945	0.4836	1.2945	1.1378
No log	6.2034	366	1.1552	0.5589	1.1552	1.0748
No log	6.2373	368	1.0468	0.5844	1.0468	1.0231
No log	6.2712	370	1.0243	0.5689	1.0243	1.0121
No log	6.3051	372	1.0786	0.6072	1.0786	1.0386
No log	6.3390	374	1.2244	0.5421	1.2244	1.1065
No log	6.3729	376	1.3890	0.4796	1.3890	1.1785
No log	6.4068	378	1.4568	0.4947	1.4568	1.2070
No log	6.4407	380	1.3909	0.4927	1.3909	1.1794
No log	6.4746	382	1.2423	0.5295	1.2423	1.1146
No log	6.5085	384	1.0982	0.5803	1.0982	1.0480
No log	6.5424	386	1.0266	0.5960	1.0266	1.0132
No log	6.5763	388	1.0419	0.6031	1.0419	1.0207
No log	6.6102	390	1.1074	0.5925	1.1074	1.0523
No log	6.6441	392	1.1925	0.5952	1.1925	1.0920
No log	6.6780	394	1.2255	0.5808	1.2255	1.1070
No log	6.7119	396	1.2637	0.5568	1.2637	1.1241
No log	6.7458	398	1.2185	0.5597	1.2185	1.1039
No log	6.7797	400	1.1689	0.5833	1.1689	1.0812
No log	6.8136	402	1.2124	0.5574	1.2124	1.1011
No log	6.8475	404	1.2731	0.5314	1.2731	1.1283
No log	6.8814	406	1.2788	0.5414	1.2788	1.1308
No log	6.9153	408	1.2535	0.5777	1.2535	1.1196
No log	6.9492	410	1.2497	0.5953	1.2497	1.1179
No log	6.9831	412	1.2368	0.5903	1.2368	1.1121
No log	7.0169	414	1.2517	0.5939	1.2517	1.1188
No log	7.0508	416	1.2346	0.5849	1.2346	1.1111
No log	7.0847	418	1.2348	0.5849	1.2348	1.1112
No log	7.1186	420	1.2022	0.5895	1.2022	1.0964
No log	7.1525	422	1.1068	0.6072	1.1068	1.0520
No log	7.1864	424	1.0391	0.6158	1.0391	1.0193
No log	7.2203	426	0.9890	0.6000	0.9890	0.9945
No log	7.2542	428	0.9911	0.6172	0.9911	0.9955
No log	7.2881	430	1.0167	0.6290	1.0167	1.0083
No log	7.3220	432	1.0822	0.6246	1.0822	1.0403
No log	7.3559	434	1.2056	0.5910	1.2056	1.0980
No log	7.3898	436	1.2847	0.5868	1.2847	1.1335
No log	7.4237	438	1.2886	0.5756	1.2886	1.1352
No log	7.4576	440	1.2177	0.5959	1.2177	1.1035
No log	7.4915	442	1.1022	0.6185	1.1022	1.0499
No log	7.5254	444	1.0283	0.6348	1.0283	1.0140
No log	7.5593	446	1.0081	0.6451	1.0081	1.0041
No log	7.5932	448	1.0364	0.6376	1.0364	1.0181
No log	7.6271	450	1.0232	0.6451	1.0232	1.0115
No log	7.6610	452	0.9689	0.6471	0.9689	0.9843
No log	7.6949	454	0.9593	0.6471	0.9593	0.9794
No log	7.7288	456	0.9380	0.6492	0.9380	0.9685
No log	7.7627	458	0.9258	0.6509	0.9258	0.9622
No log	7.7966	460	0.9478	0.6362	0.9478	0.9735
No log	7.8305	462	0.9782	0.6136	0.9782	0.9890
No log	7.8644	464	1.0198	0.6254	1.0198	1.0098
No log	7.8983	466	1.0516	0.6133	1.0516	1.0255
No log	7.9322	468	1.0656	0.6106	1.0656	1.0323
No log	7.9661	470	1.0833	0.6106	1.0833	1.0408
No log	8.0	472	1.0573	0.6072	1.0573	1.0283
No log	8.0339	474	1.0107	0.6189	1.0107	1.0054
No log	8.0678	476	0.9482	0.6160	0.9482	0.9738
No log	8.1017	478	0.9273	0.6266	0.9273	0.9630
No log	8.1356	480	0.9402	0.6139	0.9402	0.9697
No log	8.1695	482	0.9739	0.6227	0.9739	0.9869
No log	8.2034	484	1.0201	0.6060	1.0201	1.0100
No log	8.2373	486	1.0252	0.6060	1.0252	1.0125
No log	8.2712	488	1.0415	0.5968	1.0415	1.0205
No log	8.3051	490	1.0394	0.5933	1.0394	1.0195
No log	8.3390	492	1.0149	0.6038	1.0149	1.0074
No log	8.3729	494	0.9949	0.6227	0.9949	0.9974
No log	8.4068	496	0.9847	0.6369	0.9847	0.9923
No log	8.4407	498	0.9726	0.6303	0.9726	0.9862
0.3603	8.4746	500	0.9597	0.6204	0.9597	0.9796
0.3603	8.5085	502	0.9449	0.6388	0.9449	0.9721
0.3603	8.5424	504	0.9613	0.6272	0.9613	0.9805
0.3603	8.5763	506	0.9975	0.6101	0.9975	0.9988
0.3603	8.6102	508	1.0399	0.6130	1.0399	1.0197
0.3603	8.6441	510	1.0931	0.6137	1.0931	1.0455
0.3603	8.6780	512	1.1027	0.6202	1.1027	1.0501
0.3603	8.7119	514	1.1096	0.6202	1.1096	1.0534
0.3603	8.7458	516	1.0956	0.6137	1.0956	1.0467
0.3603	8.7797	518	1.0858	0.6137	1.0858	1.0420
0.3603	8.8136	520	1.0706	0.6116	1.0706	1.0347
0.3603	8.8475	522	1.0586	0.6130	1.0586	1.0289
0.3603	8.8814	524	1.0437	0.6130	1.0437	1.0216
0.3603	8.9153	526	1.0208	0.6126	1.0208	1.0103
0.3603	8.9492	528	1.0009	0.6219	1.0009	1.0004
0.3603	8.9831	530	0.9892	0.6218	0.9892	0.9946
0.3603	9.0169	532	0.9813	0.6223	0.9813	0.9906
0.3603	9.0508	534	0.9939	0.6127	0.9939	0.9969
0.3603	9.0847	536	1.0033	0.6127	1.0033	1.0016
0.3603	9.1186	538	1.0027	0.6127	1.0027	1.0014
0.3603	9.1525	540	0.9956	0.6127	0.9956	0.9978
0.3603	9.1864	542	0.9786	0.6403	0.9786	0.9892
0.3603	9.2203	544	0.9756	0.6403	0.9756	0.9877
0.3603	9.2542	546	0.9755	0.6462	0.9755	0.9877
0.3603	9.2881	548	0.9834	0.6462	0.9834	0.9917
0.3603	9.3220	550	0.9847	0.6498	0.9847	0.9923
0.3603	9.3559	552	0.9913	0.6401	0.9913	0.9956
0.3603	9.3898	554	0.9981	0.6401	0.9981	0.9990
0.3603	9.4237	556	1.0100	0.6130	1.0100	1.0050
0.3603	9.4576	558	1.0198	0.6130	1.0198	1.0098
0.3603	9.4915	560	1.0270	0.6130	1.0270	1.0134
0.3603	9.5254	562	1.0253	0.6130	1.0253	1.0126
0.3603	9.5593	564	1.0278	0.6130	1.0278	1.0138
0.3603	9.5932	566	1.0259	0.6130	1.0259	1.0129
0.3603	9.6271	568	1.0259	0.6130	1.0259	1.0128
0.3603	9.6610	570	1.0213	0.6130	1.0213	1.0106
0.3603	9.6949	572	1.0188	0.6130	1.0188	1.0093
0.3603	9.7288	574	1.0154	0.6224	1.0154	1.0077
0.3603	9.7627	576	1.0119	0.6224	1.0119	1.0059
0.3603	9.7966	578	1.0069	0.6224	1.0069	1.0034
0.3603	9.8305	580	1.0056	0.6224	1.0056	1.0028
0.3603	9.8644	582	1.0058	0.6224	1.0058	1.0029
0.3603	9.8983	584	1.0062	0.6224	1.0062	1.0031
0.3603	9.9322	586	1.0054	0.6224	1.0054	1.0027
0.3603	9.9661	588	1.0054	0.6224	1.0054	1.0027
0.3603	10.0	590	1.0056	0.6224	1.0056	1.0028

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1