ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9697
• Qwk: 0.6215
• Mse: 0.9697
• Rmse: 0.9847

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	2.2858	0.0020	2.2858	1.5119
No log	0.0784	4	1.6834	0.1044	1.6834	1.2975
No log	0.1176	6	1.9815	-0.0484	1.9815	1.4077
No log	0.1569	8	1.7776	0.0247	1.7776	1.3333
No log	0.1961	10	1.7120	0.1857	1.7120	1.3084
No log	0.2353	12	1.6481	0.2153	1.6481	1.2838
No log	0.2745	14	1.5619	0.1378	1.5619	1.2498
No log	0.3137	16	1.4992	0.1330	1.4992	1.2244
No log	0.3529	18	1.4890	0.2212	1.4890	1.2203
No log	0.3922	20	1.5385	0.2223	1.5385	1.2404
No log	0.4314	22	1.6197	0.3187	1.6197	1.2727
No log	0.4706	24	1.6794	0.2948	1.6794	1.2959
No log	0.5098	26	1.5681	0.2962	1.5681	1.2522
No log	0.5490	28	1.4225	0.2256	1.4225	1.1927
No log	0.5882	30	1.3564	0.2165	1.3564	1.1647
No log	0.6275	32	1.3179	0.2410	1.3179	1.1480
No log	0.6667	34	1.2645	0.3629	1.2645	1.1245
No log	0.7059	36	1.2591	0.4092	1.2591	1.1221
No log	0.7451	38	1.2303	0.3417	1.2303	1.1092
No log	0.7843	40	1.3182	0.3437	1.3182	1.1481
No log	0.8235	42	1.4335	0.3023	1.4335	1.1973
No log	0.8627	44	1.6077	0.3014	1.6077	1.2680
No log	0.9020	46	1.6043	0.2854	1.6043	1.2666
No log	0.9412	48	1.4296	0.3847	1.4296	1.1957
No log	0.9804	50	1.3240	0.3405	1.3240	1.1507
No log	1.0196	52	1.2292	0.3850	1.2292	1.1087
No log	1.0588	54	1.2161	0.4530	1.2161	1.1028
No log	1.0980	56	1.3343	0.3787	1.3343	1.1551
No log	1.1373	58	1.4432	0.3508	1.4432	1.2013
No log	1.1765	60	1.3477	0.3473	1.3477	1.1609
No log	1.2157	62	1.1772	0.4184	1.1772	1.0850
No log	1.2549	64	1.1084	0.4535	1.1084	1.0528
No log	1.2941	66	1.1501	0.4684	1.1501	1.0724
No log	1.3333	68	1.3002	0.4416	1.3002	1.1403
No log	1.3725	70	1.2827	0.4359	1.2827	1.1326
No log	1.4118	72	1.2625	0.2503	1.2625	1.1236
No log	1.4510	74	1.2548	0.2616	1.2548	1.1202
No log	1.4902	76	1.2511	0.4173	1.2511	1.1185
No log	1.5294	78	1.2487	0.4709	1.2487	1.1174
No log	1.5686	80	1.2408	0.4919	1.2408	1.1139
No log	1.6078	82	1.2015	0.5417	1.2015	1.0961
No log	1.6471	84	1.0020	0.5496	1.0020	1.0010
No log	1.6863	86	0.9653	0.5698	0.9653	0.9825
No log	1.7255	88	1.0409	0.5623	1.0409	1.0203
No log	1.7647	90	1.1051	0.5755	1.1051	1.0512
No log	1.8039	92	1.3683	0.5566	1.3683	1.1697
No log	1.8431	94	1.5837	0.5335	1.5837	1.2584
No log	1.8824	96	1.4039	0.5486	1.4039	1.1848
No log	1.9216	98	1.2167	0.5481	1.2167	1.1030
No log	1.9608	100	1.1726	0.5912	1.1726	1.0829
No log	2.0	102	1.3316	0.5677	1.3316	1.1540
No log	2.0392	104	1.6211	0.5642	1.6211	1.2732
No log	2.0784	106	1.4509	0.5899	1.4509	1.2045
No log	2.1176	108	1.1468	0.6296	1.1468	1.0709
No log	2.1569	110	1.0823	0.6198	1.0823	1.0403
No log	2.1961	112	1.0603	0.6231	1.0603	1.0297
No log	2.2353	114	1.1877	0.6037	1.1877	1.0898
No log	2.2745	116	1.2740	0.5931	1.2740	1.1287
No log	2.3137	118	1.5790	0.5324	1.5790	1.2566
No log	2.3529	120	1.7882	0.5233	1.7882	1.3372
No log	2.3922	122	1.7661	0.5014	1.7661	1.3290
No log	2.4314	124	1.5156	0.5210	1.5156	1.2311
No log	2.4706	126	1.1353	0.5690	1.1353	1.0655
No log	2.5098	128	1.0351	0.5609	1.0351	1.0174
No log	2.5490	130	0.9904	0.5708	0.9904	0.9952
No log	2.5882	132	1.1012	0.5712	1.1012	1.0494
No log	2.6275	134	1.3418	0.5666	1.3418	1.1584
No log	2.6667	136	1.4284	0.5562	1.4284	1.1952
No log	2.7059	138	1.2541	0.5824	1.2541	1.1199
No log	2.7451	140	1.0863	0.6056	1.0863	1.0422
No log	2.7843	142	1.0124	0.6106	1.0124	1.0062
No log	2.8235	144	1.1270	0.6107	1.1270	1.0616
No log	2.8627	146	1.3265	0.5875	1.3265	1.1517
No log	2.9020	148	1.4142	0.6080	1.4142	1.1892
No log	2.9412	150	1.1224	0.6370	1.1224	1.0594
No log	2.9804	152	0.8344	0.6564	0.8344	0.9135
No log	3.0196	154	0.7728	0.6985	0.7728	0.8791
No log	3.0588	156	0.8125	0.6548	0.8125	0.9014
No log	3.0980	158	1.0688	0.6030	1.0688	1.0338
No log	3.1373	160	1.4852	0.5438	1.4852	1.2187
No log	3.1765	162	1.7388	0.5272	1.7388	1.3186
No log	3.2157	164	1.8834	0.4958	1.8834	1.3724
No log	3.2549	166	1.8065	0.5000	1.8065	1.3441
No log	3.2941	168	1.5491	0.4981	1.5491	1.2446
No log	3.3333	170	1.6076	0.4981	1.6076	1.2679
No log	3.3725	172	1.7894	0.4974	1.7894	1.3377
No log	3.4118	174	1.9356	0.4654	1.9356	1.3913
No log	3.4510	176	1.7331	0.4701	1.7331	1.3165
No log	3.4902	178	1.4614	0.5171	1.4614	1.2089
No log	3.5294	180	1.4026	0.5165	1.4026	1.1843
No log	3.5686	182	1.3036	0.5163	1.3036	1.1417
No log	3.6078	184	1.2940	0.5097	1.2940	1.1375
No log	3.6471	186	1.3192	0.5225	1.3192	1.1485
No log	3.6863	188	1.3560	0.5319	1.3560	1.1645
No log	3.7255	190	1.1958	0.5693	1.1958	1.0935
No log	3.7647	192	1.0408	0.5765	1.0408	1.0202
No log	3.8039	194	0.9671	0.5871	0.9671	0.9834
No log	3.8431	196	0.9632	0.6196	0.9632	0.9814
No log	3.8824	198	1.1125	0.5617	1.1125	1.0547
No log	3.9216	200	1.2746	0.5597	1.2746	1.1290
No log	3.9608	202	1.3683	0.5688	1.3683	1.1697
No log	4.0	204	1.2588	0.5525	1.2588	1.1220
No log	4.0392	206	1.2600	0.5632	1.2600	1.1225
No log	4.0784	208	1.2266	0.5536	1.2266	1.1075
No log	4.1176	210	1.2485	0.5600	1.2485	1.1174
No log	4.1569	212	1.2842	0.5354	1.2842	1.1332
No log	4.1961	214	1.2375	0.5642	1.2375	1.1124
No log	4.2353	216	1.2460	0.5520	1.2460	1.1162
No log	4.2745	218	1.1645	0.5917	1.1645	1.0791
No log	4.3137	220	1.0402	0.6154	1.0402	1.0199
No log	4.3529	222	1.0060	0.6257	1.0060	1.0030
No log	4.3922	224	0.9912	0.6330	0.9912	0.9956
No log	4.4314	226	1.0554	0.6187	1.0554	1.0273
No log	4.4706	228	1.0939	0.5978	1.0939	1.0459
No log	4.5098	230	1.1381	0.5998	1.1381	1.0668
No log	4.5490	232	1.0655	0.6047	1.0655	1.0322
No log	4.5882	234	1.0578	0.5974	1.0578	1.0285
No log	4.6275	236	1.0036	0.6037	1.0036	1.0018
No log	4.6667	238	1.0422	0.5845	1.0422	1.0209
No log	4.7059	240	1.0641	0.5690	1.0641	1.0316
No log	4.7451	242	1.1408	0.5746	1.1408	1.0681
No log	4.7843	244	1.2825	0.5587	1.2825	1.1325
No log	4.8235	246	1.3421	0.5612	1.3421	1.1585
No log	4.8627	248	1.3563	0.5783	1.3563	1.1646
No log	4.9020	250	1.2650	0.5756	1.2650	1.1247
No log	4.9412	252	1.2111	0.5695	1.2111	1.1005
No log	4.9804	254	1.2273	0.5572	1.2273	1.1078
No log	5.0196	256	1.3385	0.5475	1.3385	1.1569
No log	5.0588	258	1.5154	0.5646	1.5154	1.2310
No log	5.0980	260	1.5416	0.5610	1.5416	1.2416
No log	5.1373	262	1.4757	0.5858	1.4757	1.2148
No log	5.1765	264	1.3949	0.5794	1.3949	1.1811
No log	5.2157	266	1.1699	0.5591	1.1699	1.0816
No log	5.2549	268	1.0727	0.5755	1.0727	1.0357
No log	5.2941	270	1.1233	0.5725	1.1233	1.0598
No log	5.3333	272	1.1790	0.5725	1.1790	1.0858
No log	5.3725	274	1.2027	0.5666	1.2027	1.0967
No log	5.4118	276	1.1803	0.5814	1.1803	1.0864
No log	5.4510	278	1.1193	0.5897	1.1193	1.0580
No log	5.4902	280	1.0098	0.6010	1.0098	1.0049
No log	5.5294	282	0.9789	0.6139	0.9789	0.9894
No log	5.5686	284	1.0344	0.5971	1.0344	1.0170
No log	5.6078	286	1.0360	0.6060	1.0360	1.0179
No log	5.6471	288	0.9844	0.6077	0.9844	0.9921
No log	5.6863	290	0.9650	0.6099	0.9650	0.9824
No log	5.7255	292	1.0691	0.5968	1.0691	1.0340
No log	5.7647	294	1.1624	0.6023	1.1624	1.0781
No log	5.8039	296	1.2785	0.5990	1.2785	1.1307
No log	5.8431	298	1.2908	0.5949	1.2908	1.1362
No log	5.8824	300	1.1803	0.5870	1.1803	1.0864
No log	5.9216	302	1.0257	0.6117	1.0257	1.0128
No log	5.9608	304	0.9771	0.6127	0.9771	0.9885
No log	6.0	306	1.0143	0.5895	1.0143	1.0071
No log	6.0392	308	1.0962	0.5664	1.0962	1.0470
No log	6.0784	310	1.1816	0.5746	1.1816	1.0870
No log	6.1176	312	1.1586	0.5685	1.1586	1.0764
No log	6.1569	314	1.0438	0.5991	1.0438	1.0217
No log	6.1961	316	0.9743	0.6014	0.9743	0.9871
No log	6.2353	318	0.9384	0.5983	0.9384	0.9687
No log	6.2745	320	1.0028	0.6038	1.0028	1.0014
No log	6.3137	322	1.1731	0.5786	1.1731	1.0831
No log	6.3529	324	1.4840	0.5827	1.4840	1.2182
No log	6.3922	326	1.6800	0.5554	1.6800	1.2961
No log	6.4314	328	1.6667	0.5509	1.6667	1.2910
No log	6.4706	330	1.5329	0.5793	1.5329	1.2381
No log	6.5098	332	1.3674	0.5786	1.3674	1.1694
No log	6.5490	334	1.2587	0.5550	1.2587	1.1219
No log	6.5882	336	1.2351	0.5705	1.2351	1.1114
No log	6.6275	338	1.2842	0.5930	1.2842	1.1332
No log	6.6667	340	1.2416	0.6014	1.2416	1.1143
No log	6.7059	342	1.1544	0.6032	1.1544	1.0744
No log	6.7451	344	1.0212	0.6117	1.0212	1.0105
No log	6.7843	346	0.9101	0.6270	0.9101	0.9540
No log	6.8235	348	0.8401	0.6771	0.8401	0.9166
No log	6.8627	350	0.8256	0.6728	0.8256	0.9086
No log	6.9020	352	0.8197	0.6686	0.8197	0.9054
No log	6.9412	354	0.8106	0.6602	0.8106	0.9003
No log	6.9804	356	0.8527	0.6525	0.8527	0.9234
No log	7.0196	358	0.9474	0.6101	0.9474	0.9734
No log	7.0588	360	0.9907	0.6092	0.9907	0.9953
No log	7.0980	362	0.9859	0.6104	0.9859	0.9929
No log	7.1373	364	0.9647	0.6150	0.9647	0.9822
No log	7.1765	366	0.9832	0.6092	0.9832	0.9916
No log	7.2157	368	1.0198	0.6213	1.0198	1.0099
No log	7.2549	370	1.1298	0.6094	1.1298	1.0629
No log	7.2941	372	1.1724	0.6018	1.1724	1.0828
No log	7.3333	374	1.1319	0.6090	1.1319	1.0639
No log	7.3725	376	1.1077	0.6214	1.1077	1.0525
No log	7.4118	378	1.0731	0.6227	1.0731	1.0359
No log	7.4510	380	1.0421	0.6221	1.0421	1.0208
No log	7.4902	382	1.0103	0.6142	1.0103	1.0051
No log	7.5294	384	0.9841	0.6081	0.9841	0.9920
No log	7.5686	386	1.0102	0.6142	1.0102	1.0051
No log	7.6078	388	1.0596	0.6176	1.0596	1.0294
No log	7.6471	390	1.0461	0.6145	1.0461	1.0228
No log	7.6863	392	0.9755	0.6211	0.9755	0.9877
No log	7.7255	394	0.8972	0.6554	0.8972	0.9472
No log	7.7647	396	0.8337	0.6753	0.8337	0.9131
No log	7.8039	398	0.7968	0.7124	0.7968	0.8926
No log	7.8431	400	0.8044	0.6931	0.8044	0.8969
No log	7.8824	402	0.8211	0.6865	0.8211	0.9061
No log	7.9216	404	0.8812	0.6521	0.8812	0.9387
No log	7.9608	406	0.9386	0.6381	0.9386	0.9688
No log	8.0	408	1.0149	0.6153	1.0149	1.0074
No log	8.0392	410	1.0367	0.6235	1.0367	1.0182
No log	8.0784	412	1.0216	0.6234	1.0216	1.0107
No log	8.1176	414	1.0191	0.6194	1.0191	1.0095
No log	8.1569	416	1.0074	0.6248	1.0074	1.0037
No log	8.1961	418	1.0004	0.6248	1.0004	1.0002
No log	8.2353	420	0.9791	0.6187	0.9791	0.9895
No log	8.2745	422	0.9747	0.6126	0.9747	0.9872
No log	8.3137	424	0.9832	0.6207	0.9832	0.9916
No log	8.3529	426	0.9603	0.6224	0.9603	0.9799
No log	8.3922	428	0.9457	0.6122	0.9457	0.9725
No log	8.4314	430	0.9175	0.6339	0.9175	0.9579
No log	8.4706	432	0.9035	0.6464	0.9035	0.9505
No log	8.5098	434	0.8964	0.6531	0.8964	0.9468
No log	8.5490	436	0.8821	0.6636	0.8821	0.9392
No log	8.5882	438	0.8731	0.6628	0.8731	0.9344
No log	8.6275	440	0.8617	0.6719	0.8617	0.9283
No log	8.6667	442	0.8839	0.6472	0.8839	0.9402
No log	8.7059	444	0.9028	0.6301	0.9028	0.9502
No log	8.7451	446	0.8999	0.6342	0.8999	0.9487
No log	8.7843	448	0.8960	0.6227	0.8960	0.9465
No log	8.8235	450	0.9214	0.6218	0.9214	0.9599
No log	8.8627	452	0.9670	0.6215	0.9670	0.9834
No log	8.9020	454	1.0194	0.6267	1.0194	1.0097
No log	8.9412	456	1.0350	0.6143	1.0350	1.0173
No log	8.9804	458	1.0218	0.6267	1.0218	1.0108
No log	9.0196	460	0.9927	0.6207	0.9927	0.9963
No log	9.0588	462	0.9763	0.6248	0.9763	0.9881
No log	9.0980	464	0.9797	0.6248	0.9797	0.9898
No log	9.1373	466	0.9795	0.6207	0.9795	0.9897
No log	9.1765	468	0.9619	0.6248	0.9619	0.9808
No log	9.2157	470	0.9606	0.6248	0.9606	0.9801
No log	9.2549	472	0.9733	0.6207	0.9733	0.9866
No log	9.2941	474	0.9843	0.6207	0.9843	0.9921
No log	9.3333	476	0.9931	0.6207	0.9931	0.9965
No log	9.3725	478	0.9996	0.6207	0.9996	0.9998
No log	9.4118	480	1.0096	0.6194	1.0096	1.0048
No log	9.4510	482	1.0135	0.6194	1.0135	1.0067
No log	9.4902	484	1.0134	0.6207	1.0134	1.0067
No log	9.5294	486	1.0076	0.6207	1.0076	1.0038
No log	9.5686	488	0.9972	0.6207	0.9972	0.9986
No log	9.6078	490	0.9865	0.6248	0.9865	0.9932
No log	9.6471	492	0.9782	0.6248	0.9782	0.9891
No log	9.6863	494	0.9700	0.6215	0.9700	0.9849
No log	9.7255	496	0.9645	0.6215	0.9645	0.9821
No log	9.7647	498	0.9670	0.6215	0.9670	0.9833
0.3404	9.8039	500	0.9681	0.6215	0.9681	0.9839
0.3404	9.8431	502	0.9689	0.6215	0.9689	0.9843
0.3404	9.8824	504	0.9685	0.6215	0.9685	0.9841
0.3404	9.9216	506	0.9702	0.6215	0.9702	0.9850
0.3404	9.9608	508	0.9696	0.6215	0.9696	0.9847
0.3404	10.0	510	0.9697	0.6215	0.9697	0.9847

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1