ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0566
• Qwk: 0.5878
• Mse: 1.0566
• Rmse: 1.0279

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	2.3308	-0.0139	2.3308	1.5267
No log	0.0635	4	1.5119	0.1162	1.5119	1.2296
No log	0.0952	6	1.6121	0.1430	1.6121	1.2697
No log	0.1270	8	1.7649	0.2135	1.7649	1.3285
No log	0.1587	10	1.8650	0.1893	1.8650	1.3657
No log	0.1905	12	2.0627	0.2403	2.0627	1.4362
No log	0.2222	14	2.1341	0.2175	2.1341	1.4608
No log	0.2540	16	2.0747	0.2190	2.0747	1.4404
No log	0.2857	18	1.7800	0.0915	1.7800	1.3342
No log	0.3175	20	1.7933	0.0662	1.7933	1.3391
No log	0.3492	22	1.9504	0.1569	1.9504	1.3966
No log	0.3810	24	1.9907	0.2533	1.9907	1.4109
No log	0.4127	26	1.9181	0.2529	1.9181	1.3850
No log	0.4444	28	1.7901	0.2512	1.7901	1.3380
No log	0.4762	30	1.7047	0.2533	1.7047	1.3056
No log	0.5079	32	1.6162	0.2156	1.6162	1.2713
No log	0.5397	34	1.5336	0.1827	1.5336	1.2384
No log	0.5714	36	1.5339	0.1980	1.5339	1.2385
No log	0.6032	38	1.6552	0.2874	1.6552	1.2866
No log	0.6349	40	1.7783	0.3481	1.7783	1.3335
No log	0.6667	42	1.6888	0.3520	1.6888	1.2995
No log	0.6984	44	1.5747	0.3006	1.5747	1.2549
No log	0.7302	46	1.5975	0.2766	1.5975	1.2639
No log	0.7619	48	1.6868	0.3382	1.6868	1.2988
No log	0.7937	50	1.7725	0.3364	1.7725	1.3314
No log	0.8254	52	1.6702	0.3225	1.6702	1.2924
No log	0.8571	54	1.7492	0.3228	1.7492	1.3226
No log	0.8889	56	2.0355	0.2872	2.0355	1.4267
No log	0.9206	58	2.4540	0.1974	2.4540	1.5665
No log	0.9524	60	2.7445	0.2067	2.7445	1.6566
No log	0.9841	62	2.6250	0.2917	2.6250	1.6202
No log	1.0159	64	2.0564	0.3260	2.0564	1.4340
No log	1.0476	66	1.8504	0.3412	1.8504	1.3603
No log	1.0794	68	1.7802	0.3412	1.7802	1.3343
No log	1.1111	70	2.1390	0.3611	2.1390	1.4625
No log	1.1429	72	2.1681	0.3431	2.1681	1.4724
No log	1.1746	74	2.0890	0.3007	2.0890	1.4453
No log	1.2063	76	1.8879	0.3888	1.8879	1.3740
No log	1.2381	78	1.8477	0.3887	1.8477	1.3593
No log	1.2698	80	1.7163	0.4082	1.7163	1.3101
No log	1.3016	82	1.5149	0.4831	1.5149	1.2308
No log	1.3333	84	1.9047	0.3787	1.9047	1.3801
No log	1.3651	86	2.5995	0.3659	2.5995	1.6123
No log	1.3968	88	2.4274	0.3784	2.4274	1.5580
No log	1.4286	90	1.8433	0.3975	1.8433	1.3577
No log	1.4603	92	1.9396	0.3690	1.9396	1.3927
No log	1.4921	94	2.2761	0.3203	2.2761	1.5087
No log	1.5238	96	2.1952	0.3477	2.1952	1.4816
No log	1.5556	98	1.6676	0.4187	1.6676	1.2913
No log	1.5873	100	1.2711	0.4955	1.2711	1.1274
No log	1.6190	102	1.3895	0.4668	1.3895	1.1788
No log	1.6508	104	2.0744	0.4186	2.0744	1.4403
No log	1.6825	106	2.5721	0.3838	2.5721	1.6038
No log	1.7143	108	2.0804	0.4196	2.0804	1.4424
No log	1.7460	110	1.4056	0.4763	1.4056	1.1856
No log	1.7778	112	1.3052	0.5028	1.3052	1.1425
No log	1.8095	114	1.5751	0.4695	1.5751	1.2550
No log	1.8413	116	1.9955	0.4079	1.9955	1.4126
No log	1.8730	118	1.7613	0.4418	1.7613	1.3271
No log	1.9048	120	1.4028	0.4728	1.4028	1.1844
No log	1.9365	122	1.1595	0.5478	1.1595	1.0768
No log	1.9683	124	1.1638	0.5469	1.1638	1.0788
No log	2.0	126	1.3473	0.5224	1.3473	1.1607
No log	2.0317	128	2.0135	0.4593	2.0135	1.4190
No log	2.0635	130	2.3032	0.4287	2.3032	1.5176
No log	2.0952	132	2.2111	0.4430	2.2111	1.4870
No log	2.1270	134	1.5030	0.5171	1.5030	1.2260
No log	2.1587	136	1.1348	0.5629	1.1348	1.0653
No log	2.1905	138	1.2466	0.5738	1.2466	1.1165
No log	2.2222	140	1.7724	0.4774	1.7724	1.3313
No log	2.2540	142	2.1024	0.4329	2.1024	1.4500
No log	2.2857	144	1.8525	0.4435	1.8525	1.3611
No log	2.3175	146	1.5042	0.4670	1.5042	1.2264
No log	2.3492	148	1.5734	0.4908	1.5734	1.2544
No log	2.3810	150	1.7671	0.4865	1.7671	1.3293
No log	2.4127	152	1.4688	0.5449	1.4688	1.2119
No log	2.4444	154	1.1739	0.5937	1.1739	1.0834
No log	2.4762	156	1.2187	0.5728	1.2187	1.1040
No log	2.5079	158	1.5362	0.5088	1.5362	1.2394
No log	2.5397	160	1.5603	0.4616	1.5603	1.2491
No log	2.5714	162	1.4048	0.4770	1.4048	1.1853
No log	2.6032	164	1.1954	0.5602	1.1954	1.0933
No log	2.6349	166	0.9731	0.5748	0.9731	0.9864
No log	2.6667	168	0.9573	0.6021	0.9573	0.9784
No log	2.6984	170	1.0492	0.6174	1.0492	1.0243
No log	2.7302	172	1.1922	0.5454	1.1922	1.0919
No log	2.7619	174	1.1385	0.5942	1.1385	1.0670
No log	2.7937	176	1.2293	0.5570	1.2293	1.1088
No log	2.8254	178	1.2014	0.5802	1.2014	1.0961
No log	2.8571	180	1.0694	0.6077	1.0694	1.0341
No log	2.8889	182	1.0010	0.6107	1.0010	1.0005
No log	2.9206	184	1.1383	0.5960	1.1383	1.0669
No log	2.9524	186	1.2935	0.5844	1.2935	1.1373
No log	2.9841	188	1.3557	0.5720	1.3557	1.1643
No log	3.0159	190	1.3004	0.5932	1.3004	1.1403
No log	3.0476	192	1.0620	0.6246	1.0620	1.0305
No log	3.0794	194	0.9945	0.6099	0.9945	0.9973
No log	3.1111	196	1.1718	0.6137	1.1718	1.0825
No log	3.1429	198	1.2394	0.6051	1.2394	1.1133
No log	3.1746	200	1.3279	0.5507	1.3279	1.1523
No log	3.2063	202	1.3213	0.5406	1.3213	1.1495
No log	3.2381	204	1.2866	0.5597	1.2866	1.1343
No log	3.2698	206	1.5438	0.5130	1.5438	1.2425
No log	3.3016	208	1.7417	0.4707	1.7417	1.3197
No log	3.3333	210	1.4692	0.5523	1.4692	1.2121
No log	3.3651	212	1.0212	0.6248	1.0212	1.0105
No log	3.3968	214	0.8943	0.6466	0.8943	0.9457
No log	3.4286	216	0.9852	0.6286	0.9852	0.9926
No log	3.4603	218	1.1680	0.5918	1.1680	1.0807
No log	3.4921	220	1.2455	0.5666	1.2455	1.1160
No log	3.5238	222	1.1508	0.5803	1.1508	1.0727
No log	3.5556	224	0.9078	0.5909	0.9078	0.9528
No log	3.5873	226	0.8644	0.5879	0.8644	0.9297
No log	3.6190	228	1.0624	0.5935	1.0624	1.0307
No log	3.6508	230	1.5254	0.5026	1.5254	1.2351
No log	3.6825	232	1.8052	0.4748	1.8052	1.3436
No log	3.7143	234	1.6605	0.4872	1.6605	1.2886
No log	3.7460	236	1.2553	0.5739	1.2553	1.1204
No log	3.7778	238	1.0288	0.5874	1.0288	1.0143
No log	3.8095	240	1.0420	0.5850	1.0420	1.0208
No log	3.8413	242	1.2863	0.5560	1.2863	1.1341
No log	3.8730	244	1.5761	0.5032	1.5761	1.2554
No log	3.9048	246	1.5424	0.5032	1.5424	1.2419
No log	3.9365	248	1.3581	0.5167	1.3581	1.1654
No log	3.9683	250	1.0776	0.5495	1.0776	1.0381
No log	4.0	252	0.9961	0.6308	0.9961	0.9981
No log	4.0317	254	1.0517	0.5564	1.0517	1.0255
No log	4.0635	256	1.1993	0.5320	1.1993	1.0951
No log	4.0952	258	1.3737	0.5036	1.3737	1.1720
No log	4.1270	260	1.5101	0.5030	1.5101	1.2289
No log	4.1587	262	1.3810	0.5324	1.3810	1.1752
No log	4.1905	264	1.0768	0.5947	1.0768	1.0377
No log	4.2222	266	0.9773	0.6233	0.9773	0.9886
No log	4.2540	268	1.0685	0.5891	1.0685	1.0337
No log	4.2857	270	1.1454	0.5939	1.1454	1.0702
No log	4.3175	272	1.2576	0.5897	1.2576	1.1214
No log	4.3492	274	1.2039	0.5628	1.2039	1.0972
No log	4.3810	276	1.1531	0.5714	1.1531	1.0738
No log	4.4127	278	1.0289	0.5792	1.0289	1.0144
No log	4.4444	280	0.9186	0.5568	0.9186	0.9584
No log	4.4762	282	0.9436	0.5757	0.9436	0.9714
No log	4.5079	284	0.9757	0.5895	0.9757	0.9878
No log	4.5397	286	1.0834	0.6009	1.0834	1.0409
No log	4.5714	288	1.0389	0.6082	1.0389	1.0193
No log	4.6032	290	0.9117	0.6224	0.9117	0.9548
No log	4.6349	292	0.9118	0.6354	0.9118	0.9549
No log	4.6667	294	1.0525	0.6022	1.0525	1.0259
No log	4.6984	296	1.2048	0.6033	1.2048	1.0976
No log	4.7302	298	1.1777	0.6013	1.1777	1.0852
No log	4.7619	300	1.1305	0.6170	1.1305	1.0632
No log	4.7937	302	1.0754	0.6090	1.0754	1.0370
No log	4.8254	304	0.9446	0.6400	0.9446	0.9719
No log	4.8571	306	0.9263	0.6172	0.9263	0.9624
No log	4.8889	308	1.0028	0.6092	1.0028	1.0014
No log	4.9206	310	1.0487	0.6079	1.0487	1.0241
No log	4.9524	312	1.1778	0.5645	1.1778	1.0853
No log	4.9841	314	1.1804	0.5778	1.1804	1.0865
No log	5.0159	316	1.0811	0.6022	1.0811	1.0398
No log	5.0476	318	0.9564	0.5893	0.9564	0.9780
No log	5.0794	320	0.9525	0.5940	0.9525	0.9760
No log	5.1111	322	1.0659	0.5893	1.0659	1.0324
No log	5.1429	324	1.1713	0.5651	1.1713	1.0823
No log	5.1746	326	1.1318	0.5552	1.1318	1.0639
No log	5.2063	328	1.0038	0.5953	1.0038	1.0019
No log	5.2381	330	1.0010	0.6070	1.0010	1.0005
No log	5.2698	332	1.1418	0.5736	1.1418	1.0686
No log	5.3016	334	1.2135	0.5767	1.2135	1.1016
No log	5.3333	336	1.1123	0.5884	1.1123	1.0546
No log	5.3651	338	0.9606	0.6011	0.9606	0.9801
No log	5.3968	340	0.8523	0.6575	0.8523	0.9232
No log	5.4286	342	0.8629	0.6445	0.8629	0.9289
No log	5.4603	344	0.9714	0.5975	0.9714	0.9856
No log	5.4921	346	1.1311	0.5769	1.1311	1.0635
No log	5.5238	348	1.3275	0.5470	1.3275	1.1522
No log	5.5556	350	1.3024	0.5580	1.3024	1.1412
No log	5.5873	352	1.1195	0.5758	1.1195	1.0581
No log	5.6190	354	0.9487	0.6181	0.9487	0.9740
No log	5.6508	356	0.9034	0.6089	0.9034	0.9505
No log	5.6825	358	0.9865	0.6258	0.9865	0.9932
No log	5.7143	360	1.1454	0.5617	1.1454	1.0702
No log	5.7460	362	1.2531	0.5311	1.2531	1.1194
No log	5.7778	364	1.2361	0.5294	1.2361	1.1118
No log	5.8095	366	1.1891	0.5566	1.1891	1.0905
No log	5.8413	368	1.2214	0.5566	1.2214	1.1052
No log	5.8730	370	1.1843	0.5678	1.1843	1.0882
No log	5.9048	372	1.1258	0.6167	1.1258	1.0610
No log	5.9365	374	1.1989	0.5878	1.1989	1.0949
No log	5.9683	376	1.3145	0.5492	1.3145	1.1465
No log	6.0	378	1.3184	0.5592	1.3184	1.1482
No log	6.0317	380	1.1804	0.5634	1.1804	1.0864
No log	6.0635	382	0.9790	0.6373	0.9790	0.9895
No log	6.0952	384	0.8684	0.6162	0.8684	0.9319
No log	6.1270	386	0.8697	0.6333	0.8697	0.9326
No log	6.1587	388	0.9537	0.6466	0.9537	0.9766
No log	6.1905	390	1.1032	0.5378	1.1032	1.0503
No log	6.2222	392	1.2141	0.5283	1.2141	1.1018
No log	6.2540	394	1.2313	0.5197	1.2313	1.1096
No log	6.2857	396	1.2484	0.5197	1.2484	1.1173
No log	6.3175	398	1.2683	0.5197	1.2683	1.1262
No log	6.3492	400	1.2621	0.5310	1.2621	1.1234
No log	6.3810	402	1.2835	0.5310	1.2835	1.1329
No log	6.4127	404	1.2546	0.5392	1.2546	1.1201
No log	6.4444	406	1.2858	0.5392	1.2858	1.1339
No log	6.4762	408	1.2783	0.5392	1.2783	1.1306
No log	6.5079	410	1.2486	0.5361	1.2486	1.1174
No log	6.5397	412	1.1533	0.5664	1.1533	1.0739
No log	6.5714	414	1.0803	0.6119	1.0803	1.0394
No log	6.6032	416	1.0498	0.6119	1.0498	1.0246
No log	6.6349	418	1.0735	0.6119	1.0735	1.0361
No log	6.6667	420	1.0126	0.6229	1.0126	1.0063
No log	6.6984	422	0.9248	0.6317	0.9248	0.9617
No log	6.7302	424	0.9071	0.6410	0.9071	0.9524
No log	6.7619	426	0.9745	0.6271	0.9745	0.9872
No log	6.7937	428	0.9950	0.6108	0.9950	0.9975
No log	6.8254	430	1.0312	0.6142	1.0312	1.0155
No log	6.8571	432	1.1011	0.6065	1.1011	1.0493
No log	6.8889	434	1.0914	0.6106	1.0914	1.0447
No log	6.9206	436	1.0463	0.5951	1.0463	1.0229
No log	6.9524	438	1.0847	0.5909	1.0847	1.0415
No log	6.9841	440	1.0912	0.5889	1.0912	1.0446
No log	7.0159	442	1.0508	0.5945	1.0508	1.0251
No log	7.0476	444	0.9676	0.6168	0.9676	0.9837
No log	7.0794	446	0.9240	0.6469	0.9240	0.9613
No log	7.1111	448	0.9718	0.6107	0.9718	0.9858
No log	7.1429	450	1.0611	0.5945	1.0611	1.0301
No log	7.1746	452	1.0917	0.5824	1.0917	1.0448
No log	7.2063	454	1.0890	0.6057	1.0890	1.0436
No log	7.2381	456	1.0554	0.6167	1.0554	1.0273
No log	7.2698	458	1.0393	0.6341	1.0393	1.0195
No log	7.3016	460	1.0220	0.6499	1.0220	1.0109
No log	7.3333	462	1.0659	0.6504	1.0659	1.0324
No log	7.3651	464	1.1356	0.6224	1.1356	1.0657
No log	7.3968	466	1.1517	0.6101	1.1517	1.0732
No log	7.4286	468	1.0712	0.6132	1.0712	1.0350
No log	7.4603	470	1.0027	0.6195	1.0027	1.0014
No log	7.4921	472	0.9126	0.6437	0.9126	0.9553
No log	7.5238	474	0.8487	0.6491	0.8487	0.9212
No log	7.5556	476	0.8545	0.6478	0.8545	0.9244
No log	7.5873	478	0.8883	0.6457	0.8883	0.9425
No log	7.6190	480	0.9576	0.6158	0.9576	0.9785
No log	7.6508	482	1.0716	0.5769	1.0716	1.0352
No log	7.6825	484	1.1322	0.5747	1.1322	1.0640
No log	7.7143	486	1.1548	0.5747	1.1548	1.0746
No log	7.7460	488	1.0941	0.5671	1.0941	1.0460
No log	7.7778	490	1.0029	0.5979	1.0029	1.0015
No log	7.8095	492	0.9322	0.6181	0.9322	0.9655
No log	7.8413	494	0.9136	0.6290	0.9136	0.9558
No log	7.8730	496	0.9400	0.6040	0.9400	0.9695
No log	7.9048	498	1.0098	0.6013	1.0098	1.0049
0.3653	7.9365	500	1.0794	0.5648	1.0794	1.0389
0.3653	7.9683	502	1.1268	0.5575	1.1268	1.0615
0.3653	8.0	504	1.1077	0.5527	1.1077	1.0525
0.3653	8.0317	506	1.0992	0.5527	1.0992	1.0484
0.3653	8.0635	508	1.0844	0.5527	1.0844	1.0413
0.3653	8.0952	510	1.0380	0.5614	1.0380	1.0188
0.3653	8.1270	512	1.0126	0.5566	1.0126	1.0063
0.3653	8.1587	514	1.0147	0.5566	1.0147	1.0073
0.3653	8.1905	516	1.0216	0.5596	1.0216	1.0107
0.3653	8.2222	518	1.0320	0.5666	1.0320	1.0159
0.3653	8.2540	520	1.0347	0.5666	1.0347	1.0172
0.3653	8.2857	522	1.0346	0.5666	1.0346	1.0172
0.3653	8.3175	524	1.0296	0.5666	1.0296	1.0147
0.3653	8.3492	526	1.0195	0.5791	1.0195	1.0097
0.3653	8.3810	528	0.9916	0.5839	0.9916	0.9958
0.3653	8.4127	530	0.9996	0.5978	0.9996	0.9998
0.3653	8.4444	532	1.0101	0.5857	1.0101	1.0050
0.3653	8.4762	534	1.0632	0.5758	1.0632	1.0311
0.3653	8.5079	536	1.0911	0.5758	1.0911	1.0446
0.3653	8.5397	538	1.1100	0.5715	1.1100	1.0536
0.3653	8.5714	540	1.1126	0.5715	1.1126	1.0548
0.3653	8.6032	542	1.1429	0.5233	1.1429	1.0691
0.3653	8.6349	544	1.1649	0.5218	1.1649	1.0793
0.3653	8.6667	546	1.1456	0.5463	1.1456	1.0703
0.3653	8.6984	548	1.1113	0.5517	1.1113	1.0542
0.3653	8.7302	550	1.0692	0.5682	1.0692	1.0340
0.3653	8.7619	552	1.0468	0.5682	1.0468	1.0231
0.3653	8.7937	554	1.0524	0.5658	1.0524	1.0259
0.3653	8.8254	556	1.0807	0.5561	1.0807	1.0396
0.3653	8.8571	558	1.1066	0.5517	1.1066	1.0519
0.3653	8.8889	560	1.1025	0.5517	1.1025	1.0500
0.3653	8.9206	562	1.1175	0.5517	1.1175	1.0571
0.3653	8.9524	564	1.1201	0.5584	1.1201	1.0584
0.3653	8.9841	566	1.1065	0.5638	1.1065	1.0519
0.3653	9.0159	568	1.1114	0.5704	1.1114	1.0542
0.3653	9.0476	570	1.1229	0.5738	1.1229	1.0597
0.3653	9.0794	572	1.1355	0.5651	1.1355	1.0656
0.3653	9.1111	574	1.1357	0.5684	1.1357	1.0657
0.3653	9.1429	576	1.1212	0.5771	1.1212	1.0589
0.3653	9.1746	578	1.1011	0.5846	1.1011	1.0493
0.3653	9.2063	580	1.0881	0.5869	1.0881	1.0431
0.3653	9.2381	582	1.0797	0.5836	1.0797	1.0391
0.3653	9.2698	584	1.0583	0.5923	1.0583	1.0287
0.3653	9.3016	586	1.0564	0.5923	1.0564	1.0278
0.3653	9.3333	588	1.0637	0.5942	1.0637	1.0313
0.3653	9.3651	590	1.0762	0.5942	1.0762	1.0374
0.3653	9.3968	592	1.0819	0.5942	1.0819	1.0401
0.3653	9.4286	594	1.0875	0.5975	1.0875	1.0428
0.3653	9.4603	596	1.1066	0.5965	1.1066	1.0519
0.3653	9.4921	598	1.1182	0.5598	1.1182	1.0574
0.3653	9.5238	600	1.1183	0.5759	1.1183	1.0575
0.3653	9.5556	602	1.1209	0.5759	1.1209	1.0587
0.3653	9.5873	604	1.1239	0.5759	1.1239	1.0602
0.3653	9.6190	606	1.1301	0.5598	1.1301	1.0631
0.3653	9.6508	608	1.1309	0.5598	1.1309	1.0635
0.3653	9.6825	610	1.1294	0.5598	1.1294	1.0628
0.3653	9.7143	612	1.1199	0.5759	1.1199	1.0582
0.3653	9.7460	614	1.1060	0.5846	1.1060	1.0517
0.3653	9.7778	616	1.0947	0.5846	1.0947	1.0463
0.3653	9.8095	618	1.0841	0.6008	1.0841	1.0412
0.3653	9.8413	620	1.0753	0.6008	1.0753	1.0370
0.3653	9.8730	622	1.0670	0.5942	1.0670	1.0330
0.3653	9.9048	624	1.0612	0.5878	1.0612	1.0302
0.3653	9.9365	626	1.0588	0.5878	1.0588	1.0290
0.3653	9.9683	628	1.0574	0.5878	1.0574	1.0283
0.3653	10.0	630	1.0566	0.5878	1.0566	1.0279

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1