ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0537
• Qwk: 0.5942
• Mse: 1.0537
• Rmse: 1.0265

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	2.3308	-0.0139	2.3308	1.5267
No log	0.0635	4	1.5119	0.1162	1.5119	1.2296
No log	0.0952	6	1.6121	0.1430	1.6121	1.2697
No log	0.1270	8	1.7649	0.2135	1.7649	1.3285
No log	0.1587	10	1.8650	0.1893	1.8650	1.3657
No log	0.1905	12	2.0627	0.2403	2.0627	1.4362
No log	0.2222	14	2.1341	0.2175	2.1341	1.4608
No log	0.2540	16	2.0747	0.2190	2.0747	1.4404
No log	0.2857	18	1.7800	0.0915	1.7800	1.3342
No log	0.3175	20	1.7933	0.0662	1.7933	1.3391
No log	0.3492	22	1.9504	0.1569	1.9504	1.3966
No log	0.3810	24	1.9907	0.2533	1.9907	1.4109
No log	0.4127	26	1.9181	0.2529	1.9181	1.3850
No log	0.4444	28	1.7901	0.2512	1.7901	1.3380
No log	0.4762	30	1.7047	0.2533	1.7047	1.3056
No log	0.5079	32	1.6162	0.2156	1.6162	1.2713
No log	0.5397	34	1.5336	0.1827	1.5336	1.2384
No log	0.5714	36	1.5339	0.1980	1.5339	1.2385
No log	0.6032	38	1.6552	0.2874	1.6552	1.2866
No log	0.6349	40	1.7783	0.3481	1.7783	1.3335
No log	0.6667	42	1.6888	0.3520	1.6888	1.2995
No log	0.6984	44	1.5747	0.3006	1.5747	1.2549
No log	0.7302	46	1.5975	0.2766	1.5975	1.2639
No log	0.7619	48	1.6868	0.3382	1.6868	1.2988
No log	0.7937	50	1.7725	0.3364	1.7725	1.3314
No log	0.8254	52	1.6702	0.3225	1.6702	1.2924
No log	0.8571	54	1.7492	0.3228	1.7492	1.3226
No log	0.8889	56	2.0356	0.2872	2.0356	1.4267
No log	0.9206	58	2.4540	0.1974	2.4540	1.5665
No log	0.9524	60	2.7445	0.2067	2.7445	1.6566
No log	0.9841	62	2.6250	0.2917	2.6250	1.6202
No log	1.0159	64	2.0564	0.3260	2.0564	1.4340
No log	1.0476	66	1.8504	0.3412	1.8504	1.3603
No log	1.0794	68	1.7802	0.3412	1.7802	1.3343
No log	1.1111	70	2.1390	0.3611	2.1390	1.4625
No log	1.1429	72	2.1681	0.3431	2.1681	1.4724
No log	1.1746	74	2.0890	0.3007	2.0890	1.4453
No log	1.2063	76	1.8879	0.3888	1.8879	1.3740
No log	1.2381	78	1.8476	0.3887	1.8476	1.3593
No log	1.2698	80	1.7163	0.4082	1.7163	1.3101
No log	1.3016	82	1.5149	0.4831	1.5149	1.2308
No log	1.3333	84	1.9047	0.3787	1.9047	1.3801
No log	1.3651	86	2.5995	0.3659	2.5995	1.6123
No log	1.3968	88	2.4274	0.3784	2.4274	1.5580
No log	1.4286	90	1.8433	0.3975	1.8433	1.3577
No log	1.4603	92	1.9396	0.3690	1.9396	1.3927
No log	1.4921	94	2.2761	0.3203	2.2761	1.5087
No log	1.5238	96	2.1952	0.3477	2.1952	1.4816
No log	1.5556	98	1.6675	0.4187	1.6675	1.2913
No log	1.5873	100	1.2711	0.4955	1.2711	1.1274
No log	1.6190	102	1.3895	0.4668	1.3895	1.1788
No log	1.6508	104	2.0745	0.4186	2.0745	1.4403
No log	1.6825	106	2.5721	0.3838	2.5721	1.6038
No log	1.7143	108	2.0803	0.4196	2.0803	1.4423
No log	1.7460	110	1.4055	0.4763	1.4055	1.1855
No log	1.7778	112	1.3052	0.5028	1.3052	1.1424
No log	1.8095	114	1.5750	0.4695	1.5750	1.2550
No log	1.8413	116	1.9954	0.4079	1.9954	1.4126
No log	1.8730	118	1.7613	0.4418	1.7613	1.3271
No log	1.9048	120	1.4028	0.4728	1.4028	1.1844
No log	1.9365	122	1.1596	0.5478	1.1596	1.0768
No log	1.9683	124	1.1639	0.5469	1.1639	1.0788
No log	2.0	126	1.3473	0.5224	1.3473	1.1607
No log	2.0317	128	2.0135	0.4593	2.0135	1.4190
No log	2.0635	130	2.3031	0.4287	2.3031	1.5176
No log	2.0952	132	2.2110	0.4430	2.2110	1.4869
No log	2.1270	134	1.5029	0.5171	1.5029	1.2259
No log	2.1587	136	1.1348	0.5629	1.1348	1.0653
No log	2.1905	138	1.2466	0.5738	1.2466	1.1165
No log	2.2222	140	1.7726	0.4774	1.7726	1.3314
No log	2.2540	142	2.1027	0.4304	2.1027	1.4501
No log	2.2857	144	1.8528	0.4435	1.8528	1.3612
No log	2.3175	146	1.5043	0.4670	1.5043	1.2265
No log	2.3492	148	1.5733	0.4908	1.5733	1.2543
No log	2.3810	150	1.7671	0.4865	1.7671	1.3293
No log	2.4127	152	1.4689	0.5449	1.4689	1.2120
No log	2.4444	154	1.1739	0.5937	1.1739	1.0835
No log	2.4762	156	1.2189	0.5728	1.2189	1.1040
No log	2.5079	158	1.5362	0.5088	1.5362	1.2395
No log	2.5397	160	1.5602	0.4616	1.5602	1.2491
No log	2.5714	162	1.4048	0.4770	1.4048	1.1853
No log	2.6032	164	1.1954	0.5602	1.1954	1.0934
No log	2.6349	166	0.9731	0.5748	0.9731	0.9865
No log	2.6667	168	0.9573	0.6021	0.9573	0.9784
No log	2.6984	170	1.0490	0.6174	1.0490	1.0242
No log	2.7302	172	1.1920	0.5454	1.1920	1.0918
No log	2.7619	174	1.1384	0.5942	1.1384	1.0669
No log	2.7937	176	1.2293	0.5570	1.2293	1.1087
No log	2.8254	178	1.2011	0.5802	1.2011	1.0959
No log	2.8571	180	1.0687	0.6077	1.0687	1.0338
No log	2.8889	182	1.0009	0.6107	1.0009	1.0004
No log	2.9206	184	1.1386	0.5960	1.1386	1.0671
No log	2.9524	186	1.2932	0.5844	1.2932	1.1372
No log	2.9841	188	1.3545	0.5720	1.3545	1.1638
No log	3.0159	190	1.2996	0.5932	1.2996	1.1400
No log	3.0476	192	1.0622	0.6246	1.0622	1.0306
No log	3.0794	194	0.9949	0.6099	0.9949	0.9974
No log	3.1111	196	1.1721	0.6137	1.1721	1.0826
No log	3.1429	198	1.2393	0.6051	1.2393	1.1132
No log	3.1746	200	1.3273	0.5507	1.3273	1.1521
No log	3.2063	202	1.3208	0.5406	1.3208	1.1493
No log	3.2381	204	1.2866	0.5597	1.2866	1.1343
No log	3.2698	206	1.5444	0.5130	1.5444	1.2427
No log	3.3016	208	1.7424	0.4707	1.7424	1.3200
No log	3.3333	210	1.4698	0.5523	1.4698	1.2123
No log	3.3651	212	1.0214	0.6248	1.0214	1.0106
No log	3.3968	214	0.8944	0.6466	0.8944	0.9457
No log	3.4286	216	0.9853	0.6286	0.9853	0.9926
No log	3.4603	218	1.1682	0.5918	1.1682	1.0808
No log	3.4921	220	1.2462	0.5666	1.2462	1.1163
No log	3.5238	222	1.1516	0.5803	1.1516	1.0731
No log	3.5556	224	0.9084	0.5909	0.9084	0.9531
No log	3.5873	226	0.8648	0.5879	0.8648	0.9299
No log	3.6190	228	1.0628	0.5935	1.0628	1.0309
No log	3.6508	230	1.5258	0.5026	1.5258	1.2352
No log	3.6825	232	1.8056	0.4748	1.8056	1.3437
No log	3.7143	234	1.6609	0.4872	1.6609	1.2888
No log	3.7460	236	1.2558	0.5739	1.2558	1.1206
No log	3.7778	238	1.0292	0.5874	1.0292	1.0145
No log	3.8095	240	1.0422	0.5850	1.0422	1.0209
No log	3.8413	242	1.2861	0.5560	1.2861	1.1341
No log	3.8730	244	1.5748	0.5032	1.5748	1.2549
No log	3.9048	246	1.5409	0.5032	1.5409	1.2413
No log	3.9365	248	1.3573	0.5167	1.3573	1.1650
No log	3.9683	250	1.0773	0.5442	1.0773	1.0379
No log	4.0	252	0.9961	0.6308	0.9961	0.9980
No log	4.0317	254	1.0517	0.5564	1.0517	1.0255
No log	4.0635	256	1.1993	0.5320	1.1993	1.0951
No log	4.0952	258	1.3733	0.5154	1.3733	1.1719
No log	4.1270	260	1.5095	0.5030	1.5095	1.2286
No log	4.1587	262	1.3803	0.5324	1.3803	1.1749
No log	4.1905	264	1.0765	0.5947	1.0765	1.0375
No log	4.2222	266	0.9774	0.6233	0.9774	0.9886
No log	4.2540	268	1.0682	0.5891	1.0682	1.0335
No log	4.2857	270	1.1451	0.5950	1.1451	1.0701
No log	4.3175	272	1.2575	0.5897	1.2575	1.1214
No log	4.3492	274	1.2039	0.5628	1.2039	1.0972
No log	4.3810	276	1.1528	0.5714	1.1528	1.0737
No log	4.4127	278	1.0284	0.5792	1.0284	1.0141
No log	4.4444	280	0.9183	0.5568	0.9183	0.9583
No log	4.4762	282	0.9437	0.5757	0.9437	0.9714
No log	4.5079	284	0.9754	0.5895	0.9754	0.9876
No log	4.5397	286	1.0824	0.6009	1.0824	1.0404
No log	4.5714	288	1.0381	0.6082	1.0381	1.0189
No log	4.6032	290	0.9119	0.6224	0.9119	0.9549
No log	4.6349	292	0.9126	0.6354	0.9126	0.9553
No log	4.6667	294	1.0537	0.6022	1.0537	1.0265
No log	4.6984	296	1.2051	0.6033	1.2051	1.0978
No log	4.7302	298	1.1766	0.6013	1.1766	1.0847
No log	4.7619	300	1.1284	0.6170	1.1284	1.0622
No log	4.7937	302	1.0749	0.6090	1.0749	1.0368
No log	4.8254	304	0.9451	0.6337	0.9451	0.9722
No log	4.8571	306	0.9272	0.6172	0.9272	0.9629
No log	4.8889	308	1.0023	0.6092	1.0023	1.0012
No log	4.9206	310	1.0467	0.6079	1.0467	1.0231
No log	4.9524	312	1.1751	0.5645	1.1751	1.0840
No log	4.9841	314	1.1784	0.5778	1.1784	1.0856
No log	5.0159	316	1.0805	0.6022	1.0805	1.0395
No log	5.0476	318	0.9566	0.5893	0.9566	0.9781
No log	5.0794	320	0.9533	0.5940	0.9533	0.9764
No log	5.1111	322	1.0667	0.5893	1.0667	1.0328
No log	5.1429	324	1.1688	0.5651	1.1688	1.0811
No log	5.1746	326	1.1271	0.5552	1.1271	1.0617
No log	5.2063	328	1.0006	0.5953	1.0006	1.0003
No log	5.2381	330	0.9997	0.6070	0.9997	0.9998
No log	5.2698	332	1.1412	0.5736	1.1412	1.0682
No log	5.3016	334	1.2115	0.5767	1.2115	1.1007
No log	5.3333	336	1.1092	0.5884	1.1092	1.0532
No log	5.3651	338	0.9582	0.6011	0.9582	0.9789
No log	5.3968	340	0.8516	0.6575	0.8516	0.9228
No log	5.4286	342	0.8630	0.6445	0.8630	0.9290
No log	5.4603	344	0.9722	0.5975	0.9722	0.9860
No log	5.4921	346	1.1312	0.5769	1.1312	1.0636
No log	5.5238	348	1.3252	0.5470	1.3252	1.1512
No log	5.5556	350	1.2985	0.5580	1.2985	1.1395
No log	5.5873	352	1.1155	0.5925	1.1155	1.0562
No log	5.6190	354	0.9467	0.6181	0.9467	0.9730
No log	5.6508	356	0.9043	0.6089	0.9043	0.9509
No log	5.6825	358	0.9898	0.6258	0.9898	0.9949
No log	5.7143	360	1.1510	0.5617	1.1510	1.0728
No log	5.7460	362	1.2567	0.5192	1.2567	1.1210
No log	5.7778	364	1.2348	0.5294	1.2348	1.1112
No log	5.8095	366	1.1841	0.5566	1.1841	1.0882
No log	5.8413	368	1.2155	0.5566	1.2155	1.1025
No log	5.8730	370	1.1814	0.5678	1.1814	1.0869
No log	5.9048	372	1.1275	0.6167	1.1275	1.0618
No log	5.9365	374	1.2035	0.5878	1.2035	1.0970
No log	5.9683	376	1.3197	0.5492	1.3197	1.1488
No log	6.0	378	1.3214	0.5592	1.3214	1.1495
No log	6.0317	380	1.1814	0.5634	1.1814	1.0869
No log	6.0635	382	0.9784	0.6373	0.9784	0.9892
No log	6.0952	384	0.8674	0.6162	0.8674	0.9314
No log	6.1270	386	0.8681	0.6233	0.8681	0.9317
No log	6.1587	388	0.9518	0.6466	0.9518	0.9756
No log	6.1905	390	1.1016	0.5540	1.1016	1.0496
No log	6.2222	392	1.2139	0.5283	1.2139	1.1018
No log	6.2540	394	1.2329	0.5197	1.2329	1.1104
No log	6.2857	396	1.2507	0.5197	1.2507	1.1183
No log	6.3175	398	1.2691	0.5197	1.2691	1.1266
No log	6.3492	400	1.2615	0.5310	1.2615	1.1232
No log	6.3810	402	1.2848	0.5310	1.2848	1.1335
No log	6.4127	404	1.2575	0.5392	1.2575	1.1214
No log	6.4444	406	1.2883	0.5392	1.2883	1.1350
No log	6.4762	408	1.2777	0.5392	1.2777	1.1303
No log	6.5079	410	1.2435	0.5361	1.2435	1.1151
No log	6.5397	412	1.1454	0.5664	1.1454	1.0703
No log	6.5714	414	1.0756	0.6119	1.0756	1.0371
No log	6.6032	416	1.0532	0.6119	1.0532	1.0263
No log	6.6349	418	1.0829	0.6119	1.0829	1.0406
No log	6.6667	420	1.0236	0.6263	1.0236	1.0117
No log	6.6984	422	0.9286	0.6396	0.9286	0.9636
No log	6.7302	424	0.9033	0.6410	0.9033	0.9504
No log	6.7619	426	0.9655	0.6271	0.9655	0.9826
No log	6.7937	428	0.9846	0.6291	0.9846	0.9923
No log	6.8254	430	1.0253	0.6142	1.0253	1.0126
No log	6.8571	432	1.1011	0.6065	1.1011	1.0494
No log	6.8889	434	1.0968	0.6065	1.0968	1.0473
No log	6.9206	436	1.0488	0.5932	1.0488	1.0241
No log	6.9524	438	1.0808	0.5889	1.0808	1.0396
No log	6.9841	440	1.0826	0.5889	1.0826	1.0405
No log	7.0159	442	1.0458	0.5988	1.0458	1.0226
No log	7.0476	444	0.9673	0.6168	0.9673	0.9835
No log	7.0794	446	0.9282	0.6562	0.9282	0.9634
No log	7.1111	448	0.9800	0.6107	0.9800	0.9900
No log	7.1429	450	1.0723	0.5945	1.0723	1.0355
No log	7.1746	452	1.0963	0.5824	1.0963	1.0471
No log	7.2063	454	1.0813	0.6057	1.0813	1.0399
No log	7.2381	456	1.0428	0.6167	1.0428	1.0212
No log	7.2698	458	1.0255	0.6294	1.0255	1.0127
No log	7.3016	460	1.0085	0.6439	1.0085	1.0042
No log	7.3333	462	1.0564	0.6504	1.0564	1.0278
No log	7.3651	464	1.1330	0.6224	1.1330	1.0644
No log	7.3968	466	1.1558	0.6101	1.1558	1.0751
No log	7.4286	468	1.0797	0.6132	1.0797	1.0391
No log	7.4603	470	1.0128	0.6195	1.0128	1.0064
No log	7.4921	472	0.9192	0.6421	0.9192	0.9588
No log	7.5238	474	0.8493	0.6478	0.8493	0.9216
No log	7.5556	476	0.8510	0.6478	0.8510	0.9225
No log	7.5873	478	0.8829	0.6457	0.8829	0.9396
No log	7.6190	480	0.9523	0.6286	0.9523	0.9759
No log	7.6508	482	1.0674	0.5769	1.0674	1.0332
No log	7.6825	484	1.1295	0.5747	1.1295	1.0628
No log	7.7143	486	1.1532	0.5664	1.1532	1.0739
No log	7.7460	488	1.0941	0.5909	1.0941	1.0460
No log	7.7778	490	1.0052	0.5979	1.0052	1.0026
No log	7.8095	492	0.9351	0.6181	0.9351	0.9670
No log	7.8413	494	0.9149	0.6290	0.9149	0.9565
No log	7.8730	496	0.9353	0.6085	0.9353	0.9671
No log	7.9048	498	0.9994	0.6013	0.9994	0.9997
0.3653	7.9365	500	1.0668	0.5648	1.0668	1.0329
0.3653	7.9683	502	1.1208	0.5618	1.1208	1.0587
0.3653	8.0	504	1.1083	0.5618	1.1083	1.0528
0.3653	8.0317	506	1.1055	0.5575	1.1055	1.0514
0.3653	8.0635	508	1.0909	0.5527	1.0909	1.0445
0.3653	8.0952	510	1.0409	0.5614	1.0409	1.0203
0.3653	8.1270	512	1.0110	0.5814	1.0110	1.0055
0.3653	8.1587	514	1.0101	0.5851	1.0101	1.0050
0.3653	8.1905	516	1.0160	0.5724	1.0160	1.0080
0.3653	8.2222	518	1.0271	0.5666	1.0271	1.0135
0.3653	8.2540	520	1.0316	0.5666	1.0316	1.0157
0.3653	8.2857	522	1.0335	0.5666	1.0335	1.0166
0.3653	8.3175	524	1.0297	0.5666	1.0297	1.0148
0.3653	8.3492	526	1.0204	0.5791	1.0204	1.0101
0.3653	8.3810	528	0.9923	0.6155	0.9923	0.9962
0.3653	8.4127	530	0.9994	0.6022	0.9994	0.9997
0.3653	8.4444	532	1.0090	0.6022	1.0090	1.0045
0.3653	8.4762	534	1.0610	0.5758	1.0610	1.0301
0.3653	8.5079	536	1.0885	0.5758	1.0885	1.0433
0.3653	8.5397	538	1.1067	0.5758	1.1067	1.0520
0.3653	8.5714	540	1.1099	0.5715	1.1099	1.0535
0.3653	8.6032	542	1.1414	0.5337	1.1414	1.0684
0.3653	8.6349	544	1.1650	0.5321	1.1650	1.0793
0.3653	8.6667	546	1.1464	0.5378	1.1464	1.0707
0.3653	8.6984	548	1.1112	0.5638	1.1112	1.0541
0.3653	8.7302	550	1.0675	0.5682	1.0675	1.0332
0.3653	8.7619	552	1.0433	0.5682	1.0433	1.0214
0.3653	8.7937	554	1.0469	0.5658	1.0469	1.0232
0.3653	8.8254	556	1.0738	0.5561	1.0738	1.0362
0.3653	8.8571	558	1.1003	0.5517	1.1003	1.0489
0.3653	8.8889	560	1.0977	0.5517	1.0977	1.0477
0.3653	8.9206	562	1.1141	0.5584	1.1141	1.0555
0.3653	8.9524	564	1.1181	0.5584	1.1181	1.0574
0.3653	8.9841	566	1.1055	0.5704	1.1055	1.0514
0.3653	9.0159	568	1.1108	0.5704	1.1108	1.0539
0.3653	9.0476	570	1.1222	0.5738	1.1222	1.0593
0.3653	9.0794	572	1.1342	0.5684	1.1342	1.0650
0.3653	9.1111	574	1.1337	0.5684	1.1337	1.0647
0.3653	9.1429	576	1.1188	0.5846	1.1188	1.0578
0.3653	9.1746	578	1.0987	0.5846	1.0987	1.0482
0.3653	9.2063	580	1.0861	0.5836	1.0861	1.0422
0.3653	9.2381	582	1.0776	0.5836	1.0776	1.0381
0.3653	9.2698	584	1.0561	0.5923	1.0561	1.0277
0.3653	9.3016	586	1.0540	0.5923	1.0540	1.0267
0.3653	9.3333	588	1.0610	0.5942	1.0610	1.0300
0.3653	9.3651	590	1.0731	0.5942	1.0731	1.0359
0.3653	9.3968	592	1.0787	0.5942	1.0787	1.0386
0.3653	9.4286	594	1.0847	0.5975	1.0847	1.0415
0.3653	9.4603	596	1.1040	0.5965	1.1040	1.0507
0.3653	9.4921	598	1.1159	0.5759	1.1159	1.0564
0.3653	9.5238	600	1.1159	0.5759	1.1159	1.0563
0.3653	9.5556	602	1.1185	0.5759	1.1185	1.0576
0.3653	9.5873	604	1.1213	0.5759	1.1213	1.0589
0.3653	9.6190	606	1.1274	0.5598	1.1274	1.0618
0.3653	9.6508	608	1.1281	0.5598	1.1281	1.0621
0.3653	9.6825	610	1.1266	0.5759	1.1266	1.0614
0.3653	9.7143	612	1.1171	0.5759	1.1171	1.0569
0.3653	9.7460	614	1.1033	0.5846	1.1033	1.0504
0.3653	9.7778	616	1.0919	0.6008	1.0919	1.0449
0.3653	9.8095	618	1.0812	0.6008	1.0812	1.0398
0.3653	9.8413	620	1.0724	0.6008	1.0724	1.0356
0.3653	9.8730	622	1.0642	0.5942	1.0642	1.0316
0.3653	9.9048	624	1.0584	0.5942	1.0584	1.0288
0.3653	9.9365	626	1.0560	0.5942	1.0560	1.0276
0.3653	9.9683	628	1.0545	0.5942	1.0545	1.0269
0.3653	10.0	630	1.0537	0.5942	1.0537	1.0265

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1