ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0402
• Qwk: 0.6059
• Mse: 1.0402
• Rmse: 1.0199

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	2.2120	-0.0013	2.2120	1.4873
No log	0.0635	4	1.5739	0.1860	1.5739	1.2545
No log	0.0952	6	1.4948	0.1715	1.4948	1.2226
No log	0.1270	8	1.8701	-0.0516	1.8701	1.3675
No log	0.1587	10	1.7751	-0.0399	1.7751	1.3323
No log	0.1905	12	1.7177	0.1388	1.7177	1.3106
No log	0.2222	14	1.8417	0.2672	1.8417	1.3571
No log	0.2540	16	1.9530	0.2853	1.9530	1.3975
No log	0.2857	18	1.7393	0.2524	1.7393	1.3188
No log	0.3175	20	1.4694	0.1614	1.4694	1.2122
No log	0.3492	22	1.4451	0.1755	1.4451	1.2021
No log	0.3810	24	1.3547	0.2040	1.3547	1.1639
No log	0.4127	26	1.3046	0.2086	1.3046	1.1422
No log	0.4444	28	1.3080	0.2389	1.3080	1.1437
No log	0.4762	30	1.3439	0.2196	1.3439	1.1593
No log	0.5079	32	1.4155	0.2031	1.4155	1.1897
No log	0.5397	34	1.4718	0.2379	1.4718	1.2132
No log	0.5714	36	1.5903	0.3397	1.5903	1.2611
No log	0.6032	38	1.8594	0.2669	1.8594	1.3636
No log	0.6349	40	1.8778	0.2743	1.8778	1.3703
No log	0.6667	42	1.5281	0.3708	1.5281	1.2362
No log	0.6984	44	1.3758	0.3644	1.3758	1.1729
No log	0.7302	46	1.3242	0.3539	1.3242	1.1507
No log	0.7619	48	1.3144	0.3921	1.3144	1.1465
No log	0.7937	50	1.3734	0.4066	1.3734	1.1719
No log	0.8254	52	1.4154	0.3899	1.4154	1.1897
No log	0.8571	54	1.4352	0.4087	1.4352	1.1980
No log	0.8889	56	1.3993	0.4246	1.3993	1.1829
No log	0.9206	58	1.4697	0.4347	1.4697	1.2123
No log	0.9524	60	1.2667	0.4533	1.2667	1.1255
No log	0.9841	62	1.1407	0.4234	1.1407	1.0680
No log	1.0159	64	1.0956	0.4196	1.0956	1.0467
No log	1.0476	66	1.0949	0.5225	1.0949	1.0464
No log	1.0794	68	1.5579	0.4157	1.5579	1.2482
No log	1.1111	70	2.2960	0.2759	2.2960	1.5153
No log	1.1429	72	2.2629	0.3053	2.2629	1.5043
No log	1.1746	74	1.6782	0.3765	1.6782	1.2955
No log	1.2063	76	1.1970	0.4829	1.1970	1.0941
No log	1.2381	78	1.0438	0.4703	1.0438	1.0217
No log	1.2698	80	1.0236	0.4894	1.0236	1.0117
No log	1.3016	82	1.0405	0.4866	1.0405	1.0200
No log	1.3333	84	1.3020	0.4521	1.3020	1.1410
No log	1.3651	86	1.9034	0.3803	1.9034	1.3797
No log	1.3968	88	2.0699	0.3679	2.0699	1.4387
No log	1.4286	90	1.7384	0.3884	1.7384	1.3185
No log	1.4603	92	1.2660	0.4704	1.2660	1.1251
No log	1.4921	94	1.0845	0.4770	1.0845	1.0414
No log	1.5238	96	1.0846	0.4961	1.0846	1.0414
No log	1.5556	98	1.1875	0.5447	1.1875	1.0897
No log	1.5873	100	1.5690	0.4569	1.5690	1.2526
No log	1.6190	102	1.8949	0.4283	1.8949	1.3766
No log	1.6508	104	1.7893	0.4350	1.7893	1.3376
No log	1.6825	106	1.3702	0.4595	1.3702	1.1706
No log	1.7143	108	1.0782	0.5319	1.0782	1.0384
No log	1.7460	110	1.0039	0.5229	1.0039	1.0019
No log	1.7778	112	1.0136	0.5092	1.0136	1.0068
No log	1.8095	114	1.0946	0.4879	1.0946	1.0463
No log	1.8413	116	1.2126	0.4804	1.2126	1.1012
No log	1.8730	118	1.4224	0.4856	1.4224	1.1927
No log	1.9048	120	1.5076	0.4890	1.5076	1.2278
No log	1.9365	122	1.3436	0.4956	1.3436	1.1592
No log	1.9683	124	1.1612	0.4971	1.1612	1.0776
No log	2.0	126	1.1858	0.5120	1.1858	1.0890
No log	2.0317	128	1.3742	0.4973	1.3742	1.1723
No log	2.0635	130	1.4883	0.4603	1.4883	1.2200
No log	2.0952	132	1.5003	0.4567	1.5003	1.2249
No log	2.1270	134	1.4008	0.4809	1.4008	1.1836
No log	2.1587	136	1.3138	0.4701	1.3138	1.1462
No log	2.1905	138	1.4462	0.4413	1.4462	1.2026
No log	2.2222	140	1.4988	0.4563	1.4988	1.2242
No log	2.2540	142	1.4291	0.5024	1.4291	1.1954
No log	2.2857	144	1.1626	0.5388	1.1626	1.0783
No log	2.3175	146	0.9984	0.5943	0.9984	0.9992
No log	2.3492	148	1.0274	0.6008	1.0274	1.0136
No log	2.3810	150	1.1636	0.5482	1.1636	1.0787
No log	2.4127	152	1.1771	0.5417	1.1771	1.0849
No log	2.4444	154	1.2282	0.5372	1.2282	1.1082
No log	2.4762	156	1.1541	0.5909	1.1541	1.0743
No log	2.5079	158	1.1789	0.5831	1.1789	1.0858
No log	2.5397	160	1.3082	0.5652	1.3082	1.1438
No log	2.5714	162	1.1621	0.6023	1.1621	1.0780
No log	2.6032	164	1.1451	0.6015	1.1451	1.0701
No log	2.6349	166	1.0941	0.6064	1.0941	1.0460
No log	2.6667	168	1.1319	0.6038	1.1319	1.0639
No log	2.6984	170	1.0233	0.6200	1.0233	1.0116
No log	2.7302	172	1.0167	0.6266	1.0167	1.0083
No log	2.7619	174	1.0417	0.6266	1.0417	1.0206
No log	2.7937	176	1.2409	0.5924	1.2409	1.1140
No log	2.8254	178	1.3467	0.5691	1.3467	1.1605
No log	2.8571	180	1.2267	0.5815	1.2267	1.1076
No log	2.8889	182	1.0211	0.6396	1.0211	1.0105
No log	2.9206	184	1.0271	0.6430	1.0271	1.0135
No log	2.9524	186	1.0406	0.6243	1.0406	1.0201
No log	2.9841	188	1.1043	0.6132	1.1043	1.0509
No log	3.0159	190	1.2305	0.5446	1.2305	1.1093
No log	3.0476	192	1.2960	0.5311	1.2960	1.1384
No log	3.0794	194	1.2117	0.5334	1.2117	1.1008
No log	3.1111	196	1.0074	0.5711	1.0074	1.0037
No log	3.1429	198	0.9923	0.6037	0.9923	0.9961
No log	3.1746	200	1.1647	0.5738	1.1647	1.0792
No log	3.2063	202	1.4874	0.5080	1.4874	1.2196
No log	3.2381	204	1.4582	0.5080	1.4582	1.2076
No log	3.2698	206	1.1803	0.5370	1.1803	1.0864
No log	3.3016	208	0.9738	0.5943	0.9738	0.9868
No log	3.3333	210	0.9462	0.5927	0.9462	0.9727
No log	3.3651	212	1.0453	0.5369	1.0453	1.0224
No log	3.3968	214	1.3290	0.5537	1.3290	1.1528
No log	3.4286	216	1.6923	0.5152	1.6923	1.3009
No log	3.4603	218	1.7083	0.5021	1.7083	1.3070
No log	3.4921	220	1.3839	0.5312	1.3839	1.1764
No log	3.5238	222	1.0466	0.6451	1.0466	1.0231
No log	3.5556	224	0.9776	0.6155	0.9776	0.9888
No log	3.5873	226	1.0524	0.6167	1.0524	1.0259
No log	3.6190	228	1.1608	0.5824	1.1608	1.0774
No log	3.6508	230	1.1404	0.5638	1.1404	1.0679
No log	3.6825	232	1.0854	0.5712	1.0854	1.0418
No log	3.7143	234	1.1803	0.5465	1.1803	1.0864
No log	3.7460	236	1.1580	0.5465	1.1580	1.0761
No log	3.7778	238	1.1214	0.5736	1.1214	1.0590
No log	3.8095	240	1.0683	0.5883	1.0683	1.0336
No log	3.8413	242	0.9657	0.6590	0.9657	0.9827
No log	3.8730	244	0.8597	0.6751	0.8597	0.9272
No log	3.9048	246	0.8396	0.6882	0.8396	0.9163
No log	3.9365	248	0.8937	0.6479	0.8937	0.9454
No log	3.9683	250	1.0429	0.6320	1.0429	1.0212
No log	4.0	252	1.2507	0.5990	1.2507	1.1184
No log	4.0317	254	1.3799	0.5536	1.3799	1.1747
No log	4.0635	256	1.3194	0.5663	1.3194	1.1486
No log	4.0952	258	1.1252	0.5476	1.1252	1.0607
No log	4.1270	260	1.0384	0.5574	1.0384	1.0190
No log	4.1587	262	1.0661	0.5653	1.0661	1.0325
No log	4.1905	264	1.2097	0.5781	1.2097	1.0999
No log	4.2222	266	1.2345	0.5694	1.2345	1.1111
No log	4.2540	268	1.0925	0.5747	1.0925	1.0452
No log	4.2857	270	0.9403	0.6137	0.9403	0.9697
No log	4.3175	272	0.9125	0.6095	0.9125	0.9552
No log	4.3492	274	0.9802	0.5819	0.9802	0.9901
No log	4.3810	276	1.0776	0.5736	1.0776	1.0381
No log	4.4127	278	1.2417	0.5915	1.2417	1.1143
No log	4.4444	280	1.2516	0.5915	1.2516	1.1188
No log	4.4762	282	1.1669	0.5805	1.1669	1.0802
No log	4.5079	284	1.0799	0.5560	1.0799	1.0392
No log	4.5397	286	1.0418	0.5560	1.0418	1.0207
No log	4.5714	288	0.9701	0.5877	0.9701	0.9849
No log	4.6032	290	0.9685	0.5925	0.9685	0.9841
No log	4.6349	292	1.0722	0.5723	1.0722	1.0355
No log	4.6667	294	1.1662	0.5918	1.1662	1.0799
No log	4.6984	296	1.1910	0.5981	1.1910	1.0913
No log	4.7302	298	1.0907	0.5997	1.0907	1.0444
No log	4.7619	300	1.0231	0.5618	1.0231	1.0115
No log	4.7937	302	1.0009	0.5628	1.0009	1.0005
No log	4.8254	304	1.0914	0.5543	1.0914	1.0447
No log	4.8571	306	1.1810	0.5559	1.1810	1.0867
No log	4.8889	308	1.2776	0.5463	1.2776	1.1303
No log	4.9206	310	1.3004	0.5445	1.3004	1.1403
No log	4.9524	312	1.2156	0.5589	1.2156	1.1026
No log	4.9841	314	1.0349	0.5937	1.0349	1.0173
No log	5.0159	316	0.9203	0.6390	0.9203	0.9593
No log	5.0476	318	0.8862	0.6362	0.8862	0.9414
No log	5.0794	320	0.9232	0.6399	0.9232	0.9608
No log	5.1111	322	1.0049	0.5790	1.0049	1.0024
No log	5.1429	324	1.0347	0.5998	1.0347	1.0172
No log	5.1746	326	0.9746	0.6050	0.9746	0.9872
No log	5.2063	328	0.8592	0.6455	0.8592	0.9269
No log	5.2381	330	0.7942	0.6381	0.7942	0.8912
No log	5.2698	332	0.7765	0.6470	0.7765	0.8812
No log	5.3016	334	0.7866	0.6491	0.7866	0.8869
No log	5.3333	336	0.8292	0.6481	0.8292	0.9106
No log	5.3651	338	0.9358	0.6474	0.9358	0.9673
No log	5.3968	340	0.9972	0.6721	0.9972	0.9986
No log	5.4286	342	0.9456	0.6645	0.9456	0.9724
No log	5.4603	344	0.9071	0.6669	0.9071	0.9524
No log	5.4921	346	0.8602	0.6556	0.8602	0.9274
No log	5.5238	348	0.8348	0.6520	0.8348	0.9137
No log	5.5556	350	0.8470	0.6127	0.8470	0.9203
No log	5.5873	352	0.8774	0.5858	0.8774	0.9367
No log	5.6190	354	0.9402	0.6079	0.9402	0.9696
No log	5.6508	356	0.9888	0.6158	0.9888	0.9944
No log	5.6825	358	0.9950	0.6526	0.9950	0.9975
No log	5.7143	360	0.9799	0.6867	0.9799	0.9899
No log	5.7460	362	0.9605	0.6858	0.9605	0.9801
No log	5.7778	364	0.9735	0.6921	0.9735	0.9867
No log	5.8095	366	0.9825	0.6931	0.9825	0.9912
No log	5.8413	368	0.9717	0.6931	0.9717	0.9858
No log	5.8730	370	1.0153	0.6919	1.0153	1.0076
No log	5.9048	372	1.0960	0.6414	1.0960	1.0469
No log	5.9365	374	1.1627	0.5736	1.1627	1.0783
No log	5.9683	376	1.1214	0.5572	1.1214	1.0589
No log	6.0	378	1.0421	0.5768	1.0421	1.0208
No log	6.0317	380	1.0265	0.6158	1.0265	1.0131
No log	6.0635	382	1.0272	0.6142	1.0272	1.0135
No log	6.0952	384	0.9767	0.6321	0.9767	0.9883
No log	6.1270	386	0.9185	0.6369	0.9185	0.9584
No log	6.1587	388	0.9236	0.6240	0.9236	0.9611
No log	6.1905	390	0.9629	0.6065	0.9629	0.9813
No log	6.2222	392	1.0573	0.6099	1.0573	1.0282
No log	6.2540	394	1.1041	0.5916	1.1041	1.0507
No log	6.2857	396	1.0877	0.6119	1.0877	1.0429
No log	6.3175	398	1.0416	0.6095	1.0416	1.0206
No log	6.3492	400	1.0179	0.5960	1.0179	1.0089
No log	6.3810	402	0.9342	0.6061	0.9342	0.9665
No log	6.4127	404	0.8838	0.6218	0.8838	0.9401
No log	6.4444	406	0.8864	0.6332	0.8864	0.9415
No log	6.4762	408	0.9033	0.6204	0.9033	0.9504
No log	6.5079	410	0.9180	0.6107	0.9180	0.9581
No log	6.5397	412	0.9299	0.6107	0.9299	0.9643
No log	6.5714	414	0.9611	0.6107	0.9611	0.9804
No log	6.6032	416	1.0015	0.6177	1.0015	1.0008
No log	6.6349	418	0.9601	0.6205	0.9601	0.9798
No log	6.6667	420	0.9221	0.6153	0.9221	0.9602
No log	6.6984	422	0.9079	0.6280	0.9079	0.9529
No log	6.7302	424	0.8927	0.6440	0.8927	0.9448
No log	6.7619	426	0.9128	0.6378	0.9128	0.9554
No log	6.7937	428	0.9724	0.6393	0.9724	0.9861
No log	6.8254	430	1.0299	0.6243	1.0299	1.0148
No log	6.8571	432	1.1146	0.5988	1.1146	1.0558
No log	6.8889	434	1.2012	0.5849	1.2012	1.0960
No log	6.9206	436	1.2265	0.5828	1.2265	1.1075
No log	6.9524	438	1.1669	0.5727	1.1669	1.0802
No log	6.9841	440	1.0754	0.5846	1.0754	1.0370
No log	7.0159	442	1.0147	0.6170	1.0147	1.0073
No log	7.0476	444	0.9780	0.6277	0.9780	0.9889
No log	7.0794	446	0.9799	0.6262	0.9799	0.9899
No log	7.1111	448	1.0384	0.6219	1.0384	1.0190
No log	7.1429	450	1.0926	0.5954	1.0926	1.0453
No log	7.1746	452	1.1659	0.5865	1.1659	1.0798
No log	7.2063	454	1.2454	0.5718	1.2454	1.1160
No log	7.2381	456	1.2728	0.5719	1.2728	1.1282
No log	7.2698	458	1.2436	0.5862	1.2436	1.1152
No log	7.3016	460	1.1706	0.5661	1.1706	1.0820
No log	7.3333	462	1.0931	0.5838	1.0931	1.0455
No log	7.3651	464	1.0274	0.5839	1.0274	1.0136
No log	7.3968	466	0.9867	0.6087	0.9867	0.9934
No log	7.4286	468	0.9824	0.5808	0.9824	0.9912
No log	7.4603	470	1.0059	0.5711	1.0059	1.0029
No log	7.4921	472	1.0315	0.5758	1.0315	1.0156
No log	7.5238	474	1.0532	0.5848	1.0532	1.0263
No log	7.5556	476	1.0410	0.5947	1.0410	1.0203
No log	7.5873	478	0.9894	0.5863	0.9894	0.9947
No log	7.6190	480	0.9371	0.5901	0.9371	0.9680
No log	7.6508	482	0.8917	0.5938	0.8917	0.9443
No log	7.6825	484	0.8912	0.6009	0.8912	0.9440
No log	7.7143	486	0.8952	0.6009	0.8952	0.9462
No log	7.7460	488	0.9088	0.6111	0.9088	0.9533
No log	7.7778	490	0.9539	0.6262	0.9539	0.9767
No log	7.8095	492	1.0050	0.6082	1.0050	1.0025
No log	7.8413	494	1.0308	0.5959	1.0308	1.0153
No log	7.8730	496	1.0380	0.5959	1.0380	1.0188
No log	7.9048	498	1.0624	0.5981	1.0624	1.0307
0.3385	7.9365	500	1.0816	0.6094	1.0816	1.0400
0.3385	7.9683	502	1.0933	0.6068	1.0933	1.0456
0.3385	8.0	504	1.0700	0.5917	1.0700	1.0344
0.3385	8.0317	506	1.0653	0.5817	1.0653	1.0321
0.3385	8.0635	508	1.0318	0.5887	1.0318	1.0158
0.3385	8.0952	510	0.9965	0.5782	0.9965	0.9982
0.3385	8.1270	512	0.9802	0.5878	0.9802	0.9901
0.3385	8.1587	514	0.9898	0.5887	0.9898	0.9949
0.3385	8.1905	516	0.9820	0.6109	0.9820	0.9910
0.3385	8.2222	518	1.0037	0.6014	1.0037	1.0018
0.3385	8.2540	520	1.0290	0.6103	1.0290	1.0144
0.3385	8.2857	522	1.0339	0.6007	1.0339	1.0168
0.3385	8.3175	524	1.0193	0.6127	1.0193	1.0096
0.3385	8.3492	526	1.0188	0.6001	1.0188	1.0094
0.3385	8.3810	528	1.0161	0.5981	1.0161	1.0080
0.3385	8.4127	530	1.0135	0.5981	1.0135	1.0067
0.3385	8.4444	532	1.0026	0.5878	1.0026	1.0013
0.3385	8.4762	534	0.9907	0.5878	0.9907	0.9954
0.3385	8.5079	536	0.9846	0.5878	0.9846	0.9923
0.3385	8.5397	538	0.9875	0.5747	0.9875	0.9937
0.3385	8.5714	540	1.0002	0.5853	1.0002	1.0001
0.3385	8.6032	542	1.0215	0.5975	1.0215	1.0107
0.3385	8.6349	544	1.0332	0.6072	1.0332	1.0164
0.3385	8.6667	546	1.0274	0.6072	1.0274	1.0136
0.3385	8.6984	548	1.0382	0.6183	1.0382	1.0189
0.3385	8.7302	550	1.0577	0.6094	1.0577	1.0285
0.3385	8.7619	552	1.0612	0.6094	1.0612	1.0302
0.3385	8.7937	554	1.0696	0.6094	1.0696	1.0342
0.3385	8.8254	556	1.0574	0.6094	1.0574	1.0283
0.3385	8.8571	558	1.0383	0.6183	1.0383	1.0190
0.3385	8.8889	560	1.0349	0.6167	1.0349	1.0173
0.3385	8.9206	562	1.0216	0.6072	1.0216	1.0107
0.3385	8.9524	564	1.0115	0.6054	1.0115	1.0057
0.3385	8.9841	566	1.0043	0.6054	1.0043	1.0022
0.3385	9.0159	568	0.9868	0.5955	0.9868	0.9934
0.3385	9.0476	570	0.9809	0.6145	0.9809	0.9904
0.3385	9.0794	572	0.9888	0.5955	0.9888	0.9944
0.3385	9.1111	574	1.0082	0.6054	1.0082	1.0041
0.3385	9.1429	576	1.0376	0.6059	1.0376	1.0186
0.3385	9.1746	578	1.0604	0.6077	1.0604	1.0298
0.3385	9.2063	580	1.0833	0.6077	1.0833	1.0408
0.3385	9.2381	582	1.0908	0.6094	1.0908	1.0444
0.3385	9.2698	584	1.0963	0.6094	1.0963	1.0470
0.3385	9.3016	586	1.0940	0.6094	1.0940	1.0460
0.3385	9.3333	588	1.0835	0.6077	1.0835	1.0409
0.3385	9.3651	590	1.0703	0.6077	1.0703	1.0346
0.3385	9.3968	592	1.0653	0.6077	1.0653	1.0321
0.3385	9.4286	594	1.0609	0.6059	1.0609	1.0300
0.3385	9.4603	596	1.0547	0.6059	1.0547	1.0270
0.3385	9.4921	598	1.0455	0.6059	1.0455	1.0225
0.3385	9.5238	600	1.0390	0.6059	1.0390	1.0193
0.3385	9.5556	602	1.0277	0.6054	1.0277	1.0138
0.3385	9.5873	604	1.0207	0.6054	1.0207	1.0103
0.3385	9.6190	606	1.0171	0.6179	1.0171	1.0085
0.3385	9.6508	608	1.0185	0.6179	1.0185	1.0092
0.3385	9.6825	610	1.0231	0.6179	1.0231	1.0115
0.3385	9.7143	612	1.0228	0.6179	1.0228	1.0113
0.3385	9.7460	614	1.0241	0.6179	1.0241	1.0120
0.3385	9.7778	616	1.0254	0.6179	1.0254	1.0126
0.3385	9.8095	618	1.0253	0.6179	1.0253	1.0126
0.3385	9.8413	620	1.0265	0.6179	1.0265	1.0132
0.3385	9.8730	622	1.0299	0.6181	1.0299	1.0148
0.3385	9.9048	624	1.0340	0.6059	1.0340	1.0168
0.3385	9.9365	626	1.0368	0.6059	1.0368	1.0182
0.3385	9.9683	628	1.0391	0.6059	1.0391	1.0194
0.3385	10.0	630	1.0402	0.6059	1.0402	1.0199

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1