ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0029
• Qwk: 0.6664
• Mse: 1.0029
• Rmse: 1.0015

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	2.2510	-0.0046	2.2510	1.5003
No log	0.0714	4	1.5007	0.1797	1.5007	1.2250
No log	0.1071	6	1.5434	0.0959	1.5434	1.2423
No log	0.1429	8	1.6550	0.1884	1.6550	1.2865
No log	0.1786	10	1.8011	0.2279	1.8011	1.3420
No log	0.2143	12	1.7514	0.2933	1.7514	1.3234
No log	0.25	14	1.6349	0.2992	1.6349	1.2786
No log	0.2857	16	1.5220	0.2761	1.5220	1.2337
No log	0.3214	18	1.4051	0.2475	1.4051	1.1854
No log	0.3571	20	1.3415	0.2486	1.3415	1.1582
No log	0.3929	22	1.3188	0.2812	1.3188	1.1484
No log	0.4286	24	1.2649	0.3301	1.2649	1.1247
No log	0.4643	26	1.2373	0.3658	1.2373	1.1124
No log	0.5	28	1.2866	0.3735	1.2866	1.1343
No log	0.5357	30	1.3889	0.2774	1.3889	1.1785
No log	0.5714	32	1.4125	0.2648	1.4125	1.1885
No log	0.6071	34	1.3947	0.2523	1.3947	1.1810
No log	0.6429	36	1.3250	0.2449	1.3250	1.1511
No log	0.6786	38	1.2666	0.3142	1.2666	1.1254
No log	0.7143	40	1.2568	0.3470	1.2568	1.1211
No log	0.75	42	1.2680	0.3721	1.2680	1.1261
No log	0.7857	44	1.2538	0.3827	1.2538	1.1197
No log	0.8214	46	1.3758	0.4303	1.3758	1.1730
No log	0.8571	48	1.6642	0.3567	1.6642	1.2900
No log	0.8929	50	1.8774	0.2930	1.8774	1.3702
No log	0.9286	52	1.9622	0.2078	1.9622	1.4008
No log	0.9643	54	1.7740	0.2638	1.7740	1.3319
No log	1.0	56	1.4597	0.3813	1.4597	1.2082
No log	1.0357	58	1.1920	0.4498	1.1920	1.0918
No log	1.0714	60	1.0370	0.5294	1.0370	1.0183
No log	1.1071	62	1.0513	0.5271	1.0513	1.0253
No log	1.1429	64	1.3325	0.4385	1.3325	1.1543
No log	1.1786	66	1.4140	0.4614	1.4140	1.1891
No log	1.2143	68	1.4622	0.4449	1.4622	1.2092
No log	1.25	70	1.2950	0.5135	1.2950	1.1380
No log	1.2857	72	1.2634	0.5135	1.2634	1.1240
No log	1.3214	74	1.3343	0.4892	1.3343	1.1551
No log	1.3571	76	1.3568	0.4689	1.3568	1.1648
No log	1.3929	78	1.2420	0.4558	1.2420	1.1144
No log	1.4286	80	1.2013	0.4707	1.2013	1.0960
No log	1.4643	82	1.0916	0.5533	1.0916	1.0448
No log	1.5	84	1.1041	0.5605	1.1041	1.0508
No log	1.5357	86	1.4097	0.4641	1.4097	1.1873
No log	1.5714	88	1.4705	0.4607	1.4705	1.2126
No log	1.6071	90	1.4675	0.4570	1.4675	1.2114
No log	1.6429	92	1.2973	0.5106	1.2973	1.1390
No log	1.6786	94	1.0487	0.5886	1.0487	1.0241
No log	1.7143	96	0.9737	0.6031	0.9737	0.9868
No log	1.75	98	1.0983	0.5891	1.0983	1.0480
No log	1.7857	100	1.2063	0.5573	1.2063	1.0983
No log	1.8214	102	1.2325	0.5573	1.2325	1.1102
No log	1.8571	104	1.3979	0.5012	1.3979	1.1823
No log	1.8929	106	1.6616	0.4758	1.6616	1.2890
No log	1.9286	108	1.4771	0.4755	1.4771	1.2153
No log	1.9643	110	1.0621	0.5800	1.0621	1.0306
No log	2.0	112	0.8769	0.6077	0.8769	0.9364
No log	2.0357	114	0.8713	0.6360	0.8713	0.9335
No log	2.0714	116	1.0085	0.5355	1.0085	1.0042
No log	2.1071	118	1.2845	0.4526	1.2845	1.1333
No log	2.1429	120	1.2988	0.4561	1.2988	1.1397
No log	2.1786	122	1.0537	0.5459	1.0537	1.0265
No log	2.2143	124	0.9133	0.6558	0.9133	0.9557
No log	2.25	126	0.9266	0.6378	0.9266	0.9626
No log	2.2857	128	1.1612	0.5576	1.1612	1.0776
No log	2.3214	130	1.2156	0.5530	1.2156	1.1025
No log	2.3571	132	1.1099	0.5639	1.1099	1.0535
No log	2.3929	134	1.2820	0.5659	1.2820	1.1322
No log	2.4286	136	1.2861	0.5650	1.2861	1.1340
No log	2.4643	138	1.1903	0.6040	1.1903	1.0910
No log	2.5	140	1.0607	0.6298	1.0607	1.0299
No log	2.5357	142	1.0888	0.6223	1.0888	1.0434
No log	2.5714	144	1.2152	0.5853	1.2152	1.1023
No log	2.6071	146	1.5049	0.4437	1.5049	1.2268
No log	2.6429	148	1.6517	0.4351	1.6517	1.2852
No log	2.6786	150	1.4954	0.4543	1.4954	1.2229
No log	2.7143	152	1.1476	0.5552	1.1476	1.0713
No log	2.75	154	0.9033	0.6193	0.9033	0.9504
No log	2.7857	156	0.8561	0.6527	0.8561	0.9253
No log	2.8214	158	0.9367	0.6660	0.9367	0.9678
No log	2.8571	160	1.2182	0.5982	1.2182	1.1037
No log	2.8929	162	1.3934	0.5296	1.3934	1.1804
No log	2.9286	164	1.5049	0.5148	1.5049	1.2267
No log	2.9643	166	1.2789	0.5540	1.2789	1.1309
No log	3.0	168	1.0507	0.6289	1.0507	1.0250
No log	3.0357	170	1.1000	0.6275	1.1000	1.0488
No log	3.0714	172	1.3964	0.5528	1.3964	1.1817
No log	3.1071	174	1.5305	0.5333	1.5305	1.2371
No log	3.1429	176	1.4643	0.5274	1.4643	1.2101
No log	3.1786	178	1.1696	0.6394	1.1696	1.0815
No log	3.2143	180	0.8882	0.6915	0.8882	0.9424
No log	3.25	182	0.8812	0.7080	0.8812	0.9387
No log	3.2857	184	0.8762	0.7014	0.8762	0.9360
No log	3.3214	186	0.9538	0.6530	0.9538	0.9766
No log	3.3571	188	0.9578	0.6486	0.9578	0.9787
No log	3.3929	190	0.9224	0.6792	0.9224	0.9604
No log	3.4286	192	0.9027	0.6771	0.9027	0.9501
No log	3.4643	194	0.8765	0.6905	0.8765	0.9362
No log	3.5	196	0.8558	0.6984	0.8558	0.9251
No log	3.5357	198	0.8029	0.6900	0.8029	0.8960
No log	3.5714	200	0.8978	0.6741	0.8978	0.9475
No log	3.6071	202	1.0053	0.6739	1.0053	1.0026
No log	3.6429	204	0.9938	0.6746	0.9938	0.9969
No log	3.6786	206	0.9781	0.6731	0.9781	0.9890
No log	3.7143	208	0.9911	0.6928	0.9911	0.9955
No log	3.75	210	1.1198	0.6460	1.1198	1.0582
No log	3.7857	212	1.1235	0.6222	1.1235	1.0600
No log	3.8214	214	0.9923	0.6247	0.9923	0.9961
No log	3.8571	216	1.0085	0.6321	1.0085	1.0042
No log	3.8929	218	1.2290	0.5297	1.2290	1.1086
No log	3.9286	220	1.4399	0.5068	1.4399	1.2000
No log	3.9643	222	1.3117	0.5786	1.3117	1.1453
No log	4.0	224	1.1754	0.6387	1.1754	1.0842
No log	4.0357	226	1.0793	0.6339	1.0793	1.0389
No log	4.0714	228	0.8970	0.6805	0.8970	0.9471
No log	4.1071	230	0.8869	0.6812	0.8869	0.9417
No log	4.1429	232	1.0182	0.6761	1.0182	1.0091
No log	4.1786	234	0.9209	0.6799	0.9209	0.9596
No log	4.2143	236	0.9632	0.6864	0.9632	0.9814
No log	4.25	238	1.0160	0.6681	1.0160	1.0080
No log	4.2857	240	0.8389	0.6827	0.8389	0.9159
No log	4.3214	242	0.8374	0.6827	0.8374	0.9151
No log	4.3571	244	0.8602	0.6827	0.8602	0.9274
No log	4.3929	246	0.8500	0.6965	0.8500	0.9220
No log	4.4286	248	0.8067	0.7118	0.8067	0.8981
No log	4.4643	250	0.7877	0.7133	0.7877	0.8875
No log	4.5	252	0.9584	0.6808	0.9584	0.9790
No log	4.5357	254	1.0662	0.6359	1.0662	1.0326
No log	4.5714	256	0.9124	0.6810	0.9124	0.9552
No log	4.6071	258	0.7504	0.7120	0.7504	0.8663
No log	4.6429	260	0.7635	0.7075	0.7635	0.8738
No log	4.6786	262	0.8972	0.7018	0.8972	0.9472
No log	4.7143	264	1.0550	0.6509	1.0550	1.0271
No log	4.75	266	1.1021	0.6351	1.1021	1.0498
No log	4.7857	268	1.0147	0.6615	1.0147	1.0073
No log	4.8214	270	0.8207	0.7048	0.8207	0.9059
No log	4.8571	272	0.7830	0.6979	0.7830	0.8849
No log	4.8929	274	0.8710	0.6977	0.8710	0.9333
No log	4.9286	276	1.0592	0.6501	1.0592	1.0292
No log	4.9643	278	1.1114	0.5993	1.1114	1.0542
No log	5.0	280	0.9820	0.6571	0.9820	0.9909
No log	5.0357	282	0.8078	0.7160	0.8078	0.8988
No log	5.0714	284	0.7692	0.7265	0.7692	0.8771
No log	5.1071	286	0.8187	0.7081	0.8187	0.9048
No log	5.1429	288	0.9783	0.6454	0.9783	0.9891
No log	5.1786	290	1.0287	0.6525	1.0287	1.0142
No log	5.2143	292	0.9594	0.6504	0.9594	0.9795
No log	5.25	294	0.8807	0.6982	0.8807	0.9385
No log	5.2857	296	0.8476	0.7116	0.8476	0.9207
No log	5.3214	298	0.9423	0.6404	0.9423	0.9707
No log	5.3571	300	1.0884	0.6079	1.0884	1.0433
No log	5.3929	302	1.0615	0.6294	1.0615	1.0303
No log	5.4286	304	0.9647	0.6846	0.9647	0.9822
No log	5.4643	306	0.9253	0.6722	0.9253	0.9619
No log	5.5	308	0.9373	0.6714	0.9373	0.9681
No log	5.5357	310	0.9949	0.6266	0.9949	0.9974
No log	5.5714	312	0.9617	0.6295	0.9617	0.9807
No log	5.6071	314	0.9593	0.6360	0.9593	0.9794
No log	5.6429	316	0.9146	0.6534	0.9146	0.9563
No log	5.6786	318	0.9114	0.6742	0.9114	0.9547
No log	5.7143	320	0.9833	0.6418	0.9833	0.9916
No log	5.75	322	1.0398	0.6280	1.0398	1.0197
No log	5.7857	324	1.1314	0.6104	1.1314	1.0637
No log	5.8214	326	1.1293	0.6347	1.1293	1.0627
No log	5.8571	328	1.0480	0.6548	1.0480	1.0237
No log	5.8929	330	1.0551	0.6270	1.0551	1.0272
No log	5.9286	332	1.1647	0.5816	1.1647	1.0792
No log	5.9643	334	1.1561	0.5664	1.1561	1.0752
No log	6.0	336	1.0320	0.6097	1.0320	1.0159
No log	6.0357	338	0.9473	0.6774	0.9473	0.9733
No log	6.0714	340	0.9583	0.6619	0.9583	0.9789
No log	6.1071	342	1.0577	0.5909	1.0577	1.0284
No log	6.1429	344	1.1829	0.5354	1.1829	1.0876
No log	6.1786	346	1.1712	0.5254	1.1712	1.0822
No log	6.2143	348	1.0907	0.5746	1.0907	1.0444
No log	6.25	350	1.0868	0.5746	1.0868	1.0425
No log	6.2857	352	1.1230	0.5471	1.1230	1.0597
No log	6.3214	354	1.0507	0.6072	1.0507	1.0250
No log	6.3571	356	1.0453	0.6303	1.0453	1.0224
No log	6.3929	358	1.0503	0.6403	1.0503	1.0248
No log	6.4286	360	1.1024	0.6161	1.1024	1.0499
No log	6.4643	362	1.0683	0.6289	1.0683	1.0336
No log	6.5	364	1.0038	0.6696	1.0038	1.0019
No log	6.5357	366	1.0143	0.6688	1.0143	1.0071
No log	6.5714	368	1.0362	0.6696	1.0362	1.0180
No log	6.6071	370	1.1074	0.6020	1.1074	1.0523
No log	6.6429	372	1.1805	0.5845	1.1805	1.0865
No log	6.6786	374	1.1685	0.6108	1.1685	1.0810
No log	6.7143	376	1.1093	0.6244	1.1093	1.0533
No log	6.75	378	1.0677	0.6648	1.0677	1.0333
No log	6.7857	380	1.0621	0.6622	1.0621	1.0306
No log	6.8214	382	1.1593	0.5796	1.1593	1.0767
No log	6.8571	384	1.1676	0.5724	1.1676	1.0806
No log	6.8929	386	1.1655	0.5838	1.1655	1.0796
No log	6.9286	388	1.1338	0.5994	1.1338	1.0648
No log	6.9643	390	1.1933	0.5439	1.1933	1.0924
No log	7.0	392	1.1935	0.5439	1.1935	1.0925
No log	7.0357	394	1.0827	0.6165	1.0827	1.0405
No log	7.0714	396	0.9309	0.6913	0.9309	0.9648
No log	7.1071	398	0.8637	0.6860	0.8637	0.9294
No log	7.1429	400	0.8813	0.6751	0.8813	0.9388
No log	7.1786	402	0.9735	0.6473	0.9735	0.9867
No log	7.2143	404	1.1116	0.5978	1.1116	1.0543
No log	7.25	406	1.1713	0.5323	1.1713	1.0823
No log	7.2857	408	1.1178	0.5692	1.1178	1.0573
No log	7.3214	410	1.0146	0.6321	1.0146	1.0073
No log	7.3571	412	0.9721	0.6265	0.9721	0.9860
No log	7.3929	414	0.9592	0.6457	0.9592	0.9794
No log	7.4286	416	1.0003	0.6360	1.0003	1.0001
No log	7.4643	418	1.0907	0.5692	1.0907	1.0444
No log	7.5	420	1.1899	0.5478	1.1899	1.0908
No log	7.5357	422	1.2217	0.5493	1.2217	1.1053
No log	7.5714	424	1.1868	0.5746	1.1868	1.0894
No log	7.6071	426	1.2101	0.5776	1.2101	1.1000
No log	7.6429	428	1.2249	0.5696	1.2249	1.1067
No log	7.6786	430	1.2064	0.5696	1.2064	1.0984
No log	7.7143	432	1.1480	0.5797	1.1480	1.0714
No log	7.75	434	1.0612	0.6166	1.0612	1.0301
No log	7.7857	436	1.0326	0.6442	1.0326	1.0162
No log	7.8214	438	1.0696	0.6166	1.0696	1.0342
No log	7.8571	440	1.1727	0.5510	1.1727	1.0829
No log	7.8929	442	1.2450	0.5318	1.2450	1.1158
No log	7.9286	444	1.2537	0.5199	1.2537	1.1197
No log	7.9643	446	1.2533	0.5199	1.2533	1.1195
No log	8.0	448	1.1857	0.5333	1.1857	1.0889
No log	8.0357	450	1.1137	0.5579	1.1137	1.0553
No log	8.0714	452	1.0922	0.5830	1.0922	1.0451
No log	8.1071	454	1.0760	0.6121	1.0760	1.0373
No log	8.1429	456	1.1077	0.5569	1.1077	1.0525
No log	8.1786	458	1.1456	0.5480	1.1456	1.0703
No log	8.2143	460	1.1819	0.5510	1.1819	1.0871
No log	8.25	462	1.2022	0.5430	1.2022	1.0964
No log	8.2857	464	1.1869	0.5510	1.1869	1.0895
No log	8.3214	466	1.1165	0.5715	1.1165	1.0567
No log	8.3571	468	1.0551	0.6075	1.0551	1.0272
No log	8.3929	470	1.0258	0.6555	1.0258	1.0128
No log	8.4286	472	1.0443	0.6075	1.0443	1.0219
No log	8.4643	474	1.0920	0.5871	1.0920	1.0450
No log	8.5	476	1.1532	0.5746	1.1532	1.0739
No log	8.5357	478	1.1605	0.5510	1.1605	1.0773
No log	8.5714	480	1.1436	0.5746	1.1436	1.0694
No log	8.6071	482	1.0971	0.6029	1.0971	1.0474
No log	8.6429	484	1.0438	0.6063	1.0438	1.0217
No log	8.6786	486	1.0207	0.6224	1.0207	1.0103
No log	8.7143	488	1.0145	0.6385	1.0145	1.0072
No log	8.75	490	1.0211	0.6385	1.0211	1.0105
No log	8.7857	492	1.0342	0.6397	1.0342	1.0170
No log	8.8214	494	1.0521	0.6335	1.0521	1.0257
No log	8.8571	496	1.0397	0.6335	1.0397	1.0196
No log	8.8929	498	1.0176	0.6631	1.0176	1.0088
0.3123	8.9286	500	0.9992	0.6781	0.9992	0.9996
0.3123	8.9643	502	0.9876	0.6840	0.9876	0.9938
0.3123	9.0	504	0.9713	0.6858	0.9713	0.9855
0.3123	9.0357	506	0.9680	0.6858	0.9680	0.9839
0.3123	9.0714	508	0.9726	0.6840	0.9726	0.9862
0.3123	9.1071	510	0.9705	0.6840	0.9705	0.9851
0.3123	9.1429	512	0.9536	0.6876	0.9536	0.9765
0.3123	9.1786	514	0.9537	0.6876	0.9537	0.9766
0.3123	9.2143	516	0.9585	0.6876	0.9585	0.9790
0.3123	9.25	518	0.9772	0.6808	0.9772	0.9885
0.3123	9.2857	520	1.0017	0.6503	1.0017	1.0009
0.3123	9.3214	522	1.0289	0.6451	1.0289	1.0144
0.3123	9.3571	524	1.0465	0.6381	1.0465	1.0230
0.3123	9.3929	526	1.0677	0.6185	1.0677	1.0333
0.3123	9.4286	528	1.0863	0.5912	1.0863	1.0423
0.3123	9.4643	530	1.0877	0.5912	1.0877	1.0429
0.3123	9.5	532	1.0738	0.6185	1.0738	1.0363
0.3123	9.5357	534	1.0514	0.6294	1.0514	1.0254
0.3123	9.5714	536	1.0353	0.6451	1.0353	1.0175
0.3123	9.6071	538	1.0208	0.6451	1.0208	1.0104
0.3123	9.6429	540	1.0049	0.6581	1.0049	1.0025
0.3123	9.6786	542	0.9966	0.6571	0.9966	0.9983
0.3123	9.7143	544	0.9914	0.6722	0.9914	0.9957
0.3123	9.75	546	0.9901	0.6722	0.9901	0.9950
0.3123	9.7857	548	0.9925	0.6722	0.9925	0.9962
0.3123	9.8214	550	0.9968	0.6663	0.9968	0.9984
0.3123	9.8571	552	0.9990	0.6672	0.9990	0.9995
0.3123	9.8929	554	1.0018	0.6581	1.0018	1.0009
0.3123	9.9286	556	1.0022	0.6581	1.0022	1.0011
0.3123	9.9643	558	1.0026	0.6664	1.0026	1.0013
0.3123	10.0	560	1.0029	0.6664	1.0029	1.0015

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1