ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1255
• Qwk: 0.6141
• Mse: 1.1255
• Rmse: 1.0609

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	2.2598	0.0408	2.2598	1.5033
No log	0.0625	4	1.4667	0.1974	1.4667	1.2111
No log	0.0938	6	1.5160	0.1069	1.5160	1.2313
No log	0.125	8	1.6139	0.2226	1.6139	1.2704
No log	0.1562	10	1.5690	0.2395	1.5690	1.2526
No log	0.1875	12	1.5361	0.1359	1.5361	1.2394
No log	0.2188	14	1.4487	0.1475	1.4487	1.2036
No log	0.25	16	1.3770	0.1475	1.3770	1.1735
No log	0.2812	18	1.3173	0.1475	1.3173	1.1477
No log	0.3125	20	1.3090	0.2192	1.3090	1.1441
No log	0.3438	22	1.3213	0.2604	1.3213	1.1495
No log	0.375	24	1.3974	0.2589	1.3974	1.1821
No log	0.4062	26	1.5221	0.3213	1.5221	1.2337
No log	0.4375	28	1.4759	0.2474	1.4759	1.2149
No log	0.4688	30	1.4847	0.3944	1.4847	1.2185
No log	0.5	32	1.3704	0.4186	1.3704	1.1707
No log	0.5312	34	1.2504	0.3578	1.2504	1.1182
No log	0.5625	36	1.1818	0.3589	1.1818	1.0871
No log	0.5938	38	1.2036	0.3602	1.2036	1.0971
No log	0.625	40	1.2435	0.3513	1.2435	1.1151
No log	0.6562	42	1.3608	0.3607	1.3608	1.1665
No log	0.6875	44	1.3533	0.3803	1.3533	1.1633
No log	0.7188	46	1.3044	0.3717	1.3044	1.1421
No log	0.75	48	1.1787	0.3708	1.1787	1.0857
No log	0.7812	50	1.1643	0.4013	1.1643	1.0790
No log	0.8125	52	1.1719	0.3675	1.1719	1.0825
No log	0.8438	54	1.1774	0.4000	1.1774	1.0851
No log	0.875	56	1.3425	0.4328	1.3425	1.1586
No log	0.9062	58	1.7871	0.3953	1.7871	1.3368
No log	0.9375	60	1.8784	0.3752	1.8784	1.3706
No log	0.9688	62	1.5482	0.4039	1.5482	1.2443
No log	1.0	64	1.4700	0.3326	1.4700	1.2124
No log	1.0312	66	1.5150	0.3417	1.5150	1.2308
No log	1.0625	68	1.5552	0.3806	1.5552	1.2471
No log	1.0938	70	1.7384	0.4221	1.7384	1.3185
No log	1.125	72	1.9447	0.3822	1.9447	1.3945
No log	1.1562	74	1.6729	0.4389	1.6729	1.2934
No log	1.1875	76	1.5559	0.4435	1.5559	1.2474
No log	1.2188	78	1.5078	0.4502	1.5078	1.2279
No log	1.25	80	1.5308	0.4424	1.5308	1.2373
No log	1.2812	82	1.5689	0.4457	1.5689	1.2525
No log	1.3125	84	1.4225	0.4480	1.4225	1.1927
No log	1.3438	86	1.3960	0.4714	1.3960	1.1815
No log	1.375	88	1.5008	0.4509	1.5008	1.2251
No log	1.4062	90	1.5899	0.4505	1.5899	1.2609
No log	1.4375	92	1.3524	0.4641	1.3524	1.1629
No log	1.4688	94	1.2112	0.5058	1.2112	1.1005
No log	1.5	96	1.2964	0.4657	1.2964	1.1386
No log	1.5312	98	1.3635	0.4767	1.3635	1.1677
No log	1.5625	100	1.4890	0.4485	1.4890	1.2203
No log	1.5938	102	1.6375	0.4553	1.6375	1.2796
No log	1.625	104	2.0502	0.4805	2.0502	1.4319
No log	1.6562	106	1.8638	0.4798	1.8638	1.3652
No log	1.6875	108	1.5189	0.5081	1.5189	1.2324
No log	1.7188	110	1.6993	0.4678	1.6993	1.3036
No log	1.75	112	1.6830	0.4856	1.6830	1.2973
No log	1.7812	114	1.4135	0.5101	1.4135	1.1889
No log	1.8125	116	1.3337	0.4909	1.3337	1.1549
No log	1.8438	118	1.6159	0.4972	1.6159	1.2712
No log	1.875	120	1.8471	0.4448	1.8471	1.3591
No log	1.9062	122	1.5373	0.4856	1.5373	1.2399
No log	1.9375	124	1.1760	0.4990	1.1760	1.0844
No log	1.9688	126	1.1606	0.4990	1.1606	1.0773
No log	2.0	128	1.3766	0.4984	1.3766	1.1733
No log	2.0312	130	1.7988	0.4847	1.7988	1.3412
No log	2.0625	132	1.7862	0.4780	1.7862	1.3365
No log	2.0938	134	1.2611	0.5370	1.2611	1.1230
No log	2.125	136	1.0274	0.5691	1.0274	1.0136
No log	2.1562	138	0.9995	0.5953	0.9995	0.9997
No log	2.1875	140	1.1317	0.5796	1.1317	1.0638
No log	2.2188	142	1.0926	0.5849	1.0926	1.0453
No log	2.25	144	1.0657	0.6323	1.0657	1.0323
No log	2.2812	146	1.1431	0.6346	1.1431	1.0692
No log	2.3125	148	1.4697	0.5542	1.4697	1.2123
No log	2.3438	150	1.3783	0.5986	1.3783	1.1740
No log	2.375	152	1.2045	0.6476	1.2045	1.0975
No log	2.4062	154	1.0946	0.6355	1.0946	1.0462
No log	2.4375	156	1.0468	0.6387	1.0468	1.0232
No log	2.4688	158	1.0706	0.6586	1.0706	1.0347
No log	2.5	160	1.3500	0.5532	1.3500	1.1619
No log	2.5312	162	1.3595	0.5393	1.3595	1.1660
No log	2.5625	164	1.2621	0.5252	1.2621	1.1234
No log	2.5938	166	1.2585	0.5264	1.2585	1.1218
No log	2.625	168	1.1125	0.5474	1.1125	1.0548
No log	2.6562	170	1.1487	0.5491	1.1487	1.0718
No log	2.6875	172	1.4071	0.5361	1.4071	1.1862
No log	2.7188	174	1.6396	0.5449	1.6396	1.2805
No log	2.75	176	1.6611	0.5360	1.6611	1.2889
No log	2.7812	178	1.3352	0.5670	1.3352	1.1555
No log	2.8125	180	1.1188	0.6110	1.1188	1.0578
No log	2.8438	182	1.0809	0.5881	1.0809	1.0397
No log	2.875	184	1.0203	0.6022	1.0203	1.0101
No log	2.9062	186	0.9949	0.6419	0.9949	0.9975
No log	2.9375	188	1.2082	0.5563	1.2082	1.0992
No log	2.9688	190	1.4479	0.5386	1.4479	1.2033
No log	3.0	192	1.3637	0.5482	1.3637	1.1678
No log	3.0312	194	1.1493	0.5557	1.1493	1.0721
No log	3.0625	196	0.9534	0.6220	0.9534	0.9764
No log	3.0938	198	0.9597	0.6264	0.9597	0.9797
No log	3.125	200	1.0943	0.6302	1.0943	1.0461
No log	3.1562	202	1.2192	0.5825	1.2192	1.1042
No log	3.1875	204	1.0923	0.6230	1.0922	1.0451
No log	3.2188	206	1.0983	0.6204	1.0983	1.0480
No log	3.25	208	1.2656	0.5982	1.2656	1.1250
No log	3.2812	210	1.2323	0.5836	1.2323	1.1101
No log	3.3125	212	1.1472	0.5895	1.1472	1.0711
No log	3.3438	214	1.0283	0.6373	1.0283	1.0141
No log	3.375	216	0.8929	0.6719	0.8929	0.9449
No log	3.4062	218	0.9654	0.6591	0.9654	0.9825
No log	3.4375	220	1.1618	0.6259	1.1618	1.0779
No log	3.4688	222	1.3930	0.5628	1.3930	1.1802
No log	3.5	224	1.3768	0.5445	1.3768	1.1734
No log	3.5312	226	1.2623	0.5294	1.2623	1.1235
No log	3.5625	228	1.2183	0.5364	1.2183	1.1038
No log	3.5938	230	1.1837	0.5673	1.1837	1.0880
No log	3.625	232	1.1146	0.5946	1.1146	1.0557
No log	3.6562	234	1.0792	0.5903	1.0792	1.0388
No log	3.6875	236	1.2239	0.6124	1.2239	1.1063
No log	3.7188	238	1.2723	0.6006	1.2723	1.1280
No log	3.75	240	1.1065	0.5912	1.1065	1.0519
No log	3.7812	242	1.0664	0.6022	1.0664	1.0326
No log	3.8125	244	1.0355	0.6093	1.0355	1.0176
No log	3.8438	246	0.9984	0.5980	0.9984	0.9992
No log	3.875	248	1.0813	0.5899	1.0813	1.0398
No log	3.9062	250	1.2098	0.5625	1.2098	1.0999
No log	3.9375	252	1.2365	0.5718	1.2365	1.1120
No log	3.9688	254	1.2160	0.5738	1.2160	1.1027
No log	4.0	256	1.1567	0.5967	1.1567	1.0755
No log	4.0312	258	1.0204	0.6231	1.0204	1.0101
No log	4.0625	260	1.1189	0.6308	1.1189	1.0578
No log	4.0938	262	1.4941	0.5508	1.4941	1.2223
No log	4.125	264	1.6710	0.5298	1.6710	1.2927
No log	4.1562	266	1.4426	0.5861	1.4426	1.2011
No log	4.1875	268	1.1176	0.6426	1.1176	1.0571
No log	4.2188	270	1.0077	0.6221	1.0077	1.0039
No log	4.25	272	1.0330	0.6339	1.0330	1.0164
No log	4.2812	274	1.1142	0.6423	1.1142	1.0556
No log	4.3125	276	1.2727	0.5998	1.2727	1.1282
No log	4.3438	278	1.4902	0.5493	1.4902	1.2207
No log	4.375	280	1.3623	0.5845	1.3623	1.1672
No log	4.4062	282	1.0570	0.6318	1.0570	1.0281
No log	4.4375	284	0.9426	0.6387	0.9426	0.9709
No log	4.4688	286	1.0353	0.6341	1.0353	1.0175
No log	4.5	288	1.2918	0.5987	1.2918	1.1366
No log	4.5312	290	1.3641	0.5918	1.3641	1.1680
No log	4.5625	292	1.2591	0.6168	1.2591	1.1221
No log	4.5938	294	1.2190	0.6142	1.2190	1.1041
No log	4.625	296	1.2105	0.6101	1.2104	1.1002
No log	4.6562	298	1.0593	0.6369	1.0593	1.0292
No log	4.6875	300	1.0398	0.6369	1.0398	1.0197
No log	4.7188	302	1.0210	0.6369	1.0210	1.0104
No log	4.75	304	1.2079	0.6101	1.2079	1.0991
No log	4.7812	306	1.3592	0.5928	1.3592	1.1658
No log	4.8125	308	1.3307	0.6015	1.3307	1.1535
No log	4.8438	310	1.1701	0.6168	1.1701	1.0817
No log	4.875	312	0.9483	0.6341	0.9483	0.9738
No log	4.9062	314	0.7872	0.6504	0.7872	0.8873
No log	4.9375	316	0.7791	0.6527	0.7791	0.8827
No log	4.9688	318	0.8665	0.6172	0.8665	0.9309
No log	5.0	320	1.1381	0.6168	1.1381	1.0668
No log	5.0312	322	1.5407	0.5537	1.5407	1.2413
No log	5.0625	324	1.6513	0.5073	1.6513	1.2850
No log	5.0938	326	1.5009	0.5749	1.5009	1.2251
No log	5.125	328	1.1772	0.6168	1.1772	1.0850
No log	5.1562	330	0.8820	0.6290	0.8820	0.9391
No log	5.1875	332	0.7941	0.6323	0.7941	0.8911
No log	5.2188	334	0.8272	0.6418	0.8272	0.9095
No log	5.25	336	0.9875	0.6344	0.9875	0.9937
No log	5.2812	338	1.2230	0.6168	1.2230	1.1059
No log	5.3125	340	1.3830	0.6011	1.3830	1.1760
No log	5.3438	342	1.3989	0.5961	1.3989	1.1828
No log	5.375	344	1.3165	0.6172	1.3165	1.1474
No log	5.4062	346	1.2402	0.6260	1.2402	1.1136
No log	5.4375	348	1.1952	0.6260	1.1952	1.0933
No log	5.4688	350	1.2268	0.6260	1.2268	1.1076
No log	5.5	352	1.2556	0.6221	1.2556	1.1206
No log	5.5312	354	1.2466	0.6221	1.2466	1.1165
No log	5.5625	356	1.1642	0.6246	1.1642	1.0790
No log	5.5938	358	1.1264	0.6246	1.1264	1.0613
No log	5.625	360	1.2318	0.6125	1.2318	1.1099
No log	5.6562	362	1.3073	0.5943	1.3073	1.1434
No log	5.6875	364	1.3127	0.5922	1.3127	1.1457
No log	5.7188	366	1.3236	0.6066	1.3236	1.1505
No log	5.75	368	1.2418	0.6139	1.2418	1.1143
No log	5.7812	370	1.2082	0.6125	1.2082	1.0992
No log	5.8125	372	1.3124	0.5883	1.3124	1.1456
No log	5.8438	374	1.3393	0.5866	1.3393	1.1573
No log	5.875	376	1.2450	0.5817	1.2450	1.1158
No log	5.9062	378	1.0703	0.6150	1.0703	1.0346
No log	5.9375	380	0.9686	0.6478	0.9686	0.9842
No log	5.9688	382	0.9287	0.6486	0.9287	0.9637
No log	6.0	384	0.9949	0.6403	0.9949	0.9974
No log	6.0312	386	1.1766	0.6182	1.1766	1.0847
No log	6.0625	388	1.2828	0.6104	1.2828	1.1326
No log	6.0938	390	1.3036	0.6202	1.3036	1.1418
No log	6.125	392	1.2039	0.6264	1.2039	1.0972
No log	6.1562	394	0.9935	0.6405	0.9935	0.9967
No log	6.1875	396	0.8398	0.6661	0.8398	0.9164
No log	6.2188	398	0.8149	0.6573	0.8149	0.9027
No log	6.25	400	0.8750	0.6603	0.8750	0.9354
No log	6.2812	402	1.0149	0.6419	1.0149	1.0074
No log	6.3125	404	1.1864	0.6367	1.1864	1.0892
No log	6.3438	406	1.2443	0.6329	1.2443	1.1155
No log	6.375	408	1.1323	0.6475	1.1323	1.0641
No log	6.4062	410	0.9420	0.6500	0.9420	0.9706
No log	6.4375	412	0.8140	0.6686	0.8140	0.9022
No log	6.4688	414	0.8067	0.6642	0.8067	0.8982
No log	6.5	416	0.8942	0.6504	0.8942	0.9456
No log	6.5312	418	1.0095	0.6226	1.0095	1.0048
No log	6.5625	420	1.0573	0.6172	1.0573	1.0282
No log	6.5938	422	1.0084	0.6244	1.0084	1.0042
No log	6.625	424	0.9150	0.6421	0.9150	0.9566
No log	6.6562	426	0.8752	0.6461	0.8752	0.9355
No log	6.6875	428	0.8616	0.6398	0.8616	0.9282
No log	6.7188	430	0.8854	0.6402	0.8854	0.9409
No log	6.75	432	0.9746	0.6121	0.9746	0.9872
No log	6.7812	434	1.0722	0.6141	1.0722	1.0355
No log	6.8125	436	1.1308	0.6225	1.1308	1.0634
No log	6.8438	438	1.1145	0.6239	1.1145	1.0557
No log	6.875	440	1.0469	0.6193	1.0469	1.0232
No log	6.9062	442	1.0167	0.6193	1.0167	1.0083
No log	6.9375	444	1.0792	0.6251	1.0792	1.0388
No log	6.9688	446	1.1554	0.6116	1.1554	1.0749
No log	7.0	448	1.2810	0.6096	1.2810	1.1318
No log	7.0312	450	1.3488	0.5805	1.3488	1.1614
No log	7.0625	452	1.3039	0.5837	1.3039	1.1419
No log	7.0938	454	1.2131	0.6077	1.2131	1.1014
No log	7.125	456	1.1408	0.6141	1.1408	1.0681
No log	7.1562	458	1.1098	0.6106	1.1098	1.0535
No log	7.1875	460	1.1649	0.6199	1.1649	1.0793
No log	7.2188	462	1.2830	0.5984	1.2830	1.1327
No log	7.25	464	1.4596	0.5454	1.4596	1.2081
No log	7.2812	466	1.5450	0.5490	1.5450	1.2430
No log	7.3125	468	1.4895	0.5454	1.4895	1.2205
No log	7.3438	470	1.3230	0.5728	1.3230	1.1502
No log	7.375	472	1.2003	0.5897	1.2003	1.0956
No log	7.4062	474	1.1576	0.5919	1.1576	1.0759
No log	7.4375	476	1.2018	0.5858	1.2018	1.0963
No log	7.4688	478	1.3196	0.5689	1.3196	1.1487
No log	7.5	480	1.4170	0.5553	1.4170	1.1904
No log	7.5312	482	1.5137	0.5408	1.5137	1.2303
No log	7.5625	484	1.5150	0.5346	1.5150	1.2308
No log	7.5938	486	1.4082	0.5610	1.4082	1.1867
No log	7.625	488	1.2933	0.5984	1.2933	1.1372
No log	7.6562	490	1.2485	0.6131	1.2485	1.1174
No log	7.6875	492	1.2705	0.6131	1.2705	1.1272
No log	7.7188	494	1.3179	0.5984	1.3179	1.1480
No log	7.75	496	1.2926	0.5876	1.2926	1.1369
No log	7.7812	498	1.2656	0.5876	1.2656	1.1250
0.3479	7.8125	500	1.2487	0.5858	1.2487	1.1175
0.3479	7.8438	502	1.2729	0.5818	1.2729	1.1282
0.3479	7.875	504	1.3188	0.5738	1.3188	1.1484
0.3479	7.9062	506	1.3088	0.5738	1.3088	1.1440
0.3479	7.9375	508	1.2593	0.5818	1.2593	1.1222
0.3479	7.9688	510	1.1707	0.6013	1.1707	1.0820
0.3479	8.0	512	1.1376	0.5923	1.1376	1.0666
0.3479	8.0312	514	1.1755	0.6013	1.1755	1.0842
0.3479	8.0625	516	1.1871	0.6030	1.1871	1.0895
0.3479	8.0938	518	1.1691	0.6030	1.1691	1.0812
0.3479	8.125	520	1.1044	0.6141	1.1044	1.0509
0.3479	8.1562	522	1.0673	0.6251	1.0673	1.0331
0.3479	8.1875	524	1.0750	0.6251	1.0750	1.0368
0.3479	8.2188	526	1.1372	0.6239	1.1372	1.0664
0.3479	8.25	528	1.2373	0.6277	1.2373	1.1123
0.3479	8.2812	530	1.2959	0.6172	1.2959	1.1384
0.3479	8.3125	532	1.3098	0.6066	1.3098	1.1445
0.3479	8.3438	534	1.2706	0.6066	1.2706	1.1272
0.3479	8.375	536	1.2133	0.6131	1.2133	1.1015
0.3479	8.4062	538	1.1389	0.6030	1.1389	1.0672
0.3479	8.4375	540	1.0683	0.6049	1.0683	1.0336
0.3479	8.4688	542	1.0074	0.6036	1.0074	1.0037
0.3479	8.5	544	0.9950	0.6036	0.9950	0.9975
0.3479	8.5312	546	1.0236	0.5937	1.0236	1.0118
0.3479	8.5625	548	1.0749	0.6037	1.0749	1.0368
0.3479	8.5938	550	1.1385	0.6030	1.1385	1.0670
0.3479	8.625	552	1.1812	0.6046	1.1812	1.0868
0.3479	8.6562	554	1.2318	0.6131	1.2318	1.1099
0.3479	8.6875	556	1.2570	0.6131	1.2570	1.1212
0.3479	8.7188	558	1.2639	0.6131	1.2639	1.1242
0.3479	8.75	560	1.2602	0.6131	1.2602	1.1226
0.3479	8.7812	562	1.2245	0.6131	1.2245	1.1066
0.3479	8.8125	564	1.1969	0.6046	1.1969	1.0941
0.3479	8.8438	566	1.1691	0.6046	1.1691	1.0813
0.3479	8.875	568	1.1531	0.6155	1.1531	1.0738
0.3479	8.9062	570	1.1399	0.6155	1.1399	1.0677
0.3479	8.9375	572	1.1289	0.6155	1.1289	1.0625
0.3479	8.9688	574	1.1313	0.6155	1.1313	1.0636
0.3479	9.0	576	1.1411	0.6155	1.1411	1.0682
0.3479	9.0312	578	1.1441	0.6155	1.1441	1.0696
0.3479	9.0625	580	1.1370	0.6141	1.1370	1.0663
0.3479	9.0938	582	1.1407	0.6141	1.1407	1.0680
0.3479	9.125	584	1.1388	0.6141	1.1388	1.0671
0.3479	9.1562	586	1.1399	0.6141	1.1399	1.0677
0.3479	9.1875	588	1.1449	0.6141	1.1449	1.0700
0.3479	9.2188	590	1.1404	0.6141	1.1404	1.0679
0.3479	9.25	592	1.1331	0.6141	1.1331	1.0645
0.3479	9.2812	594	1.1449	0.6155	1.1449	1.0700
0.3479	9.3125	596	1.1688	0.6155	1.1688	1.0811
0.3479	9.3438	598	1.1997	0.6155	1.1997	1.0953
0.3479	9.375	600	1.2227	0.6277	1.2227	1.1058
0.3479	9.4062	602	1.2430	0.6277	1.2430	1.1149
0.3479	9.4375	604	1.2534	0.6277	1.2534	1.1195
0.3479	9.4688	606	1.2643	0.6277	1.2643	1.1244
0.3479	9.5	608	1.2574	0.6277	1.2574	1.1214
0.3479	9.5312	610	1.2529	0.6277	1.2529	1.1193
0.3479	9.5625	612	1.2382	0.6277	1.2382	1.1128
0.3479	9.5938	614	1.2136	0.6155	1.2136	1.1016
0.3479	9.625	616	1.1871	0.6155	1.1871	1.0895
0.3479	9.6562	618	1.1578	0.6155	1.1578	1.0760
0.3479	9.6875	620	1.1337	0.6141	1.1337	1.0648
0.3479	9.7188	622	1.1239	0.6141	1.1239	1.0602
0.3479	9.75	624	1.1203	0.6141	1.1203	1.0584
0.3479	9.7812	626	1.1180	0.6141	1.1180	1.0574
0.3479	9.8125	628	1.1148	0.6141	1.1148	1.0558
0.3479	9.8438	630	1.1149	0.6141	1.1149	1.0559
0.3479	9.875	632	1.1186	0.6141	1.1186	1.0576
0.3479	9.9062	634	1.1205	0.6141	1.1205	1.0585
0.3479	9.9375	636	1.1233	0.6141	1.1233	1.0599
0.3479	9.9688	638	1.1246	0.6141	1.1246	1.0605
0.3479	10.0	640	1.1255	0.6141	1.1255	1.0609

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1