ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1831
• Qwk: 0.4294
• Mse: 1.1831
• Rmse: 1.0877

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	4.1693	-0.0066	4.1693	2.0419
No log	0.0702	4	2.7716	0.0720	2.7716	1.6648
No log	0.1053	6	1.2686	0.0641	1.2686	1.1263
No log	0.1404	8	1.0359	0.0351	1.0359	1.0178
No log	0.1754	10	1.3372	0.0206	1.3372	1.1564
No log	0.2105	12	0.8551	-0.0107	0.8551	0.9247
No log	0.2456	14	0.7208	0.1777	0.7208	0.8490
No log	0.2807	16	0.8295	0.1442	0.8295	0.9108
No log	0.3158	18	0.9106	0.0918	0.9106	0.9543
No log	0.3509	20	0.8742	0.1063	0.8742	0.9350
No log	0.3860	22	0.7810	0.1352	0.7810	0.8837
No log	0.4211	24	0.7225	0.1546	0.7225	0.8500
No log	0.4561	26	0.7001	0.1649	0.7001	0.8367
No log	0.4912	28	0.8056	0.1465	0.8056	0.8976
No log	0.5263	30	0.9259	0.0828	0.9259	0.9622
No log	0.5614	32	1.0228	0.1773	1.0228	1.0113
No log	0.5965	34	1.0042	0.3355	1.0042	1.0021
No log	0.6316	36	0.7232	0.3498	0.7232	0.8504
No log	0.6667	38	0.6594	0.3710	0.6594	0.8120
No log	0.7018	40	0.7222	0.3764	0.7222	0.8498
No log	0.7368	42	1.0563	0.2825	1.0563	1.0278
No log	0.7719	44	1.0823	0.3064	1.0823	1.0403
No log	0.8070	46	0.9309	0.3235	0.9309	0.9649
No log	0.8421	48	0.8567	0.3377	0.8567	0.9256
No log	0.8772	50	0.7585	0.3437	0.7585	0.8709
No log	0.9123	52	0.8124	0.3665	0.8124	0.9014
No log	0.9474	54	0.9850	0.3356	0.9850	0.9925
No log	0.9825	56	0.9808	0.3413	0.9808	0.9904
No log	1.0175	58	0.7973	0.3504	0.7973	0.8929
No log	1.0526	60	0.6689	0.4296	0.6689	0.8179
No log	1.0877	62	0.6582	0.4674	0.6582	0.8113
No log	1.1228	64	0.6972	0.4621	0.6972	0.8350
No log	1.1579	66	0.7633	0.3808	0.7633	0.8737
No log	1.1930	68	0.9384	0.3927	0.9384	0.9687
No log	1.2281	70	1.3455	0.3511	1.3455	1.1599
No log	1.2632	72	1.6920	0.2856	1.6920	1.3008
No log	1.2982	74	1.5345	0.3332	1.5345	1.2388
No log	1.3333	76	1.0104	0.4300	1.0104	1.0052
No log	1.3684	78	0.9149	0.5032	0.9149	0.9565
No log	1.4035	80	0.9815	0.4798	0.9815	0.9907
No log	1.4386	82	1.2106	0.3769	1.2106	1.1003
No log	1.4737	84	1.7083	0.3008	1.7083	1.3070
No log	1.5088	86	1.8544	0.3080	1.8544	1.3618
No log	1.5439	88	1.5446	0.3332	1.5446	1.2428
No log	1.5789	90	1.1217	0.4081	1.1217	1.0591
No log	1.6140	92	1.0610	0.4409	1.0610	1.0301
No log	1.6491	94	1.1696	0.3813	1.1696	1.0815
No log	1.6842	96	1.5554	0.3794	1.5554	1.2472
No log	1.7193	98	1.8133	0.3517	1.8133	1.3466
No log	1.7544	100	1.4910	0.3895	1.4910	1.2211
No log	1.7895	102	1.1786	0.3963	1.1786	1.0856
No log	1.8246	104	0.8909	0.5436	0.8909	0.9438
No log	1.8596	106	0.8372	0.4952	0.8372	0.9150
No log	1.8947	108	0.9132	0.4810	0.9132	0.9556
No log	1.9298	110	1.0096	0.4879	1.0096	1.0048
No log	1.9649	112	1.1038	0.4944	1.1038	1.0506
No log	2.0	114	1.2008	0.4012	1.2008	1.0958
No log	2.0351	116	1.1387	0.4105	1.1387	1.0671
No log	2.0702	118	1.1120	0.3516	1.1120	1.0545
No log	2.1053	120	1.1256	0.3644	1.1256	1.0610
No log	2.1404	122	1.2140	0.3796	1.2140	1.1018
No log	2.1754	124	1.2963	0.4129	1.2963	1.1386
No log	2.2105	126	1.3947	0.3475	1.3947	1.1810
No log	2.2456	128	1.2677	0.3851	1.2677	1.1259
No log	2.2807	130	1.3142	0.3732	1.3142	1.1464
No log	2.3158	132	1.2747	0.3774	1.2747	1.1290
No log	2.3509	134	1.0799	0.3775	1.0799	1.0392
No log	2.3860	136	1.1515	0.3672	1.1515	1.0731
No log	2.4211	138	1.2429	0.3751	1.2429	1.1149
No log	2.4561	140	1.0733	0.3839	1.0733	1.0360
No log	2.4912	142	1.1009	0.3907	1.1009	1.0492
No log	2.5263	144	1.2054	0.3622	1.2054	1.0979
No log	2.5614	146	1.2817	0.3669	1.2817	1.1321
No log	2.5965	148	1.3015	0.4034	1.3015	1.1408
No log	2.6316	150	1.3742	0.4062	1.3742	1.1723
No log	2.6667	152	1.5339	0.4030	1.5339	1.2385
No log	2.7018	154	1.4521	0.4070	1.4521	1.2050
No log	2.7368	156	1.3269	0.4189	1.3269	1.1519
No log	2.7719	158	1.0990	0.4243	1.0990	1.0483
No log	2.8070	160	1.0599	0.4369	1.0599	1.0295
No log	2.8421	162	0.9744	0.4575	0.9744	0.9871
No log	2.8772	164	0.9611	0.4460	0.9611	0.9804
No log	2.9123	166	0.9020	0.4270	0.9020	0.9497
No log	2.9474	168	0.8989	0.4320	0.8989	0.9481
No log	2.9825	170	0.8816	0.4374	0.8816	0.9389
No log	3.0175	172	0.8940	0.4238	0.8940	0.9455
No log	3.0526	174	0.8827	0.4515	0.8827	0.9395
No log	3.0877	176	1.0035	0.4017	1.0035	1.0017
No log	3.1228	178	1.2147	0.4194	1.2147	1.1021
No log	3.1579	180	1.3439	0.3923	1.3439	1.1593
No log	3.1930	182	1.3520	0.4053	1.3520	1.1627
No log	3.2281	184	1.1471	0.4135	1.1471	1.0710
No log	3.2632	186	0.9308	0.4717	0.9308	0.9648
No log	3.2982	188	0.8170	0.4521	0.8170	0.9039
No log	3.3333	190	0.8320	0.4648	0.8320	0.9121
No log	3.3684	192	0.9389	0.4651	0.9389	0.9690
No log	3.4035	194	1.0875	0.4489	1.0875	1.0428
No log	3.4386	196	1.1371	0.4396	1.1371	1.0663
No log	3.4737	198	1.0384	0.4514	1.0384	1.0190
No log	3.5088	200	0.9594	0.4657	0.9594	0.9795
No log	3.5439	202	0.9957	0.4823	0.9957	0.9978
No log	3.5789	204	1.0055	0.4823	1.0055	1.0028
No log	3.6140	206	1.0495	0.4752	1.0495	1.0245
No log	3.6491	208	1.0724	0.4886	1.0724	1.0356
No log	3.6842	210	1.2440	0.4561	1.2440	1.1154
No log	3.7193	212	1.5361	0.3589	1.5361	1.2394
No log	3.7544	214	1.7829	0.3719	1.7829	1.3352
No log	3.7895	216	1.8672	0.3361	1.8672	1.3664
No log	3.8246	218	1.5949	0.3415	1.5949	1.2629
No log	3.8596	220	1.4123	0.3614	1.4123	1.1884
No log	3.8947	222	1.3367	0.3679	1.3367	1.1562
No log	3.9298	224	1.1922	0.3913	1.1922	1.0919
No log	3.9649	226	1.1497	0.3912	1.1497	1.0722
No log	4.0	228	1.1048	0.3889	1.1048	1.0511
No log	4.0351	230	1.1884	0.3939	1.1884	1.0901
No log	4.0702	232	1.3443	0.3328	1.3443	1.1594
No log	4.1053	234	1.3741	0.3342	1.3741	1.1722
No log	4.1404	236	1.2079	0.3617	1.2079	1.0991
No log	4.1754	238	0.9885	0.4298	0.9885	0.9942
No log	4.2105	240	0.8594	0.4591	0.8594	0.9270
No log	4.2456	242	0.8817	0.4402	0.8817	0.9390
No log	4.2807	244	0.9322	0.4244	0.9322	0.9655
No log	4.3158	246	1.1047	0.4399	1.1047	1.0510
No log	4.3509	248	1.2377	0.3881	1.2377	1.1125
No log	4.3860	250	1.2499	0.3904	1.2499	1.1180
No log	4.4211	252	1.2237	0.3960	1.2237	1.1062
No log	4.4561	254	1.1668	0.4133	1.1668	1.0802
No log	4.4912	256	1.0603	0.4162	1.0603	1.0297
No log	4.5263	258	0.9499	0.4409	0.9499	0.9746
No log	4.5614	260	0.9835	0.4440	0.9835	0.9917
No log	4.5965	262	1.1330	0.4183	1.1330	1.0644
No log	4.6316	264	1.4234	0.3713	1.4234	1.1931
No log	4.6667	266	1.6017	0.3235	1.6017	1.2656
No log	4.7018	268	1.6218	0.3243	1.6218	1.2735
No log	4.7368	270	1.4662	0.3694	1.4662	1.2109
No log	4.7719	272	1.2722	0.3940	1.2722	1.1279
No log	4.8070	274	1.2401	0.3975	1.2401	1.1136
No log	4.8421	276	1.2938	0.3940	1.2938	1.1374
No log	4.8772	278	1.4494	0.3784	1.4494	1.2039
No log	4.9123	280	1.7389	0.3395	1.7389	1.3187
No log	4.9474	282	1.8317	0.3078	1.8317	1.3534
No log	4.9825	284	1.6462	0.375	1.6462	1.2830
No log	5.0175	286	1.3481	0.4027	1.3481	1.1611
No log	5.0526	288	1.1808	0.4325	1.1808	1.0867
No log	5.0877	290	1.1388	0.4327	1.1388	1.0671
No log	5.1228	292	1.1701	0.4462	1.1701	1.0817
No log	5.1579	294	1.1474	0.4269	1.1474	1.0712
No log	5.1930	296	1.1820	0.4226	1.1820	1.0872
No log	5.2281	298	1.3011	0.3775	1.3011	1.1407
No log	5.2632	300	1.4090	0.3493	1.4090	1.1870
No log	5.2982	302	1.5205	0.3084	1.5205	1.2331
No log	5.3333	304	1.4588	0.3113	1.4588	1.2078
No log	5.3684	306	1.2465	0.3394	1.2465	1.1165
No log	5.4035	308	1.0553	0.4211	1.0553	1.0273
No log	5.4386	310	0.9946	0.4319	0.9946	0.9973
No log	5.4737	312	1.0315	0.4219	1.0315	1.0156
No log	5.5088	314	1.1687	0.4105	1.1687	1.0811
No log	5.5439	316	1.4063	0.3431	1.4063	1.1859
No log	5.5789	318	1.6580	0.3130	1.6580	1.2876
No log	5.6140	320	1.7006	0.2991	1.7006	1.3041
No log	5.6491	322	1.5727	0.3261	1.5727	1.2541
No log	5.6842	324	1.3298	0.3705	1.3298	1.1532
No log	5.7193	326	1.2129	0.3746	1.2129	1.1013
No log	5.7544	328	1.1784	0.3740	1.1784	1.0856
No log	5.7895	330	1.2605	0.3869	1.2605	1.1227
No log	5.8246	332	1.4184	0.3563	1.4184	1.1910
No log	5.8596	334	1.6027	0.3390	1.6027	1.2660
No log	5.8947	336	1.7471	0.3219	1.7471	1.3218
No log	5.9298	338	1.6482	0.3262	1.6482	1.2838
No log	5.9649	340	1.3881	0.3576	1.3881	1.1782
No log	6.0	342	1.1118	0.4127	1.1118	1.0544
No log	6.0351	344	0.9956	0.4427	0.9956	0.9978
No log	6.0702	346	0.9568	0.4267	0.9568	0.9782
No log	6.1053	348	0.9801	0.4453	0.9801	0.9900
No log	6.1404	350	1.0239	0.4012	1.0239	1.0119
No log	6.1754	352	1.0873	0.3932	1.0873	1.0427
No log	6.2105	354	1.1939	0.3614	1.1939	1.0926
No log	6.2456	356	1.2189	0.3620	1.2189	1.1040
No log	6.2807	358	1.2891	0.3752	1.2891	1.1354
No log	6.3158	360	1.2860	0.3902	1.2860	1.1340
No log	6.3509	362	1.1771	0.4311	1.1771	1.0849
No log	6.3860	364	1.0406	0.4129	1.0406	1.0201
No log	6.4211	366	1.0153	0.3842	1.0153	1.0076
No log	6.4561	368	1.0326	0.3888	1.0326	1.0162
No log	6.4912	370	1.1024	0.4345	1.1024	1.0500
No log	6.5263	372	1.2170	0.4295	1.2170	1.1032
No log	6.5614	374	1.3053	0.3929	1.3053	1.1425
No log	6.5965	376	1.3256	0.3924	1.3256	1.1513
No log	6.6316	378	1.2336	0.4223	1.2336	1.1107
No log	6.6667	380	1.1603	0.4097	1.1603	1.0772
No log	6.7018	382	1.1461	0.4031	1.1461	1.0706
No log	6.7368	384	1.1193	0.4186	1.1193	1.0580
No log	6.7719	386	1.1443	0.4311	1.1443	1.0697
No log	6.8070	388	1.2304	0.4133	1.2304	1.1092
No log	6.8421	390	1.3552	0.3543	1.3552	1.1641
No log	6.8772	392	1.3611	0.3454	1.3611	1.1667
No log	6.9123	394	1.3616	0.3448	1.3616	1.1669
No log	6.9474	396	1.2518	0.4133	1.2518	1.1189
No log	6.9825	398	1.1511	0.4511	1.1511	1.0729
No log	7.0175	400	1.0780	0.4513	1.0780	1.0383
No log	7.0526	402	0.9922	0.3990	0.9922	0.9961
No log	7.0877	404	0.9290	0.4581	0.9290	0.9638
No log	7.1228	406	0.9114	0.4584	0.9114	0.9547
No log	7.1579	408	0.9419	0.4368	0.9419	0.9705
No log	7.1930	410	1.0269	0.4394	1.0269	1.0133
No log	7.2281	412	1.1629	0.4279	1.1629	1.0784
No log	7.2632	414	1.2508	0.3979	1.2508	1.1184
No log	7.2982	416	1.2250	0.4077	1.2250	1.1068
No log	7.3333	418	1.1578	0.4217	1.1578	1.0760
No log	7.3684	420	1.0850	0.4264	1.0850	1.0416
No log	7.4035	422	1.0243	0.4090	1.0243	1.0121
No log	7.4386	424	1.0003	0.4088	1.0003	1.0002
No log	7.4737	426	1.0218	0.4088	1.0218	1.0109
No log	7.5088	428	1.0785	0.4266	1.0785	1.0385
No log	7.5439	430	1.1233	0.4310	1.1233	1.0598
No log	7.5789	432	1.1622	0.4309	1.1622	1.0780
No log	7.6140	434	1.1691	0.4410	1.1691	1.0813
No log	7.6491	436	1.1841	0.4307	1.1841	1.0881
No log	7.6842	438	1.2328	0.3958	1.2328	1.1103
No log	7.7193	440	1.2380	0.3999	1.2380	1.1126
No log	7.7544	442	1.1891	0.4036	1.1891	1.0905
No log	7.7895	444	1.0844	0.4218	1.0844	1.0414
No log	7.8246	446	1.0233	0.4264	1.0233	1.0116
No log	7.8596	448	0.9820	0.4329	0.9820	0.9910
No log	7.8947	450	0.9943	0.4329	0.9943	0.9971
No log	7.9298	452	1.0454	0.4311	1.0454	1.0224
No log	7.9649	454	1.1022	0.4156	1.1022	1.0498
No log	8.0	456	1.1325	0.4218	1.1325	1.0642
No log	8.0351	458	1.1210	0.4234	1.1210	1.0588
No log	8.0702	460	1.0876	0.4416	1.0876	1.0429
No log	8.1053	462	1.0634	0.4660	1.0634	1.0312
No log	8.1404	464	1.0811	0.4509	1.0811	1.0397
No log	8.1754	466	1.1085	0.4659	1.1085	1.0529
No log	8.2105	468	1.1502	0.4491	1.1502	1.0725
No log	8.2456	470	1.1870	0.4085	1.1870	1.0895
No log	8.2807	472	1.1817	0.4085	1.1817	1.0870
No log	8.3158	474	1.1659	0.4322	1.1659	1.0798
No log	8.3509	476	1.1583	0.4322	1.1583	1.0762
No log	8.3860	478	1.1427	0.4367	1.1427	1.0690
No log	8.4211	480	1.1350	0.4353	1.1350	1.0654
No log	8.4561	482	1.1025	0.4459	1.1025	1.0500
No log	8.4912	484	1.0936	0.4402	1.0936	1.0458
No log	8.5263	486	1.1150	0.4354	1.1150	1.0559
No log	8.5614	488	1.1525	0.4175	1.1525	1.0736
No log	8.5965	490	1.1607	0.4175	1.1607	1.0774
No log	8.6316	492	1.1667	0.4219	1.1667	1.0801
No log	8.6667	494	1.1602	0.4158	1.1602	1.0771
No log	8.7018	496	1.1366	0.4113	1.1366	1.0661
No log	8.7368	498	1.1200	0.4234	1.1200	1.0583
0.4275	8.7719	500	1.1144	0.4234	1.1144	1.0557
0.4275	8.8070	502	1.1293	0.4234	1.1293	1.0627
0.4275	8.8421	504	1.1319	0.4234	1.1319	1.0639
0.4275	8.8772	506	1.1550	0.4158	1.1550	1.0747
0.4275	8.9123	508	1.1549	0.4158	1.1549	1.0747
0.4275	8.9474	510	1.1471	0.4218	1.1471	1.0710
0.4275	8.9825	512	1.1651	0.4158	1.1651	1.0794
0.4275	9.0175	514	1.1738	0.4158	1.1738	1.0834
0.4275	9.0526	516	1.1586	0.4158	1.1586	1.0764
0.4275	9.0877	518	1.1235	0.4279	1.1235	1.0600
0.4275	9.1228	520	1.0873	0.4280	1.0873	1.0427
0.4275	9.1579	522	1.0480	0.4329	1.0480	1.0237
0.4275	9.1930	524	1.0204	0.4331	1.0204	1.0101
0.4275	9.2281	526	1.0080	0.4166	1.0080	1.0040
0.4275	9.2632	528	1.0135	0.4166	1.0135	1.0067
0.4275	9.2982	530	1.0331	0.4394	1.0331	1.0164
0.4275	9.3333	532	1.0659	0.4343	1.0659	1.0324
0.4275	9.3684	534	1.0980	0.4340	1.0980	1.0479
0.4275	9.4035	536	1.1213	0.4340	1.1213	1.0589
0.4275	9.4386	538	1.1508	0.4294	1.1508	1.0728
0.4275	9.4737	540	1.1836	0.4294	1.1836	1.0879
0.4275	9.5088	542	1.2164	0.3992	1.2164	1.1029
0.4275	9.5439	544	1.2294	0.3857	1.2294	1.1088
0.4275	9.5789	546	1.2271	0.3857	1.2271	1.1077
0.4275	9.6140	548	1.2185	0.3914	1.2185	1.1039
0.4275	9.6491	550	1.2100	0.3914	1.2100	1.1000
0.4275	9.6842	552	1.2057	0.3914	1.2057	1.0980
0.4275	9.7193	554	1.2057	0.3914	1.2057	1.0980
0.4275	9.7544	556	1.2041	0.3914	1.2041	1.0973
0.4275	9.7895	558	1.2030	0.3914	1.2030	1.0968
0.4275	9.8246	560	1.1984	0.395	1.1984	1.0947
0.4275	9.8596	562	1.1927	0.4294	1.1927	1.0921
0.4275	9.8947	564	1.1893	0.4294	1.1893	1.0905
0.4275	9.9298	566	1.1854	0.4294	1.1854	1.0888
0.4275	9.9649	568	1.1836	0.4294	1.1836	1.0879
0.4275	10.0	570	1.1831	0.4294	1.1831	1.0877

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1