ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2443
• Qwk: 0.3251
• Mse: 1.2443
• Rmse: 1.1155

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	3.9014	-0.0151	3.9014	1.9752
No log	0.0769	4	2.0314	0.0121	2.0314	1.4253
No log	0.1154	6	1.0215	0.0666	1.0215	1.0107
No log	0.1538	8	0.7889	0.0767	0.7889	0.8882
No log	0.1923	10	0.7475	0.0094	0.7475	0.8646
No log	0.2308	12	0.7127	0.2379	0.7127	0.8442
No log	0.2692	14	0.7340	0.1101	0.7340	0.8567
No log	0.3077	16	0.8301	0.0670	0.8301	0.9111
No log	0.3462	18	0.8702	0.1092	0.8702	0.9328
No log	0.3846	20	0.8498	0.1493	0.8498	0.9219
No log	0.4231	22	0.8671	0.1793	0.8671	0.9312
No log	0.4615	24	0.8913	0.2333	0.8913	0.9441
No log	0.5	26	0.8341	0.1673	0.8341	0.9133
No log	0.5385	28	1.0228	-0.1002	1.0228	1.0113
No log	0.5769	30	1.2091	-0.0317	1.2091	1.0996
No log	0.6154	32	0.8769	0.0686	0.8769	0.9364
No log	0.6538	34	0.6758	0.1936	0.6758	0.8221
No log	0.6923	36	0.7131	0.1518	0.7131	0.8445
No log	0.7308	38	0.7876	0.2313	0.7876	0.8875
No log	0.7692	40	0.7642	0.2401	0.7642	0.8742
No log	0.8077	42	0.6559	0.1737	0.6559	0.8099
No log	0.8462	44	0.6280	0.3087	0.6280	0.7925
No log	0.8846	46	0.6219	0.2069	0.6219	0.7886
No log	0.9231	48	0.6236	0.3039	0.6236	0.7897
No log	0.9615	50	0.6286	0.4007	0.6286	0.7928
No log	1.0	52	0.6474	0.3933	0.6474	0.8046
No log	1.0385	54	0.7724	0.3191	0.7724	0.8788
No log	1.0769	56	1.0259	0.2536	1.0259	1.0129
No log	1.1154	58	1.4162	0.2073	1.4162	1.1900
No log	1.1538	60	1.4330	0.1557	1.4330	1.1971
No log	1.1923	62	1.0582	0.2980	1.0582	1.0287
No log	1.2308	64	0.7409	0.4190	0.7409	0.8607
No log	1.2692	66	0.6898	0.3741	0.6898	0.8306
No log	1.3077	68	0.6570	0.4065	0.6570	0.8105
No log	1.3462	70	0.6931	0.4476	0.6931	0.8325
No log	1.3846	72	0.9825	0.3146	0.9825	0.9912
No log	1.4231	74	1.4660	0.2169	1.4660	1.2108
No log	1.4615	76	1.4740	0.1706	1.4740	1.2141
No log	1.5	78	1.3392	0.2029	1.3392	1.1572
No log	1.5385	80	1.2310	0.2484	1.2310	1.1095
No log	1.5769	82	1.1718	0.2342	1.1718	1.0825
No log	1.6154	84	1.2935	0.2176	1.2935	1.1373
No log	1.6538	86	1.2758	0.2505	1.2758	1.1295
No log	1.6923	88	1.0822	0.2346	1.0822	1.0403
No log	1.7308	90	0.9167	0.3664	0.9167	0.9575
No log	1.7692	92	0.9125	0.3820	0.9125	0.9553
No log	1.8077	94	0.9291	0.3881	0.9291	0.9639
No log	1.8462	96	0.9089	0.4263	0.9089	0.9534
No log	1.8846	98	1.1530	0.3066	1.1530	1.0738
No log	1.9231	100	1.2490	0.3172	1.2490	1.1176
No log	1.9615	102	1.0878	0.3515	1.0878	1.0430
No log	2.0	104	0.8135	0.4056	0.8135	0.9020
No log	2.0385	106	0.7838	0.4482	0.7838	0.8853
No log	2.0769	108	0.9663	0.3831	0.9663	0.9830
No log	2.1154	110	1.0367	0.3876	1.0367	1.0182
No log	2.1538	112	1.1267	0.3777	1.1267	1.0615
No log	2.1923	114	1.0516	0.4031	1.0516	1.0255
No log	2.2308	116	0.9275	0.4302	0.9275	0.9631
No log	2.2692	118	1.0171	0.4138	1.0171	1.0085
No log	2.3077	120	1.2619	0.3653	1.2619	1.1234
No log	2.3462	122	1.2373	0.3729	1.2373	1.1123
No log	2.3846	124	1.1838	0.3751	1.1838	1.0880
No log	2.4231	126	0.9942	0.3844	0.9942	0.9971
No log	2.4615	128	0.9226	0.4187	0.9226	0.9605
No log	2.5	130	1.0775	0.3525	1.0775	1.0380
No log	2.5385	132	1.5032	0.3141	1.5032	1.2261
No log	2.5769	134	1.8470	0.2695	1.8470	1.3591
No log	2.6154	136	1.7544	0.2860	1.7544	1.3245
No log	2.6538	138	1.3168	0.3023	1.3168	1.1475
No log	2.6923	140	0.9457	0.3646	0.9457	0.9725
No log	2.7308	142	0.7667	0.4078	0.7667	0.8756
No log	2.7692	144	0.8298	0.4022	0.8298	0.9110
No log	2.8077	146	1.1430	0.3455	1.1430	1.0691
No log	2.8462	148	1.6343	0.2711	1.6343	1.2784
No log	2.8846	150	1.7090	0.2667	1.7090	1.3073
No log	2.9231	152	1.4449	0.3488	1.4449	1.2020
No log	2.9615	154	1.2486	0.3652	1.2486	1.1174
No log	3.0	156	1.2245	0.3622	1.2245	1.1066
No log	3.0385	158	1.4882	0.3395	1.4882	1.2199
No log	3.0769	160	1.7435	0.3323	1.7435	1.3204
No log	3.1154	162	1.8459	0.2849	1.8459	1.3586
No log	3.1538	164	1.7100	0.3289	1.7100	1.3077
No log	3.1923	166	1.5652	0.3361	1.5652	1.2511
No log	3.2308	168	1.4616	0.3327	1.4616	1.2090
No log	3.2692	170	1.1350	0.3225	1.1350	1.0654
No log	3.3077	172	1.1120	0.3387	1.1120	1.0545
No log	3.3462	174	1.2754	0.3047	1.2754	1.1293
No log	3.3846	176	1.3482	0.3162	1.3482	1.1611
No log	3.4231	178	1.3471	0.3425	1.3471	1.1606
No log	3.4615	180	1.2488	0.3129	1.2488	1.1175
No log	3.5	182	1.2553	0.3186	1.2553	1.1204
No log	3.5385	184	1.3288	0.3174	1.3288	1.1527
No log	3.5769	186	1.2347	0.3220	1.2347	1.1112
No log	3.6154	188	1.0912	0.3406	1.0912	1.0446
No log	3.6538	190	1.0026	0.4202	1.0026	1.0013
No log	3.6923	192	1.0518	0.4054	1.0518	1.0256
No log	3.7308	194	1.2247	0.3116	1.2247	1.1066
No log	3.7692	196	1.5726	0.2979	1.5726	1.2541
No log	3.8077	198	1.5472	0.3086	1.5472	1.2439
No log	3.8462	200	1.2811	0.3247	1.2811	1.1319
No log	3.8846	202	1.0296	0.3920	1.0296	1.0147
No log	3.9231	204	0.9167	0.4685	0.9167	0.9574
No log	3.9615	206	0.9538	0.4220	0.9538	0.9766
No log	4.0	208	1.0760	0.3823	1.0760	1.0373
No log	4.0385	210	1.2437	0.3595	1.2437	1.1152
No log	4.0769	212	1.2566	0.3316	1.2566	1.1210
No log	4.1154	214	1.3393	0.3184	1.3393	1.1573
No log	4.1538	216	1.3559	0.3126	1.3559	1.1644
No log	4.1923	218	1.2528	0.3188	1.2528	1.1193
No log	4.2308	220	1.1859	0.3182	1.1859	1.0890
No log	4.2692	222	1.2732	0.3210	1.2732	1.1284
No log	4.3077	224	1.2146	0.3382	1.2146	1.1021
No log	4.3462	226	1.1295	0.3408	1.1295	1.0628
No log	4.3846	228	0.9956	0.3737	0.9956	0.9978
No log	4.4231	230	0.9102	0.4449	0.9102	0.9541
No log	4.4615	232	1.0127	0.3648	1.0127	1.0063
No log	4.5	234	1.2270	0.3197	1.2270	1.1077
No log	4.5385	236	1.2635	0.3206	1.2635	1.1241
No log	4.5769	238	1.1405	0.3682	1.1405	1.0679
No log	4.6154	240	0.9958	0.4419	0.9958	0.9979
No log	4.6538	242	0.9936	0.4601	0.9936	0.9968
No log	4.6923	244	0.9227	0.4437	0.9227	0.9606
No log	4.7308	246	0.9422	0.4395	0.9422	0.9707
No log	4.7692	248	1.0223	0.4319	1.0223	1.0111
No log	4.8077	250	1.1601	0.3640	1.1601	1.0771
No log	4.8462	252	1.1460	0.3579	1.1460	1.0705
No log	4.8846	254	1.2080	0.3605	1.2080	1.0991
No log	4.9231	256	1.1427	0.3495	1.1427	1.0690
No log	4.9615	258	0.9584	0.3778	0.9584	0.9790
No log	5.0	260	0.8964	0.3683	0.8964	0.9468
No log	5.0385	262	0.9723	0.3359	0.9723	0.9861
No log	5.0769	264	0.9805	0.3508	0.9805	0.9902
No log	5.1154	266	0.9494	0.3775	0.9494	0.9744
No log	5.1538	268	0.8979	0.3549	0.8979	0.9476
No log	5.1923	270	0.9301	0.3830	0.9301	0.9644
No log	5.2308	272	1.0705	0.3434	1.0705	1.0346
No log	5.2692	274	1.3167	0.3269	1.3167	1.1475
No log	5.3077	276	1.4421	0.3181	1.4421	1.2009
No log	5.3462	278	1.5088	0.3153	1.5088	1.2283
No log	5.3846	280	1.3848	0.3166	1.3848	1.1768
No log	5.4231	282	1.2199	0.3199	1.2199	1.1045
No log	5.4615	284	1.1854	0.3283	1.1854	1.0887
No log	5.5	286	1.1214	0.3140	1.1214	1.0590
No log	5.5385	288	1.1452	0.2957	1.1452	1.0701
No log	5.5769	290	1.3101	0.3229	1.3101	1.1446
No log	5.6154	292	1.4909	0.3261	1.4909	1.2210
No log	5.6538	294	1.4437	0.3238	1.4437	1.2016
No log	5.6923	296	1.2538	0.2954	1.2538	1.1197
No log	5.7308	298	1.1890	0.2906	1.1890	1.0904
No log	5.7692	300	1.1006	0.3155	1.1006	1.0491
No log	5.8077	302	1.0385	0.3766	1.0385	1.0191
No log	5.8462	304	0.9935	0.3891	0.9935	0.9967
No log	5.8846	306	1.0841	0.3356	1.0841	1.0412
No log	5.9231	308	1.2952	0.3093	1.2952	1.1381
No log	5.9615	310	1.4571	0.3287	1.4571	1.2071
No log	6.0	312	1.5159	0.3219	1.5159	1.2312
No log	6.0385	314	1.4125	0.3287	1.4125	1.1885
No log	6.0769	316	1.2435	0.3111	1.2435	1.1151
No log	6.1154	318	1.1661	0.3207	1.1661	1.0799
No log	6.1538	320	1.1916	0.3207	1.1916	1.0916
No log	6.1923	322	1.2511	0.3278	1.2511	1.1185
No log	6.2308	324	1.3399	0.3212	1.3399	1.1576
No log	6.2692	326	1.3432	0.3287	1.3432	1.1590
No log	6.3077	328	1.2803	0.3184	1.2803	1.1315
No log	6.3462	330	1.1669	0.3254	1.1669	1.0802
No log	6.3846	332	1.0255	0.3663	1.0255	1.0126
No log	6.4231	334	0.9797	0.4076	0.9797	0.9898
No log	6.4615	336	1.0255	0.3845	1.0255	1.0127
No log	6.5	338	1.1406	0.3128	1.1406	1.0680
No log	6.5385	340	1.2490	0.3416	1.2490	1.1176
No log	6.5769	342	1.3640	0.3287	1.3640	1.1679
No log	6.6154	344	1.3918	0.3287	1.3918	1.1797
No log	6.6538	346	1.3116	0.3320	1.3116	1.1452
No log	6.6923	348	1.2815	0.3161	1.2814	1.1320
No log	6.7308	350	1.2255	0.3235	1.2255	1.1070
No log	6.7692	352	1.1631	0.3042	1.1631	1.0785
No log	6.8077	354	1.1798	0.3087	1.1798	1.0862
No log	6.8462	356	1.1810	0.3002	1.1810	1.0868
No log	6.8846	358	1.2042	0.3153	1.2042	1.0974
No log	6.9231	360	1.2975	0.3346	1.2975	1.1391
No log	6.9615	362	1.3476	0.3189	1.3476	1.1609
No log	7.0	364	1.2897	0.3281	1.2897	1.1357
No log	7.0385	366	1.1949	0.3300	1.1949	1.0931
No log	7.0769	368	1.1843	0.3505	1.1843	1.0883
No log	7.1154	370	1.2550	0.3263	1.2550	1.1203
No log	7.1538	372	1.3894	0.3273	1.3894	1.1787
No log	7.1923	374	1.4451	0.3444	1.4451	1.2021
No log	7.2308	376	1.3999	0.3378	1.3999	1.1832
No log	7.2692	378	1.3797	0.3440	1.3797	1.1746
No log	7.3077	380	1.3790	0.3436	1.3790	1.1743
No log	7.3462	382	1.3007	0.3429	1.3007	1.1405
No log	7.3846	384	1.2159	0.3245	1.2159	1.1027
No log	7.4231	386	1.1997	0.3146	1.1997	1.0953
No log	7.4615	388	1.1700	0.3167	1.1700	1.0817
No log	7.5	390	1.1491	0.3303	1.1491	1.0719
No log	7.5385	392	1.1338	0.3725	1.1338	1.0648
No log	7.5769	394	1.1758	0.3474	1.1758	1.0843
No log	7.6154	396	1.1944	0.3397	1.1944	1.0929
No log	7.6538	398	1.1655	0.3681	1.1655	1.0796
No log	7.6923	400	1.1776	0.3578	1.1776	1.0852
No log	7.7308	402	1.2266	0.3377	1.2266	1.1075
No log	7.7692	404	1.2139	0.3377	1.2139	1.1018
No log	7.8077	406	1.2033	0.3377	1.2033	1.0970
No log	7.8462	408	1.1473	0.3745	1.1473	1.0711
No log	7.8846	410	1.1178	0.3602	1.1178	1.0573
No log	7.9231	412	1.1006	0.3602	1.1006	1.0491
No log	7.9615	414	1.0859	0.3776	1.0859	1.0421
No log	8.0	416	1.0791	0.4014	1.0791	1.0388
No log	8.0385	418	1.0517	0.3935	1.0517	1.0255
No log	8.0769	420	1.0258	0.3999	1.0258	1.0128
No log	8.1154	422	1.0474	0.3935	1.0474	1.0234
No log	8.1538	424	1.1139	0.3781	1.1139	1.0554
No log	8.1923	426	1.1762	0.3484	1.1762	1.0845
No log	8.2308	428	1.2490	0.3408	1.2490	1.1176
No log	8.2692	430	1.2854	0.3238	1.2854	1.1337
No log	8.3077	432	1.2601	0.3408	1.2601	1.1225
No log	8.3462	434	1.1950	0.3377	1.1950	1.0931
No log	8.3846	436	1.1709	0.3647	1.1709	1.0821
No log	8.4231	438	1.1700	0.3584	1.1700	1.0817
No log	8.4615	440	1.1678	0.3647	1.1678	1.0806
No log	8.5	442	1.2037	0.3377	1.2037	1.0971
No log	8.5385	444	1.2438	0.3421	1.2438	1.1153
No log	8.5769	446	1.2950	0.3238	1.2950	1.1380
No log	8.6154	448	1.3100	0.3238	1.3100	1.1445
No log	8.6538	450	1.2776	0.3297	1.2776	1.1303
No log	8.6923	452	1.2571	0.3400	1.2571	1.1212
No log	8.7308	454	1.2306	0.3349	1.2306	1.1093
No log	8.7692	456	1.2002	0.3602	1.2002	1.0955
No log	8.8077	458	1.2030	0.3602	1.2030	1.0968
No log	8.8462	460	1.2085	0.3570	1.2085	1.0993
No log	8.8846	462	1.1959	0.3602	1.1959	1.0936
No log	8.9231	464	1.1971	0.3539	1.1971	1.0941
No log	8.9615	466	1.1994	0.3539	1.1994	1.0952
No log	9.0	468	1.2037	0.3539	1.2037	1.0971
No log	9.0385	470	1.2019	0.3539	1.2019	1.0963
No log	9.0769	472	1.2150	0.3539	1.2150	1.1023
No log	9.1154	474	1.2306	0.3584	1.2306	1.1093
No log	9.1538	476	1.2320	0.3539	1.2320	1.1100
No log	9.1923	478	1.2335	0.3539	1.2335	1.1106
No log	9.2308	480	1.2183	0.3539	1.2183	1.1038
No log	9.2692	482	1.2247	0.3539	1.2247	1.1067
No log	9.3077	484	1.2366	0.3333	1.2366	1.1120
No log	9.3462	486	1.2433	0.3333	1.2433	1.1151
No log	9.3846	488	1.2308	0.3333	1.2308	1.1094
No log	9.4231	490	1.2224	0.3539	1.2224	1.1056
No log	9.4615	492	1.2335	0.3314	1.2335	1.1106
No log	9.5	494	1.2473	0.3314	1.2473	1.1168
No log	9.5385	496	1.2692	0.3235	1.2692	1.1266
No log	9.5769	498	1.2924	0.3151	1.2924	1.1369
0.4838	9.6154	500	1.3041	0.3129	1.3041	1.1420
0.4838	9.6538	502	1.3026	0.3129	1.3026	1.1413
0.4838	9.6923	504	1.3030	0.3151	1.3030	1.1415
0.4838	9.7308	506	1.2959	0.3151	1.2959	1.1384
0.4838	9.7692	508	1.2839	0.3070	1.2839	1.1331
0.4838	9.8077	510	1.2676	0.3235	1.2676	1.1259
0.4838	9.8462	512	1.2569	0.3251	1.2569	1.1211
0.4838	9.8846	514	1.2511	0.3251	1.2511	1.1185
0.4838	9.9231	516	1.2468	0.3251	1.2468	1.1166
0.4838	9.9615	518	1.2454	0.3251	1.2454	1.1160
0.4838	10.0	520	1.2443	0.3251	1.2443	1.1155

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1