ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3147
• Qwk: 0.2965
• Mse: 1.3147
• Rmse: 1.1466

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	4.5954	0.0010	4.5954	2.1437
No log	0.4	4	2.8099	0.0012	2.8099	1.6763
No log	0.6	6	2.0661	-0.0303	2.0661	1.4374
No log	0.8	8	1.7409	0.0062	1.7409	1.3194
No log	1.0	10	1.8175	-0.0080	1.8175	1.3481
No log	1.2	12	1.7064	0.0303	1.7064	1.3063
No log	1.4	14	1.3657	0.1675	1.3657	1.1686
No log	1.6	16	1.2011	0.1975	1.2011	1.0959
No log	1.8	18	1.1850	0.2276	1.1850	1.0886
No log	2.0	20	1.2787	0.1821	1.2787	1.1308
No log	2.2	22	1.5136	0.0603	1.5136	1.2303
No log	2.4	24	1.6296	0.0862	1.6296	1.2766
No log	2.6	26	1.7732	0.1271	1.7732	1.3316
No log	2.8	28	1.7685	0.1316	1.7685	1.3298
No log	3.0	30	1.5539	0.1020	1.5539	1.2466
No log	3.2	32	1.3797	0.2191	1.3797	1.1746
No log	3.4	34	1.1868	0.1880	1.1868	1.0894
No log	3.6	36	1.1794	0.1785	1.1794	1.0860
No log	3.8	38	1.2727	0.2585	1.2727	1.1281
No log	4.0	40	1.4034	0.2239	1.4034	1.1846
No log	4.2	42	1.6863	0.0727	1.6863	1.2986
No log	4.4	44	2.1034	0.1243	2.1034	1.4503
No log	4.6	46	2.1429	0.1168	2.1429	1.4639
No log	4.8	48	2.0011	0.1687	2.0011	1.4146
No log	5.0	50	1.5590	0.2453	1.5590	1.2486
No log	5.2	52	1.2866	0.2647	1.2866	1.1343
No log	5.4	54	1.2205	0.3111	1.2205	1.1047
No log	5.6	56	1.3734	0.2430	1.3734	1.1719
No log	5.8	58	1.4623	0.2624	1.4623	1.2092
No log	6.0	60	1.4182	0.2430	1.4182	1.1909
No log	6.2	62	1.3052	0.2941	1.3052	1.1424
No log	6.4	64	1.3072	0.2857	1.3072	1.1433
No log	6.6	66	1.2590	0.3293	1.2590	1.1220
No log	6.8	68	1.1111	0.3546	1.1111	1.0541
No log	7.0	70	1.0246	0.3902	1.0246	1.0122
No log	7.2	72	1.0187	0.4197	1.0187	1.0093
No log	7.4	74	1.0599	0.3985	1.0599	1.0295
No log	7.6	76	1.2013	0.3916	1.2013	1.0960
No log	7.8	78	1.1865	0.3631	1.1865	1.0893
No log	8.0	80	1.0590	0.3805	1.0590	1.0291
No log	8.2	82	1.0105	0.3756	1.0105	1.0053
No log	8.4	84	1.0620	0.3126	1.0620	1.0305
No log	8.6	86	1.0726	0.3719	1.0726	1.0356
No log	8.8	88	1.2541	0.3309	1.2541	1.1199
No log	9.0	90	1.7214	0.2834	1.7214	1.3120
No log	9.2	92	1.5909	0.3103	1.5909	1.2613
No log	9.4	94	1.1745	0.3087	1.1745	1.0838
No log	9.6	96	1.1274	0.2919	1.1274	1.0618
No log	9.8	98	1.1074	0.3165	1.1074	1.0523
No log	10.0	100	1.2270	0.3111	1.2270	1.1077
No log	10.2	102	1.5579	0.2350	1.5579	1.2481
No log	10.4	104	1.7315	0.2375	1.7315	1.3159
No log	10.6	106	1.5482	0.2213	1.5482	1.2443
No log	10.8	108	1.3697	0.1929	1.3697	1.1703
No log	11.0	110	1.5433	0.1741	1.5433	1.2423
No log	11.2	112	1.8165	0.1795	1.8165	1.3478
No log	11.4	114	1.8745	0.1728	1.8745	1.3691
No log	11.6	116	1.7210	0.1717	1.7210	1.3119
No log	11.8	118	1.4519	0.2350	1.4519	1.2049
No log	12.0	120	1.3439	0.2498	1.3439	1.1593
No log	12.2	122	1.1330	0.2891	1.1330	1.0644
No log	12.4	124	1.0672	0.4036	1.0672	1.0331
No log	12.6	126	1.1390	0.3173	1.1390	1.0672
No log	12.8	128	1.3152	0.2899	1.3152	1.1468
No log	13.0	130	1.5892	0.2430	1.5892	1.2606
No log	13.2	132	1.5094	0.2253	1.5094	1.2286
No log	13.4	134	1.3576	0.2401	1.3576	1.1652
No log	13.6	136	1.2572	0.2751	1.2572	1.1213
No log	13.8	138	1.1538	0.3835	1.1538	1.0742
No log	14.0	140	1.2953	0.3434	1.2953	1.1381
No log	14.2	142	1.3875	0.3387	1.3875	1.1779
No log	14.4	144	1.5471	0.2679	1.5471	1.2438
No log	14.6	146	1.5825	0.2622	1.5825	1.2580
No log	14.8	148	1.4571	0.2462	1.4571	1.2071
No log	15.0	150	1.3507	0.2229	1.3507	1.1622
No log	15.2	152	1.4106	0.2230	1.4106	1.1877
No log	15.4	154	1.4617	0.1886	1.4617	1.2090
No log	15.6	156	1.5379	0.1766	1.5379	1.2401
No log	15.8	158	1.8535	0.1502	1.8535	1.3614
No log	16.0	160	1.8846	0.1607	1.8846	1.3728
No log	16.2	162	1.7447	0.1594	1.7447	1.3209
No log	16.4	164	1.4816	0.1485	1.4816	1.2172
No log	16.6	166	1.2582	0.1702	1.2582	1.1217
No log	16.8	168	1.2338	0.1839	1.2338	1.1108
No log	17.0	170	1.4789	0.2523	1.4789	1.2161
No log	17.2	172	2.0106	0.2079	2.0106	1.4179
No log	17.4	174	2.4037	0.0822	2.4037	1.5504
No log	17.6	176	2.2008	0.1770	2.2008	1.4835
No log	17.8	178	1.8839	0.2404	1.8839	1.3726
No log	18.0	180	1.6091	0.1954	1.6091	1.2685
No log	18.2	182	1.5827	0.2068	1.5827	1.2581
No log	18.4	184	1.6341	0.2325	1.6341	1.2783
No log	18.6	186	1.4289	0.2639	1.4289	1.1954
No log	18.8	188	1.2804	0.2962	1.2804	1.1315
No log	19.0	190	1.1897	0.3074	1.1897	1.0907
No log	19.2	192	1.2526	0.2985	1.2526	1.1192
No log	19.4	194	1.3724	0.3180	1.3724	1.1715
No log	19.6	196	1.5545	0.2625	1.5545	1.2468
No log	19.8	198	1.8080	0.2464	1.8080	1.3446
No log	20.0	200	2.0367	0.1626	2.0367	1.4271
No log	20.2	202	1.9100	0.1866	1.9100	1.3820
No log	20.4	204	1.6659	0.3047	1.6659	1.2907
No log	20.6	206	1.4305	0.3451	1.4305	1.1960
No log	20.8	208	1.2428	0.3179	1.2428	1.1148
No log	21.0	210	1.1722	0.2219	1.1722	1.0827
No log	21.2	212	1.2229	0.2131	1.2229	1.1058
No log	21.4	214	1.2503	0.2131	1.2503	1.1182
No log	21.6	216	1.3370	0.2964	1.3370	1.1563
No log	21.8	218	1.3982	0.3347	1.3982	1.1824
No log	22.0	220	1.4553	0.3184	1.4553	1.2064
No log	22.2	222	1.4992	0.2495	1.4992	1.2244
No log	22.4	224	1.5281	0.2258	1.5281	1.2362
No log	22.6	226	1.6660	0.1847	1.6660	1.2908
No log	22.8	228	1.7623	0.1830	1.7623	1.3275
No log	23.0	230	1.8733	0.1782	1.8733	1.3687
No log	23.2	232	1.8388	0.1915	1.8388	1.3560
No log	23.4	234	1.5437	0.2897	1.5437	1.2424
No log	23.6	236	1.3215	0.3309	1.3215	1.1496
No log	23.8	238	1.2074	0.2985	1.2074	1.0988
No log	24.0	240	1.2077	0.2985	1.2077	1.0990
No log	24.2	242	1.2419	0.3045	1.2419	1.1144
No log	24.4	244	1.3130	0.3163	1.3130	1.1459
No log	24.6	246	1.3485	0.3139	1.3485	1.1612
No log	24.8	248	1.4538	0.3487	1.4538	1.2058
No log	25.0	250	1.4661	0.3487	1.4661	1.2108
No log	25.2	252	1.5538	0.3490	1.5538	1.2465
No log	25.4	254	1.3957	0.3038	1.3957	1.1814
No log	25.6	256	1.2015	0.3026	1.2015	1.0961
No log	25.8	258	1.1064	0.3189	1.1064	1.0519
No log	26.0	260	1.1139	0.3306	1.1139	1.0554
No log	26.2	262	1.2771	0.3163	1.2771	1.1301
No log	26.4	264	1.5547	0.3276	1.5547	1.2469
No log	26.6	266	1.6912	0.3062	1.6912	1.3005
No log	26.8	268	1.6423	0.2900	1.6423	1.2815
No log	27.0	270	1.4416	0.3300	1.4416	1.2007
No log	27.2	272	1.2564	0.3719	1.2564	1.1209
No log	27.4	274	1.1386	0.3424	1.1386	1.0671
No log	27.6	276	1.1274	0.3475	1.1274	1.0618
No log	27.8	278	1.1541	0.3917	1.1541	1.0743
No log	28.0	280	1.1950	0.3548	1.1950	1.0931
No log	28.2	282	1.2567	0.3831	1.2567	1.1210
No log	28.4	284	1.3532	0.3613	1.3532	1.1633
No log	28.6	286	1.3416	0.3433	1.3416	1.1583
No log	28.8	288	1.3434	0.3278	1.3434	1.1591
No log	29.0	290	1.2744	0.3398	1.2744	1.1289
No log	29.2	292	1.3235	0.3493	1.3235	1.1504
No log	29.4	294	1.3560	0.3604	1.3560	1.1645
No log	29.6	296	1.4330	0.3646	1.4330	1.1971
No log	29.8	298	1.4028	0.3387	1.4028	1.1844
No log	30.0	300	1.3153	0.3752	1.3153	1.1469
No log	30.2	302	1.2170	0.3719	1.2170	1.1032
No log	30.4	304	1.1395	0.3715	1.1395	1.0675
No log	30.6	306	1.1129	0.3424	1.1129	1.0549
No log	30.8	308	1.1844	0.3757	1.1844	1.0883
No log	31.0	310	1.3209	0.3752	1.3209	1.1493
No log	31.2	312	1.4277	0.3477	1.4277	1.1949
No log	31.4	314	1.4134	0.3477	1.4134	1.1889
No log	31.6	316	1.3865	0.3604	1.3865	1.1775
No log	31.8	318	1.3510	0.3604	1.3510	1.1623
No log	32.0	320	1.3341	0.3493	1.3341	1.1550
No log	32.2	322	1.3397	0.3192	1.3397	1.1575
No log	32.4	324	1.4003	0.3228	1.4003	1.1833
No log	32.6	326	1.4335	0.3228	1.4335	1.1973
No log	32.8	328	1.5656	0.3129	1.5656	1.2513
No log	33.0	330	1.6129	0.3103	1.6129	1.2700
No log	33.2	332	1.4711	0.3482	1.4711	1.2129
No log	33.4	334	1.3626	0.3121	1.3626	1.1673
No log	33.6	336	1.4105	0.3238	1.4105	1.1877
No log	33.8	338	1.5322	0.3135	1.5322	1.2378
No log	34.0	340	1.6190	0.2842	1.6190	1.2724
No log	34.2	342	1.7711	0.2474	1.7711	1.3308
No log	34.4	344	1.8823	0.1720	1.8823	1.3720
No log	34.6	346	1.7273	0.2800	1.7273	1.3143
No log	34.8	348	1.4974	0.3340	1.4974	1.2237
No log	35.0	350	1.3509	0.2983	1.3509	1.1623
No log	35.2	352	1.3361	0.3042	1.3361	1.1559
No log	35.4	354	1.3045	0.3290	1.3045	1.1421
No log	35.6	356	1.2836	0.3434	1.2836	1.1330
No log	35.8	358	1.2349	0.3434	1.2349	1.1112
No log	36.0	360	1.1357	0.3792	1.1357	1.0657
No log	36.2	362	1.0770	0.3755	1.0770	1.0378
No log	36.4	364	1.0426	0.3708	1.0426	1.0211
No log	36.6	366	1.0931	0.3521	1.0931	1.0455
No log	36.8	368	1.2084	0.3752	1.2084	1.0993
No log	37.0	370	1.3060	0.3613	1.3060	1.1428
No log	37.2	372	1.2670	0.3527	1.2670	1.1256
No log	37.4	374	1.2128	0.3711	1.2128	1.1013
No log	37.6	376	1.2370	0.3711	1.2370	1.1122
No log	37.8	378	1.2207	0.3711	1.2207	1.1049
No log	38.0	380	1.2426	0.3630	1.2426	1.1147
No log	38.2	382	1.2108	0.4071	1.2108	1.1004
No log	38.4	384	1.1611	0.3805	1.1611	1.0775
No log	38.6	386	1.1222	0.4008	1.1222	1.0593
No log	38.8	388	1.1077	0.3696	1.1077	1.0525
No log	39.0	390	1.1272	0.3730	1.1272	1.0617
No log	39.2	392	1.1885	0.3879	1.1885	1.0902
No log	39.4	394	1.1828	0.3570	1.1828	1.0876
No log	39.6	396	1.1844	0.3523	1.1844	1.0883
No log	39.8	398	1.1466	0.3215	1.1466	1.0708
No log	40.0	400	1.1879	0.3798	1.1879	1.0899
No log	40.2	402	1.3038	0.4059	1.3038	1.1419
No log	40.4	404	1.3690	0.3692	1.3690	1.1700
No log	40.6	406	1.3023	0.3832	1.3023	1.1412
No log	40.8	408	1.2215	0.3392	1.2215	1.1052
No log	41.0	410	1.1384	0.3193	1.1384	1.0669
No log	41.2	412	1.1092	0.2968	1.1092	1.0532
No log	41.4	414	1.1292	0.3070	1.1292	1.0626
No log	41.6	416	1.2071	0.3125	1.2071	1.0987
No log	41.8	418	1.3909	0.3228	1.3909	1.1794
No log	42.0	420	1.5105	0.3689	1.5105	1.2290
No log	42.2	422	1.5334	0.3689	1.5334	1.2383
No log	42.4	424	1.4992	0.3729	1.4992	1.2244
No log	42.6	426	1.5226	0.3198	1.5226	1.2339
No log	42.8	428	1.4693	0.3204	1.4693	1.2122
No log	43.0	430	1.4078	0.3228	1.4078	1.1865
No log	43.2	432	1.3573	0.2983	1.3573	1.1650
No log	43.4	434	1.2856	0.3163	1.2856	1.1338
No log	43.6	436	1.2738	0.3548	1.2738	1.1286
No log	43.8	438	1.3898	0.2889	1.3898	1.1789
No log	44.0	440	1.4240	0.3180	1.4240	1.1933
No log	44.2	442	1.3880	0.3253	1.3880	1.1781
No log	44.4	444	1.2841	0.3548	1.2841	1.1332
No log	44.6	446	1.1571	0.3392	1.1571	1.0757
No log	44.8	448	1.0539	0.3413	1.0539	1.0266
No log	45.0	450	0.9883	0.4841	0.9883	0.9941
No log	45.2	452	0.9770	0.4933	0.9770	0.9884
No log	45.4	454	0.9960	0.3918	0.9960	0.9980
No log	45.6	456	1.0677	0.3437	1.0677	1.0333
No log	45.8	458	1.1923	0.3798	1.1923	1.0919
No log	46.0	460	1.2922	0.3580	1.2922	1.1368
No log	46.2	462	1.3499	0.3580	1.3499	1.1619
No log	46.4	464	1.3633	0.3412	1.3633	1.1676
No log	46.6	466	1.3398	0.3318	1.3398	1.1575
No log	46.8	468	1.3506	0.3269	1.3506	1.1621
No log	47.0	470	1.3709	0.3353	1.3709	1.1709
No log	47.2	472	1.3911	0.3253	1.3911	1.1795
No log	47.4	474	1.3907	0.3253	1.3907	1.1793
No log	47.6	476	1.3572	0.3098	1.3572	1.1650
No log	47.8	478	1.2862	0.3548	1.2862	1.1341
No log	48.0	480	1.2536	0.3548	1.2536	1.1197
No log	48.2	482	1.2785	0.3548	1.2785	1.1307
No log	48.4	484	1.3196	0.3265	1.3196	1.1487
No log	48.6	486	1.3668	0.3042	1.3668	1.1691
No log	48.8	488	1.3818	0.3042	1.3818	1.1755
No log	49.0	490	1.4291	0.3042	1.4291	1.1954
No log	49.2	492	1.3911	0.3042	1.3911	1.1794
No log	49.4	494	1.3201	0.3265	1.3201	1.1489
No log	49.6	496	1.2885	0.3548	1.2885	1.1351
No log	49.8	498	1.3182	0.3184	1.3182	1.1481
0.2534	50.0	500	1.3159	0.3466	1.3159	1.1471
0.2534	50.2	502	1.2672	0.3106	1.2672	1.1257
0.2534	50.4	504	1.2266	0.3188	1.2266	1.1075
0.2534	50.6	506	1.2079	0.3232	1.2079	1.0990
0.2534	50.8	508	1.2197	0.3558	1.2197	1.1044
0.2534	51.0	510	1.2551	0.3188	1.2551	1.1203
0.2534	51.2	512	1.2904	0.2965	1.2904	1.1360
0.2534	51.4	514	1.2928	0.3269	1.2928	1.1370
0.2534	51.6	516	1.3134	0.3682	1.3134	1.1460
0.2534	51.8	518	1.3607	0.3340	1.3607	1.1665
0.2534	52.0	520	1.4108	0.3263	1.4108	1.1878
0.2534	52.2	522	1.4168	0.3340	1.4168	1.1903
0.2534	52.4	524	1.3550	0.3368	1.3550	1.1640
0.2534	52.6	526	1.3147	0.2965	1.3147	1.1466

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1