ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6196
• Qwk: 0.3556
• Mse: 1.6196
• Rmse: 1.2726

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0308	2	6.6634	0.0176	6.6634	2.5814
No log	0.0615	4	4.1482	0.0779	4.1482	2.0367
No log	0.0923	6	3.5463	0.0101	3.5463	1.8832
No log	0.1231	8	2.5406	0.1208	2.5406	1.5939
No log	0.1538	10	2.0369	0.1832	2.0369	1.4272
No log	0.1846	12	2.0659	0.1395	2.0659	1.4373
No log	0.2154	14	2.3344	0.1752	2.3344	1.5279
No log	0.2462	16	2.2814	0.1594	2.2814	1.5104
No log	0.2769	18	2.1321	0.1333	2.1321	1.4602
No log	0.3077	20	2.0656	0.2479	2.0656	1.4372
No log	0.3385	22	2.1554	0.1803	2.1554	1.4681
No log	0.3692	24	2.0998	0.0702	2.0998	1.4491
No log	0.4	26	1.9868	0.1622	1.9868	1.4095
No log	0.4308	28	1.8730	0.1296	1.8730	1.3686
No log	0.4615	30	1.6309	0.1524	1.6309	1.2771
No log	0.4923	32	1.6317	0.2037	1.6317	1.2774
No log	0.5231	34	1.6512	0.3036	1.6512	1.2850
No log	0.5538	36	1.8155	0.3594	1.8155	1.3474
No log	0.5846	38	1.8803	0.3846	1.8803	1.3712
No log	0.6154	40	1.7450	0.3898	1.7450	1.3210
No log	0.6462	42	1.6402	0.2056	1.6402	1.2807
No log	0.6769	44	1.6799	0.2056	1.6799	1.2961
No log	0.7077	46	1.6355	0.1165	1.6355	1.2789
No log	0.7385	48	1.5484	0.1165	1.5484	1.2443
No log	0.7692	50	1.5547	0.1165	1.5547	1.2469
No log	0.8	52	1.7427	0.3393	1.7427	1.3201
No log	0.8308	54	1.7738	0.3898	1.7738	1.3318
No log	0.8615	56	1.7427	0.3871	1.7427	1.3201
No log	0.8923	58	1.8729	0.3433	1.8729	1.3686
No log	0.9231	60	1.9098	0.3433	1.9098	1.3820
No log	0.9538	62	1.7553	0.4	1.7553	1.3249
No log	0.9846	64	1.7905	0.3577	1.7905	1.3381
No log	1.0154	66	1.9487	0.2880	1.9487	1.3960
No log	1.0462	68	1.7590	0.2241	1.7590	1.3263
No log	1.0769	70	1.6747	0.2586	1.6747	1.2941
No log	1.1077	72	1.4317	0.3036	1.4317	1.1965
No log	1.1385	74	1.3401	0.3243	1.3401	1.1576
No log	1.1692	76	1.4114	0.3333	1.4114	1.1880
No log	1.2	78	1.3694	0.4	1.3694	1.1702
No log	1.2308	80	1.5353	0.4	1.5353	1.2391
No log	1.2615	82	1.8345	0.2628	1.8345	1.3544
No log	1.2923	84	1.8062	0.2647	1.8062	1.3439
No log	1.3231	86	1.4159	0.4603	1.4159	1.1899
No log	1.3538	88	1.1897	0.4833	1.1897	1.0907
No log	1.3846	90	1.1755	0.3894	1.1755	1.0842
No log	1.4154	92	1.1875	0.4915	1.1875	1.0897
No log	1.4462	94	1.2238	0.4915	1.2238	1.1063
No log	1.4769	96	1.2073	0.4915	1.2073	1.0988
No log	1.5077	98	1.1882	0.3966	1.1882	1.0901
No log	1.5385	100	1.3318	0.3802	1.3318	1.1540
No log	1.5692	102	1.4159	0.3415	1.4159	1.1899
No log	1.6	104	1.3509	0.4194	1.3509	1.1623
No log	1.6308	106	1.2381	0.3793	1.2381	1.1127
No log	1.6615	108	1.2245	0.4786	1.2245	1.1066
No log	1.6923	110	1.2702	0.4444	1.2702	1.1270
No log	1.7231	112	1.2600	0.4615	1.2600	1.1225
No log	1.7538	114	1.1453	0.5620	1.1453	1.0702
No log	1.7846	116	1.0324	0.5172	1.0324	1.0161
No log	1.8154	118	0.9623	0.5593	0.9623	0.9810
No log	1.8462	120	0.9195	0.5902	0.9195	0.9589
No log	1.8769	122	0.9617	0.5938	0.9617	0.9806
No log	1.9077	124	1.1662	0.5385	1.1662	1.0799
No log	1.9385	126	1.2393	0.4848	1.2393	1.1132
No log	1.9692	128	1.1832	0.4776	1.1832	1.0877
No log	2.0	130	1.2642	0.4776	1.2642	1.1244
No log	2.0308	132	1.4079	0.4173	1.4079	1.1866
No log	2.0615	134	1.4068	0.4317	1.4068	1.1861
No log	2.0923	136	1.3283	0.4526	1.3283	1.1525
No log	2.1231	138	1.1917	0.5	1.1917	1.0917
No log	2.1538	140	1.1061	0.5039	1.1061	1.0517
No log	2.1846	142	1.1260	0.5210	1.1260	1.0611
No log	2.2154	144	1.0710	0.5968	1.0710	1.0349
No log	2.2462	146	1.2230	0.5344	1.2230	1.1059
No log	2.2769	148	1.3817	0.4706	1.3817	1.1755
No log	2.3077	150	1.2987	0.5385	1.2987	1.1396
No log	2.3385	152	1.2699	0.5426	1.2699	1.1269
No log	2.3692	154	1.2794	0.5625	1.2794	1.1311
No log	2.4	156	1.3078	0.5581	1.3078	1.1436
No log	2.4308	158	1.3797	0.5116	1.3797	1.1746
No log	2.4615	160	1.4700	0.48	1.4700	1.2124
No log	2.4923	162	1.5594	0.4762	1.5594	1.2488
No log	2.5231	164	1.5192	0.4769	1.5192	1.2326
No log	2.5538	166	1.3302	0.4724	1.3302	1.1534
No log	2.5846	168	1.2688	0.4715	1.2688	1.1264
No log	2.6154	170	1.3077	0.48	1.3077	1.1435
No log	2.6462	172	1.3440	0.4806	1.3440	1.1593
No log	2.6769	174	1.3535	0.5116	1.3535	1.1634
No log	2.7077	176	1.3819	0.4812	1.3819	1.1755
No log	2.7385	178	1.3643	0.4394	1.3643	1.1680
No log	2.7692	180	1.3988	0.4511	1.3988	1.1827
No log	2.8	182	1.4086	0.4478	1.4086	1.1868
No log	2.8308	184	1.5483	0.4203	1.5483	1.2443
No log	2.8615	186	1.8547	0.2797	1.8547	1.3619
No log	2.8923	188	1.7867	0.3262	1.7867	1.3367
No log	2.9231	190	1.5517	0.3885	1.5517	1.2457
No log	2.9538	192	1.3120	0.4776	1.3120	1.1454
No log	2.9846	194	1.2416	0.5538	1.2416	1.1143
No log	3.0154	196	1.3556	0.4593	1.3556	1.1643
No log	3.0462	198	1.5329	0.3942	1.5329	1.2381
No log	3.0769	200	1.5228	0.3942	1.5228	1.2340
No log	3.1077	202	1.3774	0.4296	1.3774	1.1736
No log	3.1385	204	1.2015	0.5238	1.2015	1.0961
No log	3.1692	206	1.1818	0.5354	1.1818	1.0871
No log	3.2	208	1.3533	0.4889	1.3533	1.1633
No log	3.2308	210	1.6525	0.3714	1.6525	1.2855
No log	3.2615	212	1.6949	0.3380	1.6949	1.3019
No log	3.2923	214	1.5369	0.4380	1.5369	1.2397
No log	3.3231	216	1.2914	0.5152	1.2914	1.1364
No log	3.3538	218	1.2032	0.5469	1.2032	1.0969
No log	3.3846	220	1.2039	0.5469	1.2039	1.0972
No log	3.4154	222	1.3158	0.5038	1.3158	1.1471
No log	3.4462	224	1.4871	0.4234	1.4871	1.2195
No log	3.4769	226	1.5188	0.4234	1.5188	1.2324
No log	3.5077	228	1.3454	0.5037	1.3454	1.1599
No log	3.5385	230	1.1910	0.5124	1.1910	1.0913
No log	3.5692	232	1.2027	0.4444	1.2027	1.0967
No log	3.6	234	1.1887	0.4959	1.1887	1.0903
No log	3.6308	236	1.3433	0.4889	1.3433	1.1590
No log	3.6615	238	1.5869	0.3546	1.5869	1.2597
No log	3.6923	240	1.6332	0.3857	1.6332	1.2780
No log	3.7231	242	1.4517	0.4706	1.4517	1.2049
No log	3.7538	244	1.3510	0.5075	1.3510	1.1623
No log	3.7846	246	1.3328	0.5075	1.3328	1.1545
No log	3.8154	248	1.3042	0.5	1.3042	1.1420
No log	3.8462	250	1.4598	0.4412	1.4598	1.2082
No log	3.8769	252	1.5512	0.3857	1.5512	1.2455
No log	3.9077	254	1.3867	0.5191	1.3867	1.1776
No log	3.9385	256	1.1846	0.5203	1.1846	1.0884
No log	3.9692	258	1.1463	0.5760	1.1463	1.0706
No log	4.0	260	1.2180	0.5556	1.2180	1.1036
No log	4.0308	262	1.4014	0.5426	1.4014	1.1838
No log	4.0615	264	1.5900	0.3830	1.5900	1.2610
No log	4.0923	266	1.6036	0.3262	1.6036	1.2663
No log	4.1231	268	1.4628	0.4526	1.4628	1.2095
No log	4.1538	270	1.3889	0.4889	1.3889	1.1785
No log	4.1846	272	1.4073	0.4776	1.4073	1.1863
No log	4.2154	274	1.4990	0.4776	1.4990	1.2243
No log	4.2462	276	1.5259	0.4627	1.5259	1.2353
No log	4.2769	278	1.4934	0.4627	1.4934	1.2220
No log	4.3077	280	1.5433	0.4593	1.5432	1.2423
No log	4.3385	282	1.5214	0.4412	1.5214	1.2335
No log	4.3692	284	1.3914	0.5191	1.3914	1.1796
No log	4.4	286	1.3211	0.5581	1.3211	1.1494
No log	4.4308	288	1.3843	0.5	1.3843	1.1766
No log	4.4615	290	1.5376	0.4179	1.5376	1.2400
No log	4.4923	292	1.5687	0.3382	1.5687	1.2525
No log	4.5231	294	1.5183	0.4118	1.5183	1.2322
No log	4.5538	296	1.2662	0.5385	1.2662	1.1252
No log	4.5846	298	1.1853	0.528	1.1853	1.0887
No log	4.6154	300	1.2123	0.5512	1.2123	1.1010
No log	4.6462	302	1.3500	0.5	1.3500	1.1619
No log	4.6769	304	1.5368	0.3529	1.5368	1.2397
No log	4.7077	306	1.6931	0.2797	1.6931	1.3012
No log	4.7385	308	1.6538	0.2837	1.6538	1.2860
No log	4.7692	310	1.4769	0.4118	1.4769	1.2153
No log	4.8	312	1.4068	0.5	1.4068	1.1861
No log	4.8308	314	1.4459	0.4444	1.4459	1.2024
No log	4.8615	316	1.5015	0.3824	1.5015	1.2254
No log	4.8923	318	1.4254	0.4697	1.4254	1.1939
No log	4.9231	320	1.2837	0.5581	1.2837	1.1330
No log	4.9538	322	1.2538	0.5426	1.2538	1.1197
No log	4.9846	324	1.1895	0.5197	1.1895	1.0906
No log	5.0154	326	1.1822	0.5197	1.1822	1.0873
No log	5.0462	328	1.2720	0.5312	1.2720	1.1278
No log	5.0769	330	1.4871	0.4296	1.4871	1.2195
No log	5.1077	332	1.6558	0.3429	1.6558	1.2868
No log	5.1385	334	1.6809	0.3429	1.6809	1.2965
No log	5.1692	336	1.5417	0.4	1.5417	1.2417
No log	5.2	338	1.3818	0.4921	1.3818	1.1755
No log	5.2308	340	1.3414	0.5197	1.3414	1.1582
No log	5.2615	342	1.3592	0.5197	1.3592	1.1659
No log	5.2923	344	1.4327	0.5156	1.4327	1.1970
No log	5.3231	346	1.5196	0.4662	1.5196	1.2327
No log	5.3538	348	1.6595	0.3623	1.6595	1.2882
No log	5.3846	350	1.7138	0.3309	1.7138	1.3091
No log	5.4154	352	1.6812	0.4030	1.6812	1.2966
No log	5.4462	354	1.5768	0.4480	1.5768	1.2557
No log	5.4769	356	1.5665	0.3361	1.5665	1.2516
No log	5.5077	358	1.5936	0.4194	1.5936	1.2624
No log	5.5385	360	1.6256	0.4688	1.6256	1.2750
No log	5.5692	362	1.5913	0.4615	1.5913	1.2615
No log	5.6	364	1.5093	0.4961	1.5093	1.2285
No log	5.6308	366	1.5080	0.5	1.5080	1.2280
No log	5.6615	368	1.5257	0.4627	1.5257	1.2352
No log	5.6923	370	1.4328	0.4923	1.4328	1.1970
No log	5.7231	372	1.4055	0.4923	1.4055	1.1855
No log	5.7538	374	1.5142	0.4412	1.5142	1.2305
No log	5.7846	376	1.7227	0.3188	1.7227	1.3125
No log	5.8154	378	1.7762	0.2754	1.7762	1.3327
No log	5.8462	380	1.6386	0.3235	1.6386	1.2801
No log	5.8769	382	1.4158	0.4603	1.4158	1.1899
No log	5.9077	384	1.2671	0.4500	1.2671	1.1256
No log	5.9385	386	1.2473	0.4500	1.2473	1.1168
No log	5.9692	388	1.3141	0.5271	1.3141	1.1463
No log	6.0	390	1.4035	0.5077	1.4035	1.1847
No log	6.0308	392	1.6250	0.3188	1.6250	1.2748
No log	6.0615	394	1.7897	0.2857	1.7897	1.3378
No log	6.0923	396	1.7590	0.3121	1.7590	1.3263
No log	6.1231	398	1.5562	0.3688	1.5562	1.2475
No log	6.1538	400	1.3874	0.4776	1.3874	1.1779
No log	6.1846	402	1.3557	0.5152	1.3557	1.1643
No log	6.2154	404	1.4126	0.4776	1.4126	1.1885
No log	6.2462	406	1.4725	0.4776	1.4725	1.2135
No log	6.2769	408	1.5020	0.4394	1.5020	1.2255
No log	6.3077	410	1.6447	0.3022	1.6447	1.2825
No log	6.3385	412	1.7377	0.2857	1.7377	1.3182
No log	6.3692	414	1.6744	0.3022	1.6744	1.2940
No log	6.4	416	1.5580	0.4211	1.5580	1.2482
No log	6.4308	418	1.5281	0.4394	1.5281	1.2362
No log	6.4615	420	1.5075	0.4885	1.5075	1.2278
No log	6.4923	422	1.5065	0.4769	1.5065	1.2274
No log	6.5231	424	1.4629	0.4769	1.4629	1.2095
No log	6.5538	426	1.4904	0.4580	1.4904	1.2208
No log	6.5846	428	1.5987	0.3942	1.5987	1.2644
No log	6.6154	430	1.6261	0.3942	1.6261	1.2752
No log	6.6462	432	1.5797	0.4444	1.5797	1.2569
No log	6.6769	434	1.4527	0.4848	1.4527	1.2053
No log	6.7077	436	1.3209	0.5077	1.3209	1.1493
No log	6.7385	438	1.2898	0.5077	1.2898	1.1357
No log	6.7692	440	1.4023	0.5152	1.4023	1.1842
No log	6.8	442	1.4142	0.5152	1.4142	1.1892
No log	6.8308	444	1.4085	0.5152	1.4085	1.1868
No log	6.8615	446	1.3742	0.5152	1.3742	1.1722
No log	6.8923	448	1.3096	0.5077	1.3096	1.1444
No log	6.9231	450	1.3901	0.5152	1.3901	1.1790
No log	6.9538	452	1.5657	0.4203	1.5657	1.2513
No log	6.9846	454	1.7089	0.3121	1.7089	1.3072
No log	7.0154	456	1.6469	0.3857	1.6469	1.2833
No log	7.0462	458	1.5543	0.4412	1.5543	1.2467
No log	7.0769	460	1.4000	0.4848	1.4000	1.1832
No log	7.1077	462	1.3181	0.5116	1.3181	1.1481
No log	7.1385	464	1.3719	0.4885	1.3719	1.1713
No log	7.1692	466	1.3937	0.4885	1.3937	1.1805
No log	7.2	468	1.3288	0.4885	1.3288	1.1527
No log	7.2308	470	1.3728	0.4962	1.3728	1.1717
No log	7.2615	472	1.4393	0.4925	1.4393	1.1997
No log	7.2923	474	1.5545	0.3885	1.5545	1.2468
No log	7.3231	476	1.5057	0.4058	1.5057	1.2271
No log	7.3538	478	1.5791	0.3857	1.5791	1.2566
No log	7.3846	480	1.5113	0.4058	1.5113	1.2294
No log	7.4154	482	1.4751	0.4058	1.4751	1.2145
No log	7.4462	484	1.4551	0.4776	1.4551	1.2063
No log	7.4769	486	1.5482	0.4058	1.5482	1.2443
No log	7.5077	488	1.6225	0.3741	1.6225	1.2738
No log	7.5385	490	1.6147	0.3478	1.6147	1.2707
No log	7.5692	492	1.4466	0.4848	1.4466	1.2028
No log	7.6	494	1.3797	0.4844	1.3797	1.1746
No log	7.6308	496	1.4346	0.4697	1.4346	1.1977
No log	7.6615	498	1.5725	0.3768	1.5725	1.2540
0.4256	7.6923	500	1.6535	0.3768	1.6535	1.2859
0.4256	7.7231	502	1.6709	0.3597	1.6709	1.2926
0.4256	7.7538	504	1.4997	0.4697	1.4997	1.2246
0.4256	7.7846	506	1.3576	0.4724	1.3576	1.1652
0.4256	7.8154	508	1.2247	0.4882	1.2247	1.1066
0.4256	7.8462	510	1.2031	0.4882	1.2031	1.0969
0.4256	7.8769	512	1.2536	0.4882	1.2536	1.1196
0.4256	7.9077	514	1.4414	0.4580	1.4414	1.2006
0.4256	7.9385	516	1.7588	0.3022	1.7588	1.3262
0.4256	7.9692	518	1.8401	0.2857	1.8401	1.3565
0.4256	8.0	520	1.7210	0.3022	1.7210	1.3119
0.4256	8.0308	522	1.4435	0.4697	1.4435	1.2014
0.4256	8.0615	524	1.3285	0.5077	1.3285	1.1526
0.4256	8.0923	526	1.3535	0.5077	1.3535	1.1634
0.4256	8.1231	528	1.4898	0.4394	1.4898	1.2206
0.4256	8.1538	530	1.6790	0.3188	1.6790	1.2958
0.4256	8.1846	532	1.7465	0.2857	1.7465	1.3215
0.4256	8.2154	534	1.6659	0.3188	1.6659	1.2907
0.4256	8.2462	536	1.6661	0.3188	1.6661	1.2908
0.4256	8.2769	538	1.6196	0.3556	1.6196	1.2726

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1