ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1660
• Qwk: 0.4918
• Mse: 1.1660
• Rmse: 1.0798

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	6.7768	0.0239	6.7768	2.6032
No log	0.0769	4	4.2529	0.0500	4.2529	2.0623
No log	0.1154	6	3.3655	-0.0117	3.3655	1.8345
No log	0.1538	8	2.9377	0.0519	2.9377	1.7140
No log	0.1923	10	1.9862	0.1579	1.9862	1.4093
No log	0.2308	12	1.9502	0.2385	1.9502	1.3965
No log	0.2692	14	2.2998	-0.0923	2.2998	1.5165
No log	0.3077	16	2.4824	-0.0426	2.4824	1.5756
No log	0.3462	18	2.4137	-0.0432	2.4137	1.5536
No log	0.3846	20	2.1199	0.1186	2.1199	1.4560
No log	0.4231	22	2.1059	0.1345	2.1059	1.4512
No log	0.4615	24	2.2241	0.0448	2.2241	1.4913
No log	0.5	26	2.3479	0.0556	2.3479	1.5323
No log	0.5385	28	2.0874	0.1240	2.0874	1.4448
No log	0.5769	30	2.0408	0.1875	2.0408	1.4286
No log	0.6154	32	1.9313	0.1746	1.9313	1.3897
No log	0.6538	34	1.7721	0.2105	1.7721	1.3312
No log	0.6923	36	1.6613	0.2523	1.6613	1.2889
No log	0.7308	38	1.5963	0.2202	1.5963	1.2635
No log	0.7692	40	1.5318	0.2342	1.5318	1.2377
No log	0.8077	42	1.5438	0.3761	1.5438	1.2425
No log	0.8462	44	1.4441	0.3793	1.4441	1.2017
No log	0.8846	46	1.5416	0.4194	1.5416	1.2416
No log	0.9231	48	1.5365	0.4603	1.5365	1.2396
No log	0.9615	50	1.4173	0.4390	1.4173	1.1905
No log	1.0	52	1.2227	0.4370	1.2227	1.1058
No log	1.0385	54	1.1484	0.4237	1.1484	1.0716
No log	1.0769	56	1.2303	0.4706	1.2303	1.1092
No log	1.1154	58	1.1589	0.4500	1.1589	1.0765
No log	1.1538	60	1.1953	0.4320	1.1953	1.0933
No log	1.1923	62	1.1745	0.48	1.1745	1.0837
No log	1.2308	64	1.2509	0.4687	1.2509	1.1184
No log	1.2692	66	1.3343	0.4341	1.3343	1.1551
No log	1.3077	68	1.4447	0.4062	1.4447	1.2020
No log	1.3462	70	1.5259	0.3906	1.5259	1.2353
No log	1.3846	72	1.4552	0.3387	1.4552	1.2063
No log	1.4231	74	1.6284	0.3390	1.6284	1.2761
No log	1.4615	76	1.6705	0.1818	1.6705	1.2925
No log	1.5	78	1.5313	0.2832	1.5313	1.2374
No log	1.5385	80	1.3121	0.4034	1.3121	1.1455
No log	1.5769	82	1.2062	0.4590	1.2062	1.0983
No log	1.6154	84	1.3385	0.5	1.3385	1.1569
No log	1.6538	86	1.8075	0.2857	1.8075	1.3444
No log	1.6923	88	1.6065	0.3969	1.6065	1.2675
No log	1.7308	90	1.3121	0.5224	1.3121	1.1455
No log	1.7692	92	1.1609	0.4925	1.1609	1.0775
No log	1.8077	94	1.1784	0.4925	1.1784	1.0855
No log	1.8462	96	1.2634	0.4853	1.2634	1.1240
No log	1.8846	98	1.2153	0.4962	1.2153	1.1024
No log	1.9231	100	1.2681	0.4962	1.2681	1.1261
No log	1.9615	102	1.4452	0.4493	1.4452	1.2021
No log	2.0	104	1.4110	0.4412	1.4110	1.1878
No log	2.0385	106	1.4356	0.4672	1.4356	1.1982
No log	2.0769	108	1.5726	0.4380	1.5726	1.2540
No log	2.1154	110	1.3439	0.4511	1.3439	1.1593
No log	2.1538	112	1.4356	0.4697	1.4356	1.1982
No log	2.1923	114	1.6991	0.3609	1.6991	1.3035
No log	2.2308	116	1.2892	0.4697	1.2892	1.1354
No log	2.2692	118	1.1971	0.5147	1.1971	1.0941
No log	2.3077	120	1.5491	0.4394	1.5491	1.2446
No log	2.3462	122	1.3952	0.4394	1.3952	1.1812
No log	2.3846	124	1.0737	0.6074	1.0737	1.0362
No log	2.4231	126	0.9869	0.6	0.9869	0.9934
No log	2.4615	128	1.1301	0.5802	1.1301	1.0631
No log	2.5	130	1.2446	0.5075	1.2446	1.1156
No log	2.5385	132	1.1110	0.5909	1.1110	1.0541
No log	2.5769	134	0.9340	0.6043	0.9340	0.9664
No log	2.6154	136	0.9790	0.6176	0.9790	0.9894
No log	2.6538	138	1.2339	0.5294	1.2339	1.1108
No log	2.6923	140	1.1611	0.5294	1.1611	1.0776
No log	2.7308	142	1.2925	0.5185	1.2925	1.1369
No log	2.7692	144	1.5896	0.4286	1.5896	1.2608
No log	2.8077	146	1.4368	0.4818	1.4368	1.1987
No log	2.8462	148	1.4032	0.5037	1.4032	1.1845
No log	2.8846	150	1.1698	0.5294	1.1698	1.0816
No log	2.9231	152	1.2224	0.5373	1.2224	1.1056
No log	2.9615	154	1.1825	0.5735	1.1825	1.0874
No log	3.0	156	1.3288	0.5075	1.3288	1.1527
No log	3.0385	158	1.4445	0.4672	1.4445	1.2019
No log	3.0769	160	1.3164	0.5152	1.3164	1.1474
No log	3.1154	162	1.3114	0.4962	1.3114	1.1452
No log	3.1538	164	1.1843	0.5714	1.1843	1.0883
No log	3.1923	166	1.0038	0.5496	1.0038	1.0019
No log	3.2308	168	1.1298	0.5455	1.1298	1.0629
No log	3.2692	170	1.4274	0.4559	1.4274	1.1947
No log	3.3077	172	1.3642	0.5303	1.3642	1.1680
No log	3.3462	174	1.3808	0.4697	1.3808	1.1751
No log	3.3846	176	1.4584	0.4776	1.4584	1.2076
No log	3.4231	178	1.2866	0.5344	1.2866	1.1343
No log	3.4615	180	1.2491	0.5077	1.2491	1.1176
No log	3.5	182	1.2187	0.5077	1.2187	1.1040
No log	3.5385	184	1.1119	0.4882	1.1119	1.0545
No log	3.5769	186	1.1542	0.5312	1.1542	1.0743
No log	3.6154	188	1.3605	0.5077	1.3605	1.1664
No log	3.6538	190	1.4460	0.4545	1.4460	1.2025
No log	3.6923	192	1.2079	0.4923	1.2079	1.0991
No log	3.7308	194	1.0932	0.5538	1.0932	1.0456
No log	3.7692	196	1.1813	0.5191	1.1813	1.0869
No log	3.8077	198	1.3132	0.5077	1.3132	1.1460
No log	3.8462	200	1.3438	0.5077	1.3438	1.1592
No log	3.8846	202	1.1653	0.5116	1.1653	1.0795
No log	3.9231	204	1.0802	0.5625	1.0802	1.0393
No log	3.9615	206	1.0827	0.5469	1.0827	1.0405
No log	4.0	208	1.2187	0.4806	1.2187	1.1039
No log	4.0385	210	1.5149	0.3881	1.5149	1.2308
No log	4.0769	212	1.4981	0.4148	1.4981	1.2240
No log	4.1154	214	1.5252	0.3885	1.5252	1.2350
No log	4.1538	216	1.3696	0.4478	1.3696	1.1703
No log	4.1923	218	1.3372	0.4511	1.3372	1.1564
No log	4.2308	220	1.5631	0.3546	1.5631	1.2502
No log	4.2692	222	1.6403	0.3768	1.6403	1.2807
No log	4.3077	224	1.4745	0.4733	1.4745	1.2143
No log	4.3462	226	1.3445	0.3871	1.3445	1.1595
No log	4.3846	228	1.3437	0.3871	1.3437	1.1592
No log	4.4231	230	1.3144	0.4127	1.3144	1.1465
No log	4.4615	232	1.3422	0.5077	1.3422	1.1585
No log	4.5	234	1.3682	0.5077	1.3682	1.1697
No log	4.5385	236	1.5403	0.4118	1.5403	1.2411
No log	4.5769	238	1.6863	0.3504	1.6863	1.2986
No log	4.6154	240	1.5256	0.4	1.5256	1.2351
No log	4.6538	242	1.3087	0.4806	1.3087	1.1440
No log	4.6923	244	1.2955	0.4806	1.2955	1.1382
No log	4.7308	246	1.3949	0.4545	1.3949	1.1810
No log	4.7692	248	1.6765	0.3382	1.6765	1.2948
No log	4.8077	250	1.7293	0.3382	1.7293	1.3150
No log	4.8462	252	1.4448	0.4427	1.4448	1.2020
No log	4.8846	254	1.1810	0.4882	1.1810	1.0868
No log	4.9231	256	1.1155	0.5909	1.1154	1.0561
No log	4.9615	258	1.2461	0.5077	1.2461	1.1163
No log	5.0	260	1.6672	0.3768	1.6672	1.2912
No log	5.0385	262	1.8350	0.3121	1.8350	1.3546
No log	5.0769	264	1.6282	0.3556	1.6282	1.2760
No log	5.1154	266	1.3580	0.4545	1.3580	1.1653
No log	5.1538	268	1.2544	0.5077	1.2544	1.1200
No log	5.1923	270	1.2401	0.5156	1.2401	1.1136
No log	5.2308	272	1.1833	0.4628	1.1833	1.0878
No log	5.2692	274	1.1959	0.4333	1.1959	1.0936
No log	5.3077	276	1.3023	0.4882	1.3023	1.1412
No log	5.3462	278	1.3522	0.5077	1.3522	1.1628
No log	5.3846	280	1.2672	0.4806	1.2672	1.1257
No log	5.4231	282	1.0707	0.5323	1.0707	1.0347
No log	5.4615	284	0.9782	0.5778	0.9782	0.9890
No log	5.5	286	0.9893	0.6000	0.9893	0.9946
No log	5.5385	288	0.9390	0.5926	0.9390	0.9690
No log	5.5769	290	1.0576	0.5736	1.0576	1.0284
No log	5.6154	292	1.3724	0.5191	1.3724	1.1715
No log	5.6538	294	1.5160	0.4651	1.5160	1.2312
No log	5.6923	296	1.4240	0.4806	1.4240	1.1933
No log	5.7308	298	1.2506	0.5082	1.2506	1.1183
No log	5.7692	300	1.1180	0.4348	1.1180	1.0573
No log	5.8077	302	1.0897	0.5323	1.0897	1.0439
No log	5.8462	304	1.0106	0.5574	1.0106	1.0053
No log	5.8846	306	1.0444	0.5512	1.0444	1.0219
No log	5.9231	308	1.2711	0.5191	1.2711	1.1274
No log	5.9615	310	1.3702	0.4531	1.3702	1.1705
No log	6.0	312	1.3010	0.4677	1.3010	1.1406
No log	6.0385	314	1.1930	0.48	1.1930	1.0923
No log	6.0769	316	1.1271	0.5079	1.1271	1.0617
No log	6.1154	318	1.1759	0.5354	1.1759	1.0844
No log	6.1538	320	1.2792	0.5271	1.2792	1.1310
No log	6.1923	322	1.2015	0.5271	1.2015	1.0961
No log	6.2308	324	1.1248	0.5271	1.1248	1.0605
No log	6.2692	326	1.0731	0.5271	1.0731	1.0359
No log	6.3077	328	1.1166	0.5271	1.1166	1.0567
No log	6.3462	330	1.2715	0.5496	1.2715	1.1276
No log	6.3846	332	1.4206	0.4741	1.4206	1.1919
No log	6.4231	334	1.3970	0.5469	1.3970	1.1819
No log	6.4615	336	1.2668	0.5079	1.2668	1.1255
No log	6.5	338	1.1387	0.4878	1.1387	1.0671
No log	6.5385	340	1.1072	0.4754	1.1072	1.0522
No log	6.5769	342	1.1509	0.4882	1.1509	1.0728
No log	6.6154	344	1.1874	0.4882	1.1874	1.0897
No log	6.6538	346	1.1680	0.4687	1.1680	1.0807
No log	6.6923	348	1.1747	0.4806	1.1747	1.0838
No log	6.7308	350	1.0669	0.5323	1.0669	1.0329
No log	6.7692	352	1.0317	0.5714	1.0317	1.0157
No log	6.8077	354	1.1874	0.5077	1.1874	1.0897
No log	6.8462	356	1.4436	0.5068	1.4436	1.2015
No log	6.8846	358	1.3684	0.5	1.3684	1.1698
No log	6.9231	360	1.2101	0.4806	1.2101	1.1000
No log	6.9615	362	1.1253	0.5156	1.1253	1.0608
No log	7.0	364	1.2055	0.4882	1.2055	1.0980
No log	7.0385	366	1.3461	0.5077	1.3461	1.1602
No log	7.0769	368	1.2823	0.4687	1.2823	1.1324
No log	7.1154	370	1.3079	0.5077	1.3079	1.1436
No log	7.1538	372	1.3080	0.4733	1.3080	1.1437
No log	7.1923	374	1.3950	0.4478	1.3950	1.1811
No log	7.2308	376	1.3589	0.4545	1.3589	1.1657
No log	7.2692	378	1.3107	0.4603	1.3107	1.1449
No log	7.3077	380	1.3297	0.4603	1.3297	1.1531
No log	7.3462	382	1.3393	0.4882	1.3393	1.1573
No log	7.3846	384	1.2267	0.48	1.2267	1.1076
No log	7.4231	386	1.1820	0.5079	1.1820	1.0872
No log	7.4615	388	1.2908	0.4733	1.2908	1.1361
No log	7.5	390	1.2723	0.5077	1.2723	1.1280
No log	7.5385	392	1.4027	0.4412	1.4027	1.1843
No log	7.5769	394	1.3833	0.4412	1.3833	1.1762
No log	7.6154	396	1.2401	0.5271	1.2401	1.1136
No log	7.6538	398	1.1438	0.5323	1.1438	1.0695
No log	7.6923	400	1.1415	0.5082	1.1415	1.0684
No log	7.7308	402	1.1943	0.5041	1.1943	1.0928
No log	7.7692	404	1.2498	0.4921	1.2498	1.1179
No log	7.8077	406	1.2602	0.5039	1.2602	1.1226
No log	7.8462	408	1.2627	0.4844	1.2627	1.1237
No log	7.8846	410	1.2375	0.4806	1.2375	1.1124
No log	7.9231	412	1.1854	0.4844	1.1854	1.0888
No log	7.9615	414	1.1527	0.4921	1.1527	1.0737
No log	8.0	416	1.1844	0.512	1.1844	1.0883
No log	8.0385	418	1.3034	0.4806	1.3034	1.1417
No log	8.0769	420	1.5267	0.4242	1.5267	1.2356
No log	8.1154	422	1.5518	0.4	1.5518	1.2457
No log	8.1538	424	1.4431	0.4409	1.4431	1.2013
No log	8.1923	426	1.3424	0.4553	1.3424	1.1586
No log	8.2308	428	1.3616	0.4553	1.3616	1.1669
No log	8.2692	430	1.4336	0.4409	1.4336	1.1973
No log	8.3077	432	1.5794	0.4211	1.5794	1.2568
No log	8.3462	434	1.6985	0.3459	1.6985	1.3033
No log	8.3846	436	1.7549	0.3088	1.7549	1.3247
No log	8.4231	438	1.5817	0.3664	1.5817	1.2577
No log	8.4615	440	1.3287	0.4531	1.3287	1.1527
No log	8.5	442	1.2319	0.5197	1.2319	1.1099
No log	8.5385	444	1.2889	0.4923	1.2889	1.1353
No log	8.5769	446	1.4848	0.4462	1.4848	1.2185
No log	8.6154	448	1.6311	0.3459	1.6311	1.2772
No log	8.6538	450	1.6961	0.3459	1.6961	1.3024
No log	8.6923	452	1.5806	0.3385	1.5806	1.2572
No log	8.7308	454	1.4437	0.4651	1.4437	1.2015
No log	8.7692	456	1.3984	0.4409	1.3984	1.1825
No log	8.8077	458	1.4581	0.384	1.4581	1.2075
No log	8.8462	460	1.5040	0.4094	1.5040	1.2264
No log	8.8846	462	1.5293	0.4094	1.5293	1.2366
No log	8.9231	464	1.4470	0.4651	1.4470	1.2029
No log	8.9615	466	1.2939	0.4603	1.2939	1.1375
No log	9.0	468	1.2337	0.5161	1.2337	1.1107
No log	9.0385	470	1.2582	0.4882	1.2582	1.1217
No log	9.0769	472	1.3910	0.4923	1.3910	1.1794
No log	9.1154	474	1.4915	0.4030	1.4915	1.2213
No log	9.1538	476	1.3680	0.5	1.3680	1.1696
No log	9.1923	478	1.2109	0.5	1.2109	1.1004
No log	9.2308	480	1.1920	0.5	1.1920	1.0918
No log	9.2692	482	1.2448	0.4882	1.2448	1.1157
No log	9.3077	484	1.3528	0.4882	1.3528	1.1631
No log	9.3462	486	1.4754	0.4462	1.4754	1.2146
No log	9.3846	488	1.5117	0.4122	1.5117	1.2295
No log	9.4231	490	1.4345	0.4806	1.4345	1.1977
No log	9.4615	492	1.3189	0.4882	1.3189	1.1485
No log	9.5	494	1.2316	0.512	1.2316	1.1098
No log	9.5385	496	1.1994	0.5366	1.1994	1.0952
No log	9.5769	498	1.2268	0.5366	1.2268	1.1076
0.3746	9.6154	500	1.2877	0.512	1.2877	1.1348
0.3746	9.6538	502	1.3814	0.4688	1.3814	1.1753
0.3746	9.6923	504	1.4024	0.4806	1.4024	1.1842
0.3746	9.7308	506	1.3705	0.5077	1.3705	1.1707
0.3746	9.7692	508	1.2127	0.5271	1.2127	1.1012
0.3746	9.8077	510	1.0863	0.6107	1.0863	1.0422
0.3746	9.8462	512	1.0720	0.6107	1.0720	1.0354
0.3746	9.8846	514	1.2174	0.5191	1.2174	1.1034
0.3746	9.9231	516	1.2740	0.5077	1.2740	1.1287
0.3746	9.9615	518	1.3052	0.4961	1.3052	1.1424
0.3746	10.0	520	1.3630	0.5156	1.3630	1.1675
0.3746	10.0385	522	1.3458	0.5041	1.3458	1.1601
0.3746	10.0769	524	1.3404	0.4793	1.3404	1.1577
0.3746	10.1154	526	1.2909	0.4793	1.2909	1.1362
0.3746	10.1538	528	1.2198	0.4793	1.2198	1.1044
0.3746	10.1923	530	1.1660	0.4918	1.1660	1.0798

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1