ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2902
• Qwk: 0.1144
• Mse: 1.2902
• Rmse: 1.1359

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	4.7899	0.0010	4.7899	2.1886
No log	0.1905	4	3.0080	-0.0317	3.0080	1.7344
No log	0.2857	6	1.9567	-0.0017	1.9567	1.3988
No log	0.3810	8	1.6906	0.0062	1.6906	1.3002
No log	0.4762	10	1.6994	-0.0293	1.6994	1.3036
No log	0.5714	12	1.6722	-0.0993	1.6722	1.2931
No log	0.6667	14	1.5567	-0.0828	1.5567	1.2477
No log	0.7619	16	1.4820	0.0077	1.4820	1.2174
No log	0.8571	18	1.4686	-0.0052	1.4686	1.2119
No log	0.9524	20	1.5713	-0.1723	1.5713	1.2535
No log	1.0476	22	1.4169	0.0253	1.4169	1.1903
No log	1.1429	24	1.4013	0.0982	1.4013	1.1837
No log	1.2381	26	1.4750	0.0768	1.4750	1.2145
No log	1.3333	28	1.4352	0.0854	1.4352	1.1980
No log	1.4286	30	1.4147	0.1203	1.4147	1.1894
No log	1.5238	32	1.3935	0.1203	1.3935	1.1804
No log	1.6190	34	1.5187	0.0462	1.5187	1.2324
No log	1.7143	36	1.4769	0.0758	1.4769	1.2153
No log	1.8095	38	1.2855	0.2025	1.2855	1.1338
No log	1.9048	40	1.2990	0.1570	1.2990	1.1397
No log	2.0	42	1.5682	-0.0411	1.5682	1.2523
No log	2.0952	44	1.7349	-0.1230	1.7349	1.3172
No log	2.1905	46	1.7170	-0.1237	1.7170	1.3104
No log	2.2857	48	1.5742	-0.0460	1.5742	1.2547
No log	2.3810	50	1.5032	0.0230	1.5032	1.2260
No log	2.4762	52	1.5337	0.0299	1.5337	1.2384
No log	2.5714	54	1.5298	-0.0271	1.5298	1.2369
No log	2.6667	56	1.4959	0.0395	1.4959	1.2231
No log	2.7619	58	1.4191	0.0390	1.4191	1.1913
No log	2.8571	60	1.4292	0.0149	1.4292	1.1955
No log	2.9524	62	1.4145	0.0233	1.4145	1.1893
No log	3.0476	64	1.3765	0.1683	1.3765	1.1732
No log	3.1429	66	1.3944	0.1302	1.3944	1.1808
No log	3.2381	68	1.3818	0.1683	1.3818	1.1755
No log	3.3333	70	1.4384	0.0766	1.4384	1.1993
No log	3.4286	72	1.4866	0.0614	1.4866	1.2193
No log	3.5238	74	1.3757	0.1727	1.3757	1.1729
No log	3.6190	76	1.3159	0.1667	1.3159	1.1471
No log	3.7143	78	1.3443	0.0513	1.3443	1.1594
No log	3.8095	80	1.3849	0.0612	1.3849	1.1768
No log	3.9048	82	1.2975	0.1379	1.2975	1.1391
No log	4.0	84	1.2941	0.1110	1.2941	1.1376
No log	4.0952	86	1.3632	0.0802	1.3632	1.1676
No log	4.1905	88	1.6180	0.1358	1.6180	1.2720
No log	4.2857	90	1.7392	0.1399	1.7392	1.3188
No log	4.3810	92	1.6409	0.2270	1.6409	1.2810
No log	4.4762	94	1.5261	0.1900	1.5261	1.2354
No log	4.5714	96	1.5413	0.1866	1.5413	1.2415
No log	4.6667	98	1.6348	0.2552	1.6348	1.2786
No log	4.7619	100	1.6104	0.2585	1.6104	1.2690
No log	4.8571	102	1.4754	0.2593	1.4754	1.2146
No log	4.9524	104	1.3764	0.2261	1.3764	1.1732
No log	5.0476	106	1.3305	0.1363	1.3305	1.1535
No log	5.1429	108	1.3640	0.1387	1.3640	1.1679
No log	5.2381	110	1.4431	0.2808	1.4431	1.2013
No log	5.3333	112	1.6728	0.1924	1.6728	1.2934
No log	5.4286	114	1.7807	0.1650	1.7807	1.3344
No log	5.5238	116	1.6948	0.2140	1.6948	1.3018
No log	5.6190	118	1.4849	0.2084	1.4849	1.2186
No log	5.7143	120	1.4051	0.2445	1.4051	1.1854
No log	5.8095	122	1.4662	0.1950	1.4662	1.2108
No log	5.9048	124	1.4324	0.1331	1.4324	1.1968
No log	6.0	126	1.4704	0.2381	1.4704	1.2126
No log	6.0952	128	1.6639	0.1847	1.6639	1.2899
No log	6.1905	130	1.7705	0.1953	1.7705	1.3306
No log	6.2857	132	1.6930	0.1960	1.6930	1.3012
No log	6.3810	134	1.5346	0.1283	1.5346	1.2388
No log	6.4762	136	1.3769	0.1441	1.3769	1.1734
No log	6.5714	138	1.3351	0.1562	1.3351	1.1555
No log	6.6667	140	1.3842	0.1562	1.3842	1.1765
No log	6.7619	142	1.4056	0.1599	1.4056	1.1856
No log	6.8571	144	1.4302	0.1650	1.4302	1.1959
No log	6.9524	146	1.3756	0.0954	1.3756	1.1729
No log	7.0476	148	1.3126	0.1701	1.3126	1.1457
No log	7.1429	150	1.2701	0.2119	1.2701	1.1270
No log	7.2381	152	1.3001	0.1701	1.3001	1.1402
No log	7.3333	154	1.4035	0.1441	1.4035	1.1847
No log	7.4286	156	1.4573	0.1022	1.4573	1.2072
No log	7.5238	158	1.4502	0.1463	1.4502	1.2043
No log	7.6190	160	1.4991	0.1307	1.4991	1.2244
No log	7.7143	162	1.5761	0.1882	1.5761	1.2554
No log	7.8095	164	1.5151	0.1436	1.5151	1.2309
No log	7.9048	166	1.4292	0.1498	1.4292	1.1955
No log	8.0	168	1.4011	0.1477	1.4011	1.1837
No log	8.0952	170	1.3887	0.2348	1.3887	1.1784
No log	8.1905	172	1.3448	0.2669	1.3448	1.1597
No log	8.2857	174	1.3466	0.1894	1.3466	1.1604
No log	8.3810	176	1.3902	0.2131	1.3902	1.1790
No log	8.4762	178	1.4966	0.2181	1.4966	1.2234
No log	8.5714	180	1.5636	0.1767	1.5636	1.2504
No log	8.6667	182	1.5112	0.2285	1.5112	1.2293
No log	8.7619	184	1.4106	0.2934	1.4106	1.1877
No log	8.8571	186	1.4077	0.2028	1.4077	1.1865
No log	8.9524	188	1.3929	0.2864	1.3929	1.1802
No log	9.0476	190	1.3504	0.3212	1.3504	1.1621
No log	9.1429	192	1.3818	0.2961	1.3818	1.1755
No log	9.2381	194	1.3971	0.2371	1.3971	1.1820
No log	9.3333	196	1.3698	0.2747	1.3698	1.1704
No log	9.4286	198	1.3839	0.3025	1.3839	1.1764
No log	9.5238	200	1.4138	0.2406	1.4138	1.1891
No log	9.6190	202	1.4263	0.2406	1.4263	1.1943
No log	9.7143	204	1.3383	0.3174	1.3383	1.1568
No log	9.8095	206	1.2542	0.3474	1.2542	1.1199
No log	9.9048	208	1.2868	0.3341	1.2868	1.1344
No log	10.0	210	1.4074	0.2275	1.4074	1.1863
No log	10.0952	212	1.4223	0.1888	1.4223	1.1926
No log	10.1905	214	1.3900	0.2354	1.3900	1.1790
No log	10.2857	216	1.4663	0.1677	1.4663	1.2109
No log	10.3810	218	1.4396	0.2060	1.4396	1.1998
No log	10.4762	220	1.4955	0.1677	1.4955	1.2229
No log	10.5714	222	1.4681	0.1935	1.4681	1.2116
No log	10.6667	224	1.3676	0.2395	1.3676	1.1695
No log	10.7619	226	1.3580	0.2060	1.3580	1.1654
No log	10.8571	228	1.4478	0.1395	1.4478	1.2033
No log	10.9524	230	1.6221	0.1336	1.6221	1.2736
No log	11.0476	232	1.6827	0.1307	1.6827	1.2972
No log	11.1429	234	1.5761	0.1568	1.5761	1.2554
No log	11.2381	236	1.4200	0.1098	1.4200	1.1916
No log	11.3333	238	1.2916	0.1871	1.2916	1.1365
No log	11.4286	240	1.2649	0.1176	1.2649	1.1247
No log	11.5238	242	1.2883	0.1505	1.2883	1.1350
No log	11.6190	244	1.3806	0.1219	1.3806	1.1750
No log	11.7143	246	1.5362	0.1516	1.5362	1.2394
No log	11.8095	248	1.5967	0.1149	1.5967	1.2636
No log	11.9048	250	1.5116	0.2020	1.5116	1.2295
No log	12.0	252	1.4155	0.2532	1.4155	1.1898
No log	12.0952	254	1.3101	0.1732	1.3101	1.1446
No log	12.1905	256	1.3214	0.2745	1.3214	1.1495
No log	12.2857	258	1.4501	0.1848	1.4501	1.2042
No log	12.3810	260	1.5893	0.1149	1.5893	1.2607
No log	12.4762	262	1.6208	0.1416	1.6208	1.2731
No log	12.5714	264	1.5622	0.1416	1.5622	1.2499
No log	12.6667	266	1.4522	0.1848	1.4522	1.2051
No log	12.7619	268	1.4113	0.2532	1.4113	1.1880
No log	12.8571	270	1.3969	0.1966	1.3969	1.1819
No log	12.9524	272	1.4206	0.1950	1.4206	1.1919
No log	13.0476	274	1.3946	0.1745	1.3946	1.1809
No log	13.1429	276	1.4311	0.1592	1.4311	1.1963
No log	13.2381	278	1.4407	0.1592	1.4407	1.2003
No log	13.3333	280	1.4685	0.1191	1.4685	1.2118
No log	13.4286	282	1.5556	0.1311	1.5556	1.2472
No log	13.5238	284	1.5085	0.0969	1.5085	1.2282
No log	13.6190	286	1.3832	0.2236	1.3832	1.1761
No log	13.7143	288	1.3224	0.1814	1.3224	1.1500
No log	13.8095	290	1.3337	0.1959	1.3337	1.1548
No log	13.9048	292	1.3986	0.2236	1.3986	1.1826
No log	14.0	294	1.4572	0.1943	1.4572	1.2071
No log	14.0952	296	1.4674	0.2077	1.4674	1.2114
No log	14.1905	298	1.4596	0.1943	1.4596	1.2082
No log	14.2857	300	1.4435	0.1625	1.4435	1.2015
No log	14.3810	302	1.4606	0.1659	1.4606	1.2086
No log	14.4762	304	1.5225	0.1224	1.5225	1.2339
No log	14.5714	306	1.5055	0.1224	1.5055	1.2270
No log	14.6667	308	1.4652	0.1516	1.4652	1.2105
No log	14.7619	310	1.4227	0.1935	1.4227	1.1928
No log	14.8571	312	1.4265	0.1516	1.4265	1.1944
No log	14.9524	314	1.5070	0.1667	1.5070	1.2276
No log	15.0476	316	1.5960	0.1309	1.5960	1.2633
No log	15.1429	318	1.5498	0.1580	1.5498	1.2449
No log	15.2381	320	1.4547	0.1667	1.4547	1.2061
No log	15.3333	322	1.3906	0.1162	1.3906	1.1792
No log	15.4286	324	1.3108	0.2490	1.3108	1.1449
No log	15.5238	326	1.2923	0.2164	1.2923	1.1368
No log	15.6190	328	1.3602	0.1312	1.3602	1.1663
No log	15.7143	330	1.4639	0.1135	1.4639	1.2099
No log	15.8095	332	1.5055	0.1196	1.5055	1.2270
No log	15.9048	334	1.4963	0.1135	1.4963	1.2232
No log	16.0	336	1.4409	0.1462	1.4409	1.2004
No log	16.0952	338	1.4249	0.1005	1.4249	1.1937
No log	16.1905	340	1.3868	0.1159	1.3868	1.1776
No log	16.2857	342	1.3432	0.2119	1.3432	1.1590
No log	16.3810	344	1.3473	0.1808	1.3473	1.1607
No log	16.4762	346	1.3806	0.1480	1.3806	1.1750
No log	16.5714	348	1.4468	0.0526	1.4468	1.2028
No log	16.6667	350	1.4720	0.0526	1.4720	1.2132
No log	16.7619	352	1.5150	0.0447	1.5150	1.2308
No log	16.8571	354	1.5318	0.0662	1.5318	1.2377
No log	16.9524	356	1.5335	0.0878	1.5335	1.2383
No log	17.0476	358	1.5096	0.1395	1.5096	1.2287
No log	17.1429	360	1.5074	0.1395	1.5074	1.2277
No log	17.2381	362	1.5484	0.0586	1.5484	1.2443
No log	17.3333	364	1.5096	0.1313	1.5096	1.2287
No log	17.4286	366	1.4489	0.0916	1.4489	1.2037
No log	17.5238	368	1.4452	0.1443	1.4452	1.2022
No log	17.6190	370	1.5262	0.1140	1.5262	1.2354
No log	17.7143	372	1.6069	0.0207	1.6069	1.2676
No log	17.8095	374	1.7037	0.1697	1.7037	1.3052
No log	17.9048	376	1.6787	0.1616	1.6787	1.2956
No log	18.0	378	1.6111	0.1179	1.6111	1.2693
No log	18.0952	380	1.5098	0.0964	1.5098	1.2287
No log	18.1905	382	1.4632	0.1850	1.4632	1.2096
No log	18.2857	384	1.4385	0.2291	1.4385	1.1994
No log	18.3810	386	1.4395	0.1896	1.4395	1.1998
No log	18.4762	388	1.4270	0.1896	1.4270	1.1946
No log	18.5714	390	1.3939	0.1896	1.3939	1.1806
No log	18.6667	392	1.4174	0.1745	1.4174	1.1905
No log	18.7619	394	1.4624	0.1745	1.4624	1.2093
No log	18.8571	396	1.4907	0.1313	1.4907	1.2210
No log	18.9524	398	1.5365	0.0964	1.5365	1.2396
No log	19.0476	400	1.5431	0.1618	1.5431	1.2422
No log	19.1429	402	1.5288	0.1935	1.5288	1.2364
No log	19.2381	404	1.6234	0.1308	1.6234	1.2741
No log	19.3333	406	1.6448	0.1607	1.6448	1.2825
No log	19.4286	408	1.6883	0.1886	1.6883	1.2993
No log	19.5238	410	1.6566	0.1886	1.6566	1.2871
No log	19.6190	412	1.5582	0.1562	1.5582	1.2483
No log	19.7143	414	1.4628	0.2354	1.4628	1.2095
No log	19.8095	416	1.4258	0.2278	1.4258	1.1941
No log	19.9048	418	1.4359	0.2553	1.4359	1.1983
No log	20.0	420	1.4230	0.2278	1.4230	1.1929
No log	20.0952	422	1.4250	0.2080	1.4250	1.1937
No log	20.1905	424	1.4034	0.1554	1.4034	1.1846
No log	20.2857	426	1.3832	0.1554	1.3832	1.1761
No log	20.3810	428	1.3799	0.1896	1.3799	1.1747
No log	20.4762	430	1.4056	0.1745	1.4056	1.1856
No log	20.5714	432	1.4436	0.1745	1.4436	1.2015
No log	20.6667	434	1.4014	0.1692	1.4014	1.1838
No log	20.7619	436	1.3799	0.1538	1.3799	1.1747
No log	20.8571	438	1.3972	0.1846	1.3972	1.1820
No log	20.9524	440	1.4502	0.1745	1.4502	1.2042
No log	21.0476	442	1.5415	0.1135	1.5415	1.2416
No log	21.1429	444	1.6158	0.1395	1.6158	1.2711
No log	21.2381	446	1.5906	0.1162	1.5906	1.2612
No log	21.3333	448	1.4868	0.1219	1.4868	1.2193
No log	21.4286	450	1.3703	0.1379	1.3703	1.1706
No log	21.5238	452	1.3419	0.1538	1.3419	1.1584
No log	21.6190	454	1.3760	0.1952	1.3760	1.1730
No log	21.7143	456	1.4345	0.1896	1.4345	1.1977
No log	21.8095	458	1.5124	0.1109	1.5124	1.2298
No log	21.9048	460	1.5950	0.1027	1.5950	1.2629
No log	22.0	462	1.6813	0.1802	1.6813	1.2967
No log	22.0952	464	1.6716	0.1531	1.6716	1.2929
No log	22.1905	466	1.5877	0.1162	1.5877	1.2600
No log	22.2857	468	1.4731	0.1219	1.4731	1.2137
No log	22.3810	470	1.3742	0.1053	1.3742	1.1723
No log	22.4762	472	1.3255	0.0628	1.3255	1.1513
No log	22.5714	474	1.3213	0.1582	1.3213	1.1495
No log	22.6667	476	1.3487	0.1952	1.3487	1.1614
No log	22.7619	478	1.4130	0.1094	1.4130	1.1887
No log	22.8571	480	1.5477	0.1481	1.5477	1.2441
No log	22.9524	482	1.6602	0.1228	1.6602	1.2885
No log	23.0476	484	1.6899	0.1112	1.6899	1.2999
No log	23.1429	486	1.6200	0.1283	1.6200	1.2728
No log	23.2381	488	1.5077	0.1219	1.5077	1.2279
No log	23.3333	490	1.4305	0.1219	1.4305	1.1960
No log	23.4286	492	1.3749	0.0454	1.3749	1.1726
No log	23.5238	494	1.3578	0.0454	1.3578	1.1653
No log	23.6190	496	1.3517	0.0454	1.3517	1.1626
No log	23.7143	498	1.3658	0.0887	1.3658	1.1687
0.268	23.8095	500	1.3958	0.1219	1.3958	1.1814
0.268	23.9048	502	1.4241	0.1592	1.4241	1.1934
0.268	24.0	504	1.4063	0.1592	1.4063	1.1859
0.268	24.0952	506	1.3536	0.0887	1.3536	1.1634
0.268	24.1905	508	1.3292	0.0887	1.3292	1.1529
0.268	24.2857	510	1.3278	0.0887	1.3278	1.1523
0.268	24.3810	512	1.3579	0.1592	1.3579	1.1653
0.268	24.4762	514	1.3788	0.1592	1.3788	1.1742
0.268	24.5714	516	1.3881	0.1592	1.3881	1.1782
0.268	24.6667	518	1.3603	0.1592	1.3603	1.1663
0.268	24.7619	520	1.3258	0.1745	1.3258	1.1515
0.268	24.8571	522	1.3255	0.1745	1.3255	1.1513
0.268	24.9524	524	1.3419	0.1592	1.3419	1.1584
0.268	25.0476	526	1.3589	0.1592	1.3589	1.1657
0.268	25.1429	528	1.4187	0.1592	1.4187	1.1911
0.268	25.2381	530	1.4308	0.1592	1.4308	1.1961
0.268	25.3333	532	1.4258	0.1592	1.4258	1.1941
0.268	25.4286	534	1.4022	0.0887	1.4022	1.1841
0.268	25.5238	536	1.4087	0.1283	1.4087	1.1869
0.268	25.6190	538	1.3543	0.0887	1.3543	1.1637
0.268	25.7143	540	1.2972	0.0628	1.2972	1.1389
0.268	25.8095	542	1.2710	0.0628	1.2710	1.1274
0.268	25.9048	544	1.2789	0.0628	1.2789	1.1309
0.268	26.0	546	1.2902	0.1144	1.2902	1.1359

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1