ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3899
• Qwk: 0.1142
• Mse: 1.3899
• Rmse: 1.1790

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1053	2	3.9176	-0.0150	3.9176	1.9793
No log	0.2105	4	2.3266	0.0014	2.3266	1.5253
No log	0.3158	6	1.4976	-0.0219	1.4976	1.2238
No log	0.4211	8	1.3063	0.0683	1.3063	1.1429
No log	0.5263	10	1.1381	0.1864	1.1381	1.0668
No log	0.6316	12	1.1502	0.1521	1.1502	1.0725
No log	0.7368	14	1.1766	0.1361	1.1766	1.0847
No log	0.8421	16	1.1754	0.1268	1.1754	1.0842
No log	0.9474	18	1.0866	0.2042	1.0866	1.0424
No log	1.0526	20	1.0508	0.2140	1.0508	1.0251
No log	1.1579	22	1.0410	0.2140	1.0410	1.0203
No log	1.2632	24	1.0478	0.2391	1.0478	1.0236
No log	1.3684	26	1.0752	0.1196	1.0752	1.0369
No log	1.4737	28	1.0536	0.2239	1.0536	1.0264
No log	1.5789	30	1.0848	0.2061	1.0848	1.0416
No log	1.6842	32	1.3580	0.0169	1.3580	1.1653
No log	1.7895	34	1.5793	0.0178	1.5793	1.2567
No log	1.8947	36	1.2727	0.0202	1.2727	1.1281
No log	2.0	38	1.1210	0.3478	1.1210	1.0588
No log	2.1053	40	1.2585	0.1745	1.2585	1.1218
No log	2.2105	42	1.1723	0.2594	1.1723	1.0827
No log	2.3158	44	1.2669	0.1131	1.2669	1.1256
No log	2.4211	46	1.6367	-0.2230	1.6367	1.2793
No log	2.5263	48	1.6755	-0.2645	1.6755	1.2944
No log	2.6316	50	1.3141	-0.0393	1.3141	1.1464
No log	2.7368	52	1.1324	0.1408	1.1324	1.0641
No log	2.8421	54	1.1472	0.1489	1.1472	1.0711
No log	2.9474	56	1.4208	0.1914	1.4208	1.1920
No log	3.0526	58	1.8329	0.1078	1.8329	1.3538
No log	3.1579	60	1.8598	0.1020	1.8598	1.3637
No log	3.2632	62	1.5590	0.1627	1.5590	1.2486
No log	3.3684	64	1.3824	0.2062	1.3824	1.1758
No log	3.4737	66	1.5354	0.1322	1.5354	1.2391
No log	3.5789	68	1.8040	0.1283	1.8040	1.3431
No log	3.6842	70	1.9207	-0.0056	1.9207	1.3859
No log	3.7895	72	1.9469	0.0018	1.9469	1.3953
No log	3.8947	74	1.9005	-0.0283	1.9005	1.3786
No log	4.0	76	1.8292	0.0477	1.8292	1.3525
No log	4.1053	78	1.6410	0.0484	1.6410	1.2810
No log	4.2105	80	1.5210	0.1081	1.5210	1.2333
No log	4.3158	82	1.4128	0.0033	1.4128	1.1886
No log	4.4211	84	1.3979	0.0691	1.3979	1.1823
No log	4.5263	86	1.4478	0.1081	1.4478	1.2032
No log	4.6316	88	1.5616	0.1328	1.5616	1.2496
No log	4.7368	90	1.7871	0.1207	1.7871	1.3368
No log	4.8421	92	1.9847	0.1252	1.9847	1.4088
No log	4.9474	94	1.9684	0.1176	1.9684	1.4030
No log	5.0526	96	1.6582	0.1353	1.6582	1.2877
No log	5.1579	98	1.6567	0.1353	1.6567	1.2871
No log	5.2632	100	1.9028	0.1409	1.9028	1.3794
No log	5.3684	102	2.3246	0.0950	2.3246	1.5247
No log	5.4737	104	2.2938	0.0900	2.2938	1.5145
No log	5.5789	106	2.0357	0.1368	2.0357	1.4268
No log	5.6842	108	1.6460	0.1071	1.6460	1.2830
No log	5.7895	110	1.4527	0.1751	1.4527	1.2053
No log	5.8947	112	1.4925	0.1630	1.4925	1.2217
No log	6.0	114	1.6255	0.1000	1.6255	1.2749
No log	6.1053	116	1.6562	0.1000	1.6562	1.2870
No log	6.2105	118	1.6340	0.1365	1.6340	1.2783
No log	6.3158	120	1.5847	0.2129	1.5847	1.2589
No log	6.4211	122	1.6998	0.1183	1.6998	1.3038
No log	6.5263	124	1.8697	0.1140	1.8697	1.3674
No log	6.6316	126	2.0162	0.1258	2.0162	1.4199
No log	6.7368	128	1.8876	0.1505	1.8876	1.3739
No log	6.8421	130	1.5074	0.1562	1.5074	1.2277
No log	6.9474	132	1.2349	0.0987	1.2349	1.1112
No log	7.0526	134	1.2134	0.1141	1.2134	1.1015
No log	7.1579	136	1.3453	0.0931	1.3453	1.1599
No log	7.2632	138	1.6169	0.1509	1.6169	1.2716
No log	7.3684	140	1.6776	0.1487	1.6776	1.2952
No log	7.4737	142	1.5720	0.1729	1.5720	1.2538
No log	7.5789	144	1.5050	0.1832	1.5050	1.2268
No log	7.6842	146	1.5237	0.2117	1.5237	1.2344
No log	7.7895	148	1.6316	0.1344	1.6316	1.2774
No log	7.8947	150	1.6266	0.1467	1.6266	1.2754
No log	8.0	152	1.5043	0.2221	1.5043	1.2265
No log	8.1053	154	1.4140	0.2117	1.4140	1.1891
No log	8.2105	156	1.4278	0.2117	1.4278	1.1949
No log	8.3158	158	1.3340	0.1958	1.3340	1.1550
No log	8.4211	160	1.3011	0.1904	1.3011	1.1407
No log	8.5263	162	1.3779	0.1832	1.3779	1.1738
No log	8.6316	164	1.5340	0.2170	1.5340	1.2386
No log	8.7368	166	1.5984	0.1635	1.5984	1.2643
No log	8.8421	168	1.6468	0.1694	1.6468	1.2833
No log	8.9474	170	1.6180	0.1635	1.6180	1.2720
No log	9.0526	172	1.4764	0.1595	1.4764	1.2151
No log	9.1579	174	1.4013	0.0760	1.4013	1.1838
No log	9.2632	176	1.3915	0.0	1.3915	1.1796
No log	9.3684	178	1.4553	0.1814	1.4553	1.2064
No log	9.4737	180	1.4647	0.2126	1.4647	1.2102
No log	9.5789	182	1.4300	0.2126	1.4300	1.1958
No log	9.6842	184	1.3482	0.0401	1.3482	1.1611
No log	9.7895	186	1.2226	-0.0091	1.2226	1.1057
No log	9.8947	188	1.2123	0.1198	1.2123	1.1010
No log	10.0	190	1.3346	0.1980	1.3346	1.1553
No log	10.1053	192	1.5157	0.2005	1.5157	1.2311
No log	10.2105	194	1.5091	0.2058	1.5091	1.2284
No log	10.3158	196	1.4358	0.1950	1.4358	1.1983
No log	10.4211	198	1.2546	0.0691	1.2546	1.1201
No log	10.5263	200	1.2045	-0.0216	1.2045	1.0975
No log	10.6316	202	1.3057	0.1728	1.3057	1.1427
No log	10.7368	204	1.4385	0.2005	1.4385	1.1994
No log	10.8421	206	1.5348	0.2005	1.5348	1.2389
No log	10.9474	208	1.4751	0.2005	1.4751	1.2146
No log	11.0526	210	1.3500	0.1832	1.3500	1.1619
No log	11.1579	212	1.1840	0.1170	1.1840	1.0881
No log	11.2632	214	1.1584	0.0811	1.1584	1.0763
No log	11.3684	216	1.2645	0.1880	1.2645	1.1245
No log	11.4737	218	1.4375	0.1950	1.4375	1.1990
No log	11.5789	220	1.5114	0.1950	1.5114	1.2294
No log	11.6842	222	1.6426	0.1344	1.6426	1.2817
No log	11.7895	224	1.7074	0.1663	1.7074	1.3067
No log	11.8947	226	1.6150	0.1279	1.6150	1.2708
No log	12.0	228	1.4748	0.1943	1.4748	1.2144
No log	12.1053	230	1.4182	0.2065	1.4182	1.1909
No log	12.2105	232	1.4542	0.2065	1.4542	1.2059
No log	12.3158	234	1.5575	0.1573	1.5575	1.2480
No log	12.4211	236	1.6645	0.1007	1.6645	1.2901
No log	12.5263	238	1.7150	0.1014	1.7150	1.3096
No log	12.6316	240	1.5629	0.2110	1.5629	1.2502
No log	12.7368	242	1.3688	0.1751	1.3688	1.1700
No log	12.8421	244	1.3463	0.1751	1.3463	1.1603
No log	12.9474	246	1.5056	0.2058	1.5056	1.2270
No log	13.0526	248	1.5366	0.2058	1.5366	1.2396
No log	13.1579	250	1.5290	0.2005	1.5290	1.2365
No log	13.2632	252	1.4272	0.1562	1.4272	1.1946
No log	13.3684	254	1.3998	0.0781	1.3998	1.1831
No log	13.4737	256	1.4328	0.0781	1.4328	1.1970
No log	13.5789	258	1.4054	0.0390	1.4054	1.1855
No log	13.6842	260	1.4702	0.1032	1.4702	1.2125
No log	13.7895	262	1.5703	0.2005	1.5703	1.2531
No log	13.8947	264	1.6183	0.1694	1.6183	1.2721
No log	14.0	266	1.6066	0.1635	1.6066	1.2675
No log	14.1053	268	1.4817	0.1950	1.4817	1.2173
No log	14.2105	270	1.4413	0.1950	1.4413	1.2005
No log	14.3158	272	1.4126	0.1950	1.4126	1.1885
No log	14.4211	274	1.4732	0.1950	1.4732	1.2138
No log	14.5263	276	1.4856	0.1950	1.4856	1.2189
No log	14.6316	278	1.4484	0.2117	1.4484	1.2035
No log	14.7368	280	1.3714	0.2292	1.3714	1.1710
No log	14.8421	282	1.3312	0.2084	1.3312	1.1538
No log	14.9474	284	1.4385	0.2170	1.4385	1.1994
No log	15.0526	286	1.4809	0.2391	1.4809	1.2169
No log	15.1579	288	1.4925	0.1943	1.4925	1.2217
No log	15.2632	290	1.5102	0.1943	1.5102	1.2289
No log	15.3684	292	1.5475	0.2062	1.5475	1.2440
No log	15.4737	294	1.5514	0.2117	1.5514	1.2455
No log	15.5789	296	1.5168	0.2117	1.5168	1.2316
No log	15.6842	298	1.4277	0.2117	1.4277	1.1949
No log	15.7895	300	1.4340	0.1950	1.4340	1.1975
No log	15.8947	302	1.4547	0.1950	1.4547	1.2061
No log	16.0	304	1.3524	0.1790	1.3524	1.1629
No log	16.1053	306	1.3186	0.1790	1.3186	1.1483
No log	16.2105	308	1.4042	0.1950	1.4042	1.1850
No log	16.3158	310	1.4142	0.1950	1.4142	1.1892
No log	16.4211	312	1.4042	0.1950	1.4042	1.1850
No log	16.5263	314	1.2643	0.2112	1.2643	1.1244
No log	16.6316	316	1.2167	0.2112	1.2167	1.1031
No log	16.7368	318	1.3570	0.2144	1.3570	1.1649
No log	16.8421	320	1.3923	0.2144	1.3923	1.1800
No log	16.9474	322	1.4215	0.1751	1.4215	1.1922
No log	17.0526	324	1.3627	0.1914	1.3627	1.1674
No log	17.1579	326	1.3550	0.1854	1.3550	1.1641
No log	17.2632	328	1.3621	0.2184	1.3621	1.1671
No log	17.3684	330	1.3136	0.2372	1.3136	1.1461
No log	17.4737	332	1.2905	0.2203	1.2905	1.1360
No log	17.5789	334	1.3098	0.2315	1.3098	1.1445
No log	17.6842	336	1.2990	0.2015	1.2990	1.1398
No log	17.7895	338	1.3915	0.2187	1.3915	1.1796
No log	17.8947	340	1.5539	0.1902	1.5539	1.2465
No log	18.0	342	1.7262	0.2457	1.7262	1.3139
No log	18.1053	344	1.7673	0.2457	1.7673	1.3294
No log	18.2105	346	1.6504	0.2338	1.6504	1.2847
No log	18.3158	348	1.4575	0.2117	1.4575	1.2073
No log	18.4211	350	1.3113	0.1654	1.3113	1.1451
No log	18.5263	352	1.2733	0.0310	1.2733	1.1284
No log	18.6316	354	1.2881	0.0961	1.2881	1.1350
No log	18.7368	356	1.3179	0.1886	1.3179	1.1480
No log	18.8421	358	1.3917	0.2239	1.3917	1.1797
No log	18.9474	360	1.4840	0.1950	1.4840	1.2182
No log	19.0526	362	1.5211	0.1635	1.5211	1.2333
No log	19.1579	364	1.4728	0.2005	1.4728	1.2136
No log	19.2632	366	1.3604	0.2187	1.3604	1.1663
No log	19.3684	368	1.2626	0.2260	1.2626	1.1237
No log	19.4737	370	1.2954	0.2126	1.2954	1.1382
No log	19.5789	372	1.3142	0.2126	1.3142	1.1464
No log	19.6842	374	1.2450	0.2126	1.2450	1.1158
No log	19.7895	376	1.2405	0.2126	1.2405	1.1138
No log	19.8947	378	1.3254	0.1958	1.3254	1.1512
No log	20.0	380	1.4871	0.2117	1.4871	1.2195
No log	20.1053	382	1.4813	0.1751	1.4813	1.2171
No log	20.2105	384	1.4522	0.1872	1.4522	1.2051
No log	20.3158	386	1.4772	0.1790	1.4772	1.2154
No log	20.4211	388	1.5036	0.2062	1.5036	1.2262
No log	20.5263	390	1.4570	0.1943	1.4570	1.2071
No log	20.6316	392	1.4378	0.2062	1.4378	1.1991
No log	20.7368	394	1.3644	0.1395	1.3644	1.1681
No log	20.8421	396	1.2743	0.1476	1.2743	1.1289
No log	20.9474	398	1.2609	0.1419	1.2609	1.1229
No log	21.0526	400	1.3958	0.1810	1.3958	1.1815
No log	21.1579	402	1.5779	0.2806	1.5779	1.2561
No log	21.2632	404	1.6199	0.2103	1.6199	1.2727
No log	21.3684	406	1.5060	0.2005	1.5060	1.2272
No log	21.4737	408	1.3542	0.2292	1.3542	1.1637
No log	21.5789	410	1.2574	0.1486	1.2574	1.1213
No log	21.6842	412	1.2508	0.1486	1.2508	1.1184
No log	21.7895	414	1.3002	0.1486	1.3002	1.1403
No log	21.8947	416	1.3576	0.2126	1.3576	1.1651
No log	22.0	418	1.4035	0.2292	1.4035	1.1847
No log	22.1053	420	1.3700	0.2417	1.3700	1.1705
No log	22.2105	422	1.3617	0.2417	1.3617	1.1669
No log	22.3158	424	1.4811	0.2117	1.4811	1.2170
No log	22.4211	426	1.6230	0.1847	1.6230	1.2740
No log	22.5263	428	1.6384	0.1789	1.6384	1.2800
No log	22.6316	430	1.5363	0.1832	1.5363	1.2395
No log	22.7368	432	1.3776	0.0401	1.3776	1.1737
No log	22.8421	434	1.2602	0.0	1.2602	1.1226
No log	22.9474	436	1.2567	0.0	1.2567	1.1210
No log	23.0526	438	1.2976	0.0	1.2976	1.1391
No log	23.1579	440	1.3930	0.0401	1.3930	1.1802
No log	23.2632	442	1.5301	0.2126	1.5301	1.2370
No log	23.3684	444	1.5954	0.1943	1.5954	1.2631
No log	23.4737	446	1.5731	0.1943	1.5731	1.2542
No log	23.5789	448	1.5024	0.2126	1.5024	1.2257
No log	23.6842	450	1.4595	0.2126	1.4595	1.2081
No log	23.7895	452	1.4480	0.1562	1.4480	1.2033
No log	23.8947	454	1.4642	0.1486	1.4642	1.2100
No log	24.0	456	1.4647	0.1486	1.4647	1.2103
No log	24.1053	458	1.5153	0.2126	1.5153	1.2310
No log	24.2105	460	1.5240	0.1486	1.5240	1.2345
No log	24.3158	462	1.4763	0.1486	1.4763	1.2150
No log	24.4211	464	1.3853	0.0781	1.3853	1.1770
No log	24.5263	466	1.3377	0.0	1.3377	1.1566
No log	24.6316	468	1.3616	0.0781	1.3616	1.1669
No log	24.7368	470	1.4343	0.1562	1.4343	1.1976
No log	24.8421	472	1.4987	0.2342	1.4987	1.2242
No log	24.9474	474	1.5790	0.2170	1.5790	1.2566
No log	25.0526	476	1.6612	0.2270	1.6612	1.2889
No log	25.1579	478	1.7019	0.2159	1.7019	1.3046
No log	25.2632	480	1.6873	0.2110	1.6873	1.2990
No log	25.3684	482	1.6438	0.2170	1.6438	1.2821
No log	25.4737	484	1.5806	0.2292	1.5806	1.2572
No log	25.5789	486	1.5024	0.2292	1.5024	1.2257
No log	25.6842	488	1.4563	0.2239	1.4563	1.2068
No log	25.7895	490	1.4210	0.2239	1.4210	1.1921
No log	25.8947	492	1.4110	0.1388	1.4110	1.1879
No log	26.0	494	1.4062	0.1562	1.4062	1.1858
No log	26.1053	496	1.4326	0.1562	1.4326	1.1969
No log	26.2105	498	1.4824	0.2292	1.4824	1.2176
0.2184	26.3158	500	1.4870	0.2342	1.4870	1.2194
0.2184	26.4211	502	1.4394	0.2342	1.4394	1.1997
0.2184	26.5263	504	1.4221	0.1943	1.4221	1.1925
0.2184	26.6316	506	1.4437	0.1943	1.4437	1.2015
0.2184	26.7368	508	1.4327	0.1943	1.4327	1.1969
0.2184	26.8421	510	1.3899	0.1142	1.3899	1.1790

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1