ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3872
• Qwk: 0.1142
• Mse: 1.3872
• Rmse: 1.1778

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1053	2	3.9176	-0.0150	3.9176	1.9793
No log	0.2105	4	2.3266	0.0014	2.3266	1.5253
No log	0.3158	6	1.4976	-0.0219	1.4976	1.2238
No log	0.4211	8	1.3063	0.0683	1.3063	1.1429
No log	0.5263	10	1.1381	0.1864	1.1381	1.0668
No log	0.6316	12	1.1502	0.1521	1.1502	1.0725
No log	0.7368	14	1.1766	0.1361	1.1766	1.0847
No log	0.8421	16	1.1754	0.1268	1.1754	1.0842
No log	0.9474	18	1.0866	0.2042	1.0866	1.0424
No log	1.0526	20	1.0508	0.2140	1.0508	1.0251
No log	1.1579	22	1.0410	0.2140	1.0410	1.0203
No log	1.2632	24	1.0478	0.2391	1.0478	1.0236
No log	1.3684	26	1.0752	0.1196	1.0752	1.0369
No log	1.4737	28	1.0536	0.2239	1.0536	1.0264
No log	1.5789	30	1.0848	0.2061	1.0848	1.0416
No log	1.6842	32	1.3580	0.0169	1.3580	1.1653
No log	1.7895	34	1.5793	0.0178	1.5793	1.2567
No log	1.8947	36	1.2727	0.0202	1.2727	1.1281
No log	2.0	38	1.1210	0.3478	1.1210	1.0588
No log	2.1053	40	1.2585	0.1745	1.2585	1.1218
No log	2.2105	42	1.1723	0.2594	1.1723	1.0827
No log	2.3158	44	1.2669	0.1131	1.2669	1.1256
No log	2.4211	46	1.6367	-0.2230	1.6367	1.2793
No log	2.5263	48	1.6755	-0.2645	1.6755	1.2944
No log	2.6316	50	1.3141	-0.0393	1.3141	1.1464
No log	2.7368	52	1.1324	0.1408	1.1324	1.0641
No log	2.8421	54	1.1472	0.1489	1.1472	1.0711
No log	2.9474	56	1.4207	0.1914	1.4207	1.1919
No log	3.0526	58	1.8328	0.1078	1.8328	1.3538
No log	3.1579	60	1.8597	0.1020	1.8597	1.3637
No log	3.2632	62	1.5590	0.1627	1.5590	1.2486
No log	3.3684	64	1.3824	0.2062	1.3824	1.1758
No log	3.4737	66	1.5355	0.1322	1.5355	1.2391
No log	3.5789	68	1.8041	0.1283	1.8041	1.3432
No log	3.6842	70	1.9208	-0.0056	1.9208	1.3859
No log	3.7895	72	1.9470	0.0018	1.9470	1.3953
No log	3.8947	74	1.9005	-0.0283	1.9005	1.3786
No log	4.0	76	1.8293	0.0477	1.8293	1.3525
No log	4.1053	78	1.6410	0.0484	1.6410	1.2810
No log	4.2105	80	1.5210	0.1081	1.5210	1.2333
No log	4.3158	82	1.4128	0.0033	1.4128	1.1886
No log	4.4211	84	1.3978	0.0691	1.3978	1.1823
No log	4.5263	86	1.4478	0.1081	1.4478	1.2032
No log	4.6316	88	1.5616	0.1328	1.5616	1.2496
No log	4.7368	90	1.7871	0.1207	1.7871	1.3368
No log	4.8421	92	1.9847	0.1252	1.9847	1.4088
No log	4.9474	94	1.9684	0.1176	1.9684	1.4030
No log	5.0526	96	1.6582	0.1353	1.6582	1.2877
No log	5.1579	98	1.6566	0.1353	1.6566	1.2871
No log	5.2632	100	1.9027	0.1409	1.9027	1.3794
No log	5.3684	102	2.3245	0.0950	2.3245	1.5246
No log	5.4737	104	2.2937	0.0900	2.2937	1.5145
No log	5.5789	106	2.0356	0.1368	2.0356	1.4267
No log	5.6842	108	1.6458	0.1071	1.6458	1.2829
No log	5.7895	110	1.4525	0.1751	1.4525	1.2052
No log	5.8947	112	1.4924	0.1630	1.4924	1.2216
No log	6.0	114	1.6254	0.1000	1.6254	1.2749
No log	6.1053	116	1.6562	0.1000	1.6562	1.2869
No log	6.2105	118	1.6338	0.1365	1.6338	1.2782
No log	6.3158	120	1.5846	0.2129	1.5846	1.2588
No log	6.4211	122	1.6997	0.1183	1.6997	1.3037
No log	6.5263	124	1.8698	0.1140	1.8698	1.3674
No log	6.6316	126	2.0165	0.1258	2.0165	1.4201
No log	6.7368	128	1.8880	0.1505	1.8880	1.3740
No log	6.8421	130	1.5077	0.1634	1.5077	1.2279
No log	6.9474	132	1.2350	0.0987	1.2350	1.1113
No log	7.0526	134	1.2135	0.1141	1.2135	1.1016
No log	7.1579	136	1.3455	0.0931	1.3455	1.1599
No log	7.2632	138	1.6170	0.1509	1.6170	1.2716
No log	7.3684	140	1.6777	0.1487	1.6777	1.2953
No log	7.4737	142	1.5721	0.1729	1.5721	1.2538
No log	7.5789	144	1.5050	0.1832	1.5050	1.2268
No log	7.6842	146	1.5235	0.2117	1.5235	1.2343
No log	7.7895	148	1.6313	0.1344	1.6313	1.2772
No log	7.8947	150	1.6262	0.1467	1.6262	1.2752
No log	8.0	152	1.5039	0.2221	1.5039	1.2263
No log	8.1053	154	1.4137	0.2117	1.4137	1.1890
No log	8.2105	156	1.4275	0.2117	1.4275	1.1948
No log	8.3158	158	1.3339	0.1958	1.3339	1.1549
No log	8.4211	160	1.3011	0.1904	1.3011	1.1406
No log	8.5263	162	1.3780	0.1832	1.3780	1.1739
No log	8.6316	164	1.5343	0.2170	1.5343	1.2387
No log	8.7368	166	1.5987	0.1635	1.5987	1.2644
No log	8.8421	168	1.6470	0.1694	1.6470	1.2834
No log	8.9474	170	1.6179	0.1694	1.6179	1.2720
No log	9.0526	172	1.4761	0.1595	1.4761	1.2149
No log	9.1579	174	1.4010	0.0760	1.4010	1.1836
No log	9.2632	176	1.3913	0.0	1.3913	1.1795
No log	9.3684	178	1.4553	0.1814	1.4553	1.2064
No log	9.4737	180	1.4645	0.2126	1.4645	1.2102
No log	9.5789	182	1.4298	0.2126	1.4298	1.1958
No log	9.6842	184	1.3482	0.0401	1.3482	1.1611
No log	9.7895	186	1.2226	-0.0091	1.2226	1.1057
No log	9.8947	188	1.2121	0.1198	1.2121	1.1009
No log	10.0	190	1.3341	0.1980	1.3341	1.1550
No log	10.1053	192	1.5149	0.2005	1.5149	1.2308
No log	10.2105	194	1.5089	0.2058	1.5089	1.2284
No log	10.3158	196	1.4371	0.1950	1.4371	1.1988
No log	10.4211	198	1.2562	0.0541	1.2562	1.1208
No log	10.5263	200	1.2060	-0.0216	1.2060	1.0982
No log	10.6316	202	1.3077	0.1728	1.3077	1.1436
No log	10.7368	204	1.4397	0.2005	1.4397	1.1999
No log	10.8421	206	1.5346	0.2005	1.5346	1.2388
No log	10.9474	208	1.4742	0.2005	1.4742	1.2142
No log	11.0526	210	1.3491	0.1832	1.3491	1.1615
No log	11.1579	212	1.1832	0.1170	1.1832	1.0877
No log	11.2632	214	1.1579	0.0811	1.1579	1.0760
No log	11.3684	216	1.2644	0.1880	1.2644	1.1245
No log	11.4737	218	1.4376	0.1950	1.4376	1.1990
No log	11.5789	220	1.5114	0.1950	1.5114	1.2294
No log	11.6842	222	1.6425	0.1344	1.6425	1.2816
No log	11.7895	224	1.7071	0.1663	1.7071	1.3065
No log	11.8947	226	1.6149	0.1279	1.6149	1.2708
No log	12.0	228	1.4746	0.1943	1.4746	1.2143
No log	12.1053	230	1.4180	0.2065	1.4180	1.1908
No log	12.2105	232	1.4547	0.2065	1.4547	1.2061
No log	12.3158	234	1.5618	0.1573	1.5618	1.2497
No log	12.4211	236	1.6697	0.1007	1.6697	1.2922
No log	12.5263	238	1.7174	0.1014	1.7174	1.3105
No log	12.6316	240	1.5630	0.2110	1.5630	1.2502
No log	12.7368	242	1.3729	0.1751	1.3729	1.1717
No log	12.8421	244	1.3521	0.1751	1.3521	1.1628
No log	12.9474	246	1.5094	0.2058	1.5094	1.2286
No log	13.0526	248	1.5393	0.2058	1.5393	1.2407
No log	13.1579	250	1.5269	0.2005	1.5269	1.2357
No log	13.2632	252	1.4245	0.1562	1.4245	1.1935
No log	13.3684	254	1.3981	0.0781	1.3981	1.1824
No log	13.4737	256	1.4330	0.0781	1.4330	1.1971
No log	13.5789	258	1.4087	0.0781	1.4087	1.1869
No log	13.6842	260	1.4749	0.1032	1.4749	1.2145
No log	13.7895	262	1.5755	0.2005	1.5755	1.2552
No log	13.8947	264	1.6229	0.1694	1.6229	1.2739
No log	14.0	266	1.6082	0.1635	1.6082	1.2681
No log	14.1053	268	1.4801	0.1950	1.4801	1.2166
No log	14.2105	270	1.4363	0.1950	1.4363	1.1985
No log	14.3158	272	1.4135	0.1950	1.4135	1.1889
No log	14.4211	274	1.4792	0.1950	1.4792	1.2162
No log	14.5263	276	1.4931	0.1950	1.4931	1.2219
No log	14.6316	278	1.4537	0.1950	1.4537	1.2057
No log	14.7368	280	1.3746	0.2117	1.3746	1.1724
No log	14.8421	282	1.3315	0.2084	1.3315	1.1539
No log	14.9474	284	1.4369	0.2170	1.4369	1.1987
No log	15.0526	286	1.4750	0.2342	1.4750	1.2145
No log	15.1579	288	1.4850	0.2004	1.4850	1.2186
No log	15.2632	290	1.4970	0.2126	1.4970	1.2235
No log	15.3684	292	1.5356	0.2062	1.5356	1.2392
No log	15.4737	294	1.5404	0.2117	1.5404	1.2411
No log	15.5789	296	1.5043	0.2117	1.5043	1.2265
No log	15.6842	298	1.4164	0.2117	1.4164	1.1901
No log	15.7895	300	1.4236	0.2117	1.4236	1.1932
No log	15.8947	302	1.4448	0.1950	1.4448	1.2020
No log	16.0	304	1.3485	0.1790	1.3485	1.1612
No log	16.1053	306	1.3172	0.1790	1.3172	1.1477
No log	16.2105	308	1.4019	0.1950	1.4019	1.1840
No log	16.3158	310	1.4124	0.1950	1.4124	1.1884
No log	16.4211	312	1.4007	0.2221	1.4007	1.1835
No log	16.5263	314	1.2588	0.2211	1.2588	1.1220
No log	16.6316	316	1.2114	0.2112	1.2114	1.1007
No log	16.7368	318	1.3455	0.2144	1.3455	1.1599
No log	16.8421	320	1.3785	0.2144	1.3785	1.1741
No log	16.9474	322	1.4096	0.1751	1.4096	1.1873
No log	17.0526	324	1.3582	0.1914	1.3582	1.1654
No log	17.1579	326	1.3569	0.1728	1.3569	1.1649
No log	17.2632	328	1.3664	0.2184	1.3664	1.1689
No log	17.3684	330	1.3243	0.2372	1.3243	1.1508
No log	17.4737	332	1.3023	0.2506	1.3023	1.1412
No log	17.5789	334	1.3217	0.2315	1.3217	1.1496
No log	17.6842	336	1.3099	0.2203	1.3099	1.1445
No log	17.7895	338	1.4031	0.2062	1.4031	1.1845
No log	17.8947	340	1.5446	0.2110	1.5446	1.2428
No log	18.0	342	1.6717	0.2338	1.6717	1.2929
No log	18.1053	344	1.6808	0.2565	1.6808	1.2965
No log	18.2105	346	1.5523	0.2270	1.5523	1.2459
No log	18.3158	348	1.3948	0.2026	1.3948	1.1810
No log	18.4211	350	1.2910	0.0691	1.2910	1.1362
No log	18.5263	352	1.2718	0.0310	1.2718	1.1277
No log	18.6316	354	1.2927	0.1170	1.2927	1.1370
No log	18.7368	356	1.3216	0.1904	1.3216	1.1496
No log	18.8421	358	1.3856	0.2240	1.3856	1.1771
No log	18.9474	360	1.4772	0.2005	1.4772	1.2154
No log	19.0526	362	1.5200	0.1635	1.5200	1.2329
No log	19.1579	364	1.4715	0.1950	1.4715	1.2130
No log	19.2632	366	1.3747	0.2117	1.3747	1.1725
No log	19.3684	368	1.2947	0.2126	1.2947	1.1378
No log	19.4737	370	1.3408	0.1814	1.3408	1.1579
No log	19.5789	372	1.3539	0.2126	1.3539	1.1636
No log	19.6842	374	1.2752	0.2126	1.2752	1.1292
No log	19.7895	376	1.2603	0.1595	1.2603	1.1226
No log	19.8947	378	1.3594	0.2117	1.3594	1.1659
No log	20.0	380	1.5366	0.2117	1.5366	1.2396
No log	20.1053	382	1.5396	0.1963	1.5396	1.2408
No log	20.2105	384	1.4758	0.1692	1.4758	1.2148
No log	20.3158	386	1.4716	0.1790	1.4716	1.2131
No log	20.4211	388	1.4654	0.2117	1.4654	1.2106
No log	20.5263	390	1.3947	0.1634	1.3947	1.1810
No log	20.6316	392	1.3813	0.1388	1.3813	1.1753
No log	20.7368	394	1.3264	0.1388	1.3264	1.1517
No log	20.8421	396	1.2328	0.0973	1.2328	1.1103
No log	20.9474	398	1.1839	0.1194	1.1839	1.0881
No log	21.0526	400	1.2777	0.1522	1.2777	1.1304
No log	21.1579	402	1.4796	0.2566	1.4796	1.2164
No log	21.2632	404	1.5677	0.2806	1.5677	1.2521
No log	21.3684	406	1.4723	0.2005	1.4723	1.2134
No log	21.4737	408	1.3599	0.2292	1.3599	1.1662
No log	21.5789	410	1.2561	0.1486	1.2561	1.1208
No log	21.6842	412	1.1907	0.0556	1.1907	1.0912
No log	21.7895	414	1.1675	0.0710	1.1675	1.0805
No log	21.8947	416	1.1655	0.0710	1.1655	1.0796
No log	22.0	418	1.2322	0.1628	1.2322	1.1100
No log	22.1053	420	1.2863	0.1769	1.2863	1.1341
No log	22.2105	422	1.3471	0.2417	1.3471	1.1607
No log	22.3158	424	1.4784	0.2170	1.4784	1.2159
No log	22.4211	426	1.6072	0.1694	1.6072	1.2678
No log	22.5263	428	1.6353	0.1694	1.6353	1.2788
No log	22.6316	430	1.5500	0.2117	1.5500	1.2450
No log	22.7368	432	1.4357	0.1562	1.4357	1.1982
No log	22.8421	434	1.3995	0.0401	1.3995	1.1830
No log	22.9474	436	1.3896	0.0	1.3896	1.1788
No log	23.0526	438	1.4193	0.0	1.4193	1.1913
No log	23.1579	440	1.4644	0.0401	1.4644	1.2101
No log	23.2632	442	1.5171	0.1142	1.5171	1.2317
No log	23.3684	444	1.5443	0.2065	1.5443	1.2427
No log	23.4737	446	1.5108	0.1634	1.5108	1.2291
No log	23.5789	448	1.4818	0.1634	1.4818	1.2173
No log	23.6842	450	1.4434	0.1634	1.4434	1.2014
No log	23.7895	452	1.4121	0.1228	1.4121	1.1883
No log	23.8947	454	1.3979	0.1228	1.3979	1.1823
No log	24.0	456	1.3761	0.1228	1.3761	1.1731
No log	24.1053	458	1.4420	0.2126	1.4420	1.2008
No log	24.2105	460	1.5349	0.2474	1.5349	1.2389
No log	24.3158	462	1.5119	0.2126	1.5119	1.2296
No log	24.4211	464	1.4185	0.1228	1.4185	1.1910
No log	24.5263	466	1.3941	0.0878	1.3941	1.1807
No log	24.6316	468	1.4087	0.0878	1.4088	1.1869
No log	24.7368	470	1.4298	0.1769	1.4298	1.1957
No log	24.8421	472	1.4578	0.1663	1.4578	1.2074
No log	24.9474	474	1.5245	0.2431	1.5245	1.2347
No log	25.0526	476	1.6141	0.2606	1.6141	1.2705
No log	25.1579	478	1.6582	0.2566	1.6582	1.2877
No log	25.2632	480	1.6303	0.2525	1.6303	1.2768
No log	25.3684	482	1.5293	0.2568	1.5293	1.2367
No log	25.4737	484	1.3964	0.1168	1.3964	1.1817
No log	25.5789	486	1.3342	0.0789	1.3342	1.1551
No log	25.6842	488	1.3365	0.1140	1.3365	1.1560
No log	25.7895	490	1.4015	0.1168	1.4015	1.1838
No log	25.8947	492	1.4888	0.1769	1.4888	1.2202
No log	26.0	494	1.5071	0.2117	1.5071	1.2277
No log	26.1053	496	1.4740	0.2117	1.4740	1.2141
No log	26.2105	498	1.4479	0.1462	1.4479	1.2033
0.2189	26.3158	500	1.4045	0.1634	1.4045	1.1851
0.2189	26.4211	502	1.3660	0.1562	1.3660	1.1687
0.2189	26.5263	504	1.3572	0.1562	1.3572	1.1650
0.2189	26.6316	506	1.4085	0.1943	1.4085	1.1868
0.2189	26.7368	508	1.4626	0.2292	1.4626	1.2094
0.2189	26.8421	510	1.4578	0.2004	1.4578	1.2074
0.2189	26.9474	512	1.4621	0.2004	1.4621	1.2092
0.2189	27.0526	514	1.4241	0.1634	1.4241	1.1933
0.2189	27.1579	516	1.4171	0.1310	1.4171	1.1904
0.2189	27.2632	518	1.4151	0.1142	1.4151	1.1896
0.2189	27.3684	520	1.3819	0.1310	1.3819	1.1755
0.2189	27.4737	522	1.3872	0.1142	1.3872	1.1778

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1