ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3500
• Qwk: 0.1536
• Mse: 1.3500
• Rmse: 1.1619

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.7510	-0.0020	4.7510	2.1797
No log	0.0976	4	2.6202	0.0332	2.6202	1.6187
No log	0.1463	6	2.3616	-0.0464	2.3616	1.5367
No log	0.1951	8	1.9839	-0.0588	1.9839	1.4085
No log	0.2439	10	1.3510	0.0661	1.3510	1.1623
No log	0.2927	12	1.3262	-0.0047	1.3262	1.1516
No log	0.3415	14	1.3885	0.0019	1.3885	1.1783
No log	0.3902	16	1.4415	0.0538	1.4415	1.2006
No log	0.4390	18	1.4977	-0.0149	1.4977	1.2238
No log	0.4878	20	1.5054	0.0	1.5054	1.2270
No log	0.5366	22	1.4717	0.0	1.4717	1.2131
No log	0.5854	24	1.4220	0.0	1.4220	1.1925
No log	0.6341	26	1.3324	0.0339	1.3324	1.1543
No log	0.6829	28	1.2224	0.1397	1.2224	1.1056
No log	0.7317	30	1.1839	0.1752	1.1839	1.0881
No log	0.7805	32	1.1907	0.1076	1.1907	1.0912
No log	0.8293	34	1.2411	0.0628	1.2411	1.1140
No log	0.8780	36	1.2348	0.0628	1.2348	1.1112
No log	0.9268	38	1.2081	0.1076	1.2081	1.0991
No log	0.9756	40	1.1956	0.0780	1.1956	1.0934
No log	1.0244	42	1.2661	0.0831	1.2661	1.1252
No log	1.0732	44	1.2841	0.0831	1.2841	1.1332
No log	1.1220	46	1.3111	0.0796	1.3111	1.1450
No log	1.1707	48	1.3074	0.0559	1.3074	1.1434
No log	1.2195	50	1.3334	0.1009	1.3334	1.1547
No log	1.2683	52	1.3463	0.1009	1.3463	1.1603
No log	1.3171	54	1.3063	0.1016	1.3063	1.1429
No log	1.3659	56	1.2741	0.0921	1.2741	1.1287
No log	1.4146	58	1.2418	0.2143	1.2418	1.1144
No log	1.4634	60	1.3433	0.0750	1.3433	1.1590
No log	1.5122	62	1.4936	0.1935	1.4936	1.2221
No log	1.5610	64	1.4175	0.0702	1.4175	1.1906
No log	1.6098	66	1.1865	0.1144	1.1865	1.0893
No log	1.6585	68	1.2449	0.1658	1.2449	1.1157
No log	1.7073	70	1.7724	0.0084	1.7724	1.3313
No log	1.7561	72	1.8359	0.0	1.8359	1.3550
No log	1.8049	74	1.7490	0.0	1.7490	1.3225
No log	1.8537	76	1.7451	0.0	1.7451	1.3210
No log	1.9024	78	1.6055	0.0	1.6055	1.2671
No log	1.9512	80	1.4011	0.0	1.4011	1.1837
No log	2.0	82	1.2999	0.0926	1.2999	1.1401
No log	2.0488	84	1.2216	0.2200	1.2216	1.1053
No log	2.0976	86	1.2024	0.2246	1.2024	1.0965
No log	2.1463	88	1.2128	0.2083	1.2128	1.1013
No log	2.1951	90	1.2389	0.1482	1.2389	1.1130
No log	2.2439	92	1.3095	0.1860	1.3095	1.1443
No log	2.2927	94	1.3791	0.1587	1.3791	1.1744
No log	2.3415	96	1.4447	0.0931	1.4447	1.2019
No log	2.3902	98	1.3981	0.1951	1.3981	1.1824
No log	2.4390	100	1.3747	0.1646	1.3747	1.1725
No log	2.4878	102	1.3483	0.1016	1.3483	1.1611
No log	2.5366	104	1.3188	0.1827	1.3188	1.1484
No log	2.5854	106	1.3790	0.1101	1.3790	1.1743
No log	2.6341	108	1.4105	0.0994	1.4105	1.1877
No log	2.6829	110	1.3857	0.0389	1.3857	1.1771
No log	2.7317	112	1.4831	0.0927	1.4831	1.2178
No log	2.7805	114	1.4796	0.0642	1.4796	1.2164
No log	2.8293	116	1.3418	0.1337	1.3418	1.1584
No log	2.8780	118	1.5379	0.0750	1.5379	1.2401
No log	2.9268	120	1.6192	0.0389	1.6192	1.2725
No log	2.9756	122	1.3335	0.1076	1.3335	1.1548
No log	3.0244	124	1.3392	0.1217	1.3392	1.1572
No log	3.0732	126	1.4275	0.1935	1.4275	1.1948
No log	3.1220	128	1.3681	0.0623	1.3681	1.1696
No log	3.1707	130	1.2517	0.1689	1.2517	1.1188
No log	3.2195	132	1.1987	0.1609	1.1987	1.0948
No log	3.2683	134	1.1981	0.1918	1.1981	1.0946
No log	3.3171	136	1.1876	0.1814	1.1876	1.0898
No log	3.3659	138	1.1871	0.1271	1.1871	1.0895
No log	3.4146	140	1.2391	0.1753	1.2391	1.1132
No log	3.4634	142	1.2080	0.1432	1.2080	1.0991
No log	3.5122	144	1.2323	0.2110	1.2323	1.1101
No log	3.5610	146	1.3113	0.2236	1.3113	1.1451
No log	3.6098	148	1.3045	0.2248	1.3045	1.1422
No log	3.6585	150	1.2817	0.2271	1.2817	1.1321
No log	3.7073	152	1.2865	0.2007	1.2865	1.1342
No log	3.7561	154	1.2453	0.1584	1.2453	1.1159
No log	3.8049	156	1.2593	0.1696	1.2593	1.1222
No log	3.8537	158	1.3025	0.2097	1.3025	1.1413
No log	3.9024	160	1.2902	0.2097	1.2902	1.1359
No log	3.9512	162	1.2957	0.2000	1.2957	1.1383
No log	4.0	164	1.2910	0.2141	1.2910	1.1362
No log	4.0488	166	1.2753	0.2046	1.2753	1.1293
No log	4.0976	168	1.3257	0.1991	1.3257	1.1514
No log	4.1463	170	1.4047	0.2080	1.4047	1.1852
No log	4.1951	172	1.4513	0.1659	1.4513	1.2047
No log	4.2439	174	1.3952	0.1944	1.3952	1.1812
No log	4.2927	176	1.3513	0.1479	1.3513	1.1624
No log	4.3415	178	1.3149	0.1479	1.3149	1.1467
No log	4.3902	180	1.2972	0.1148	1.2972	1.1389
No log	4.4390	182	1.2800	0.1148	1.2800	1.1314
No log	4.4878	184	1.3141	0.1479	1.3141	1.1463
No log	4.5366	186	1.3904	0.1536	1.3904	1.1791
No log	4.5854	188	1.3819	0.1536	1.3819	1.1756
No log	4.6341	190	1.2965	0.1479	1.2965	1.1386
No log	4.6829	192	1.2965	0.1479	1.2965	1.1386
No log	4.7317	194	1.3822	0.2087	1.3822	1.1757
No log	4.7805	196	1.4560	0.2173	1.4560	1.2067
No log	4.8293	198	1.4840	0.2173	1.4840	1.2182
No log	4.8780	200	1.4118	0.1345	1.4118	1.1882
No log	4.9268	202	1.3489	0.1316	1.3489	1.1614
No log	4.9756	204	1.2893	0.1148	1.2893	1.1355
No log	5.0244	206	1.2553	0.1076	1.2554	1.1204
No log	5.0732	208	1.2935	0.1148	1.2935	1.1373
No log	5.1220	210	1.3123	0.1148	1.3123	1.1456
No log	5.1707	212	1.3406	0.0541	1.3406	1.1578
No log	5.2195	214	1.2961	0.0980	1.2961	1.1385
No log	5.2683	216	1.2800	0.1076	1.2800	1.1314
No log	5.3171	218	1.3123	0.0541	1.3123	1.1455
No log	5.3659	220	1.3530	0.0887	1.3530	1.1632
No log	5.4146	222	1.3218	0.0887	1.3218	1.1497
No log	5.4634	224	1.3470	0.1219	1.3470	1.1606
No log	5.5122	226	1.3397	0.1536	1.3397	1.1575
No log	5.5610	228	1.2208	0.1480	1.2208	1.1049
No log	5.6098	230	1.1697	0.1649	1.1697	1.0815
No log	5.6585	232	1.1657	0.1875	1.1657	1.0797
No log	5.7073	234	1.2410	0.1645	1.2410	1.1140
No log	5.7561	236	1.3097	0.2207	1.3097	1.1444
No log	5.8049	238	1.3207	0.2097	1.3207	1.1492
No log	5.8537	240	1.3098	0.2097	1.3098	1.1445
No log	5.9024	242	1.2681	0.2263	1.2681	1.1261
No log	5.9512	244	1.2725	0.2263	1.2725	1.1281
No log	6.0	246	1.2695	0.2263	1.2695	1.1267
No log	6.0488	248	1.3359	0.2000	1.3359	1.1558
No log	6.0976	250	1.3459	0.1944	1.3459	1.1601
No log	6.1463	252	1.3096	0.1944	1.3096	1.1444
No log	6.1951	254	1.2382	0.1379	1.2382	1.1127
No log	6.2439	256	1.2144	0.1645	1.2144	1.1020
No log	6.2927	258	1.2497	0.1379	1.2497	1.1179
No log	6.3415	260	1.3825	0.2278	1.3825	1.1758
No log	6.3902	262	1.3396	0.1896	1.3396	1.1574
No log	6.4390	264	1.2814	0.1379	1.2814	1.1320
No log	6.4878	266	1.2205	0.0977	1.2205	1.1048
No log	6.5366	268	1.2357	0.1362	1.2357	1.1116
No log	6.5854	270	1.2235	0.1271	1.2235	1.1061
No log	6.6341	272	1.2436	0.1144	1.2436	1.1152
No log	6.6829	274	1.3724	0.1637	1.3724	1.1715
No log	6.7317	276	1.4176	0.2037	1.4176	1.1906
No log	6.7805	278	1.3951	0.1637	1.3951	1.1811
No log	6.8293	280	1.3681	0.1637	1.3681	1.1696
No log	6.8780	282	1.3251	0.1795	1.3251	1.1511
No log	6.9268	284	1.3172	0.1795	1.3172	1.1477
No log	6.9756	286	1.3163	0.1795	1.3163	1.1473
No log	7.0244	288	1.3550	0.1637	1.3550	1.1641
No log	7.0732	290	1.3287	0.1696	1.3287	1.1527
No log	7.1220	292	1.2825	0.1696	1.2825	1.1325
No log	7.1707	294	1.1778	0.2072	1.1778	1.0853
No log	7.2195	296	1.1552	0.2781	1.1552	1.0748
No log	7.2683	298	1.1795	0.1585	1.1795	1.0861
No log	7.3171	300	1.2660	0.0980	1.2660	1.1251
No log	7.3659	302	1.2852	0.0980	1.2852	1.1337
No log	7.4146	304	1.2051	0.1144	1.2051	1.0978
No log	7.4634	306	1.1794	0.1875	1.1794	1.0860
No log	7.5122	308	1.1928	0.1979	1.1928	1.0922
No log	7.5610	310	1.2264	0.1042	1.2264	1.1074
No log	7.6098	312	1.2716	0.0802	1.2716	1.1277
No log	7.6585	314	1.2973	0.0904	1.2973	1.1390
No log	7.7073	316	1.3205	0.0904	1.3205	1.1491
No log	7.7561	318	1.3338	0.0802	1.3338	1.1549
No log	7.8049	320	1.3851	0.0980	1.3851	1.1769
No log	7.8537	322	1.4053	0.1316	1.4053	1.1855
No log	7.9024	324	1.4515	0.1536	1.4515	1.2048
No log	7.9512	326	1.4538	0.1219	1.4538	1.2057
No log	8.0	328	1.4323	0.1219	1.4323	1.1968
No log	8.0488	330	1.3679	0.0454	1.3679	1.1696
No log	8.0976	332	1.3303	0.0454	1.3303	1.1534
No log	8.1463	334	1.3152	0.0353	1.3152	1.1468
No log	8.1951	336	1.3002	0.0353	1.3002	1.1403
No log	8.2439	338	1.3270	0.0454	1.3270	1.1520
No log	8.2927	340	1.3581	0.0454	1.3581	1.1654
No log	8.3415	342	1.3739	0.0454	1.3739	1.1721
No log	8.3902	344	1.3369	0.0454	1.3369	1.1562
No log	8.4390	346	1.3107	0.0454	1.3107	1.1449
No log	8.4878	348	1.2688	0.0904	1.2688	1.1264
No log	8.5366	350	1.2219	0.1857	1.2219	1.1054
No log	8.5854	352	1.1873	0.1507	1.1873	1.0896
No log	8.6341	354	1.1835	0.1893	1.1835	1.0879
No log	8.6829	356	1.1963	0.2023	1.1963	1.0937
No log	8.7317	358	1.2659	0.0802	1.2659	1.1251
No log	8.7805	360	1.3879	0.0887	1.3879	1.1781
No log	8.8293	362	1.4514	0.1536	1.4514	1.2047
No log	8.8780	364	1.3818	0.0887	1.3818	1.1755
No log	8.9268	366	1.2911	0.0802	1.2911	1.1363
No log	8.9756	368	1.2571	0.0974	1.2571	1.1212
No log	9.0244	370	1.3039	0.0880	1.3039	1.1419
No log	9.0732	372	1.3965	0.1536	1.3965	1.1817
No log	9.1220	374	1.5406	0.0884	1.5406	1.2412
No log	9.1707	376	1.5218	0.0948	1.5218	1.2336
No log	9.2195	378	1.3680	0.1646	1.3680	1.1696
No log	9.2683	380	1.2872	0.1557	1.2872	1.1346
No log	9.3171	382	1.2167	0.2108	1.2167	1.1030
No log	9.3659	384	1.2604	0.1696	1.2604	1.1227
No log	9.4146	386	1.3626	0.1646	1.3626	1.1673
No log	9.4634	388	1.3638	0.1646	1.3638	1.1678
No log	9.5122	390	1.3321	0.1098	1.3321	1.1542
No log	9.5610	392	1.2497	0.1379	1.2497	1.1179
No log	9.6098	394	1.2283	0.1379	1.2283	1.1083
No log	9.6585	396	1.1869	0.1910	1.1869	1.0895
No log	9.7073	398	1.2296	0.1048	1.2296	1.1089
No log	9.7561	400	1.3394	0.0887	1.3394	1.1573
No log	9.8049	402	1.4857	0.1646	1.4857	1.2189
No log	9.8537	404	1.5227	0.1698	1.5227	1.2340
No log	9.9024	406	1.4687	0.1646	1.4687	1.2119
No log	9.9512	408	1.3460	0.0887	1.3460	1.1602
No log	10.0	410	1.2406	0.1048	1.2406	1.1138
No log	10.0488	412	1.1749	0.1649	1.1749	1.0839
No log	10.0976	414	1.1667	0.1814	1.1667	1.0801
No log	10.1463	416	1.2086	0.1048	1.2086	1.0993
No log	10.1951	418	1.2801	0.1148	1.2801	1.1314
No log	10.2439	420	1.3427	0.0711	1.3427	1.1587
No log	10.2927	422	1.3445	0.0541	1.3445	1.1595
No log	10.3415	424	1.2806	0.0711	1.2806	1.1316
No log	10.3902	426	1.2470	0.1048	1.2470	1.1167
No log	10.4390	428	1.2037	0.1480	1.2037	1.0971
No log	10.4878	430	1.2072	0.1480	1.2072	1.0987
No log	10.5366	432	1.2726	0.1379	1.2726	1.1281
No log	10.5854	434	1.3675	0.1536	1.3675	1.1694
No log	10.6341	436	1.3791	0.1536	1.3791	1.1744
No log	10.6829	438	1.3354	0.1692	1.3354	1.1556
No log	10.7317	440	1.2337	0.1417	1.2337	1.1107
No log	10.7805	442	1.1945	0.2023	1.1945	1.0929
No log	10.8293	444	1.2048	0.2072	1.2048	1.0976
No log	10.8780	446	1.2654	0.1379	1.2654	1.1249
No log	10.9268	448	1.2949	0.1379	1.2949	1.1379
No log	10.9756	450	1.3268	0.1148	1.3268	1.1519
No log	11.0244	452	1.2915	0.1076	1.2915	1.1365
No log	11.0732	454	1.2426	0.1076	1.2426	1.1147
No log	11.1220	456	1.2585	0.1076	1.2585	1.1218
No log	11.1707	458	1.2993	0.0541	1.2993	1.1398
No log	11.2195	460	1.3355	0.0541	1.3355	1.1557
No log	11.2683	462	1.3314	0.1477	1.3314	1.1539
No log	11.3171	464	1.2784	0.0887	1.2784	1.1306
No log	11.3659	466	1.2433	0.1316	1.2433	1.1151
No log	11.4146	468	1.2005	0.1479	1.2005	1.0957
No log	11.4634	470	1.1697	0.1479	1.1697	1.0815
No log	11.5122	472	1.1881	0.1379	1.1881	1.0900
No log	11.5610	474	1.2522	0.1795	1.2522	1.1190
No log	11.6098	476	1.3287	0.2037	1.3287	1.1527
No log	11.6585	478	1.3325	0.2037	1.3325	1.1543
No log	11.7073	480	1.2550	0.1316	1.2550	1.1203
No log	11.7561	482	1.1986	0.1479	1.1986	1.0948
No log	11.8049	484	1.1964	0.1641	1.1964	1.0938
No log	11.8537	486	1.2126	0.1379	1.2126	1.1012
No log	11.9024	488	1.2405	0.1316	1.2405	1.1138
No log	11.9512	490	1.2531	0.1316	1.2531	1.1194
No log	12.0	492	1.2643	0.1316	1.2643	1.1244
No log	12.0488	494	1.2797	0.1944	1.2797	1.1312
No log	12.0976	496	1.2786	0.1944	1.2786	1.1308
No log	12.1463	498	1.2237	0.1217	1.2237	1.1062
0.3357	12.1951	500	1.1729	0.2220	1.1729	1.0830
0.3357	12.2439	502	1.1616	0.1773	1.1616	1.0778
0.3357	12.2927	504	1.1648	0.1773	1.1648	1.0792
0.3357	12.3415	506	1.1775	0.1180	1.1775	1.0851
0.3357	12.3902	508	1.2355	0.1217	1.2355	1.1115
0.3357	12.4390	510	1.3500	0.1536	1.3500	1.1619

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1