ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3454
• Qwk: 0.1185
• Mse: 1.3454
• Rmse: 1.1599

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	4.8945	0.0064	4.8945	2.2124
No log	0.4444	4	3.0030	0.0215	3.0030	1.7329
No log	0.6667	6	2.2236	-0.0744	2.2236	1.4912
No log	0.8889	8	2.0972	-0.0164	2.0972	1.4482
No log	1.1111	10	1.7518	0.0196	1.7518	1.3236
No log	1.3333	12	1.8672	0.0548	1.8672	1.3665
No log	1.5556	14	2.1411	-0.1076	2.1411	1.4632
No log	1.7778	16	2.0902	-0.0430	2.0902	1.4458
No log	2.0	18	1.8423	0.0227	1.8423	1.3573
No log	2.2222	20	1.3859	0.0297	1.3859	1.1772
No log	2.4444	22	1.2689	0.0768	1.2689	1.1264
No log	2.6667	24	1.2646	0.0860	1.2646	1.1245
No log	2.8889	26	1.4115	0.0275	1.4115	1.1881
No log	3.1111	28	1.5963	0.0339	1.5963	1.2634
No log	3.3333	30	1.5255	-0.0047	1.5255	1.2351
No log	3.5556	32	1.4444	0.0124	1.4444	1.2019
No log	3.7778	34	1.4720	0.0124	1.4720	1.2132
No log	4.0	36	1.3789	0.0955	1.3789	1.1742
No log	4.2222	38	1.3217	0.1887	1.3217	1.1496
No log	4.4444	40	1.2728	0.1812	1.2728	1.1282
No log	4.6667	42	1.2950	0.1713	1.2950	1.1380
No log	4.8889	44	1.3098	0.2180	1.3098	1.1445
No log	5.1111	46	1.2956	0.1911	1.2956	1.1382
No log	5.3333	48	1.2511	0.2111	1.2511	1.1185
No log	5.5556	50	1.2277	0.1893	1.2277	1.1080
No log	5.7778	52	1.2145	0.0977	1.2145	1.1020
No log	6.0	54	1.2024	0.2111	1.2024	1.0965
No log	6.2222	56	1.1951	0.2268	1.1951	1.0932
No log	6.4444	58	1.1759	0.2097	1.1759	1.0844
No log	6.6667	60	1.1631	0.1875	1.1631	1.0785
No log	6.8889	62	1.1567	0.2142	1.1567	1.0755
No log	7.1111	64	1.1591	0.2624	1.1591	1.0766
No log	7.3333	66	1.1410	0.2628	1.1410	1.0682
No log	7.5556	68	1.1518	0.3041	1.1518	1.0732
No log	7.7778	70	1.1552	0.1875	1.1552	1.0748
No log	8.0	72	1.1873	0.1211	1.1873	1.0896
No log	8.2222	74	1.2462	0.0948	1.2462	1.1163
No log	8.4444	76	1.3058	0.0596	1.3058	1.1427
No log	8.6667	78	1.2277	0.1344	1.2277	1.1080
No log	8.8889	80	1.1909	0.1986	1.1909	1.0913
No log	9.1111	82	1.1866	0.2086	1.1866	1.0893
No log	9.3333	84	1.2802	0.1654	1.2802	1.1315
No log	9.5556	86	1.3754	0.0880	1.3754	1.1728
No log	9.7778	88	1.2605	0.1315	1.2605	1.1227
No log	10.0	90	1.1662	0.1706	1.1662	1.0799
No log	10.2222	92	1.1492	0.2028	1.1492	1.0720
No log	10.4444	94	1.2216	0.1085	1.2216	1.1053
No log	10.6667	96	1.5078	0.0526	1.5078	1.2279
No log	10.8889	98	1.6332	0.1135	1.6332	1.2780
No log	11.1111	100	1.5270	0.1308	1.5270	1.2357
No log	11.3333	102	1.2115	0.1279	1.2115	1.1007
No log	11.5556	104	1.1202	0.2971	1.1202	1.0584
No log	11.7778	106	1.1218	0.2689	1.1218	1.0592
No log	12.0	108	1.1971	0.1726	1.1971	1.0941
No log	12.2222	110	1.2448	0.1535	1.2448	1.1157
No log	12.4444	112	1.1781	0.1463	1.1781	1.0854
No log	12.6667	114	1.1103	0.1379	1.1103	1.0537
No log	12.8889	116	1.1126	0.1605	1.1126	1.0548
No log	13.1111	118	1.1909	0.125	1.1909	1.0913
No log	13.3333	120	1.2352	0.1761	1.2352	1.1114
No log	13.5556	122	1.1165	0.2195	1.1165	1.0567
No log	13.7778	124	1.1018	0.3043	1.1018	1.0497
No log	14.0	126	1.1795	0.2211	1.1795	1.0861
No log	14.2222	128	1.2167	0.2211	1.2167	1.1031
No log	14.4444	130	1.1565	0.1912	1.1565	1.0754
No log	14.6667	132	1.1276	0.2843	1.1276	1.0619
No log	14.8889	134	1.1582	0.2614	1.1582	1.0762
No log	15.1111	136	1.1964	0.1245	1.1964	1.0938
No log	15.3333	138	1.3108	0.2090	1.3108	1.1449
No log	15.5556	140	1.3868	0.2132	1.3868	1.1776
No log	15.7778	142	1.3310	0.125	1.3310	1.1537
No log	16.0	144	1.2636	0.1541	1.2636	1.1241
No log	16.2222	146	1.2173	0.1602	1.2173	1.1033
No log	16.4444	148	1.2874	0.1000	1.2874	1.1347
No log	16.6667	150	1.4440	0.2122	1.4440	1.2016
No log	16.8889	152	1.4477	0.2301	1.4477	1.2032
No log	17.1111	154	1.3686	0.2250	1.3686	1.1699
No log	17.3333	156	1.3430	0.2403	1.3430	1.1589
No log	17.5556	158	1.3038	0.1067	1.3038	1.1419
No log	17.7778	160	1.3278	0.1637	1.3278	1.1523
No log	18.0	162	1.2994	0.1637	1.2994	1.1399
No log	18.2222	164	1.2460	0.1441	1.2460	1.1163
No log	18.4444	166	1.2054	0.2065	1.2054	1.0979
No log	18.6667	168	1.2192	0.1911	1.2192	1.1042
No log	18.8889	170	1.2505	0.2207	1.2505	1.1182
No log	19.1111	172	1.3021	0.1758	1.3021	1.1411
No log	19.3333	174	1.2670	0.2207	1.2670	1.1256
No log	19.5556	176	1.2203	0.1667	1.2203	1.1047
No log	19.7778	178	1.2146	0.1343	1.2146	1.1021
No log	20.0	180	1.2310	0.1706	1.2310	1.1095
No log	20.2222	182	1.3141	0.2313	1.3141	1.1463
No log	20.4444	184	1.4072	0.1801	1.4072	1.1863
No log	20.6667	186	1.3510	0.2069	1.3510	1.1623
No log	20.8889	188	1.2490	0.1860	1.2490	1.1176
No log	21.1111	190	1.2340	0.0855	1.2340	1.1109
No log	21.3333	192	1.2460	0.0789	1.2460	1.1162
No log	21.5556	194	1.2942	0.1576	1.2942	1.1376
No log	21.7778	196	1.4052	0.2074	1.4052	1.1854
No log	22.0	198	1.5146	0.1935	1.5146	1.2307
No log	22.2222	200	1.5254	0.1980	1.5254	1.2351
No log	22.4444	202	1.4335	0.1219	1.4335	1.1973
No log	22.6667	204	1.3060	0.1952	1.3060	1.1428
No log	22.8889	206	1.2346	0.1602	1.2346	1.1111
No log	23.1111	208	1.2397	0.2317	1.2397	1.1134
No log	23.3333	210	1.3086	0.1995	1.3086	1.1439
No log	23.5556	212	1.4872	0.2520	1.4872	1.2195
No log	23.7778	214	1.6097	0.2569	1.6097	1.2687
No log	24.0	216	1.5700	0.2348	1.5700	1.2530
No log	24.2222	218	1.4367	0.2252	1.4367	1.1986
No log	24.4444	220	1.2885	0.1602	1.2885	1.1351
No log	24.6667	222	1.2698	0.1278	1.2698	1.1269
No log	24.8889	224	1.2765	0.1278	1.2765	1.1298
No log	25.1111	226	1.2998	0.1279	1.2998	1.1401
No log	25.3333	228	1.3629	0.1850	1.3629	1.1674
No log	25.5556	230	1.4383	0.1404	1.4383	1.1993
No log	25.7778	232	1.4641	0.1748	1.4641	1.2100
No log	26.0	234	1.4264	0.1795	1.4264	1.1943
No log	26.2222	236	1.3457	0.0994	1.3457	1.1601
No log	26.4444	238	1.3037	0.0994	1.3037	1.1418
No log	26.6667	240	1.2594	0.1053	1.2594	1.1222
No log	26.8889	242	1.2515	0.1149	1.2515	1.1187
No log	27.1111	244	1.2955	0.0994	1.2955	1.1382
No log	27.3333	246	1.3936	0.1026	1.3936	1.1805
No log	27.5556	248	1.4585	0.1498	1.4585	1.2077
No log	27.7778	250	1.4054	0.2184	1.4054	1.1855
No log	28.0	252	1.2912	0.1405	1.2912	1.1363
No log	28.2222	254	1.2266	0.1444	1.2266	1.1075
No log	28.4444	256	1.2442	0.1654	1.2442	1.1154
No log	28.6667	258	1.2467	0.1335	1.2467	1.1166
No log	28.8889	260	1.2602	0.0870	1.2602	1.1226
No log	29.1111	262	1.3396	0.2223	1.3396	1.1574
No log	29.3333	264	1.3782	0.1761	1.3782	1.1740
No log	29.5556	266	1.3291	0.2223	1.3291	1.1529
No log	29.7778	268	1.2619	0.1523	1.2619	1.1233
No log	30.0	270	1.2420	0.1878	1.2420	1.1144
No log	30.2222	272	1.2316	0.1632	1.2316	1.1098
No log	30.4444	274	1.2247	0.1628	1.2247	1.1067
No log	30.6667	276	1.2336	0.1406	1.2336	1.1107
No log	30.8889	278	1.2752	0.1853	1.2752	1.1293
No log	31.1111	280	1.3045	0.1500	1.3045	1.1422
No log	31.3333	282	1.3024	0.1479	1.3024	1.1412
No log	31.5556	284	1.2802	0.1541	1.2802	1.1314
No log	31.7778	286	1.2539	0.1480	1.2539	1.1198
No log	32.0	288	1.2307	0.1645	1.2307	1.1093
No log	32.2222	290	1.2342	0.1645	1.2342	1.1109
No log	32.4444	292	1.2802	0.1952	1.2802	1.1315
No log	32.6667	294	1.3651	0.1252	1.3651	1.1684
No log	32.8889	296	1.3740	0.0937	1.3740	1.1722
No log	33.1111	298	1.3134	0.1795	1.3134	1.1460
No log	33.3333	300	1.2444	0.1541	1.2444	1.1155
No log	33.5556	302	1.2355	0.2009	1.2355	1.1116
No log	33.7778	304	1.2865	0.1405	1.2865	1.1343
No log	34.0	306	1.3616	0.1844	1.3616	1.1669
No log	34.2222	308	1.3581	0.1844	1.3581	1.1654
No log	34.4444	310	1.2856	0.1345	1.2856	1.1339
No log	34.6667	312	1.2054	0.1602	1.2054	1.0979
No log	34.8889	314	1.1895	0.1602	1.1895	1.0906
No log	35.1111	316	1.2128	0.1701	1.2128	1.1013
No log	35.3333	318	1.2422	0.1379	1.2422	1.1145
No log	35.5556	320	1.2976	0.1026	1.2976	1.1391
No log	35.7778	322	1.3353	0.1650	1.3353	1.1556
No log	36.0	324	1.3335	0.1670	1.3335	1.1548
No log	36.2222	326	1.2881	0.1812	1.2881	1.1349
No log	36.4444	328	1.2461	0.2184	1.2461	1.1163
No log	36.6667	330	1.2287	0.2006	1.2287	1.1085
No log	36.8889	332	1.2474	0.2326	1.2474	1.1169
No log	37.1111	334	1.2528	0.2362	1.2528	1.1193
No log	37.3333	336	1.2355	0.2762	1.2355	1.1115
No log	37.5556	338	1.2295	0.1959	1.2295	1.1088
No log	37.7778	340	1.1972	0.2331	1.1972	1.0942
No log	38.0	342	1.1899	0.2331	1.1899	1.0908
No log	38.2222	344	1.1812	0.2331	1.1812	1.0868
No log	38.4444	346	1.2060	0.2331	1.2060	1.0982
No log	38.6667	348	1.2129	0.2019	1.2129	1.1013
No log	38.8889	350	1.2200	0.2019	1.2200	1.1045
No log	39.1111	352	1.2149	0.1969	1.2149	1.1022
No log	39.3333	354	1.2180	0.1969	1.2180	1.1036
No log	39.5556	356	1.2083	0.1808	1.2083	1.0992
No log	39.7778	358	1.2165	0.1808	1.2165	1.1029
No log	40.0	360	1.2310	0.1645	1.2310	1.1095
No log	40.2222	362	1.2080	0.1969	1.2080	1.0991
No log	40.4444	364	1.1936	0.2812	1.1936	1.0925
No log	40.6667	366	1.1955	0.2605	1.1955	1.0934
No log	40.8889	368	1.1958	0.2605	1.1958	1.0935
No log	41.1111	370	1.1958	0.2605	1.1958	1.0935
No log	41.3333	372	1.2075	0.2371	1.2075	1.0989
No log	41.5556	374	1.2640	0.1559	1.2640	1.1243
No log	41.7778	376	1.3161	0.2173	1.3161	1.1472
No log	42.0	378	1.3497	0.2503	1.3497	1.1618
No log	42.2222	380	1.3237	0.2534	1.3237	1.1505
No log	42.4444	382	1.2449	0.2345	1.2449	1.1157
No log	42.6667	384	1.1872	0.2735	1.1872	1.0896
No log	42.8889	386	1.1639	0.2792	1.1639	1.0788
No log	43.1111	388	1.1628	0.2792	1.1628	1.0783
No log	43.3333	390	1.1702	0.2640	1.1702	1.0817
No log	43.5556	392	1.2131	0.2015	1.2131	1.1014
No log	43.7778	394	1.2484	0.1280	1.2484	1.1173
No log	44.0	396	1.2621	0.1000	1.2621	1.1234
No log	44.2222	398	1.2445	0.1185	1.2445	1.1156
No log	44.4444	400	1.1841	0.1808	1.1841	1.0881
No log	44.6667	402	1.1327	0.2812	1.1327	1.0643
No log	44.8889	404	1.1060	0.2569	1.1060	1.0517
No log	45.1111	406	1.0990	0.2569	1.0990	1.0483
No log	45.3333	408	1.1137	0.2142	1.1137	1.0553
No log	45.5556	410	1.1645	0.1747	1.1645	1.0791
No log	45.7778	412	1.2455	0.1026	1.2455	1.1160
No log	46.0	414	1.3005	0.1650	1.3005	1.1404
No log	46.2222	416	1.2815	0.1650	1.2815	1.1320
No log	46.4444	418	1.2277	0.1654	1.2277	1.1080
No log	46.6667	420	1.1648	0.2219	1.1648	1.0792
No log	46.8889	422	1.1410	0.2331	1.1410	1.0682
No log	47.1111	424	1.1343	0.2231	1.1343	1.0650
No log	47.3333	426	1.1343	0.2331	1.1343	1.0650
No log	47.5556	428	1.1373	0.2331	1.1373	1.0664
No log	47.7778	430	1.1539	0.2165	1.1539	1.0742
No log	48.0	432	1.2002	0.1951	1.2002	1.0956
No log	48.2222	434	1.2163	0.1951	1.2163	1.1028
No log	48.4444	436	1.2293	0.1654	1.2293	1.1087
No log	48.6667	438	1.2273	0.1344	1.2273	1.1078
No log	48.8889	440	1.2319	0.1344	1.2319	1.1099
No log	49.1111	442	1.2164	0.1344	1.2164	1.1029
No log	49.3333	444	1.2106	0.1344	1.2106	1.1003
No log	49.5556	446	1.2311	0.1344	1.2311	1.1095
No log	49.7778	448	1.2371	0.1248	1.2371	1.1122
No log	50.0	450	1.2612	0.1801	1.2612	1.1230
No log	50.2222	452	1.2566	0.1801	1.2566	1.1210
No log	50.4444	454	1.2193	0.1310	1.2193	1.1042
No log	50.6667	456	1.1679	0.1761	1.1679	1.0807
No log	50.8889	458	1.1491	0.2231	1.1491	1.0720
No log	51.1111	460	1.1539	0.2331	1.1539	1.0742
No log	51.3333	462	1.1783	0.1761	1.1783	1.0855
No log	51.5556	464	1.1943	0.1860	1.1943	1.0928
No log	51.7778	466	1.2204	0.1344	1.2204	1.1047
No log	52.0	468	1.2385	0.1344	1.2385	1.1129
No log	52.2222	470	1.2483	0.1185	1.2483	1.1173
No log	52.4444	472	1.2500	0.1344	1.2500	1.1181
No log	52.6667	474	1.2266	0.1344	1.2266	1.1075
No log	52.8889	476	1.1910	0.2019	1.1910	1.0913
No log	53.1111	478	1.1631	0.2640	1.1631	1.0785
No log	53.3333	480	1.1622	0.2792	1.1622	1.0781
No log	53.5556	482	1.1660	0.2341	1.1660	1.0798
No log	53.7778	484	1.1647	0.2242	1.1647	1.0792
No log	54.0	486	1.1676	0.2692	1.1676	1.0805
No log	54.2222	488	1.1769	0.2539	1.1769	1.0848
No log	54.4444	490	1.1818	0.1977	1.1818	1.0871
No log	54.6667	492	1.1851	0.2539	1.1851	1.0886
No log	54.8889	494	1.2010	0.2231	1.2010	1.0959
No log	55.1111	496	1.2051	0.2640	1.2051	1.0978
No log	55.3333	498	1.2074	0.2640	1.2074	1.0988
0.2615	55.5556	500	1.2161	0.2331	1.2161	1.1028
0.2615	55.7778	502	1.2329	0.2331	1.2329	1.1104
0.2615	56.0	504	1.2671	0.1405	1.2671	1.1257
0.2615	56.2222	506	1.2832	0.1185	1.2832	1.1328
0.2615	56.4444	508	1.2999	0.1185	1.2999	1.1401
0.2615	56.6667	510	1.3454	0.1185	1.3454	1.1599

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1