ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5222
• Qwk: 0.1364
• Mse: 1.5222
• Rmse: 1.2338

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	4.4727	0.0163	4.4727	2.1149
No log	0.1053	4	2.7155	0.0012	2.7155	1.6479
No log	0.1579	6	2.0518	0.0062	2.0518	1.4324
No log	0.2105	8	1.8906	0.0062	1.8906	1.3750
No log	0.2632	10	1.9512	-0.0366	1.9512	1.3969
No log	0.3158	12	1.3972	-0.0374	1.3972	1.1821
No log	0.3684	14	1.2935	0.0454	1.2935	1.1373
No log	0.4211	16	1.2797	0.0904	1.2797	1.1312
No log	0.4737	18	1.3104	0.0370	1.3104	1.1447
No log	0.5263	20	1.6451	-0.0451	1.6451	1.2826
No log	0.5789	22	1.9443	0.0	1.9443	1.3944
No log	0.6316	24	1.7241	0.0	1.7241	1.3131
No log	0.6842	26	1.4738	0.0	1.4738	1.2140
No log	0.7368	28	1.2923	0.1288	1.2923	1.1368
No log	0.7895	30	1.2202	0.1470	1.2202	1.1046
No log	0.8421	32	1.3019	0.1423	1.3019	1.1410
No log	0.8947	34	1.4520	-0.1074	1.4520	1.2050
No log	0.9474	36	1.5232	-0.0149	1.5232	1.2342
No log	1.0	38	1.5884	0.0	1.5884	1.2603
No log	1.0526	40	1.5286	0.0	1.5286	1.2364
No log	1.1053	42	1.4799	-0.0149	1.4799	1.2165
No log	1.1579	44	1.4217	-0.0029	1.4217	1.1924
No log	1.2105	46	1.3779	-0.0059	1.3779	1.1739
No log	1.2632	48	1.3998	-0.0217	1.3998	1.1831
No log	1.3158	50	1.6127	-0.1229	1.6127	1.2699
No log	1.3684	52	1.7190	-0.0839	1.7190	1.3111
No log	1.4211	54	1.7049	-0.0839	1.7049	1.3057
No log	1.4737	56	1.5835	-0.0745	1.5835	1.2584
No log	1.5263	58	1.3379	0.1108	1.3379	1.1567
No log	1.5789	60	1.3012	0.0041	1.3012	1.1407
No log	1.6316	62	1.3139	-0.0552	1.3139	1.1462
No log	1.6842	64	1.2919	-0.0616	1.2919	1.1366
No log	1.7368	66	1.2566	0.0327	1.2566	1.1210
No log	1.7895	68	1.2434	0.0642	1.2434	1.1151
No log	1.8421	70	1.2464	0.2212	1.2464	1.1164
No log	1.8947	72	1.2325	0.2155	1.2325	1.1102
No log	1.9474	74	1.2387	0.1407	1.2387	1.1130
No log	2.0	76	1.3275	0.1260	1.3275	1.1522
No log	2.0526	78	1.5822	-0.0534	1.5822	1.2579
No log	2.1053	80	1.8255	0.0	1.8255	1.3511
No log	2.1579	82	1.7509	0.0	1.7509	1.3232
No log	2.2105	84	1.4833	-0.0132	1.4833	1.2179
No log	2.2632	86	1.2676	0.0948	1.2676	1.1259
No log	2.3158	88	1.2159	0.0904	1.2159	1.1027
No log	2.3684	90	1.2480	0.0454	1.2480	1.1172
No log	2.4211	92	1.2347	0.0628	1.2347	1.1112
No log	2.4737	94	1.2456	0.1176	1.2456	1.1161
No log	2.5263	96	1.2459	0.1076	1.2459	1.1162
No log	2.5789	98	1.2372	0.0841	1.2372	1.1123
No log	2.6316	100	1.2349	0.0841	1.2349	1.1112
No log	2.6842	102	1.2377	0.1532	1.2377	1.1125
No log	2.7368	104	1.3393	0.1200	1.3393	1.1573
No log	2.7895	106	1.3916	0.0831	1.3916	1.1797
No log	2.8421	108	1.2507	0.1675	1.2507	1.1184
No log	2.8947	110	1.2394	0.0527	1.2394	1.1133
No log	2.9474	112	1.3409	0.0811	1.3409	1.1580
No log	3.0	114	1.2918	0.0711	1.2918	1.1366
No log	3.0526	116	1.2243	0.1727	1.2243	1.1065
No log	3.1053	118	1.3378	0.1696	1.3378	1.1566
No log	3.1579	120	1.5735	-0.0412	1.5735	1.2544
No log	3.2105	122	1.4279	0.0319	1.4279	1.1950
No log	3.2632	124	1.2147	0.2618	1.2147	1.1022
No log	3.3158	126	1.1646	0.2371	1.1646	1.0792
No log	3.3684	128	1.2088	0.1764	1.2088	1.0995
No log	3.4211	130	1.1807	0.1920	1.1807	1.0866
No log	3.4737	132	1.1918	0.1897	1.1918	1.0917
No log	3.5263	134	1.2295	0.2850	1.2295	1.1088
No log	3.5789	136	1.2118	0.1475	1.2118	1.1008
No log	3.6316	138	1.3357	0.1984	1.3357	1.1557
No log	3.6842	140	1.5185	0.1845	1.5185	1.2323
No log	3.7368	142	1.4231	0.2295	1.4231	1.1929
No log	3.7895	144	1.2838	0.1864	1.2838	1.1330
No log	3.8421	146	1.2621	0.1693	1.2621	1.1234
No log	3.8947	148	1.3587	0.1984	1.3587	1.1656
No log	3.9474	150	1.4022	0.2069	1.4022	1.1842
No log	4.0	152	1.4960	0.2009	1.4960	1.2231
No log	4.0526	154	1.4161	0.1340	1.4161	1.1900
No log	4.1053	156	1.3129	0.2032	1.3129	1.1458
No log	4.1579	158	1.1719	0.2431	1.1719	1.0826
No log	4.2105	160	1.1124	0.3094	1.1124	1.0547
No log	4.2632	162	1.1200	0.2556	1.1200	1.0583
No log	4.3158	164	1.1325	0.2355	1.1325	1.0642
No log	4.3684	166	1.1843	0.3405	1.1843	1.0883
No log	4.4211	168	1.2689	0.2634	1.2689	1.1264
No log	4.4737	170	1.2635	0.2909	1.2635	1.1240
No log	4.5263	172	1.2111	0.2268	1.2111	1.1005
No log	4.5789	174	1.2731	0.1928	1.2731	1.1283
No log	4.6316	176	1.2343	0.1568	1.2343	1.1110
No log	4.6842	178	1.3055	0.2259	1.3055	1.1426
No log	4.7368	180	1.3997	0.2387	1.3997	1.1831
No log	4.7895	182	1.3129	0.2391	1.3129	1.1458
No log	4.8421	184	1.2907	0.2076	1.2907	1.1361
No log	4.8947	186	1.2970	0.1921	1.2970	1.1389
No log	4.9474	188	1.4394	0.1801	1.4394	1.1997
No log	5.0	190	1.4907	0.1801	1.4907	1.2209
No log	5.0526	192	1.3909	0.1188	1.3909	1.1794
No log	5.1053	194	1.2848	0.1431	1.2848	1.1335
No log	5.1579	196	1.3049	0.0150	1.3049	1.1423
No log	5.2105	198	1.3267	0.1027	1.3267	1.1518
No log	5.2632	200	1.4168	0.1713	1.4168	1.1903
No log	5.3158	202	1.4252	0.1224	1.4252	1.1938
No log	5.3684	204	1.3763	0.0876	1.3763	1.1732
No log	5.4211	206	1.4573	0.0896	1.4573	1.2072
No log	5.4737	208	1.3965	0.0988	1.3965	1.1818
No log	5.5263	210	1.2886	0.1067	1.2886	1.1352
No log	5.5789	212	1.3705	0.1570	1.3705	1.1707
No log	5.6316	214	1.3400	0.1094	1.3400	1.1576
No log	5.6842	216	1.2665	0.0994	1.2665	1.1254
No log	5.7368	218	1.1991	0.1838	1.1991	1.0950
No log	5.7895	220	1.1960	0.1548	1.1960	1.0936
No log	5.8421	222	1.2375	0.1864	1.2375	1.1124
No log	5.8947	224	1.4333	0.0818	1.4333	1.1972
No log	5.9474	226	1.4896	0.1051	1.4896	1.2205
No log	6.0	228	1.3591	0.0937	1.3591	1.1658
No log	6.0526	230	1.2239	0.1701	1.2239	1.1063
No log	6.1053	232	1.1877	0.2276	1.1877	1.0898
No log	6.1579	234	1.2162	0.1807	1.2162	1.1028
No log	6.2105	236	1.3402	0.1371	1.3402	1.1577
No log	6.2632	238	1.4822	0.1929	1.4822	1.2175
No log	6.3158	240	1.4075	0.1892	1.4075	1.1864
No log	6.3684	242	1.2195	0.1867	1.2195	1.1043
No log	6.4211	244	1.2062	0.2871	1.2062	1.0983
No log	6.4737	246	1.2166	0.2349	1.2166	1.1030
No log	6.5263	248	1.2319	0.2801	1.2319	1.1099
No log	6.5789	250	1.3691	0.1282	1.3691	1.1701
No log	6.6316	252	1.3637	0.1339	1.3637	1.1678
No log	6.6842	254	1.4362	0.1112	1.4362	1.1984
No log	6.7368	256	1.4407	0.0818	1.4407	1.2003
No log	6.7895	258	1.3450	0.1898	1.3451	1.1598
No log	6.8421	260	1.3708	0.0964	1.3708	1.1708
No log	6.8947	262	1.3593	0.1483	1.3593	1.1659
No log	6.9474	264	1.2947	0.2668	1.2947	1.1378
No log	7.0	266	1.3471	0.1854	1.3471	1.1606
No log	7.0526	268	1.5200	0.0824	1.5200	1.2329
No log	7.1053	270	1.6412	0.1095	1.6412	1.2811
No log	7.1579	272	1.5651	0.0992	1.5651	1.2510
No log	7.2105	274	1.3818	0.1196	1.3818	1.1755
No log	7.2632	276	1.3152	0.2250	1.3152	1.1468
No log	7.3158	278	1.2939	0.25	1.2939	1.1375
No log	7.3684	280	1.3829	0.0987	1.3829	1.1760
No log	7.4211	282	1.4829	0.0884	1.4829	1.2177
No log	7.4737	284	1.6381	0.1513	1.6381	1.2799
No log	7.5263	286	1.6188	0.1810	1.6188	1.2723
No log	7.5789	288	1.3741	0.1801	1.3741	1.1722
No log	7.6316	290	1.1804	0.3560	1.1804	1.0865
No log	7.6842	292	1.1405	0.2970	1.1405	1.0679
No log	7.7368	294	1.1666	0.3122	1.1666	1.0801
No log	7.7895	296	1.2988	0.2195	1.2988	1.1397
No log	7.8421	298	1.3906	0.1461	1.3906	1.1792
No log	7.8947	300	1.3592	0.1889	1.3592	1.1658
No log	7.9474	302	1.3230	0.1745	1.3230	1.1502
No log	8.0	304	1.3039	0.2291	1.3039	1.1419
No log	8.0526	306	1.2697	0.2056	1.2697	1.1268
No log	8.1053	308	1.2631	0.2263	1.2631	1.1239
No log	8.1579	310	1.3383	0.2132	1.3383	1.1568
No log	8.2105	312	1.4006	0.2173	1.4006	1.1835
No log	8.2632	314	1.4790	0.1448	1.4790	1.2161
No log	8.3158	316	1.4682	0.1801	1.4682	1.2117
No log	8.3684	318	1.3870	0.1989	1.3870	1.1777
No log	8.4211	320	1.2927	0.2263	1.2927	1.1370
No log	8.4737	322	1.2921	0.1807	1.2921	1.1367
No log	8.5263	324	1.2869	0.1614	1.2869	1.1344
No log	8.5789	326	1.3152	0.1850	1.3152	1.1468
No log	8.6316	328	1.3410	0.2132	1.3410	1.1580
No log	8.6842	330	1.3697	0.1254	1.3697	1.1704
No log	8.7368	332	1.2711	0.1905	1.2711	1.1274
No log	8.7895	334	1.1910	0.2801	1.1910	1.0913
No log	8.8421	336	1.2026	0.2352	1.2026	1.0966
No log	8.8947	338	1.2623	0.2077	1.2623	1.1235
No log	8.9474	340	1.4849	0.2217	1.4849	1.2186
No log	9.0	342	1.5560	0.2285	1.5560	1.2474
No log	9.0526	344	1.3996	0.1748	1.3996	1.1830
No log	9.1053	346	1.1902	0.2263	1.1902	1.0910
No log	9.1579	348	1.1410	0.2200	1.1410	1.0682
No log	9.2105	350	1.1495	0.2200	1.1495	1.0721
No log	9.2632	352	1.1804	0.1649	1.1804	1.0865
No log	9.3158	354	1.2970	0.1379	1.2970	1.1389
No log	9.3684	356	1.4158	0.1345	1.4158	1.1899
No log	9.4211	358	1.5567	0.0913	1.5567	1.2477
No log	9.4737	360	1.5525	0.1179	1.5525	1.2460
No log	9.5263	362	1.4003	0.1168	1.4003	1.1834
No log	9.5789	364	1.2897	0.2417	1.2897	1.1356
No log	9.6316	366	1.2918	0.2417	1.2918	1.1366
No log	9.6842	368	1.2716	0.2417	1.2716	1.1277
No log	9.7368	370	1.2848	0.1959	1.2848	1.1335
No log	9.7895	372	1.3637	0.1449	1.3637	1.1678
No log	9.8421	374	1.3778	0.1722	1.3778	1.1738
No log	9.8947	376	1.3558	0.1109	1.3558	1.1644
No log	9.9474	378	1.3559	0.0964	1.3559	1.1644
No log	10.0	380	1.3085	0.1650	1.3085	1.1439
No log	10.0526	382	1.2562	0.1500	1.2562	1.1208
No log	10.1053	384	1.2243	0.2108	1.2243	1.1065
No log	10.1579	386	1.2661	0.1944	1.2661	1.1252
No log	10.2105	388	1.3258	0.1345	1.3258	1.1514
No log	10.2632	390	1.3757	0.0964	1.3757	1.1729
No log	10.3158	392	1.3972	0.1254	1.3972	1.1820
No log	10.3684	394	1.4001	0.1310	1.4001	1.1832
No log	10.4211	396	1.4265	0.1718	1.4265	1.1944
No log	10.4737	398	1.5056	0.2217	1.5056	1.2270
No log	10.5263	400	1.5329	0.2217	1.5329	1.2381
No log	10.5789	402	1.3884	0.1112	1.3884	1.1783
No log	10.6316	404	1.2338	0.2263	1.2338	1.1108
No log	10.6842	406	1.2106	0.2164	1.2106	1.1003
No log	10.7368	408	1.2837	0.1193	1.2837	1.1330
No log	10.7895	410	1.4226	0.1112	1.4226	1.1927
No log	10.8421	412	1.4414	0.1112	1.4414	1.2006
No log	10.8947	414	1.4784	0.1447	1.4784	1.2159
No log	10.9474	416	1.3497	0.0898	1.3497	1.1618
No log	11.0	418	1.3026	0.1371	1.3026	1.1413
No log	11.0526	420	1.3628	0.0898	1.3628	1.1674
No log	11.1053	422	1.4708	0.0884	1.4708	1.2128
No log	11.1579	424	1.4907	0.1009	1.4907	1.2209
No log	11.2105	426	1.3949	0.1135	1.3949	1.1811
No log	11.2632	428	1.2802	0.0937	1.2802	1.1315
No log	11.3158	430	1.2635	0.2046	1.2635	1.1240
No log	11.3684	432	1.2719	0.2636	1.2719	1.1278
No log	11.4211	434	1.3231	0.2184	1.3231	1.1502
No log	11.4737	436	1.4823	0.1387	1.4823	1.2175
No log	11.5263	438	1.6171	0.1733	1.6171	1.2716
No log	11.5789	440	1.6465	0.1692	1.6465	1.2832
No log	11.6316	442	1.5229	0.1358	1.5229	1.2340
No log	11.6842	444	1.3816	0.1282	1.3816	1.1754
No log	11.7368	446	1.2719	0.1959	1.2719	1.1278
No log	11.7895	448	1.2717	0.1959	1.2717	1.1277
No log	11.8421	450	1.3423	0.1428	1.3423	1.1586
No log	11.8947	452	1.4285	0.1226	1.4285	1.1952
No log	11.9474	454	1.5208	0.1207	1.5208	1.2332
No log	12.0	456	1.5925	0.1082	1.5925	1.2620
No log	12.0526	458	1.5245	0.0894	1.5245	1.2347
No log	12.1053	460	1.4036	0.1109	1.4036	1.1847
No log	12.1579	462	1.3636	0.1428	1.3636	1.1677
No log	12.2105	464	1.4013	0.1046	1.4013	1.1838
No log	12.2632	466	1.4936	0.0637	1.4936	1.2221
No log	12.3158	468	1.4654	0.0708	1.4654	1.2105
No log	12.3684	470	1.4560	0.0708	1.4560	1.2066
No log	12.4211	472	1.4238	0.1046	1.4238	1.1932
No log	12.4737	474	1.3570	0.1046	1.3570	1.1649
No log	12.5263	476	1.3679	0.1046	1.3679	1.1696
No log	12.5789	478	1.4473	0.1027	1.4473	1.2030
No log	12.6316	480	1.4788	0.0927	1.4788	1.2161
No log	12.6842	482	1.4572	0.1448	1.4572	1.2071
No log	12.7368	484	1.4503	0.1448	1.4503	1.2043
No log	12.7895	486	1.5280	0.1121	1.5280	1.2361
No log	12.8421	488	1.5926	0.1163	1.5926	1.2620
No log	12.8947	490	1.5969	0.1886	1.5969	1.2637
No log	12.9474	492	1.4724	0.1500	1.4724	1.2134
No log	13.0	494	1.3561	0.0871	1.3561	1.1645
No log	13.0526	496	1.3413	0.1338	1.3412	1.1581
No log	13.1053	498	1.4239	0.1448	1.4239	1.1933
0.4145	13.1579	500	1.4790	0.1500	1.4790	1.2162
0.4145	13.2105	502	1.5468	0.0913	1.5468	1.2437
0.4145	13.2632	504	1.4941	0.1310	1.4941	1.2223
0.4145	13.3158	506	1.4712	0.1310	1.4712	1.2129
0.4145	13.3684	508	1.4883	0.1310	1.4883	1.2200
0.4145	13.4211	510	1.5222	0.1364	1.5222	1.2338

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1