ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1688
• Qwk: 0.1247
• Mse: 1.1688
• Rmse: 1.0811

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	4.5481	0.0042	4.5481	2.1326
No log	0.1053	4	2.7299	0.0140	2.7299	1.6523
No log	0.1579	6	2.2359	-0.0433	2.2359	1.4953
No log	0.2105	8	1.7243	0.0363	1.7243	1.3131
No log	0.2632	10	1.5280	-0.0143	1.5280	1.2361
No log	0.3158	12	1.2904	0.1016	1.2904	1.1360
No log	0.3684	14	1.2696	0.1507	1.2696	1.1268
No log	0.4211	16	1.2757	0.0796	1.2757	1.1295
No log	0.4737	18	1.3633	0.0894	1.3633	1.1676
No log	0.5263	20	1.8768	0.0277	1.8768	1.3700
No log	0.5789	22	2.0447	0.0165	2.0447	1.4299
No log	0.6316	24	1.7400	0.0	1.7400	1.3191
No log	0.6842	26	1.3914	0.0408	1.3914	1.1796
No log	0.7368	28	1.2633	0.1009	1.2633	1.1240
No log	0.7895	30	1.2957	0.0771	1.2957	1.1383
No log	0.8421	32	1.3578	0.1042	1.3578	1.1652
No log	0.8947	34	1.4421	0.0276	1.4421	1.2009
No log	0.9474	36	1.6758	-0.0974	1.6758	1.2945
No log	1.0	38	1.7991	-0.1041	1.7991	1.3413
No log	1.0526	40	1.6951	-0.0234	1.6951	1.3020
No log	1.1053	42	1.6921	0.0010	1.6921	1.3008
No log	1.1579	44	1.6438	-0.0147	1.6438	1.2821
No log	1.2105	46	1.5811	-0.0563	1.5811	1.2574
No log	1.2632	48	1.4938	-0.0234	1.4938	1.2222
No log	1.3158	50	1.4889	-0.0321	1.4889	1.2202
No log	1.3684	52	1.4481	-0.0321	1.4481	1.2034
No log	1.4211	54	1.5592	0.0732	1.5592	1.2487
No log	1.4737	56	1.6891	0.0622	1.6891	1.2997
No log	1.5263	58	1.5812	0.0331	1.5812	1.2575
No log	1.5789	60	1.4695	0.0732	1.4695	1.2122
No log	1.6316	62	1.3416	0.1110	1.3416	1.1583
No log	1.6842	64	1.2390	0.2509	1.2390	1.1131
No log	1.7368	66	1.3870	0.0339	1.3870	1.1777
No log	1.7895	68	1.4607	0.1064	1.4607	1.2086
No log	1.8421	70	1.3614	0.1080	1.3614	1.1668
No log	1.8947	72	1.2992	0.1217	1.2992	1.1398
No log	1.9474	74	1.1885	0.2711	1.1885	1.0902
No log	2.0	76	1.2662	0.1835	1.2662	1.1252
No log	2.0526	78	1.3730	0.1371	1.3730	1.1717
No log	2.1053	80	1.2253	0.1830	1.2253	1.1069
No log	2.1579	82	1.1247	0.2711	1.1247	1.0605
No log	2.2105	84	1.2206	0.2288	1.2206	1.1048
No log	2.2632	86	1.3560	0.2647	1.3560	1.1645
No log	2.3158	88	1.2575	0.2781	1.2575	1.1214
No log	2.3684	90	1.0728	0.3335	1.0728	1.0358
No log	2.4211	92	1.0789	0.2505	1.0789	1.0387
No log	2.4737	94	1.2977	0.1972	1.2977	1.1392
No log	2.5263	96	1.2376	0.1832	1.2376	1.1125
No log	2.5789	98	1.0288	0.3829	1.0288	1.0143
No log	2.6316	100	1.0698	0.2929	1.0698	1.0343
No log	2.6842	102	1.1756	0.3617	1.1756	1.0843
No log	2.7368	104	1.1041	0.2594	1.1041	1.0508
No log	2.7895	106	1.0803	0.3796	1.0803	1.0394
No log	2.8421	108	1.1039	0.3443	1.1039	1.0506
No log	2.8947	110	1.0932	0.3639	1.0932	1.0456
No log	2.9474	112	1.0822	0.4218	1.0822	1.0403
No log	3.0	114	1.0509	0.3948	1.0509	1.0251
No log	3.0526	116	1.0546	0.4575	1.0546	1.0270
No log	3.1053	118	1.0399	0.4242	1.0399	1.0197
No log	3.1579	120	1.0100	0.3467	1.0100	1.0050
No log	3.2105	122	1.1517	0.2285	1.1517	1.0732
No log	3.2632	124	1.2113	0.2005	1.2113	1.1006
No log	3.3158	126	1.0780	0.2963	1.0780	1.0383
No log	3.3684	128	1.0226	0.3201	1.0226	1.0113
No log	3.4211	130	1.0523	0.3537	1.0523	1.0258
No log	3.4737	132	1.0982	0.3655	1.0982	1.0479
No log	3.5263	134	1.0482	0.3374	1.0482	1.0238
No log	3.5789	136	1.0764	0.2991	1.0764	1.0375
No log	3.6316	138	1.0904	0.2991	1.0904	1.0442
No log	3.6842	140	1.1293	0.1935	1.1293	1.0627
No log	3.7368	142	1.1477	0.1878	1.1477	1.0713
No log	3.7895	144	1.3894	0.2389	1.3894	1.1787
No log	3.8421	146	1.4464	0.2521	1.4464	1.2027
No log	3.8947	148	1.1982	0.2909	1.1982	1.0946
No log	3.9474	150	1.1098	0.3042	1.1098	1.0535
No log	4.0	152	1.1556	0.2409	1.1556	1.0750
No log	4.0526	154	1.2976	0.1801	1.2976	1.1391
No log	4.1053	156	1.3260	0.1801	1.3260	1.1515
No log	4.1579	158	1.1468	0.1706	1.1468	1.0709
No log	4.2105	160	1.0930	0.2520	1.0930	1.0455
No log	4.2632	162	1.1694	0.1279	1.1694	1.0814
No log	4.3158	164	1.2776	0.0442	1.2776	1.1303
No log	4.3684	166	1.2355	0.0513	1.2355	1.1115
No log	4.4211	168	1.1919	0.0513	1.1919	1.0917
No log	4.4737	170	1.1374	0.1667	1.1374	1.0665
No log	4.5263	172	1.0964	0.2662	1.0964	1.0471
No log	4.5789	174	1.1364	0.3115	1.1364	1.0660
No log	4.6316	176	1.1685	0.3449	1.1685	1.0810
No log	4.6842	178	1.1684	0.3191	1.1684	1.0809
No log	4.7368	180	1.1409	0.2644	1.1409	1.0682
No log	4.7895	182	1.1339	0.2755	1.1339	1.0649
No log	4.8421	184	1.1076	0.2344	1.1076	1.0524
No log	4.8947	186	1.1137	0.2439	1.1137	1.0553
No log	4.9474	188	1.1184	0.2318	1.1184	1.0575
No log	5.0	190	1.2462	0.1817	1.2462	1.1163
No log	5.0526	192	1.1740	0.2909	1.1740	1.0835
No log	5.1053	194	1.1965	0.2523	1.1965	1.0939
No log	5.1579	196	1.1543	0.2206	1.1543	1.0744
No log	5.2105	198	1.1223	0.3089	1.1223	1.0594
No log	5.2632	200	1.1990	0.2767	1.1990	1.0950
No log	5.3158	202	1.3651	0.2599	1.3651	1.1684
No log	5.3684	204	1.6677	0.2621	1.6677	1.2914
No log	5.4211	206	1.6313	0.2873	1.6313	1.2772
No log	5.4737	208	1.3687	0.0551	1.3687	1.1699
No log	5.5263	210	1.2012	0.1210	1.2012	1.0960
No log	5.5789	212	1.1574	0.2763	1.1574	1.0758
No log	5.6316	214	1.1647	0.1530	1.1647	1.0792
No log	5.6842	216	1.2105	0.1546	1.2105	1.1002
No log	5.7368	218	1.2651	0.1042	1.2651	1.1248
No log	5.7895	220	1.3151	0.1076	1.3151	1.1468
No log	5.8421	222	1.2641	0.1279	1.2641	1.1243
No log	5.8947	224	1.2316	0.1279	1.2316	1.1098
No log	5.9474	226	1.1186	0.1995	1.1186	1.0576
No log	6.0	228	1.1081	0.2509	1.1081	1.0527
No log	6.0526	230	1.1847	0.1505	1.1847	1.0884
No log	6.1053	232	1.2275	0.1149	1.2275	1.1079
No log	6.1579	234	1.2073	0.1343	1.2073	1.0988
No log	6.2105	236	1.1312	0.1875	1.1312	1.0636
No log	6.2632	238	1.1111	0.1875	1.1111	1.0541
No log	6.3158	240	1.1873	0.3625	1.1873	1.0897
No log	6.3684	242	1.2116	0.3446	1.2116	1.1007
No log	6.4211	244	1.1567	0.2651	1.1567	1.0755
No log	6.4737	246	1.0776	0.2486	1.0776	1.0381
No log	6.5263	248	1.0524	0.2520	1.0524	1.0259
No log	6.5789	250	1.0362	0.3374	1.0362	1.0179
No log	6.6316	252	1.0844	0.3434	1.0844	1.0413
No log	6.6842	254	1.2696	0.3180	1.2696	1.1268
No log	6.7368	256	1.2228	0.3083	1.2228	1.1058
No log	6.7895	258	1.0692	0.4	1.0692	1.0340
No log	6.8421	260	0.9868	0.4203	0.9868	0.9934
No log	6.8947	262	1.0528	0.4700	1.0528	1.0260
No log	6.9474	264	1.2281	0.375	1.2281	1.1082
No log	7.0	266	1.2326	0.3317	1.2326	1.1102
No log	7.0526	268	1.1317	0.2844	1.1317	1.0638
No log	7.1053	270	1.0886	0.3451	1.0886	1.0434
No log	7.1579	272	1.1982	0.3148	1.1982	1.0946
No log	7.2105	274	1.3692	0.3082	1.3692	1.1701
No log	7.2632	276	1.4192	0.2775	1.4192	1.1913
No log	7.3158	278	1.3642	0.2468	1.3642	1.1680
No log	7.3684	280	1.2385	0.2207	1.2385	1.1129
No log	7.4211	282	1.1248	0.2083	1.1248	1.0606
No log	7.4737	284	1.0673	0.2155	1.0673	1.0331
No log	7.5263	286	1.0385	0.2574	1.0385	1.0190
No log	7.5789	288	1.0666	0.2513	1.0666	1.0327
No log	7.6316	290	1.2661	0.1850	1.2661	1.1252
No log	7.6842	292	1.4619	0.1583	1.4619	1.2091
No log	7.7368	294	1.4475	0.2806	1.4475	1.2031
No log	7.7895	296	1.1990	0.1898	1.1990	1.0950
No log	7.8421	298	0.9525	0.2887	0.9525	0.9760
No log	7.8947	300	0.9503	0.3660	0.9503	0.9748
No log	7.9474	302	0.9711	0.4411	0.9711	0.9855
No log	8.0	304	0.9508	0.2991	0.9508	0.9751
No log	8.0526	306	0.9785	0.2887	0.9785	0.9892
No log	8.1053	308	1.0472	0.2290	1.0472	1.0233
No log	8.1579	310	1.0510	0.2432	1.0510	1.0252
No log	8.2105	312	1.0088	0.1979	1.0088	1.0044
No log	8.2632	314	0.9835	0.3045	0.9835	0.9917
No log	8.3158	316	0.9850	0.3356	0.9850	0.9925
No log	8.3684	318	1.0031	0.2569	1.0031	1.0016
No log	8.4211	320	1.0401	0.2083	1.0401	1.0199
No log	8.4737	322	1.0887	0.0948	1.0887	1.0434
No log	8.5263	324	1.0773	0.0849	1.0773	1.0379
No log	8.5789	326	1.1288	0.1048	1.1288	1.0625
No log	8.6316	328	1.1473	0.1048	1.1473	1.0711
No log	8.6842	330	1.1144	0.1048	1.1144	1.0557
No log	8.7368	332	1.0897	0.1649	1.0897	1.0439
No log	8.7895	334	1.0698	0.2083	1.0698	1.0343
No log	8.8421	336	1.0937	0.1868	1.0937	1.0458
No log	8.8947	338	1.2763	0.2693	1.2763	1.1297
No log	8.9474	340	1.4044	0.3478	1.4044	1.1851
No log	9.0	342	1.2736	0.2384	1.2736	1.1285
No log	9.0526	344	1.1723	0.2285	1.1723	1.0827
No log	9.1053	346	1.0958	0.1944	1.0958	1.0468
No log	9.1579	348	1.1010	0.2369	1.1010	1.0493
No log	9.2105	350	1.1075	0.2887	1.1075	1.0524
No log	9.2632	352	1.0953	0.2155	1.0953	1.0466
No log	9.3158	354	1.1426	0.0841	1.1426	1.0689
No log	9.3684	356	1.2131	0.0780	1.2131	1.1014
No log	9.4211	358	1.2127	0.0780	1.2127	1.1012
No log	9.4737	360	1.1718	0.0751	1.1718	1.0825
No log	9.5263	362	1.0774	0.2464	1.0774	1.0380
No log	9.5789	364	1.0775	0.3020	1.0775	1.0380
No log	9.6316	366	1.1619	0.2103	1.1619	1.0779
No log	9.6842	368	1.3279	0.3210	1.3279	1.1523
No log	9.7368	370	1.3331	0.2520	1.3331	1.1546
No log	9.7895	372	1.2592	0.125	1.2592	1.1222
No log	9.8421	374	1.1382	0.1314	1.1382	1.0669
No log	9.8947	376	1.1174	0.1752	1.1174	1.0570
No log	9.9474	378	1.1200	0.1752	1.1200	1.0583
No log	10.0	380	1.1185	0.1752	1.1185	1.0576
No log	10.0526	382	1.0970	0.2246	1.0970	1.0474
No log	10.1053	384	1.0662	0.2257	1.0662	1.0326
No log	10.1579	386	1.0752	0.2257	1.0752	1.0369
No log	10.2105	388	1.1164	0.2142	1.1164	1.0566
No log	10.2632	390	1.1994	0.1247	1.1994	1.0952
No log	10.3158	392	1.3236	0.1708	1.3236	1.1505
No log	10.3684	394	1.3418	0.1364	1.3418	1.1583
No log	10.4211	396	1.2870	0.2032	1.2870	1.1345
No log	10.4737	398	1.2719	0.2141	1.2719	1.1278
No log	10.5263	400	1.2229	0.1315	1.2229	1.1058
No log	10.5789	402	1.1558	0.1211	1.1558	1.0751
No log	10.6316	404	1.1537	0.1314	1.1537	1.0741
No log	10.6842	406	1.1586	0.1315	1.1586	1.0764
No log	10.7368	408	1.1592	0.1479	1.1592	1.0766
No log	10.7895	410	1.1682	0.1795	1.1682	1.0808
No log	10.8421	412	1.1304	0.1952	1.1304	1.0632
No log	10.8947	414	1.1570	0.1379	1.1570	1.0756
No log	10.9474	416	1.1761	0.1379	1.1761	1.0845
No log	11.0	418	1.1716	0.1379	1.1716	1.0824
No log	11.0526	420	1.1297	0.2013	1.1297	1.0629
No log	11.1053	422	1.0452	0.2188	1.0452	1.0223
No log	11.1579	424	1.0295	0.2246	1.0295	1.0147
No log	11.2105	426	1.0606	0.1752	1.0606	1.0299
No log	11.2632	428	1.1126	0.1689	1.1126	1.0548
No log	11.3158	430	1.1756	0.1076	1.1756	1.0843
No log	11.3684	432	1.1536	0.1076	1.1536	1.0741
No log	11.4211	434	1.1014	0.1752	1.1014	1.0495
No log	11.4737	436	1.0827	0.1752	1.0827	1.0405
No log	11.5263	438	1.0787	0.2188	1.0787	1.0386
No log	11.5789	440	1.0619	0.2188	1.0619	1.0305
No log	11.6316	442	1.0340	0.2246	1.0340	1.0168
No log	11.6842	444	1.0981	0.1752	1.0981	1.0479
No log	11.7368	446	1.1909	0.1076	1.1909	1.0913
No log	11.7895	448	1.2604	0.1076	1.2604	1.1227
No log	11.8421	450	1.2368	0.1076	1.2368	1.1121
No log	11.8947	452	1.1760	0.1076	1.1760	1.0845
No log	11.9474	454	1.1211	0.1752	1.1211	1.0588
No log	12.0	456	1.0629	0.2624	1.0629	1.0310
No log	12.0526	458	1.0179	0.3045	1.0179	1.0089
No log	12.1053	460	0.9921	0.2624	0.9921	0.9960
No log	12.1579	462	1.0288	0.2188	1.0288	1.0143
No log	12.2105	464	1.2103	0.1159	1.2103	1.1002
No log	12.2632	466	1.3340	0.2201	1.3340	1.1550
No log	12.3158	468	1.3090	0.2163	1.3090	1.1441
No log	12.3684	470	1.1874	0.2141	1.1874	1.0897
No log	12.4211	472	1.0526	0.2669	1.0526	1.0260
No log	12.4737	474	0.9821	0.2624	0.9821	0.9910
No log	12.5263	476	0.9846	0.2624	0.9846	0.9923
No log	12.5789	478	1.0060	0.2624	1.0060	1.0030
No log	12.6316	480	1.0700	0.1918	1.0700	1.0344
No log	12.6842	482	1.1705	0.1795	1.1705	1.0819
No log	12.7368	484	1.1982	0.0980	1.1982	1.0946
No log	12.7895	486	1.1721	0.1076	1.1721	1.0827
No log	12.8421	488	1.1634	0.1247	1.1634	1.0786
No log	12.8947	490	1.1455	0.1585	1.1455	1.0703
No log	12.9474	492	1.1441	0.1585	1.1441	1.0696
No log	13.0	494	1.1496	0.1585	1.1496	1.0722
No log	13.0526	496	1.1792	0.1696	1.1792	1.0859
No log	13.1053	498	1.2201	0.2367	1.2201	1.1046
0.3838	13.1579	500	1.2150	0.1696	1.2150	1.1023
0.3838	13.2105	502	1.1575	0.1582	1.1575	1.0759
0.3838	13.2632	504	1.1562	0.1582	1.1562	1.0753
0.3838	13.3158	506	1.1715	0.1582	1.1715	1.0823
0.3838	13.3684	508	1.1592	0.1247	1.1592	1.0767
0.3838	13.4211	510	1.1688	0.1247	1.1688	1.0811

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1