ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2284
• Qwk: 0.1058
• Mse: 1.2284
• Rmse: 1.1083

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	2.5916	-0.0593	2.5916	1.6098
No log	0.1212	4	1.2543	0.1549	1.2543	1.1200
No log	0.1818	6	1.0858	-0.0927	1.0858	1.0420
No log	0.2424	8	1.1551	-0.1802	1.1551	1.0747
No log	0.3030	10	1.0165	-0.0426	1.0165	1.0082
No log	0.3636	12	0.9504	-0.0831	0.9504	0.9749
No log	0.4242	14	0.8909	-0.0831	0.8909	0.9439
No log	0.4848	16	0.9632	-0.0408	0.9632	0.9814
No log	0.5455	18	0.9490	-0.0831	0.9490	0.9742
No log	0.6061	20	0.9569	-0.0741	0.9569	0.9782
No log	0.6667	22	1.0463	-0.0123	1.0463	1.0229
No log	0.7273	24	0.9977	-0.0148	0.9977	0.9989
No log	0.7879	26	0.9332	0.0145	0.9332	0.9660
No log	0.8485	28	0.8392	0.0481	0.8392	0.9161
No log	0.9091	30	0.7767	0.0	0.7767	0.8813
No log	0.9697	32	0.7942	0.0393	0.7942	0.8912
No log	1.0303	34	0.8226	0.2145	0.8226	0.9070
No log	1.0909	36	0.9090	0.1648	0.9090	0.9534
No log	1.1515	38	0.9409	0.1550	0.9409	0.9700
No log	1.2121	40	0.9168	0.1699	0.9168	0.9575
No log	1.2727	42	0.9318	-0.0444	0.9318	0.9653
No log	1.3333	44	0.9485	-0.1217	0.9485	0.9739
No log	1.3939	46	0.8567	-0.0426	0.8567	0.9256
No log	1.4545	48	0.7844	0.0295	0.7844	0.8857
No log	1.5152	50	0.8504	0.1504	0.8504	0.9222
No log	1.5758	52	0.9694	0.1584	0.9694	0.9846
No log	1.6364	54	0.9914	0.1550	0.9914	0.9957
No log	1.6970	56	0.9951	0.1407	0.9951	0.9976
No log	1.7576	58	1.0108	-0.0443	1.0108	1.0054
No log	1.8182	60	1.0398	-0.1111	1.0398	1.0197
No log	1.8788	62	0.9755	-0.0831	0.9755	0.9877
No log	1.9394	64	0.8940	0.0	0.8940	0.9455
No log	2.0	66	0.8463	-0.0051	0.8463	0.9199
No log	2.0606	68	0.8512	-0.0462	0.8512	0.9226
No log	2.1212	70	0.8564	-0.0511	0.8564	0.9254
No log	2.1818	72	0.9124	-0.0511	0.9124	0.9552
No log	2.2424	74	0.9526	0.0227	0.9526	0.9760
No log	2.3030	76	0.9920	0.0552	0.9920	0.9960
No log	2.3636	78	1.0502	0.1718	1.0502	1.0248
No log	2.4242	80	1.0816	0.0860	1.0816	1.0400
No log	2.4848	82	1.0426	0.1332	1.0426	1.0211
No log	2.5455	84	0.9872	0.1531	0.9872	0.9936
No log	2.6061	86	0.9879	0.0218	0.9879	0.9939
No log	2.6667	88	1.0197	-0.0487	1.0197	1.0098
No log	2.7273	90	1.0376	0.0532	1.0376	1.0186
No log	2.7879	92	1.0827	0.1800	1.0827	1.0405
No log	2.8485	94	1.0960	0.1800	1.0960	1.0469
No log	2.9091	96	1.0936	0.1800	1.0936	1.0457
No log	2.9697	98	1.1919	0.1534	1.1919	1.0918
No log	3.0303	100	1.2244	0.1045	1.2244	1.1065
No log	3.0909	102	1.1959	0.0648	1.1959	1.0936
No log	3.1515	104	1.1014	0.1946	1.1014	1.0495
No log	3.2121	106	1.1053	0.0864	1.1053	1.0513
No log	3.2727	108	1.1143	0.0563	1.1143	1.0556
No log	3.3333	110	1.0804	0.1140	1.0804	1.0394
No log	3.3939	112	1.0838	0.1718	1.0838	1.0411
No log	3.4545	114	1.0758	0.1718	1.0758	1.0372
No log	3.5152	116	1.0383	0.1718	1.0383	1.0190
No log	3.5758	118	1.0115	0.0860	1.0115	1.0057
No log	3.6364	120	1.0121	0.0563	1.0121	1.0060
No log	3.6970	122	1.0248	0.0892	1.0248	1.0123
No log	3.7576	124	1.0564	0.1065	1.0564	1.0278
No log	3.8182	126	1.1420	0.0412	1.1420	1.0687
No log	3.8788	128	1.2580	0.0896	1.2580	1.1216
No log	3.9394	130	1.2970	0.0616	1.2970	1.1389
No log	4.0	132	1.3389	0.0765	1.3389	1.1571
No log	4.0606	134	1.4025	0.0459	1.4025	1.1843
No log	4.1212	136	1.3742	0.0820	1.3742	1.1723
No log	4.1818	138	1.2448	0.0898	1.2448	1.1157
No log	4.2424	140	1.1925	0.0365	1.1925	1.0920
No log	4.3030	142	1.1994	0.0316	1.1994	1.0952
No log	4.3636	144	1.3081	0.0613	1.3081	1.1437
No log	4.4242	146	1.3370	0.1226	1.3370	1.1563
No log	4.4848	148	1.2125	0.1014	1.2125	1.1011
No log	4.5455	150	1.0754	0.0962	1.0754	1.0370
No log	4.6061	152	1.0305	0.0056	1.0305	1.0152
No log	4.6667	154	1.0506	0.1289	1.0506	1.0250
No log	4.7273	156	1.1690	0.1274	1.1690	1.0812
No log	4.7879	158	1.2245	0.1175	1.2245	1.1066
No log	4.8485	160	1.1419	0.1110	1.1419	1.0686
No log	4.9091	162	1.0000	0.1142	1.0000	1.0000
No log	4.9697	164	0.9610	0.0604	0.9610	0.9803
No log	5.0303	166	0.9364	0.0930	0.9364	0.9677
No log	5.0909	168	0.9610	0.1459	0.9610	0.9803
No log	5.1515	170	1.0298	0.1373	1.0298	1.0148
No log	5.2121	172	1.0616	0.1650	1.0616	1.0303
No log	5.2727	174	1.1007	0.0728	1.1007	1.0492
No log	5.3333	176	1.1627	0.0094	1.1627	1.0783
No log	5.3939	178	1.2250	0.0248	1.2250	1.1068
No log	5.4545	180	1.4066	0.0927	1.4066	1.1860
No log	5.5152	182	1.5296	0.0753	1.5296	1.2368
No log	5.5758	184	1.4551	0.1067	1.4551	1.2063
No log	5.6364	186	1.2602	0.1077	1.2602	1.1226
No log	5.6970	188	1.0894	0.0430	1.0894	1.0437
No log	5.7576	190	1.0341	-0.0124	1.0341	1.0169
No log	5.8182	192	1.0129	0.1437	1.0129	1.0064
No log	5.8788	194	1.0654	0.1328	1.0654	1.0322
No log	5.9394	196	1.1497	0.1271	1.1497	1.0722
No log	6.0	198	1.1238	0.1045	1.1238	1.0601
No log	6.0606	200	1.0955	0.1416	1.0955	1.0467
No log	6.1212	202	0.9964	0.1416	0.9964	0.9982
No log	6.1818	204	0.9558	0.1222	0.9558	0.9776
No log	6.2424	206	0.9830	0.1298	0.9830	0.9914
No log	6.3030	208	0.9932	0.1140	0.9932	0.9966
No log	6.3636	210	1.0732	0.1899	1.0732	1.0359
No log	6.4242	212	1.1708	0.0925	1.1708	1.0820
No log	6.4848	214	1.1702	0.0953	1.1702	1.0818
No log	6.5455	216	1.2641	0.0794	1.2641	1.1243
No log	6.6061	218	1.2800	0.0820	1.2800	1.1314
No log	6.6667	220	1.2632	0.0607	1.2632	1.1239
No log	6.7273	222	1.2265	0.0630	1.2265	1.1075
No log	6.7879	224	1.2302	0.0630	1.2302	1.1092
No log	6.8485	226	1.2556	0.0591	1.2556	1.1205
No log	6.9091	228	1.2346	0.0959	1.2346	1.1111
No log	6.9697	230	1.1767	0.0816	1.1767	1.0847
No log	7.0303	232	1.0753	0.1285	1.0753	1.0369
No log	7.0909	234	1.0580	0.1650	1.0580	1.0286
No log	7.1515	236	1.1066	0.1248	1.1066	1.0520
No log	7.2121	238	1.1936	0.0710	1.1936	1.0925
No log	7.2727	240	1.2502	0.1031	1.2502	1.1181
No log	7.3333	242	1.1666	0.1492	1.1666	1.0801
No log	7.3939	244	1.0777	0.1984	1.0777	1.0381
No log	7.4545	246	1.0327	0.2096	1.0327	1.0162
No log	7.5152	248	1.0358	0.1694	1.0358	1.0178
No log	7.5758	250	1.0864	0.0898	1.0864	1.0423
No log	7.6364	252	1.1697	0.0591	1.1697	1.0815
No log	7.6970	254	1.1933	0.1085	1.1933	1.0924
No log	7.7576	256	1.2008	0.1384	1.2008	1.0958
No log	7.8182	258	1.1892	0.1583	1.1892	1.0905
No log	7.8788	260	1.1148	0.1815	1.1148	1.0558
No log	7.9394	262	1.0800	0.2147	1.0800	1.0392
No log	8.0	264	1.1161	0.1626	1.1161	1.0565
No log	8.0606	266	1.0725	0.1775	1.0725	1.0356
No log	8.1212	268	0.9941	0.2697	0.9941	0.9970
No log	8.1818	270	1.0060	0.2697	1.0060	1.0030
No log	8.2424	272	1.1841	0.1448	1.1841	1.0882
No log	8.3030	274	1.3787	0.1571	1.3787	1.1742
No log	8.3636	276	1.3754	0.1517	1.3754	1.1728
No log	8.4242	278	1.3301	0.1441	1.3301	1.1533
No log	8.4848	280	1.1442	0.2354	1.1442	1.0697
No log	8.5455	282	0.9919	0.1839	0.9919	0.9960
No log	8.6061	284	0.9628	0.2202	0.9628	0.9812
No log	8.6667	286	1.0069	0.2439	1.0069	1.0035
No log	8.7273	288	1.0483	0.1912	1.0483	1.0239
No log	8.7879	290	1.1146	0.2578	1.1146	1.0557
No log	8.8485	292	1.2042	0.2094	1.2042	1.0974
No log	8.9091	294	1.1852	0.1910	1.1852	1.0886
No log	8.9697	296	1.1933	0.1576	1.1933	1.0924
No log	9.0303	298	1.1755	0.1445	1.1755	1.0842
No log	9.0909	300	1.2163	0.1283	1.2163	1.1028
No log	9.1515	302	1.3555	0.1217	1.3555	1.1643
No log	9.2121	304	1.4383	0.1329	1.4383	1.1993
No log	9.2727	306	1.4441	0.1168	1.4441	1.2017
No log	9.3333	308	1.4135	0.0996	1.4135	1.1889
No log	9.3939	310	1.2265	0.1031	1.2265	1.1075
No log	9.4545	312	1.1569	0.0904	1.1569	1.0756
No log	9.5152	314	1.1405	0.1085	1.1405	1.0679
No log	9.5758	316	1.1823	0.1283	1.1823	1.0873
No log	9.6364	318	1.2511	0.1479	1.2511	1.1185
No log	9.6970	320	1.2998	0.1145	1.2998	1.1401
No log	9.7576	322	1.3358	0.1067	1.3358	1.1558
No log	9.8182	324	1.3191	0.0886	1.3191	1.1485
No log	9.8788	326	1.2978	0.0933	1.2978	1.1392
No log	9.9394	328	1.2139	0.1317	1.2139	1.1018
No log	10.0	330	1.1930	0.1922	1.1930	1.0922
No log	10.0606	332	1.0619	0.2336	1.0619	1.0305
No log	10.1212	334	0.9508	0.1103	0.9508	0.9751
No log	10.1818	336	0.9364	0.1103	0.9364	0.9677
No log	10.2424	338	0.9884	0.1373	0.9884	0.9942
No log	10.3030	340	1.0885	0.2589	1.0885	1.0433
No log	10.3636	342	1.2368	0.1653	1.2368	1.1121
No log	10.4242	344	1.2476	0.1257	1.2476	1.1170
No log	10.4848	346	1.1459	0.2070	1.1459	1.0705
No log	10.5455	348	1.1528	0.2329	1.1528	1.0737
No log	10.6061	350	1.2574	0.0687	1.2574	1.1213
No log	10.6667	352	1.4250	0.0788	1.4250	1.1937
No log	10.7273	354	1.5021	0.0689	1.5021	1.2256
No log	10.7879	356	1.4193	0.0993	1.4193	1.1913
No log	10.8485	358	1.3423	0.1278	1.3423	1.1586
No log	10.9091	360	1.2530	0.1029	1.2530	1.1194
No log	10.9697	362	1.2483	0.0770	1.2483	1.1173
No log	11.0303	364	1.2705	0.0770	1.2705	1.1272
No log	11.0909	366	1.2519	0.1260	1.2519	1.1189
No log	11.1515	368	1.1965	0.1057	1.1965	1.0938
No log	11.2121	370	1.1118	0.1926	1.1118	1.0544
No log	11.2727	372	1.1099	0.1926	1.1099	1.0535
No log	11.3333	374	1.1250	0.1268	1.1250	1.0607
No log	11.3939	376	1.2808	0.1479	1.2808	1.1317
No log	11.4545	378	1.4041	0.1463	1.4041	1.1850
No log	11.5152	380	1.3501	0.1491	1.3501	1.1620
No log	11.5758	382	1.1892	0.0904	1.1892	1.0905
No log	11.6364	384	1.0307	0.2071	1.0307	1.0152
No log	11.6970	386	0.9840	0.2551	0.9840	0.9920
No log	11.7576	388	0.9895	0.2495	0.9895	0.9947
No log	11.8182	390	1.0620	0.1369	1.0620	1.0305
No log	11.8788	392	1.2494	0.1058	1.2494	1.1178
No log	11.9394	394	1.4011	0.0997	1.4011	1.1837
No log	12.0	396	1.3775	0.1270	1.3775	1.1737
No log	12.0606	398	1.2645	0.1004	1.2645	1.1245
No log	12.1212	400	1.1683	0.1058	1.1683	1.0809
No log	12.1818	402	1.1423	0.1716	1.1423	1.0688
No log	12.2424	404	1.1875	0.1645	1.1875	1.0897
No log	12.3030	406	1.2367	0.1536	1.2367	1.1121
No log	12.3636	408	1.2519	0.1720	1.2519	1.1189
No log	12.4242	410	1.1710	0.2134	1.1710	1.0821
No log	12.4848	412	1.0315	0.3194	1.0315	1.0156
No log	12.5455	414	0.9775	0.3131	0.9775	0.9887
No log	12.6061	416	0.9686	0.3131	0.9686	0.9842
No log	12.6667	418	1.0523	0.2416	1.0523	1.0258
No log	12.7273	420	1.0720	0.1988	1.0720	1.0354
No log	12.7879	422	1.0006	0.3562	1.0006	1.0003
No log	12.8485	424	0.9813	0.3131	0.9813	0.9906
No log	12.9091	426	1.0690	0.2651	1.0690	1.0339
No log	12.9697	428	1.1304	0.2485	1.1304	1.0632
No log	13.0303	430	1.2717	0.1379	1.2717	1.1277
No log	13.0909	432	1.4073	0.1097	1.4073	1.1863
No log	13.1515	434	1.3435	0.0753	1.3435	1.1591
No log	13.2121	436	1.1792	0.1962	1.1792	1.0859
No log	13.2727	438	1.0798	0.2192	1.0798	1.0392
No log	13.3333	440	1.0086	0.1822	1.0086	1.0043
No log	13.3939	442	1.0126	0.1542	1.0126	1.0063
No log	13.4545	444	1.0697	0.2287	1.0697	1.0342
No log	13.5152	446	1.1255	0.2086	1.1255	1.0609
No log	13.5758	448	1.1469	0.1860	1.1469	1.0709
No log	13.6364	450	1.1076	0.2070	1.1076	1.0524
No log	13.6970	452	1.0354	0.1486	1.0354	1.0176
No log	13.7576	454	1.0031	0.1839	1.0031	1.0016
No log	13.8182	456	1.0222	0.1486	1.0222	1.0111
No log	13.8788	458	1.1265	0.2303	1.1265	1.0613
No log	13.9394	460	1.3212	0.1620	1.3212	1.1494
No log	14.0	462	1.3716	0.1511	1.3716	1.1711
No log	14.0606	464	1.2375	0.1413	1.2375	1.1124
No log	14.1212	466	1.0554	0.3256	1.0554	1.0273
No log	14.1818	468	0.9686	0.2352	0.9686	0.9842
No log	14.2424	470	0.9725	0.2547	0.9725	0.9862
No log	14.3030	472	1.0123	0.2754	1.0123	1.0062
No log	14.3636	474	1.0963	0.3076	1.0963	1.0471
No log	14.4242	476	1.2401	0.1655	1.2401	1.1136
No log	14.4848	478	1.3372	0.1875	1.3372	1.1564
No log	14.5455	480	1.3079	0.2052	1.3079	1.1436
No log	14.6061	482	1.2267	0.2335	1.2267	1.1076
No log	14.6667	484	1.0749	0.1632	1.0749	1.0368
No log	14.7273	486	1.0100	0.2029	1.0100	1.0050
No log	14.7879	488	0.9831	0.2029	0.9831	0.9915
No log	14.8485	490	0.9781	0.1808	0.9781	0.9890
No log	14.9091	492	0.9772	0.1808	0.9772	0.9885
No log	14.9697	494	0.9848	0.1808	0.9848	0.9924
No log	15.0303	496	0.9656	0.2547	0.9656	0.9827
No log	15.0909	498	0.9862	0.2173	0.9862	0.9931
0.3426	15.1515	500	1.0266	0.1808	1.0266	1.0132
0.3426	15.2121	502	1.0271	0.1808	1.0271	1.0134
0.3426	15.2727	504	0.9934	0.2173	0.9934	0.9967
0.3426	15.3333	506	1.0010	0.2173	1.0010	1.0005
0.3426	15.3939	508	1.1023	0.2129	1.1023	1.0499
0.3426	15.4545	510	1.2701	0.1754	1.2701	1.1270
0.3426	15.5152	512	1.3384	0.1656	1.3384	1.1569
0.3426	15.5758	514	1.2596	0.1872	1.2596	1.1223
0.3426	15.6364	516	1.0862	0.3076	1.0862	1.0422
0.3426	15.6970	518	0.9890	0.2358	0.9890	0.9945
0.3426	15.7576	520	0.9640	0.2094	0.9640	0.9818
0.3426	15.8182	522	0.9654	0.2410	0.9654	0.9825
0.3426	15.8788	524	1.0175	0.3076	1.0175	1.0087
0.3426	15.9394	526	1.0396	0.3134	1.0396	1.0196
0.3426	16.0	528	1.0508	0.3134	1.0508	1.0251
0.3426	16.0606	530	1.0900	0.2677	1.0900	1.0440
0.3426	16.1212	532	1.1336	0.2252	1.1336	1.0647
0.3426	16.1818	534	1.1502	0.2209	1.1502	1.0725
0.3426	16.2424	536	1.1823	0.1557	1.1823	1.0873
0.3426	16.3030	538	1.1254	0.2252	1.1254	1.0609
0.3426	16.3636	540	1.0349	0.3076	1.0349	1.0173
0.3426	16.4242	542	0.9718	0.2843	0.9718	0.9858
0.3426	16.4848	544	0.9302	0.2297	0.9302	0.9644
0.3426	16.5455	546	0.9086	0.2883	0.9086	0.9532
0.3426	16.6061	548	0.9442	0.3131	0.9442	0.9717
0.3426	16.6667	550	1.0381	0.2892	1.0381	1.0189
0.3426	16.7273	552	1.1059	0.2485	1.1059	1.0516
0.3426	16.7879	554	1.0758	0.2651	1.0758	1.0372
0.3426	16.8485	556	1.0268	0.3069	1.0268	1.0133
0.3426	16.9091	558	1.0347	0.2754	1.0347	1.0172
0.3426	16.9697	560	1.0826	0.1803	1.0826	1.0405
0.3426	17.0303	562	1.1228	0.1764	1.1228	1.0596
0.3426	17.0909	564	1.2319	0.1473	1.2319	1.1099
0.3426	17.1515	566	1.2859	0.1443	1.2859	1.1340
0.3426	17.2121	568	1.2284	0.1058	1.2284	1.1083

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1