ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1357
• Qwk: 0.1869
• Mse: 1.1357
• Rmse: 1.0657

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	2.5916	-0.0593	2.5916	1.6098
No log	0.1212	4	1.2543	0.1549	1.2543	1.1200
No log	0.1818	6	1.0858	-0.0927	1.0858	1.0420
No log	0.2424	8	1.1550	-0.1802	1.1550	1.0747
No log	0.3030	10	1.0165	-0.0426	1.0165	1.0082
No log	0.3636	12	0.9504	-0.0831	0.9504	0.9749
No log	0.4242	14	0.8909	-0.0831	0.8909	0.9439
No log	0.4848	16	0.9632	-0.0408	0.9632	0.9814
No log	0.5455	18	0.9490	-0.0831	0.9490	0.9742
No log	0.6061	20	0.9569	-0.0741	0.9569	0.9782
No log	0.6667	22	1.0463	-0.0123	1.0463	1.0229
No log	0.7273	24	0.9977	-0.0148	0.9977	0.9989
No log	0.7879	26	0.9332	0.0145	0.9332	0.9660
No log	0.8485	28	0.8392	0.0481	0.8392	0.9161
No log	0.9091	30	0.7767	0.0	0.7767	0.8813
No log	0.9697	32	0.7942	0.0393	0.7942	0.8912
No log	1.0303	34	0.8226	0.2145	0.8226	0.9069
No log	1.0909	36	0.9090	0.1648	0.9090	0.9534
No log	1.1515	38	0.9409	0.1550	0.9409	0.9700
No log	1.2121	40	0.9168	0.1699	0.9168	0.9575
No log	1.2727	42	0.9318	-0.0444	0.9318	0.9653
No log	1.3333	44	0.9485	-0.1217	0.9485	0.9739
No log	1.3939	46	0.8567	-0.0426	0.8567	0.9256
No log	1.4545	48	0.7844	0.0295	0.7844	0.8857
No log	1.5152	50	0.8504	0.1504	0.8504	0.9222
No log	1.5758	52	0.9694	0.1584	0.9694	0.9846
No log	1.6364	54	0.9914	0.1550	0.9914	0.9957
No log	1.6970	56	0.9951	0.1407	0.9951	0.9976
No log	1.7576	58	1.0108	-0.0443	1.0108	1.0054
No log	1.8182	60	1.0398	-0.1111	1.0398	1.0197
No log	1.8788	62	0.9755	-0.0831	0.9755	0.9877
No log	1.9394	64	0.8940	0.0	0.8940	0.9455
No log	2.0	66	0.8463	-0.0051	0.8463	0.9199
No log	2.0606	68	0.8512	-0.0462	0.8512	0.9226
No log	2.1212	70	0.8564	-0.0511	0.8564	0.9254
No log	2.1818	72	0.9124	-0.0511	0.9124	0.9552
No log	2.2424	74	0.9526	0.0227	0.9526	0.9760
No log	2.3030	76	0.9920	0.0552	0.9920	0.9960
No log	2.3636	78	1.0502	0.1718	1.0502	1.0248
No log	2.4242	80	1.0816	0.0860	1.0816	1.0400
No log	2.4848	82	1.0426	0.1332	1.0426	1.0211
No log	2.5455	84	0.9872	0.1531	0.9872	0.9936
No log	2.6061	86	0.9879	0.0218	0.9879	0.9939
No log	2.6667	88	1.0196	-0.0487	1.0196	1.0098
No log	2.7273	90	1.0376	0.0532	1.0376	1.0186
No log	2.7879	92	1.0827	0.1800	1.0827	1.0405
No log	2.8485	94	1.0960	0.1800	1.0960	1.0469
No log	2.9091	96	1.0935	0.1800	1.0935	1.0457
No log	2.9697	98	1.1919	0.1534	1.1919	1.0917
No log	3.0303	100	1.2244	0.1045	1.2244	1.1065
No log	3.0909	102	1.1959	0.0648	1.1959	1.0936
No log	3.1515	104	1.1014	0.1946	1.1014	1.0495
No log	3.2121	106	1.1053	0.0864	1.1053	1.0513
No log	3.2727	108	1.1143	0.0563	1.1143	1.0556
No log	3.3333	110	1.0804	0.1140	1.0804	1.0394
No log	3.3939	112	1.0838	0.1718	1.0838	1.0411
No log	3.4545	114	1.0757	0.1718	1.0757	1.0372
No log	3.5152	116	1.0383	0.1718	1.0383	1.0190
No log	3.5758	118	1.0115	0.0860	1.0115	1.0057
No log	3.6364	120	1.0120	0.0563	1.0120	1.0060
No log	3.6970	122	1.0248	0.0892	1.0248	1.0123
No log	3.7576	124	1.0564	0.1065	1.0564	1.0278
No log	3.8182	126	1.1420	0.0412	1.1420	1.0687
No log	3.8788	128	1.2581	0.0896	1.2581	1.1216
No log	3.9394	130	1.2971	0.0616	1.2971	1.1389
No log	4.0	132	1.3390	0.0765	1.3390	1.1572
No log	4.0606	134	1.4025	0.0459	1.4025	1.1843
No log	4.1212	136	1.3742	0.0820	1.3742	1.1723
No log	4.1818	138	1.2448	0.0898	1.2448	1.1157
No log	4.2424	140	1.1925	0.0365	1.1925	1.0920
No log	4.3030	142	1.1994	0.0316	1.1994	1.0952
No log	4.3636	144	1.3081	0.0613	1.3081	1.1437
No log	4.4242	146	1.3370	0.1226	1.3370	1.1563
No log	4.4848	148	1.2124	0.1014	1.2124	1.1011
No log	4.5455	150	1.0754	0.0962	1.0754	1.0370
No log	4.6061	152	1.0306	0.0056	1.0306	1.0152
No log	4.6667	154	1.0507	0.1289	1.0507	1.0250
No log	4.7273	156	1.1692	0.1274	1.1692	1.0813
No log	4.7879	158	1.2247	0.1175	1.2247	1.1066
No log	4.8485	160	1.1420	0.1110	1.1420	1.0687
No log	4.9091	162	1.0000	0.1142	1.0000	1.0000
No log	4.9697	164	0.9610	0.0604	0.9610	0.9803
No log	5.0303	166	0.9364	0.0930	0.9364	0.9677
No log	5.0909	168	0.9609	0.1459	0.9609	0.9803
No log	5.1515	170	1.0297	0.1373	1.0297	1.0147
No log	5.2121	172	1.0615	0.1650	1.0615	1.0303
No log	5.2727	174	1.1008	0.0728	1.1008	1.0492
No log	5.3333	176	1.1628	0.0094	1.1628	1.0783
No log	5.3939	178	1.2252	0.0248	1.2252	1.1069
No log	5.4545	180	1.4067	0.0927	1.4067	1.1861
No log	5.5152	182	1.5298	0.0753	1.5298	1.2369
No log	5.5758	184	1.4552	0.1067	1.4552	1.2063
No log	5.6364	186	1.2603	0.1077	1.2603	1.1226
No log	5.6970	188	1.0895	0.0430	1.0895	1.0438
No log	5.7576	190	1.0342	-0.0124	1.0342	1.0169
No log	5.8182	192	1.0131	0.1437	1.0131	1.0065
No log	5.8788	194	1.0659	0.1328	1.0659	1.0324
No log	5.9394	196	1.1501	0.1271	1.1501	1.0724
No log	6.0	198	1.1241	0.1045	1.1241	1.0602
No log	6.0606	200	1.0957	0.1416	1.0957	1.0467
No log	6.1212	202	0.9965	0.1416	0.9965	0.9982
No log	6.1818	204	0.9557	0.1222	0.9557	0.9776
No log	6.2424	206	0.9829	0.1298	0.9829	0.9914
No log	6.3030	208	0.9932	0.1140	0.9932	0.9966
No log	6.3636	210	1.0732	0.1899	1.0732	1.0359
No log	6.4242	212	1.1710	0.0925	1.1710	1.0821
No log	6.4848	214	1.1707	0.0953	1.1707	1.0820
No log	6.5455	216	1.2651	0.0794	1.2651	1.1248
No log	6.6061	218	1.2811	0.0820	1.2811	1.1319
No log	6.6667	220	1.2645	0.0607	1.2645	1.1245
No log	6.7273	222	1.2275	0.0630	1.2275	1.1079
No log	6.7879	224	1.2306	0.0630	1.2306	1.1093
No log	6.8485	226	1.2545	0.0591	1.2545	1.1201
No log	6.9091	228	1.2336	0.0959	1.2336	1.1107
No log	6.9697	230	1.1781	0.0816	1.1781	1.0854
No log	7.0303	232	1.0773	0.1285	1.0773	1.0379
No log	7.0909	234	1.0604	0.1650	1.0604	1.0298
No log	7.1515	236	1.1094	0.1248	1.1094	1.0533
No log	7.2121	238	1.1964	0.0685	1.1964	1.0938
No log	7.2727	240	1.2530	0.1031	1.2530	1.1194
No log	7.3333	242	1.1694	0.1492	1.1694	1.0814
No log	7.3939	244	1.0810	0.1723	1.0810	1.0397
No log	7.4545	246	1.0362	0.2096	1.0362	1.0179
No log	7.5152	248	1.0401	0.1694	1.0401	1.0198
No log	7.5758	250	1.0925	0.1448	1.0925	1.0452
No log	7.6364	252	1.1743	0.0591	1.1743	1.0837
No log	7.6970	254	1.1941	0.1085	1.1941	1.0927
No log	7.7576	256	1.2008	0.1384	1.2008	1.0958
No log	7.8182	258	1.1871	0.1352	1.1871	1.0895
No log	7.8788	260	1.1099	0.1815	1.1099	1.0535
No log	7.9394	262	1.0788	0.2147	1.0788	1.0387
No log	8.0	264	1.1218	0.1626	1.1218	1.0592
No log	8.0606	266	1.0826	0.1775	1.0826	1.0405
No log	8.1212	268	0.9994	0.2336	0.9994	0.9997
No log	8.1818	270	1.0064	0.2697	1.0064	1.0032
No log	8.2424	272	1.1776	0.1448	1.1776	1.0852
No log	8.3030	274	1.3715	0.1413	1.3715	1.1711
No log	8.3636	276	1.3686	0.1517	1.3686	1.1699
No log	8.4242	278	1.3262	0.1441	1.3262	1.1516
No log	8.4848	280	1.1398	0.2354	1.1398	1.0676
No log	8.5455	282	0.9862	0.1839	0.9862	0.9931
No log	8.6061	284	0.9560	0.1930	0.9560	0.9778
No log	8.6667	286	0.9979	0.2439	0.9979	0.9990
No log	8.7273	288	1.0393	0.1912	1.0393	1.0195
No log	8.7879	290	1.1061	0.2627	1.1061	1.0517
No log	8.8485	292	1.1987	0.2094	1.1987	1.0949
No log	8.9091	294	1.1824	0.1910	1.1824	1.0874
No log	8.9697	296	1.1889	0.1799	1.1889	1.0904
No log	9.0303	298	1.1762	0.1445	1.1762	1.0845
No log	9.0909	300	1.2284	0.1283	1.2284	1.1083
No log	9.1515	302	1.3687	0.1192	1.3687	1.1699
No log	9.2121	304	1.4454	0.1329	1.4454	1.2022
No log	9.2727	306	1.4429	0.1329	1.4429	1.2012
No log	9.3333	308	1.4291	0.0996	1.4291	1.1955
No log	9.3939	310	1.2518	0.1196	1.2518	1.1189
No log	9.4545	312	1.1534	0.1407	1.1534	1.0740
No log	9.5152	314	1.1264	0.1671	1.1264	1.0613
No log	9.5758	316	1.1621	0.1283	1.1621	1.0780
No log	9.6364	318	1.2275	0.1479	1.2275	1.1079
No log	9.6970	320	1.2882	0.1172	1.2882	1.1350
No log	9.7576	322	1.3455	0.1019	1.3455	1.1599
No log	9.8182	324	1.3353	0.0838	1.3353	1.1556
No log	9.8788	326	1.2806	0.1169	1.2806	1.1316
No log	9.9394	328	1.1731	0.1764	1.1731	1.0831
No log	10.0	330	1.1562	0.2059	1.1562	1.0753
No log	10.0606	332	1.0444	0.1899	1.0443	1.0219
No log	10.1212	334	0.9680	0.0722	0.9680	0.9839
No log	10.1818	336	0.9786	0.0722	0.9786	0.9893
No log	10.2424	338	1.0925	0.2029	1.0925	1.0452
No log	10.3030	340	1.1748	0.2437	1.1748	1.0839
No log	10.3636	342	1.2519	0.1317	1.2519	1.1189
No log	10.4242	344	1.2182	0.1445	1.2182	1.1037
No log	10.4848	346	1.1129	0.2329	1.1129	1.0549
No log	10.5455	348	1.1331	0.2329	1.1331	1.0645
No log	10.6061	350	1.2701	0.0687	1.2701	1.1270
No log	10.6667	352	1.4071	0.0995	1.4071	1.1862
No log	10.7273	354	1.4101	0.1195	1.4101	1.1875
No log	10.7879	356	1.2739	0.1202	1.2739	1.1287
No log	10.8485	358	1.1710	0.1320	1.1710	1.0821
No log	10.9091	360	1.1281	0.1146	1.1281	1.0621
No log	10.9697	362	1.2098	0.1550	1.2098	1.0999
No log	11.0303	364	1.3181	0.1392	1.3181	1.1481
No log	11.0909	366	1.2791	0.1422	1.2791	1.1310
No log	11.1515	368	1.1612	0.1726	1.1612	1.0776
No log	11.2121	370	1.0588	0.1753	1.0588	1.0290
No log	11.2727	372	1.0745	0.1753	1.0745	1.0366
No log	11.3333	374	1.1496	0.1549	1.1496	1.0722
No log	11.3939	376	1.3890	0.0998	1.3890	1.1786
No log	11.4545	378	1.5792	0.1682	1.5792	1.2567
No log	11.5152	380	1.5221	0.0855	1.5221	1.2337
No log	11.5758	382	1.2871	0.0980	1.2871	1.1345
No log	11.6364	384	1.1197	0.1330	1.1197	1.0582
No log	11.6970	386	1.0680	0.1983	1.0680	1.0335
No log	11.7576	388	1.0952	0.1586	1.0952	1.0465
No log	11.8182	390	1.2249	0.1114	1.2249	1.1068
No log	11.8788	392	1.3516	0.1359	1.3516	1.1626
No log	11.9394	394	1.3940	0.1093	1.3940	1.1807
No log	12.0	396	1.3528	0.1145	1.3528	1.1631
No log	12.0606	398	1.2945	0.1228	1.2945	1.1377
No log	12.1212	400	1.2353	0.1257	1.2353	1.1115
No log	12.1818	402	1.2224	0.1257	1.2224	1.1056
No log	12.2424	404	1.2905	0.1448	1.2905	1.1360
No log	12.3030	406	1.3468	0.1218	1.3468	1.1605
No log	12.3636	408	1.3330	0.0810	1.3330	1.1545
No log	12.4242	410	1.1982	0.1417	1.1982	1.0946
No log	12.4848	412	1.0077	0.3562	1.0077	1.0038
No log	12.5455	414	0.9232	0.3131	0.9232	0.9609
No log	12.6061	416	0.9282	0.3630	0.9282	0.9634
No log	12.6667	418	1.0286	0.3194	1.0286	1.0142
No log	12.7273	420	1.0721	0.2964	1.0721	1.0354
No log	12.7879	422	1.0240	0.3310	1.0240	1.0119
No log	12.8485	424	0.9944	0.3134	0.9944	0.9972
No log	12.9091	426	1.0325	0.2934	1.0325	1.0161
No log	12.9697	428	1.0513	0.3274	1.0513	1.0253
No log	13.0303	430	1.1846	0.1835	1.1846	1.0884
No log	13.0909	432	1.3477	0.1270	1.3477	1.1609
No log	13.1515	434	1.3434	0.1270	1.3434	1.1591
No log	13.2121	436	1.2746	0.1413	1.2746	1.1290
No log	13.2727	438	1.2165	0.1479	1.2165	1.1029
No log	13.3333	440	1.1390	0.1922	1.1390	1.0673
No log	13.3939	442	1.1464	0.1922	1.1464	1.0707
No log	13.4545	444	1.2245	0.1618	1.2245	1.1066
No log	13.5152	446	1.2728	0.1543	1.2728	1.1282
No log	13.5758	448	1.2458	0.1872	1.2458	1.1162
No log	13.6364	450	1.1867	0.2217	1.1867	1.0894
No log	13.6970	452	1.1366	0.1843	1.1366	1.0661
No log	13.7576	454	1.1044	0.1843	1.1044	1.0509
No log	13.8182	456	1.1482	0.1962	1.1482	1.0715
No log	13.8788	458	1.2614	0.1448	1.2614	1.1231
No log	13.9394	460	1.4423	0.1414	1.4423	1.2010
No log	14.0	462	1.4740	0.1414	1.4740	1.2141
No log	14.0606	464	1.3200	0.1473	1.3200	1.1489
No log	14.1212	466	1.0976	0.2389	1.0976	1.0477
No log	14.1818	468	0.9970	0.2275	0.9970	0.9985
No log	14.2424	470	0.9998	0.2839	0.9998	0.9999
No log	14.3030	472	1.0522	0.2013	1.0522	1.0258
No log	14.3636	474	1.1788	0.1384	1.1788	1.0857
No log	14.4242	476	1.4076	0.1170	1.4076	1.1864
No log	14.4848	478	1.5679	0.1362	1.5679	1.2521
No log	14.5455	480	1.5627	0.1362	1.5627	1.2501
No log	14.6061	482	1.4062	0.0972	1.4062	1.1858
No log	14.6667	484	1.1644	0.1645	1.1644	1.0791
No log	14.7273	486	1.0149	0.3069	1.0149	1.0074
No log	14.7879	488	0.9961	0.2547	0.9961	0.9980
No log	14.8485	490	1.0113	0.2547	1.0113	1.0057
No log	14.9091	492	1.0561	0.2267	1.0561	1.0277
No log	14.9697	494	1.1564	0.1872	1.1564	1.0754
No log	15.0303	496	1.1982	0.1835	1.1982	1.0946
No log	15.0909	498	1.2154	0.1835	1.2154	1.1024
0.3439	15.1515	500	1.1255	0.1910	1.1255	1.0609
0.3439	15.2121	502	0.9958	0.2275	0.9958	0.9979
0.3439	15.2727	504	0.9485	0.2045	0.9485	0.9739
0.3439	15.3333	506	0.9639	0.1694	0.9639	0.9818
0.3439	15.3939	508	1.0236	0.1783	1.0236	1.0117
0.3439	15.4545	510	1.1043	0.2348	1.1043	1.0509
0.3439	15.5152	512	1.1742	0.1872	1.1742	1.0836
0.3439	15.5758	514	1.2138	0.1799	1.2138	1.1017
0.3439	15.6364	516	1.1370	0.1835	1.1370	1.0663
0.3439	15.6970	518	1.0302	0.3333	1.0302	1.0150
0.3439	15.7576	520	0.9491	0.2754	0.9491	0.9742
0.3439	15.8182	522	0.9474	0.2173	0.9474	0.9733
0.3439	15.8788	524	1.0121	0.2779	1.0121	1.0060
0.3439	15.9394	526	1.0236	0.1742	1.0236	1.0117
0.3439	16.0	528	1.0245	0.1175	1.0245	1.0122
0.3439	16.0606	530	1.0488	0.1954	1.0488	1.0241
0.3439	16.1212	532	1.1255	0.2348	1.1255	1.0609
0.3439	16.1818	534	1.1582	0.2830	1.1582	1.0762
0.3439	16.2424	536	1.1748	0.2461	1.1748	1.0839
0.3439	16.3030	538	1.1358	0.2460	1.1358	1.0657
0.3439	16.3636	540	1.0383	0.2670	1.0383	1.0190
0.3439	16.4242	542	0.9619	0.1029	0.9619	0.9808
0.3439	16.4848	544	0.9459	0.0432	0.9459	0.9726
0.3439	16.5455	546	0.9723	0.1409	0.9723	0.9860
0.3439	16.6061	548	1.0460	0.2315	1.0460	1.0227
0.3439	16.6667	550	1.1545	0.2507	1.1545	1.0745
0.3439	16.7273	552	1.2295	0.1510	1.2295	1.1088
0.3439	16.7879	554	1.2552	0.1550	1.2552	1.1203
0.3439	16.8485	556	1.2281	0.1550	1.2281	1.1082
0.3439	16.9091	558	1.1496	0.1535	1.1496	1.0722
0.3439	16.9697	560	1.1357	0.1869	1.1357	1.0657

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1