ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1794
• Qwk: 0.1653
• Mse: 1.1794
• Rmse: 1.0860

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	2.5916	-0.0593	2.5916	1.6098
No log	0.1212	4	1.2543	0.1549	1.2543	1.1200
No log	0.1818	6	1.0858	-0.0927	1.0858	1.0420
No log	0.2424	8	1.1550	-0.1802	1.1550	1.0747
No log	0.3030	10	1.0165	-0.0426	1.0165	1.0082
No log	0.3636	12	0.9504	-0.0831	0.9504	0.9749
No log	0.4242	14	0.8909	-0.0831	0.8909	0.9439
No log	0.4848	16	0.9632	-0.0408	0.9632	0.9814
No log	0.5455	18	0.9490	-0.0831	0.9490	0.9742
No log	0.6061	20	0.9569	-0.0741	0.9569	0.9782
No log	0.6667	22	1.0463	-0.0123	1.0463	1.0229
No log	0.7273	24	0.9977	-0.0148	0.9977	0.9989
No log	0.7879	26	0.9332	0.0145	0.9332	0.9660
No log	0.8485	28	0.8392	0.0481	0.8392	0.9161
No log	0.9091	30	0.7767	0.0	0.7767	0.8813
No log	0.9697	32	0.7942	0.0393	0.7942	0.8912
No log	1.0303	34	0.8226	0.2145	0.8226	0.9069
No log	1.0909	36	0.9090	0.1648	0.9090	0.9534
No log	1.1515	38	0.9409	0.1550	0.9409	0.9700
No log	1.2121	40	0.9168	0.1699	0.9168	0.9575
No log	1.2727	42	0.9318	-0.0444	0.9318	0.9653
No log	1.3333	44	0.9485	-0.1217	0.9485	0.9739
No log	1.3939	46	0.8567	-0.0426	0.8567	0.9256
No log	1.4545	48	0.7844	0.0295	0.7844	0.8857
No log	1.5152	50	0.8504	0.1504	0.8504	0.9222
No log	1.5758	52	0.9694	0.1584	0.9694	0.9846
No log	1.6364	54	0.9914	0.1550	0.9914	0.9957
No log	1.6970	56	0.9951	0.1407	0.9951	0.9976
No log	1.7576	58	1.0108	-0.0443	1.0108	1.0054
No log	1.8182	60	1.0398	-0.1111	1.0398	1.0197
No log	1.8788	62	0.9755	-0.0831	0.9755	0.9877
No log	1.9394	64	0.8940	0.0	0.8940	0.9455
No log	2.0	66	0.8463	-0.0051	0.8463	0.9199
No log	2.0606	68	0.8512	-0.0462	0.8512	0.9226
No log	2.1212	70	0.8564	-0.0511	0.8564	0.9254
No log	2.1818	72	0.9124	-0.0511	0.9124	0.9552
No log	2.2424	74	0.9526	0.0227	0.9526	0.9760
No log	2.3030	76	0.9920	0.0552	0.9920	0.9960
No log	2.3636	78	1.0502	0.1718	1.0502	1.0248
No log	2.4242	80	1.0816	0.0860	1.0816	1.0400
No log	2.4848	82	1.0426	0.1332	1.0426	1.0211
No log	2.5455	84	0.9871	0.1531	0.9871	0.9936
No log	2.6061	86	0.9879	0.0218	0.9879	0.9939
No log	2.6667	88	1.0196	-0.0487	1.0196	1.0098
No log	2.7273	90	1.0376	0.0532	1.0376	1.0186
No log	2.7879	92	1.0827	0.1800	1.0827	1.0405
No log	2.8485	94	1.0959	0.1800	1.0959	1.0469
No log	2.9091	96	1.0935	0.1800	1.0935	1.0457
No log	2.9697	98	1.1919	0.1534	1.1919	1.0917
No log	3.0303	100	1.2244	0.1045	1.2244	1.1065
No log	3.0909	102	1.1959	0.0648	1.1959	1.0936
No log	3.1515	104	1.1014	0.1946	1.1014	1.0495
No log	3.2121	106	1.1053	0.0864	1.1053	1.0513
No log	3.2727	108	1.1143	0.0563	1.1143	1.0556
No log	3.3333	110	1.0804	0.1140	1.0804	1.0394
No log	3.3939	112	1.0838	0.1718	1.0838	1.0411
No log	3.4545	114	1.0757	0.1718	1.0757	1.0372
No log	3.5152	116	1.0383	0.1718	1.0383	1.0190
No log	3.5758	118	1.0116	0.0860	1.0116	1.0058
No log	3.6364	120	1.0122	0.0563	1.0122	1.0061
No log	3.6970	122	1.0249	0.0892	1.0249	1.0124
No log	3.7576	124	1.0564	0.1065	1.0564	1.0278
No log	3.8182	126	1.1423	0.0412	1.1423	1.0688
No log	3.8788	128	1.2581	0.0896	1.2581	1.1217
No log	3.9394	130	1.2968	0.0616	1.2968	1.1388
No log	4.0	132	1.3387	0.0765	1.3387	1.1570
No log	4.0606	134	1.4023	0.0459	1.4023	1.1842
No log	4.1212	136	1.3741	0.0820	1.3741	1.1722
No log	4.1818	138	1.2447	0.0898	1.2447	1.1157
No log	4.2424	140	1.1924	0.0365	1.1924	1.0920
No log	4.3030	142	1.1994	0.0316	1.1994	1.0952
No log	4.3636	144	1.3082	0.0613	1.3082	1.1438
No log	4.4242	146	1.3371	0.1226	1.3371	1.1563
No log	4.4848	148	1.2126	0.1014	1.2126	1.1012
No log	4.5455	150	1.0755	0.0962	1.0755	1.0371
No log	4.6061	152	1.0304	0.0056	1.0304	1.0151
No log	4.6667	154	1.0504	0.1289	1.0504	1.0249
No log	4.7273	156	1.1687	0.1274	1.1687	1.0811
No log	4.7879	158	1.2240	0.1175	1.2240	1.1063
No log	4.8485	160	1.1415	0.1110	1.1415	1.0684
No log	4.9091	162	0.9998	0.1142	0.9998	0.9999
No log	4.9697	164	0.9610	0.0604	0.9610	0.9803
No log	5.0303	166	0.9364	0.0930	0.9364	0.9677
No log	5.0909	168	0.9612	0.1459	0.9612	0.9804
No log	5.1515	170	1.0302	0.1373	1.0302	1.0150
No log	5.2121	172	1.0619	0.1650	1.0619	1.0305
No log	5.2727	174	1.1007	0.0728	1.1007	1.0491
No log	5.3333	176	1.1625	0.0094	1.1625	1.0782
No log	5.3939	178	1.2247	0.0248	1.2247	1.1066
No log	5.4545	180	1.4062	0.0927	1.4062	1.1859
No log	5.5152	182	1.5291	0.0753	1.5291	1.2366
No log	5.5758	184	1.4546	0.1067	1.4546	1.2061
No log	5.6364	186	1.2598	0.1077	1.2598	1.1224
No log	5.6970	188	1.0889	0.0430	1.0889	1.0435
No log	5.7576	190	1.0336	-0.0124	1.0336	1.0167
No log	5.8182	192	1.0125	0.1437	1.0125	1.0062
No log	5.8788	194	1.0647	0.1328	1.0647	1.0318
No log	5.9394	196	1.1489	0.1271	1.1489	1.0719
No log	6.0	198	1.1233	0.1045	1.1233	1.0599
No log	6.0606	200	1.0953	0.1416	1.0953	1.0466
No log	6.1212	202	0.9962	0.1416	0.9962	0.9981
No log	6.1818	204	0.9559	0.1222	0.9559	0.9777
No log	6.2424	206	0.9831	0.1298	0.9831	0.9915
No log	6.3030	208	0.9931	0.1140	0.9931	0.9966
No log	6.3636	210	1.0731	0.1899	1.0731	1.0359
No log	6.4242	212	1.1705	0.0925	1.1705	1.0819
No log	6.4848	214	1.1695	0.0953	1.1695	1.0814
No log	6.5455	216	1.2629	0.0794	1.2629	1.1238
No log	6.6061	218	1.2785	0.0820	1.2785	1.1307
No log	6.6667	220	1.2615	0.0607	1.2615	1.1231
No log	6.7273	222	1.2252	0.0630	1.2252	1.1069
No log	6.7879	224	1.2297	0.0630	1.2297	1.1089
No log	6.8485	226	1.2571	0.0591	1.2571	1.1212
No log	6.9091	228	1.2365	0.0959	1.2365	1.1120
No log	6.9697	230	1.1754	0.0816	1.1754	1.0842
No log	7.0303	232	1.0731	0.1285	1.0731	1.0359
No log	7.0909	234	1.0553	0.1650	1.0553	1.0273
No log	7.1515	236	1.1035	0.1248	1.1035	1.0505
No log	7.2121	238	1.1907	0.0710	1.1907	1.0912
No log	7.2727	240	1.2470	0.1031	1.2470	1.1167
No log	7.3333	242	1.1634	0.0899	1.1634	1.0786
No log	7.3939	244	1.0736	0.1984	1.0736	1.0362
No log	7.4545	246	1.0285	0.2096	1.0285	1.0141
No log	7.5152	248	1.0307	0.1694	1.0307	1.0152
No log	7.5758	250	1.0788	0.1248	1.0788	1.0387
No log	7.6364	252	1.1631	0.0613	1.1631	1.0785
No log	7.6970	254	1.1916	0.1085	1.1916	1.0916
No log	7.7576	256	1.2012	0.1618	1.2012	1.0960
No log	7.8182	258	1.1939	0.1583	1.1939	1.0926
No log	7.8788	260	1.1238	0.1815	1.1238	1.0601
No log	7.9394	262	1.0824	0.2389	1.0824	1.0404
No log	8.0	264	1.1080	0.1626	1.1080	1.0526
No log	8.0606	266	1.0595	0.2102	1.0595	1.0293
No log	8.1212	268	0.9890	0.2697	0.9890	0.9945
No log	8.1818	270	1.0094	0.2949	1.0094	1.0047
No log	8.2424	272	1.1993	0.1417	1.1993	1.0951
No log	8.3030	274	1.3904	0.1571	1.3904	1.1791
No log	8.3636	276	1.3848	0.1663	1.3848	1.1768
No log	8.4242	278	1.3344	0.1413	1.3344	1.1552
No log	8.4848	280	1.1525	0.1835	1.1525	1.0735
No log	8.5455	282	1.0049	0.2439	1.0049	1.0024
No log	8.6061	284	0.9774	0.1839	0.9774	0.9886
No log	8.6667	286	1.0242	0.2013	1.0242	1.0121
No log	8.7273	288	1.0645	0.1912	1.0645	1.0318
No log	8.7879	290	1.1267	0.2217	1.1267	1.0615
No log	8.8485	292	1.2078	0.1872	1.2078	1.0990
No log	8.9091	294	1.1818	0.1610	1.1818	1.0871
No log	8.9697	296	1.1925	0.1610	1.1925	1.0920
No log	9.0303	298	1.1803	0.1445	1.1803	1.0864
No log	9.0909	300	1.2302	0.1283	1.2302	1.1092
No log	9.1515	302	1.3829	0.1168	1.3829	1.1759
No log	9.2121	304	1.4535	0.1684	1.4535	1.2056
No log	9.2727	306	1.4327	0.0954	1.4327	1.1969
No log	9.3333	308	1.3871	0.0816	1.3871	1.1778
No log	9.3939	310	1.2018	0.1058	1.2018	1.0963
No log	9.4545	312	1.1496	0.1085	1.1496	1.0722
No log	9.5152	314	1.1717	0.0755	1.1717	1.0825
No log	9.5758	316	1.2374	0.1448	1.2374	1.1124
No log	9.6364	318	1.2696	0.1417	1.2696	1.1267
No log	9.6970	320	1.2586	0.1448	1.2586	1.1219
No log	9.7576	322	1.2877	0.0905	1.2877	1.1348
No log	9.8182	324	1.2999	0.0929	1.2999	1.1401
No log	9.8788	326	1.3366	0.0576	1.3366	1.1561
No log	9.9394	328	1.2418	0.1085	1.2418	1.1144
No log	10.0	330	1.1785	0.1576	1.1785	1.0856
No log	10.0606	332	1.0294	0.2364	1.0294	1.0146
No log	10.1212	334	0.9366	0.1495	0.9366	0.9678
No log	10.1818	336	0.9288	0.1495	0.9288	0.9637
No log	10.2424	338	0.9918	0.1328	0.9918	0.9959
No log	10.3030	340	1.0532	0.2267	1.0532	1.0262
No log	10.3636	342	1.1573	0.2437	1.1573	1.0758
No log	10.4242	344	1.2547	0.0954	1.2547	1.1201
No log	10.4848	346	1.1906	0.1948	1.1906	1.0912
No log	10.5455	348	1.2262	0.0979	1.2262	1.1073
No log	10.6061	350	1.3560	0.0371	1.3560	1.1645
No log	10.6667	352	1.3828	0.0788	1.3828	1.1759
No log	10.7273	354	1.3477	0.1093	1.3477	1.1609
No log	10.7879	356	1.2888	0.0950	1.2888	1.1352
No log	10.8485	358	1.2491	0.0750	1.2491	1.1176
No log	10.9091	360	1.2253	0.0750	1.2253	1.1069
No log	10.9697	362	1.2741	0.0977	1.2741	1.1287
No log	11.0303	364	1.3522	0.0925	1.3522	1.1628
No log	11.0909	366	1.2903	0.1230	1.2903	1.1359
No log	11.1515	368	1.1502	0.0902	1.1502	1.0725
No log	11.2121	370	1.0455	0.2364	1.0455	1.0225
No log	11.2727	372	1.0786	0.2364	1.0786	1.0385
No log	11.3333	374	1.1594	0.1204	1.1594	1.0768
No log	11.3939	376	1.4110	0.1189	1.4110	1.1879
No log	11.4545	378	1.5818	0.1143	1.5818	1.2577
No log	11.5152	380	1.5265	0.1423	1.5265	1.2355
No log	11.5758	382	1.2827	0.1468	1.2827	1.1326
No log	11.6364	384	1.0794	0.1983	1.0794	1.0389
No log	11.6970	386	1.0000	0.2212	1.0000	1.0000
No log	11.7576	388	1.0065	0.1839	1.0065	1.0033
No log	11.8182	390	1.1036	0.1235	1.1036	1.0505
No log	11.8788	392	1.3275	0.1422	1.3275	1.1522
No log	11.9394	394	1.5066	0.0637	1.5066	1.2274
No log	12.0	396	1.5079	0.0412	1.5079	1.2280
No log	12.0606	398	1.4044	0.0994	1.4044	1.1851
No log	12.1212	400	1.3031	0.1257	1.3031	1.1415
No log	12.1818	402	1.1818	0.1645	1.1818	1.0871
No log	12.2424	404	1.1517	0.1969	1.1517	1.0732
No log	12.3030	406	1.1452	0.1969	1.1452	1.0702
No log	12.3636	408	1.1395	0.2129	1.1395	1.0675
No log	12.4242	410	1.1647	0.2234	1.1647	1.0792
No log	12.4848	412	1.1417	0.2192	1.1417	1.0685
No log	12.5455	414	1.0788	0.2554	1.0788	1.0387
No log	12.6061	416	1.0152	0.2781	1.0152	1.0075
No log	12.6667	418	1.0578	0.2677	1.0578	1.0285
No log	12.7273	420	1.0020	0.3194	1.0020	1.0010
No log	12.7879	422	0.9441	0.3630	0.9441	0.9716
No log	12.8485	424	0.9403	0.3131	0.9403	0.9697
No log	12.9091	426	1.0241	0.3562	1.0241	1.0120
No log	12.9697	428	1.1596	0.2094	1.1596	1.0768
No log	13.0303	430	1.4038	0.0868	1.4038	1.1848
No log	13.0909	432	1.5586	0.1480	1.5586	1.2484
No log	13.1515	434	1.4784	0.0865	1.4784	1.2159
No log	13.2121	436	1.2593	0.1704	1.2593	1.1222
No log	13.2727	438	1.0939	0.3019	1.0939	1.0459
No log	13.3333	440	0.9630	0.3069	0.9630	0.9813
No log	13.3939	442	0.9448	0.2576	0.9448	0.9720
No log	13.4545	444	1.0022	0.3069	1.0022	1.0011
No log	13.5152	446	1.1332	0.2578	1.1332	1.0645
No log	13.5758	448	1.2057	0.1687	1.2057	1.0980
No log	13.6364	450	1.1556	0.2485	1.1556	1.0750
No log	13.6970	452	1.0400	0.2892	1.0400	1.0198
No log	13.7576	454	0.9404	0.2576	0.9404	0.9697
No log	13.8182	456	0.9218	0.1694	0.9218	0.9601
No log	13.8788	458	0.9698	0.2467	0.9698	0.9848
No log	13.9394	460	1.1272	0.2507	1.1272	1.0617
No log	14.0	462	1.2397	0.1383	1.2397	1.1134
No log	14.0606	464	1.1951	0.1810	1.1951	1.0932
No log	14.1212	466	1.0753	0.2892	1.0753	1.0370
No log	14.1818	468	1.0069	0.2724	1.0069	1.0034
No log	14.2424	470	1.0234	0.2364	1.0234	1.0116
No log	14.3030	472	1.0930	0.2192	1.0930	1.0454
No log	14.3636	474	1.2384	0.1704	1.2384	1.1129
No log	14.4242	476	1.3228	0.1305	1.3228	1.1501
No log	14.4848	478	1.3146	0.1334	1.3146	1.1466
No log	14.5455	480	1.2650	0.1479	1.2650	1.1247
No log	14.6061	482	1.2697	0.1510	1.2697	1.1268
No log	14.6667	484	1.2017	0.1618	1.2017	1.0962
No log	14.7273	486	1.1133	0.2267	1.1133	1.0551
No log	14.7879	488	1.0844	0.2589	1.0844	1.0413
No log	14.8485	490	1.0700	0.2781	1.0700	1.0344
No log	14.9091	492	1.0627	0.2487	1.0627	1.0309
No log	14.9697	494	1.0437	0.3194	1.0437	1.0216
No log	15.0303	496	0.9892	0.2812	0.9892	0.9946
No log	15.0909	498	1.0183	0.3069	1.0183	1.0091
0.3435	15.1515	500	1.0687	0.2697	1.0687	1.0338
0.3435	15.2121	502	1.1695	0.1618	1.1695	1.0814
0.3435	15.2727	504	1.2438	0.1144	1.2438	1.1153
0.3435	15.3333	506	1.3007	0.1144	1.3007	1.1405
0.3435	15.3939	508	1.2731	0.1200	1.2731	1.1283
0.3435	15.4545	510	1.1794	0.1653	1.1794	1.0860

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1