ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k16_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6549
• Qwk: 0.0246
• Mse: 1.6549
• Rmse: 1.2864

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	2.6272	-0.0593	2.6272	1.6209
No log	0.1053	4	1.3533	0.0412	1.3533	1.1633
No log	0.1579	6	1.1248	-0.1866	1.1248	1.0606
No log	0.2105	8	1.2809	-0.2576	1.2809	1.1317
No log	0.2632	10	1.1955	-0.0609	1.1955	1.0934
No log	0.3158	12	1.2034	-0.1027	1.2034	1.0970
No log	0.3684	14	1.1322	0.0868	1.1322	1.0641
No log	0.4211	16	1.0782	0.0943	1.0782	1.0384
No log	0.4737	18	1.0863	0.0391	1.0863	1.0423
No log	0.5263	20	1.1633	-0.1081	1.1633	1.0786
No log	0.5789	22	1.0268	0.0419	1.0268	1.0133
No log	0.6316	24	0.9608	-0.0054	0.9608	0.9802
No log	0.6842	26	0.9309	-0.0103	0.9309	0.9648
No log	0.7368	28	0.9532	0.0208	0.9532	0.9763
No log	0.7895	30	0.9817	0.1268	0.9817	0.9908
No log	0.8421	32	1.0772	0.0958	1.0772	1.0379
No log	0.8947	34	1.0455	0.1103	1.0455	1.0225
No log	0.9474	36	1.0125	-0.0472	1.0125	1.0062
No log	1.0	38	1.3162	-0.0624	1.3162	1.1473
No log	1.0526	40	1.5613	-0.0844	1.5613	1.2495
No log	1.1053	42	1.4443	-0.0219	1.4443	1.2018
No log	1.1579	44	1.1555	-0.0579	1.1555	1.0749
No log	1.2105	46	0.9541	-0.0915	0.9541	0.9768
No log	1.2632	48	1.0257	0.1028	1.0257	1.0128
No log	1.3158	50	1.1605	-0.0201	1.1605	1.0772
No log	1.3684	52	1.2818	-0.0529	1.2818	1.1322
No log	1.4211	54	1.1967	-0.0753	1.1967	1.0939
No log	1.4737	56	1.0339	-0.0569	1.0339	1.0168
No log	1.5263	58	1.1167	-0.1355	1.1167	1.0567
No log	1.5789	60	1.0975	-0.1120	1.0975	1.0476
No log	1.6316	62	1.1324	-0.1389	1.1324	1.0641
No log	1.6842	64	1.4684	-0.1344	1.4684	1.2118
No log	1.7368	66	1.6105	-0.1020	1.6105	1.2691
No log	1.7895	68	1.4590	-0.1956	1.4590	1.2079
No log	1.8421	70	1.3797	-0.2625	1.3797	1.1746
No log	1.8947	72	1.3951	-0.1445	1.3951	1.1811
No log	1.9474	74	1.4090	-0.1745	1.4090	1.1870
No log	2.0	76	1.4590	-0.1263	1.4590	1.2079
No log	2.0526	78	1.6217	-0.0934	1.6217	1.2735
No log	2.1053	80	1.6123	-0.0973	1.6123	1.2697
No log	2.1579	82	1.4720	-0.0703	1.4720	1.2133
No log	2.2105	84	1.3864	-0.0980	1.3864	1.1775
No log	2.2632	86	1.3088	-0.0693	1.3088	1.1440
No log	2.3158	88	1.1973	0.0012	1.1973	1.0942
No log	2.3684	90	1.1401	0.0184	1.1401	1.0678
No log	2.4211	92	1.1138	0.0162	1.1138	1.0554
No log	2.4737	94	1.1471	-0.0358	1.1471	1.0710
No log	2.5263	96	1.1660	0.0445	1.1660	1.0798
No log	2.5789	98	1.1249	-0.0274	1.1249	1.0606
No log	2.6316	100	1.1856	-0.0077	1.1856	1.0889
No log	2.6842	102	1.3302	0.1004	1.3302	1.1533
No log	2.7368	104	1.4543	0.0633	1.4543	1.2060
No log	2.7895	106	1.2951	0.1479	1.2951	1.1380
No log	2.8421	108	1.0956	0.0378	1.0956	1.0467
No log	2.8947	110	1.1455	0.0327	1.1455	1.0703
No log	2.9474	112	1.3362	0.0900	1.3362	1.1559
No log	3.0	114	1.4208	0.1093	1.4208	1.1920
No log	3.0526	116	1.3003	0.0849	1.3003	1.1403
No log	3.1053	118	1.2708	-0.0670	1.2708	1.1273
No log	3.1579	120	1.2687	0.0155	1.2687	1.1264
No log	3.2105	122	1.3567	0.0802	1.3567	1.1648
No log	3.2632	124	1.4962	0.1244	1.4962	1.2232
No log	3.3158	126	1.4461	0.0881	1.4461	1.2025
No log	3.3684	128	1.3509	0.0979	1.3509	1.1623
No log	3.4211	130	1.2981	0.1031	1.2981	1.1393
No log	3.4737	132	1.1881	-0.0025	1.1881	1.0900
No log	3.5263	134	1.1408	-0.0025	1.1408	1.0681
No log	3.5789	136	1.1315	-0.0347	1.1315	1.0637
No log	3.6316	138	1.1819	0.0445	1.1819	1.0872
No log	3.6842	140	1.3570	0.1145	1.3570	1.1649
No log	3.7368	142	1.4567	0.0791	1.4567	1.2069
No log	3.7895	144	1.2300	0.0122	1.2300	1.1090
No log	3.8421	146	1.1815	0.0184	1.1815	1.0870
No log	3.8947	148	1.2707	-0.0557	1.2707	1.1272
No log	3.9474	150	1.5071	0.1044	1.5071	1.2277
No log	4.0	152	1.7647	0.1336	1.7647	1.3284
No log	4.0526	154	1.6852	0.0240	1.6852	1.2981
No log	4.1053	156	1.3488	0.1146	1.3488	1.1614
No log	4.1579	158	1.0604	-0.0619	1.0604	1.0298
No log	4.2105	160	1.0328	-0.0826	1.0328	1.0163
No log	4.2632	162	1.0057	0.0255	1.0057	1.0028
No log	4.3158	164	1.0835	0.0653	1.0835	1.0409
No log	4.3684	166	1.3013	-0.0391	1.3013	1.1408
No log	4.4211	168	1.3980	-0.0391	1.3980	1.1824
No log	4.4737	170	1.3088	-0.0027	1.3088	1.1440
No log	4.5263	172	1.2101	0.0196	1.2101	1.1001
No log	4.5789	174	1.2634	-0.0462	1.2634	1.1240
No log	4.6316	176	1.4147	0.0736	1.4147	1.1894
No log	4.6842	178	1.4883	0.0399	1.4883	1.2200
No log	4.7368	180	1.5821	-0.0149	1.5821	1.2578
No log	4.7895	182	1.5581	-0.0149	1.5581	1.2482
No log	4.8421	184	1.5311	0.0353	1.5311	1.2374
No log	4.8947	186	1.3558	0.0838	1.3558	1.1644
No log	4.9474	188	1.2241	-0.0383	1.2241	1.1064
No log	5.0	190	1.1881	-0.0383	1.1881	1.0900
No log	5.0526	192	1.2160	0.1110	1.2160	1.1027
No log	5.1053	194	1.3854	0.1568	1.3854	1.1770
No log	5.1579	196	1.4549	0.1272	1.4549	1.2062
No log	5.2105	198	1.3749	0.0727	1.3749	1.1726
No log	5.2632	200	1.3388	0.0347	1.3388	1.1571
No log	5.3158	202	1.4430	0.1093	1.4430	1.2013
No log	5.3684	204	1.4773	0.1019	1.4773	1.2155
No log	5.4211	206	1.5085	0.1364	1.5085	1.2282
No log	5.4737	208	1.3182	0.1626	1.3182	1.1481
No log	5.5263	210	1.2462	0.1457	1.2462	1.1163
No log	5.5789	212	1.3007	0.1144	1.3007	1.1405
No log	5.6316	214	1.4051	0.0704	1.4051	1.1854
No log	5.6842	216	1.6039	0.0971	1.6039	1.2665
No log	5.7368	218	1.5922	0.0531	1.5922	1.2618
No log	5.7895	220	1.3717	0.0873	1.3717	1.1712
No log	5.8421	222	1.1001	0.0683	1.1001	1.0488
No log	5.8947	224	1.0040	-0.0548	1.0040	1.0020
No log	5.9474	226	0.9847	-0.0232	0.9847	0.9923
No log	6.0	228	1.0377	0.0683	1.0377	1.0187
No log	6.0526	230	1.2047	0.1146	1.2047	1.0976
No log	6.1053	232	1.2841	0.1030	1.2841	1.1332
No log	6.1579	234	1.1717	0.1339	1.1717	1.0824
No log	6.2105	236	1.0773	0.0293	1.0773	1.0380
No log	6.2632	238	1.0452	0.0097	1.0452	1.0224
No log	6.3158	240	1.0695	0.0332	1.0695	1.0342
No log	6.3684	242	1.1681	0.1557	1.1681	1.0808
No log	6.4211	244	1.1031	0.1369	1.1031	1.0503
No log	6.4737	246	0.9963	0.0352	0.9963	0.9981
No log	6.5263	248	1.0276	0.2094	1.0276	1.0137
No log	6.5789	250	1.2167	0.1653	1.2167	1.1031
No log	6.6316	252	1.2966	0.0925	1.2966	1.1387
No log	6.6842	254	1.2368	0.1591	1.2368	1.1121
No log	6.7368	256	1.1288	0.1777	1.1288	1.0624
No log	6.7895	258	1.1596	0.0829	1.1596	1.0768
No log	6.8421	260	1.2046	-0.0969	1.2046	1.0975
No log	6.8947	262	1.2756	0.0808	1.2756	1.1294
No log	6.9474	264	1.3489	0.0869	1.3489	1.1614
No log	7.0	266	1.4028	0.0250	1.4028	1.1844
No log	7.0526	268	1.4257	0.0250	1.4257	1.1940
No log	7.1053	270	1.3315	0.0390	1.3315	1.1539
No log	7.1579	272	1.3413	0.1115	1.3413	1.1581
No log	7.2105	274	1.3785	0.0976	1.3785	1.1741
No log	7.2632	276	1.4054	0.0976	1.4054	1.1855
No log	7.3158	278	1.3665	0.1320	1.3665	1.1690
No log	7.3684	280	1.3753	0.1320	1.3753	1.1727
No log	7.4211	282	1.3451	0.0607	1.3451	1.1598
No log	7.4737	284	1.3068	0.0902	1.3068	1.1432
No log	7.5263	286	1.3109	0.0561	1.3109	1.1449
No log	7.5789	288	1.2660	0.0679	1.2660	1.1252
No log	7.6316	290	1.3218	0.0539	1.3218	1.1497
No log	7.6842	292	1.5596	0.0708	1.5596	1.2489
No log	7.7368	294	1.7401	0.0225	1.7401	1.3191
No log	7.7895	296	1.8534	0.0465	1.8534	1.3614
No log	7.8421	298	1.6678	0.0704	1.6678	1.2914
No log	7.8947	300	1.4676	0.1067	1.4676	1.2114
No log	7.9474	302	1.3618	0.0820	1.3618	1.1670
No log	8.0	304	1.3196	0.1175	1.3196	1.1487
No log	8.0526	306	1.3175	0.1238	1.3175	1.1478
No log	8.1053	308	1.3666	0.1257	1.3666	1.1690
No log	8.1579	310	1.4090	0.1067	1.4090	1.1870
No log	8.2105	312	1.3368	0.1748	1.3368	1.1562
No log	8.2632	314	1.1862	0.0548	1.1862	1.0891
No log	8.3158	316	1.1468	0.1251	1.1468	1.0709
No log	8.3684	318	1.2193	0.1045	1.2193	1.1042
No log	8.4211	320	1.4236	0.0858	1.4236	1.1931
No log	8.4737	322	1.4955	0.0929	1.4955	1.2229
No log	8.5263	324	1.3804	0.0774	1.3804	1.1749
No log	8.5789	326	1.3161	0.1689	1.3161	1.1472
No log	8.6316	328	1.2851	0.1492	1.2851	1.1336
No log	8.6842	330	1.2650	0.2166	1.2650	1.1247
No log	8.7368	332	1.1966	0.1869	1.1966	1.0939
No log	8.7895	334	1.1496	0.1827	1.1496	1.0722
No log	8.8421	336	1.0821	0.1180	1.0821	1.0402
No log	8.8947	338	1.0693	0.1777	1.0693	1.0341
No log	8.9474	340	1.1462	0.2075	1.1462	1.0706
No log	9.0	342	1.2951	0.1205	1.2951	1.1380
No log	9.0526	344	1.3277	0.2092	1.3277	1.1522
No log	9.1053	346	1.2425	0.1846	1.2425	1.1147
No log	9.1579	348	1.2029	0.1884	1.2029	1.0968
No log	9.2105	350	1.2872	0.1846	1.2872	1.1346
No log	9.2632	352	1.4293	0.1823	1.4293	1.1955
No log	9.3158	354	1.4413	0.1195	1.4413	1.2006
No log	9.3684	356	1.3595	0.1815	1.3595	1.1660
No log	9.4211	358	1.2756	0.1821	1.2756	1.1294
No log	9.4737	360	1.1684	0.1869	1.1684	1.0809
No log	9.5263	362	1.1147	0.2259	1.1147	1.0558
No log	9.5789	364	1.1747	0.2411	1.1747	1.0839
No log	9.6316	366	1.3342	0.1367	1.3342	1.1551
No log	9.6842	368	1.3946	0.1017	1.3946	1.1809
No log	9.7368	370	1.3486	0.1713	1.3486	1.1613
No log	9.7895	372	1.2570	0.1632	1.2570	1.1212
No log	9.8421	374	1.1729	-0.0025	1.1729	1.0830
No log	9.8947	376	1.1765	0.0270	1.1765	1.0847
No log	9.9474	378	1.2502	0.2166	1.2502	1.1181
No log	10.0	380	1.2985	0.1490	1.2985	1.1395
No log	10.0526	382	1.3369	0.1367	1.3369	1.1563
No log	10.1053	384	1.2991	0.1748	1.2991	1.1398
No log	10.1579	386	1.1886	0.2252	1.1886	1.0902
No log	10.2105	388	1.1377	0.0860	1.1377	1.0666
No log	10.2632	390	1.0916	0.0338	1.0916	1.0448
No log	10.3158	392	1.1211	0.0338	1.1211	1.0588
No log	10.3684	394	1.2150	0.1935	1.2150	1.1023
No log	10.4211	396	1.2850	0.1202	1.2850	1.1336
No log	10.4737	398	1.2521	0.1484	1.2521	1.1190
No log	10.5263	400	1.1593	0.1308	1.1593	1.0767
No log	10.5789	402	1.0642	0.0715	1.0642	1.0316
No log	10.6316	404	1.0778	0.0036	1.0778	1.0382
No log	10.6842	406	1.1627	0.1501	1.1627	1.0783
No log	10.7368	408	1.2959	0.0948	1.2959	1.1384
No log	10.7895	410	1.4195	0.0806	1.4195	1.1914
No log	10.8421	412	1.4698	0.0724	1.4698	1.2124
No log	10.8947	414	1.4298	0.1018	1.4298	1.1957
No log	10.9474	416	1.3750	0.1003	1.3750	1.1726
No log	11.0	418	1.4252	0.0835	1.4252	1.1938
No log	11.0526	420	1.4769	0.1278	1.4769	1.2153
No log	11.1053	422	1.5610	0.0907	1.5610	1.2494
No log	11.1579	424	1.5452	0.1170	1.5452	1.2431
No log	11.2105	426	1.5162	0.0952	1.5162	1.2314
No log	11.2632	428	1.4835	0.0952	1.4835	1.2180
No log	11.3158	430	1.4639	0.0855	1.4639	1.2099
No log	11.3684	432	1.4482	0.0351	1.4482	1.2034
No log	11.4211	434	1.4230	0.0333	1.4230	1.1929
No log	11.4737	436	1.3677	0.0895	1.3677	1.1695
No log	11.5263	438	1.3483	0.1176	1.3483	1.1612
No log	11.5789	440	1.3467	0.0401	1.3467	1.1605
No log	11.6316	442	1.4092	0.1115	1.4092	1.1871
No log	11.6842	444	1.4830	0.1383	1.4830	1.2178
No log	11.7368	446	1.4617	0.1383	1.4617	1.2090
No log	11.7895	448	1.3828	0.1320	1.3828	1.1759
No log	11.8421	450	1.3759	0.1320	1.3759	1.1730
No log	11.8947	452	1.4361	0.1599	1.4361	1.1984
No log	11.9474	454	1.6096	0.0948	1.6096	1.2687
No log	12.0	456	1.6575	0.0493	1.6575	1.2874
No log	12.0526	458	1.5154	0.0599	1.5154	1.2310
No log	12.1053	460	1.3480	0.1028	1.3480	1.1610
No log	12.1579	462	1.3052	0.1428	1.3052	1.1424
No log	12.2105	464	1.3468	0.0736	1.3468	1.1605
No log	12.2632	466	1.4799	0.0333	1.4799	1.2165
No log	12.3158	468	1.5503	0.0741	1.5503	1.2451
No log	12.3684	470	1.5518	0.0741	1.5518	1.2457
No log	12.4211	472	1.4913	0.1042	1.4913	1.2212
No log	12.4737	474	1.4004	0.0561	1.4004	1.1834
No log	12.5263	476	1.4856	0.0829	1.4856	1.2188
No log	12.5789	478	1.5771	0.0225	1.5771	1.2558
No log	12.6316	480	1.5459	0.0261	1.5459	1.2433
No log	12.6842	482	1.4988	0.0277	1.4988	1.2243
No log	12.7368	484	1.3255	0.1243	1.3255	1.1513
No log	12.7895	486	1.2803	0.1312	1.2803	1.1315
No log	12.8421	488	1.3102	0.1499	1.3102	1.1446
No log	12.8947	490	1.4410	0.0120	1.4410	1.2004
No log	12.9474	492	1.6071	0.0042	1.6071	1.2677
No log	13.0	494	1.6119	0.0251	1.6119	1.2696
No log	13.0526	496	1.4842	0.0353	1.4842	1.2183
No log	13.1053	498	1.4193	0.1115	1.4193	1.1913
0.3267	13.1579	500	1.4043	0.1176	1.4043	1.1850
0.3267	13.2105	502	1.4337	0.0820	1.4337	1.1974
0.3267	13.2632	504	1.4659	0.0746	1.4659	1.2107
0.3267	13.3158	506	1.4842	0.0676	1.4842	1.2183
0.3267	13.3684	508	1.5569	0.0344	1.5569	1.2478
0.3267	13.4211	510	1.6549	0.0246	1.6549	1.2864

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1