ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4960
• Qwk: 0.4545
• Mse: 1.4960
• Rmse: 1.2231

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	7.0368	0.0057	7.0368	2.6527
No log	0.0656	4	4.5166	0.0964	4.5166	2.1252
No log	0.0984	6	3.3072	0.0791	3.3072	1.8186
No log	0.1311	8	3.0504	0.0513	3.0504	1.7465
No log	0.1639	10	2.0888	0.1000	2.0888	1.4453
No log	0.1967	12	1.8723	0.1852	1.8723	1.3683
No log	0.2295	14	2.0023	0.1579	2.0023	1.4150
No log	0.2623	16	2.0512	0.1186	2.0512	1.4322
No log	0.2951	18	1.8866	0.1296	1.8866	1.3735
No log	0.3279	20	1.8264	0.1308	1.8264	1.3514
No log	0.3607	22	1.8763	0.1468	1.8763	1.3698
No log	0.3934	24	2.1548	0.1260	2.1548	1.4679
No log	0.4262	26	2.2624	0.0909	2.2624	1.5041
No log	0.4590	28	2.1253	0.125	2.1253	1.4579
No log	0.4918	30	1.9653	0.2105	1.9653	1.4019
No log	0.5246	32	1.8381	0.1333	1.8381	1.3557
No log	0.5574	34	1.7186	0.1296	1.7186	1.3110
No log	0.5902	36	1.5696	0.2456	1.5696	1.2528
No log	0.6230	38	1.5623	0.3167	1.5623	1.2499
No log	0.6557	40	1.5112	0.3248	1.5112	1.2293
No log	0.6885	42	1.4821	0.3590	1.4821	1.2174
No log	0.7213	44	1.3477	0.3390	1.3477	1.1609
No log	0.7541	46	1.2931	0.3902	1.2931	1.1371
No log	0.7869	48	1.3261	0.3871	1.3261	1.1516
No log	0.8197	50	1.1227	0.5197	1.1227	1.0596
No log	0.8525	52	1.0967	0.5827	1.0967	1.0472
No log	0.8852	54	1.0900	0.5556	1.0900	1.0441
No log	0.9180	56	1.1062	0.5625	1.1062	1.0517
No log	0.9508	58	1.1996	0.512	1.1996	1.0953
No log	0.9836	60	1.3766	0.3387	1.3766	1.1733
No log	1.0164	62	1.5889	0.2602	1.5889	1.2605
No log	1.0492	64	1.2527	0.4776	1.2527	1.1193
No log	1.0820	66	1.2121	0.5072	1.2121	1.1009
No log	1.1148	68	1.0359	0.6763	1.0359	1.0178
No log	1.1475	70	1.0264	0.6812	1.0264	1.0131
No log	1.1803	72	1.1161	0.5588	1.1161	1.0565
No log	1.2131	74	1.1359	0.5522	1.1359	1.0658
No log	1.2459	76	1.0492	0.5891	1.0492	1.0243
No log	1.2787	78	1.0629	0.5781	1.0629	1.0309
No log	1.3115	80	1.1064	0.5079	1.1064	1.0518
No log	1.3443	82	1.1831	0.4918	1.1831	1.0877
No log	1.3770	84	1.4315	0.3548	1.4315	1.1965
No log	1.4098	86	1.6576	0.2769	1.6576	1.2875
No log	1.4426	88	1.8587	0.2206	1.8587	1.3634
No log	1.4754	90	1.8093	0.2370	1.8093	1.3451
No log	1.5082	92	1.5648	0.272	1.5648	1.2509
No log	1.5410	94	1.3898	0.3652	1.3898	1.1789
No log	1.5738	96	1.4536	0.3119	1.4536	1.2056
No log	1.6066	98	1.7142	0.0952	1.7142	1.3093
No log	1.6393	100	1.8653	0.1538	1.8653	1.3657
No log	1.6721	102	1.7077	0.2857	1.7077	1.3068
No log	1.7049	104	1.4358	0.3220	1.4358	1.1982
No log	1.7377	106	1.2293	0.4333	1.2293	1.1088
No log	1.7705	108	1.2573	0.4921	1.2573	1.1213
No log	1.8033	110	1.1822	0.4923	1.1822	1.0873
No log	1.8361	112	1.1518	0.5191	1.1518	1.0732
No log	1.8689	114	1.3076	0.4308	1.3076	1.1435
No log	1.9016	116	1.6231	0.3556	1.6231	1.2740
No log	1.9344	118	1.5645	0.4211	1.5645	1.2508
No log	1.9672	120	1.2345	0.4724	1.2345	1.1111
No log	2.0	122	1.1485	0.5426	1.1485	1.0717
No log	2.0328	124	1.2269	0.4806	1.2269	1.1077
No log	2.0656	126	1.3805	0.4062	1.3805	1.1750
No log	2.0984	128	1.4352	0.4	1.4352	1.1980
No log	2.1311	130	1.4125	0.4154	1.4125	1.1885
No log	2.1639	132	1.4300	0.4361	1.4300	1.1958
No log	2.1967	134	1.3207	0.4186	1.3207	1.1492
No log	2.2295	136	1.3346	0.4308	1.3346	1.1552
No log	2.2623	138	1.3258	0.4094	1.3258	1.1514
No log	2.2951	140	1.4060	0.4275	1.4060	1.1857
No log	2.3279	142	1.6784	0.3382	1.6784	1.2955
No log	2.3607	144	1.8329	0.2734	1.8329	1.3538
No log	2.3934	146	1.5902	0.4030	1.5902	1.2610
No log	2.4262	148	1.1737	0.4724	1.1737	1.0834
No log	2.4590	150	1.1220	0.5124	1.1220	1.0592
No log	2.4918	152	1.1867	0.4959	1.1867	1.0894
No log	2.5246	154	1.3134	0.4628	1.3134	1.1460
No log	2.5574	156	1.3395	0.4370	1.3395	1.1574
No log	2.5902	158	1.2757	0.375	1.2757	1.1295
No log	2.6230	160	1.2554	0.3717	1.2554	1.1205
No log	2.6557	162	1.2198	0.3717	1.2198	1.1044
No log	2.6885	164	1.2209	0.4068	1.2209	1.1049
No log	2.7213	166	1.1085	0.5	1.1085	1.0529
No log	2.7541	168	1.1627	0.4762	1.1627	1.0783
No log	2.7869	170	1.2418	0.5	1.2418	1.1144
No log	2.8197	172	1.2582	0.5	1.2582	1.1217
No log	2.8525	174	1.4763	0.4211	1.4763	1.2150
No log	2.8852	176	1.4039	0.5	1.4039	1.1849
No log	2.9180	178	1.2346	0.4746	1.2346	1.1111
No log	2.9508	180	1.2614	0.3478	1.2614	1.1231
No log	2.9836	182	1.2408	0.3509	1.2408	1.1139
No log	3.0164	184	1.2401	0.4628	1.2401	1.1136
No log	3.0492	186	1.4133	0.4308	1.4133	1.1888
No log	3.0820	188	1.5296	0.3910	1.5296	1.2368
No log	3.1148	190	1.3027	0.4242	1.3027	1.1414
No log	3.1475	192	1.2016	0.4925	1.2016	1.0962
No log	3.1803	194	1.0790	0.5481	1.0790	1.0387
No log	3.2131	196	1.1233	0.5303	1.1233	1.0598
No log	3.2459	198	1.2564	0.4615	1.2564	1.1209
No log	3.2787	200	1.2760	0.4961	1.2760	1.1296
No log	3.3115	202	1.2039	0.5161	1.2039	1.0972
No log	3.3443	204	1.1741	0.5455	1.1741	1.0835
No log	3.3770	206	1.1692	0.3684	1.1692	1.0813
No log	3.4098	208	1.2362	0.3540	1.2362	1.1118
No log	3.4426	210	1.2785	0.3571	1.2785	1.1307
No log	3.4754	212	1.3716	0.2569	1.3716	1.1711
No log	3.5082	214	1.4013	0.2593	1.4013	1.1838
No log	3.5410	216	1.3688	0.2936	1.3688	1.1699
No log	3.5738	218	1.3242	0.3393	1.3242	1.1507
No log	3.6066	220	1.2880	0.4370	1.2880	1.1349
No log	3.6393	222	1.2929	0.4882	1.2929	1.1370
No log	3.6721	224	1.2538	0.5	1.2538	1.1197
No log	3.7049	226	1.2283	0.4688	1.2283	1.1083
No log	3.7377	228	1.3158	0.4733	1.3158	1.1471
No log	3.7705	230	1.5886	0.3636	1.5886	1.2604
No log	3.8033	232	1.5453	0.3387	1.5453	1.2431
No log	3.8361	234	1.2629	0.4103	1.2629	1.1238
No log	3.8689	236	1.2218	0.3509	1.2218	1.1053
No log	3.9016	238	1.2717	0.4035	1.2717	1.1277
No log	3.9344	240	1.3037	0.4706	1.3037	1.1418
No log	3.9672	242	1.2438	0.4833	1.2438	1.1153
No log	4.0	244	1.1173	0.5210	1.1173	1.0570
No log	4.0328	246	1.0399	0.5246	1.0399	1.0198
No log	4.0656	248	1.0107	0.608	1.0107	1.0053
No log	4.0984	250	1.1615	0.5191	1.1615	1.0777
No log	4.1311	252	1.2619	0.5113	1.2619	1.1233
No log	4.1639	254	1.1296	0.5156	1.1296	1.0628
No log	4.1967	256	1.0838	0.4786	1.0838	1.0411
No log	4.2295	258	1.1410	0.4035	1.1410	1.0682
No log	4.2623	260	1.1342	0.4035	1.1342	1.0650
No log	4.2951	262	1.1782	0.5246	1.1782	1.0854
No log	4.3279	264	1.4358	0.4242	1.4358	1.1983
No log	4.3607	266	1.4722	0.4242	1.4722	1.2133
No log	4.3934	268	1.3235	0.4925	1.3235	1.1504
No log	4.4262	270	1.1168	0.5512	1.1168	1.0568
No log	4.4590	272	1.0768	0.5691	1.0768	1.0377
No log	4.4918	274	1.2022	0.5344	1.2022	1.0964
No log	4.5246	276	1.3135	0.5113	1.3135	1.1461
No log	4.5574	278	1.3607	0.4733	1.3607	1.1665
No log	4.5902	280	1.2950	0.5191	1.2950	1.1380
No log	4.6230	282	1.1425	0.5042	1.1425	1.0689
No log	4.6557	284	1.0516	0.4874	1.0516	1.0255
No log	4.6885	286	1.0203	0.5203	1.0203	1.0101
No log	4.7213	288	1.1537	0.5113	1.1537	1.0741
No log	4.7541	290	1.0775	0.5077	1.0775	1.0380
No log	4.7869	292	0.9473	0.6562	0.9473	0.9733
No log	4.8197	294	0.9703	0.5806	0.9703	0.9850
No log	4.8525	296	0.9977	0.5124	0.9977	0.9989
No log	4.8852	298	1.2149	0.5113	1.2149	1.1022
No log	4.9180	300	1.2671	0.4812	1.2671	1.1257
No log	4.9508	302	1.2599	0.4925	1.2599	1.1225
No log	4.9836	304	1.1973	0.5426	1.1973	1.0942
No log	5.0164	306	1.1809	0.5512	1.1809	1.0867
No log	5.0492	308	1.2270	0.5512	1.2270	1.1077
No log	5.0820	310	1.3523	0.4496	1.3523	1.1629
No log	5.1148	312	1.3434	0.4921	1.3434	1.1591
No log	5.1475	314	1.2403	0.4706	1.2403	1.1137
No log	5.1803	316	1.1612	0.4615	1.1612	1.0776
No log	5.2131	318	1.1090	0.4874	1.1090	1.0531
No log	5.2459	320	1.1779	0.5041	1.1779	1.0853
No log	5.2787	322	1.3383	0.4496	1.3383	1.1568
No log	5.3115	324	1.5147	0.4242	1.5147	1.2307
No log	5.3443	326	1.4009	0.4427	1.4009	1.1836
No log	5.3770	328	1.1807	0.4762	1.1807	1.0866
No log	5.4098	330	1.0436	0.5691	1.0436	1.0215
No log	5.4426	332	1.0329	0.4615	1.0329	1.0163
No log	5.4754	334	1.0392	0.5455	1.0392	1.0194
No log	5.5082	336	1.0641	0.5323	1.0641	1.0315
No log	5.5410	338	1.1110	0.5079	1.1110	1.0540
No log	5.5738	340	1.1227	0.5197	1.1227	1.0596
No log	5.6066	342	1.0623	0.5312	1.0623	1.0307
No log	5.6393	344	1.0036	0.5760	1.0036	1.0018
No log	5.6721	346	0.9979	0.5528	0.9979	0.9990
No log	5.7049	348	1.0395	0.5410	1.0395	1.0196
No log	5.7377	350	1.1833	0.4921	1.1833	1.0878
No log	5.7705	352	1.3414	0.4806	1.3414	1.1582
No log	5.8033	354	1.2582	0.4806	1.2582	1.1217
No log	5.8361	356	1.0571	0.5323	1.0571	1.0282
No log	5.8689	358	0.9802	0.5645	0.9802	0.9901
No log	5.9016	360	1.0119	0.5203	1.0119	1.0060
No log	5.9344	362	1.2071	0.5038	1.2071	1.0987
No log	5.9672	364	1.5853	0.4211	1.5853	1.2591
No log	6.0	366	1.8732	0.3358	1.8732	1.3687
No log	6.0328	368	1.7790	0.3939	1.7790	1.3338
No log	6.0656	370	1.4196	0.4496	1.4196	1.1915
No log	6.0984	372	1.1651	0.4833	1.1651	1.0794
No log	6.1311	374	1.1437	0.3509	1.1437	1.0694
No log	6.1639	376	1.1918	0.2545	1.1918	1.0917
No log	6.1967	378	1.2228	0.3423	1.2228	1.1058
No log	6.2295	380	1.2610	0.4915	1.2610	1.1229
No log	6.2623	382	1.3430	0.4480	1.3430	1.1589
No log	6.2951	384	1.3566	0.4375	1.3566	1.1647
No log	6.3279	386	1.2712	0.4409	1.2712	1.1275
No log	6.3607	388	1.1939	0.4921	1.1939	1.0927
No log	6.3934	390	1.1771	0.4651	1.1771	1.0849
No log	6.4262	392	1.0976	0.528	1.0976	1.0477
No log	6.4590	394	0.9921	0.4793	0.9921	0.9961
No log	6.4918	396	0.9917	0.4959	0.9917	0.9958
No log	6.5246	398	1.0265	0.4793	1.0265	1.0132
No log	6.5574	400	1.1354	0.4724	1.1354	1.0656
No log	6.5902	402	1.1910	0.4806	1.1910	1.0913
No log	6.6230	404	1.2459	0.4651	1.2459	1.1162
No log	6.6557	406	1.3167	0.4733	1.3167	1.1475
No log	6.6885	408	1.2023	0.5197	1.2023	1.0965
No log	6.7213	410	1.0757	0.5246	1.0757	1.0372
No log	6.7541	412	1.0337	0.4500	1.0337	1.0167
No log	6.7869	414	1.0580	0.4715	1.0580	1.0286
No log	6.8197	416	1.1853	0.5469	1.1853	1.0887
No log	6.8525	418	1.2900	0.5038	1.2900	1.1358
No log	6.8852	420	1.2228	0.5469	1.2228	1.1058
No log	6.9180	422	1.1037	0.5246	1.1037	1.0506
No log	6.9508	424	1.1136	0.4274	1.1136	1.0553
No log	6.9836	426	1.1517	0.4746	1.1517	1.0732
No log	7.0164	428	1.1946	0.5333	1.1946	1.0930
No log	7.0492	430	1.2382	0.4746	1.2382	1.1127
No log	7.0820	432	1.2456	0.4746	1.2456	1.1160
No log	7.1148	434	1.2391	0.4746	1.2391	1.1132
No log	7.1475	436	1.2171	0.4538	1.2171	1.1032
No log	7.1803	438	1.1435	0.5161	1.1435	1.0694
No log	7.2131	440	1.1210	0.528	1.1210	1.0588
No log	7.2459	442	1.1665	0.5397	1.1665	1.0801
No log	7.2787	444	1.2057	0.4688	1.2057	1.0981
No log	7.3115	446	1.1537	0.5397	1.1537	1.0741
No log	7.3443	448	1.1411	0.5397	1.1411	1.0682
No log	7.3770	450	1.1305	0.528	1.1305	1.0632
No log	7.4098	452	1.1011	0.5410	1.1011	1.0493
No log	7.4426	454	1.1529	0.4918	1.1529	1.0737
No log	7.4754	456	1.2839	0.4286	1.2839	1.1331
No log	7.5082	458	1.4738	0.4375	1.4738	1.2140
No log	7.5410	460	1.5464	0.4275	1.5464	1.2435
No log	7.5738	462	1.4095	0.4496	1.4095	1.1872
No log	7.6066	464	1.1731	0.5271	1.1731	1.0831
No log	7.6393	466	1.0194	0.5079	1.0194	1.0096
No log	7.6721	468	0.9759	0.5	0.9759	0.9879
No log	7.7049	470	1.0119	0.5039	1.0119	1.0059
No log	7.7377	472	1.1562	0.5191	1.1562	1.0753
No log	7.7705	474	1.2417	0.5152	1.2417	1.1143
No log	7.8033	476	1.1665	0.5385	1.1665	1.0800
No log	7.8361	478	1.1601	0.5271	1.1601	1.0771
No log	7.8689	480	1.2218	0.5385	1.2218	1.1054
No log	7.9016	482	1.1572	0.5354	1.1572	1.0757
No log	7.9344	484	1.0943	0.5354	1.0943	1.0461
No log	7.9672	486	1.0818	0.5354	1.0818	1.0401
No log	8.0	488	1.0258	0.5469	1.0258	1.0128
No log	8.0328	490	1.0447	0.5385	1.0447	1.0221
No log	8.0656	492	1.2195	0.5152	1.2195	1.1043
No log	8.0984	494	1.4524	0.4741	1.4524	1.2051
No log	8.1311	496	1.5692	0.4296	1.5692	1.2527
No log	8.1639	498	1.5200	0.4211	1.5200	1.2329
0.3709	8.1967	500	1.4690	0.4545	1.4690	1.2120
0.3709	8.2295	502	1.3295	0.4496	1.3295	1.1530
0.3709	8.2623	504	1.2707	0.4603	1.2707	1.1273
0.3709	8.2951	506	1.2864	0.4603	1.2864	1.1342
0.3709	8.3279	508	1.3006	0.4567	1.3006	1.1404
0.3709	8.3607	510	1.3106	0.4531	1.3106	1.1448
0.3709	8.3934	512	1.3235	0.4531	1.3235	1.1504
0.3709	8.4262	514	1.4138	0.4462	1.4138	1.1890
0.3709	8.4590	516	1.5366	0.4545	1.5366	1.2396
0.3709	8.4918	518	1.4960	0.4545	1.4960	1.2231

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1