ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5745
• Qwk: 0.3609
• Mse: 1.5745
• Rmse: 1.2548

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	6.9177	0.0	6.9177	2.6302
No log	0.0556	4	4.5141	0.0976	4.5141	2.1246
No log	0.0833	6	3.4311	0.0222	3.4311	1.8523
No log	0.1111	8	3.0610	0.0	3.0610	1.7496
No log	0.1389	10	3.3563	0.0	3.3563	1.8320
No log	0.1667	12	2.8379	0.0690	2.8379	1.6846
No log	0.1944	14	2.3008	0.1120	2.3008	1.5168
No log	0.2222	16	2.0495	0.2385	2.0495	1.4316
No log	0.25	18	2.4676	-0.1077	2.4676	1.5709
No log	0.2778	20	2.8459	-0.1007	2.8459	1.6870
No log	0.3056	22	3.2804	-0.0503	3.2804	1.8112
No log	0.3333	24	3.0185	0.0	3.0185	1.7374
No log	0.3611	26	2.2597	-0.0163	2.2597	1.5032
No log	0.3889	28	1.9684	0.1143	1.9684	1.4030
No log	0.4167	30	1.8632	0.1165	1.8632	1.3650
No log	0.4444	32	1.7976	0.1165	1.7976	1.3408
No log	0.4722	34	1.7560	0.1165	1.7560	1.3251
No log	0.5	36	1.8949	0.2883	1.8949	1.3766
No log	0.5278	38	2.0836	0.2190	2.0836	1.4435
No log	0.5556	40	2.0949	0.2190	2.0949	1.4474
No log	0.5833	42	1.7898	0.3710	1.7898	1.3379
No log	0.6111	44	1.6949	0.3710	1.6948	1.3019
No log	0.6389	46	1.5744	0.3761	1.5744	1.2547
No log	0.6667	48	1.7562	0.384	1.7562	1.3252
No log	0.6944	50	1.9313	0.2190	1.9313	1.3897
No log	0.7222	52	1.7708	0.3721	1.7708	1.3307
No log	0.75	54	1.6486	0.4068	1.6486	1.2840
No log	0.7778	56	2.0343	0.1667	2.0343	1.4263
No log	0.8056	58	1.9428	0.2623	1.9428	1.3939
No log	0.8333	60	1.6380	0.3448	1.6380	1.2799
No log	0.8611	62	1.5728	0.3448	1.5728	1.2541
No log	0.8889	64	1.6682	0.4065	1.6682	1.2916
No log	0.9167	66	1.5276	0.3636	1.5276	1.2360
No log	0.9444	68	1.3978	0.4034	1.3978	1.1823
No log	0.9722	70	1.2151	0.4370	1.2151	1.1023
No log	1.0	72	1.2179	0.5620	1.2179	1.1036
No log	1.0278	74	1.1686	0.5968	1.1686	1.0810
No log	1.0556	76	1.1172	0.5984	1.1172	1.0570
No log	1.0833	78	1.1083	0.5891	1.1083	1.0528
No log	1.1111	80	1.2988	0.4662	1.2988	1.1396
No log	1.1389	82	1.5423	0.4	1.5423	1.2419
No log	1.1667	84	1.3435	0.4848	1.3435	1.1591
No log	1.1944	86	1.1096	0.5344	1.1096	1.0534
No log	1.2222	88	1.0756	0.5556	1.0756	1.0371
No log	1.25	90	1.1749	0.4754	1.1749	1.0839
No log	1.2778	92	1.1403	0.5000	1.1403	1.0679
No log	1.3056	94	1.5086	0.3768	1.5086	1.2283
No log	1.3333	96	1.5803	0.4219	1.5803	1.2571
No log	1.3611	98	1.4175	0.4174	1.4175	1.1906
No log	1.3889	100	1.2971	0.3273	1.2971	1.1389
No log	1.4167	102	1.2097	0.375	1.2097	1.0999
No log	1.4444	104	1.1914	0.3571	1.1914	1.0915
No log	1.4722	106	1.1801	0.3604	1.1801	1.0863
No log	1.5	108	1.2205	0.3604	1.2205	1.1048
No log	1.5278	110	1.4385	0.3193	1.4385	1.1994
No log	1.5556	112	1.3899	0.3051	1.3899	1.1789
No log	1.5833	114	1.2138	0.4628	1.2138	1.1017
No log	1.6111	116	1.1644	0.5042	1.1644	1.0791
No log	1.6389	118	1.3252	0.4248	1.3252	1.1512
No log	1.6667	120	1.2888	0.4211	1.2888	1.1352
No log	1.6944	122	1.1127	0.5496	1.1127	1.0549
No log	1.7222	124	1.2256	0.5455	1.2256	1.1071
No log	1.75	126	1.4493	0.5161	1.4494	1.2039
No log	1.7778	128	1.5178	0.4967	1.5178	1.2320
No log	1.8056	130	1.4101	0.5	1.4101	1.1875
No log	1.8333	132	1.3380	0.5180	1.3380	1.1567
No log	1.8611	134	1.1967	0.5109	1.1967	1.0939
No log	1.8889	136	1.2174	0.5441	1.2174	1.1034
No log	1.9167	138	1.1154	0.5630	1.1154	1.0561
No log	1.9444	140	1.1678	0.5672	1.1678	1.0806
No log	1.9722	142	1.4620	0.4789	1.4620	1.2091
No log	2.0	144	1.6096	0.375	1.6096	1.2687
No log	2.0278	146	1.3875	0.4823	1.3875	1.1779
No log	2.0556	148	1.2918	0.5255	1.2918	1.1366
No log	2.0833	150	1.2881	0.4741	1.2881	1.1350
No log	2.1111	152	1.0430	0.5873	1.0430	1.0213
No log	2.1389	154	1.1056	0.5620	1.1056	1.0515
No log	2.1667	156	1.0488	0.5691	1.0488	1.0241
No log	2.1944	158	1.3464	0.4296	1.3464	1.1604
No log	2.2222	160	1.4540	0.4526	1.4540	1.2058
No log	2.25	162	1.2871	0.5106	1.2871	1.1345
No log	2.2778	164	1.2928	0.5352	1.2928	1.1370
No log	2.3056	166	1.3975	0.5070	1.3975	1.1822
No log	2.3333	168	1.6092	0.4	1.6092	1.2686
No log	2.3611	170	1.4844	0.4748	1.4844	1.2184
No log	2.3889	172	1.1763	0.5778	1.1763	1.0846
No log	2.4167	174	0.8872	0.6016	0.8872	0.9419
No log	2.4444	176	0.9217	0.5902	0.9217	0.9600
No log	2.4722	178	0.9225	0.6129	0.9225	0.9605
No log	2.5	180	1.0848	0.5736	1.0848	1.0415
No log	2.5278	182	1.2160	0.5303	1.2160	1.1027
No log	2.5556	184	1.1631	0.5564	1.1631	1.0785
No log	2.5833	186	1.0721	0.6	1.0721	1.0354
No log	2.6111	188	1.0746	0.6061	1.0746	1.0367
No log	2.6389	190	1.2274	0.5481	1.2274	1.1079
No log	2.6667	192	1.3003	0.5037	1.3003	1.1403
No log	2.6944	194	1.3176	0.5037	1.3176	1.1479
No log	2.7222	196	1.5079	0.4234	1.5079	1.2280
No log	2.75	198	1.4378	0.4526	1.4378	1.1991
No log	2.7778	200	1.2065	0.5075	1.2065	1.0984
No log	2.8056	202	1.1671	0.4962	1.1671	1.0803
No log	2.8333	204	1.2797	0.4741	1.2797	1.1312
No log	2.8611	206	1.2538	0.4394	1.2538	1.1197
No log	2.8889	208	1.1713	0.5191	1.1713	1.0823
No log	2.9167	210	1.0795	0.5802	1.0795	1.0390
No log	2.9444	212	1.1124	0.5821	1.1124	1.0547
No log	2.9722	214	1.1138	0.5821	1.1138	1.0554
No log	3.0	216	1.2007	0.4741	1.2007	1.0958
No log	3.0278	218	1.2040	0.4627	1.2040	1.0972
No log	3.0556	220	1.1302	0.5564	1.1302	1.0631
No log	3.0833	222	1.0399	0.5854	1.0399	1.0198
No log	3.1111	224	1.0772	0.5854	1.0772	1.0379
No log	3.1389	226	1.1659	0.5152	1.1659	1.0798
No log	3.1667	228	1.1280	0.5522	1.1280	1.0621
No log	3.1944	230	1.0998	0.5333	1.0998	1.0487
No log	3.2222	232	1.2299	0.5	1.2299	1.1090
No log	3.25	234	1.3024	0.4526	1.3024	1.1412
No log	3.2778	236	1.1351	0.5147	1.1351	1.0654
No log	3.3056	238	1.0142	0.6154	1.0142	1.0071
No log	3.3333	240	0.9668	0.625	0.9668	0.9833
No log	3.3611	242	1.0019	0.6016	1.0019	1.0009
No log	3.3889	244	1.0754	0.5484	1.0754	1.0370
No log	3.4167	246	1.2431	0.4545	1.2431	1.1149
No log	3.4444	248	1.4004	0.4741	1.4004	1.1834
No log	3.4722	250	1.4072	0.4559	1.4072	1.1862
No log	3.5	252	1.2664	0.4741	1.2664	1.1253
No log	3.5278	254	1.2308	0.4697	1.2308	1.1094
No log	3.5556	256	1.3460	0.4741	1.3460	1.1602
No log	3.5833	258	1.5597	0.4	1.5597	1.2489
No log	3.6111	260	1.5041	0.4	1.5041	1.2264
No log	3.6389	262	1.3134	0.4308	1.3134	1.1460
No log	3.6667	264	1.1436	0.5203	1.1436	1.0694
No log	3.6944	266	1.0981	0.5410	1.0981	1.0479
No log	3.7222	268	1.0783	0.5366	1.0783	1.0384
No log	3.75	270	1.1773	0.4885	1.1773	1.0850
No log	3.7778	272	1.3307	0.4776	1.3307	1.1536
No log	3.8056	274	1.4326	0.4526	1.4326	1.1969
No log	3.8333	276	1.5103	0.4526	1.5103	1.2289
No log	3.8611	278	1.4460	0.4526	1.4460	1.2025
No log	3.8889	280	1.4474	0.4559	1.4474	1.2031
No log	3.9167	282	1.3179	0.4627	1.3179	1.1480
No log	3.9444	284	1.2742	0.4627	1.2742	1.1288
No log	3.9722	286	1.2284	0.4848	1.2284	1.1083
No log	4.0	288	1.2309	0.4627	1.2309	1.1095
No log	4.0278	290	1.2739	0.4328	1.2739	1.1287
No log	4.0556	292	1.2732	0.4328	1.2732	1.1283
No log	4.0833	294	1.2256	0.4593	1.2256	1.1071
No log	4.1111	296	1.1392	0.5303	1.1392	1.0673
No log	4.1389	298	1.2335	0.4662	1.2335	1.1106
No log	4.1667	300	1.3414	0.4444	1.3414	1.1582
No log	4.1944	302	1.2414	0.5191	1.2414	1.1142
No log	4.2222	304	1.1538	0.5692	1.1538	1.0742
No log	4.25	306	1.1299	0.5692	1.1299	1.0630
No log	4.2778	308	1.1330	0.5649	1.1330	1.0644
No log	4.3056	310	1.1433	0.5455	1.1433	1.0692
No log	4.3333	312	1.1244	0.5714	1.1244	1.0604
No log	4.3611	314	1.1487	0.5455	1.1487	1.0718
No log	4.3889	316	1.1673	0.5455	1.1673	1.0804
No log	4.4167	318	1.1561	0.5385	1.1561	1.0752
No log	4.4444	320	1.1375	0.5385	1.1375	1.0665
No log	4.4722	322	1.1849	0.5385	1.1849	1.0885
No log	4.5	324	1.3485	0.4179	1.3485	1.1612
No log	4.5278	326	1.3743	0.4148	1.3743	1.1723
No log	4.5556	328	1.2420	0.4844	1.2420	1.1145
No log	4.5833	330	1.1302	0.5873	1.1302	1.0631
No log	4.6111	332	1.1250	0.6142	1.1250	1.0607
No log	4.6389	334	1.1722	0.5625	1.1722	1.0827
No log	4.6667	336	1.1920	0.5758	1.1920	1.0918
No log	4.6944	338	1.2801	0.4627	1.2801	1.1314
No log	4.7222	340	1.3338	0.4559	1.3338	1.1549
No log	4.75	342	1.3129	0.4672	1.3129	1.1458
No log	4.7778	344	1.2877	0.4593	1.2877	1.1348
No log	4.8056	346	1.1919	0.5455	1.1919	1.0917
No log	4.8333	348	1.1482	0.5758	1.1482	1.0715
No log	4.8611	350	1.1010	0.5854	1.1010	1.0493
No log	4.8889	352	1.1123	0.5827	1.1123	1.0547
No log	4.9167	354	1.1002	0.5669	1.1002	1.0489
No log	4.9444	356	1.1286	0.5649	1.1286	1.0623
No log	4.9722	358	1.2527	0.4776	1.2527	1.1193
No log	5.0	360	1.4425	0.4203	1.4425	1.2010
No log	5.0278	362	1.4178	0.4412	1.4178	1.1907
No log	5.0556	364	1.2609	0.5077	1.2609	1.1229
No log	5.0833	366	1.1328	0.5397	1.1328	1.0643
No log	5.1111	368	1.0417	0.6016	1.0417	1.0207
No log	5.1389	370	1.0253	0.6016	1.0253	1.0126
No log	5.1667	372	1.0988	0.5781	1.0988	1.0482
No log	5.1944	374	1.2935	0.4154	1.2935	1.1373
No log	5.2222	376	1.2775	0.4341	1.2775	1.1302
No log	5.25	378	1.2616	0.4615	1.2616	1.1232
No log	5.2778	380	1.2805	0.4211	1.2805	1.1316
No log	5.3056	382	1.2666	0.4706	1.2666	1.1254
No log	5.3333	384	1.4294	0.4203	1.4294	1.1956
No log	5.3611	386	1.3623	0.4380	1.3623	1.1672
No log	5.3889	388	1.1817	0.5821	1.1817	1.0870
No log	5.4167	390	1.0701	0.5954	1.0701	1.0345
No log	5.4444	392	1.0730	0.5954	1.0730	1.0359
No log	5.4722	394	1.2101	0.5191	1.2101	1.1000
No log	5.5	396	1.3604	0.4179	1.3604	1.1664
No log	5.5278	398	1.3258	0.4328	1.3258	1.1514
No log	5.5556	400	1.2241	0.5191	1.2241	1.1064
No log	5.5833	402	1.2613	0.4848	1.2613	1.1231
No log	5.6111	404	1.3497	0.4091	1.3497	1.1617
No log	5.6389	406	1.3145	0.4545	1.3145	1.1465
No log	5.6667	408	1.2761	0.4697	1.2761	1.1297
No log	5.6944	410	1.1371	0.5496	1.1371	1.0663
No log	5.7222	412	1.0389	0.6357	1.0389	1.0193
No log	5.75	414	1.0248	0.5760	1.0248	1.0123
No log	5.7778	416	1.0852	0.5116	1.0852	1.0417
No log	5.8056	418	1.3800	0.4412	1.3800	1.1747
No log	5.8333	420	1.6385	0.3973	1.6385	1.2800
No log	5.8611	422	1.5701	0.4	1.5701	1.2530
No log	5.8889	424	1.3272	0.4638	1.3272	1.1520
No log	5.9167	426	1.2680	0.4526	1.2680	1.1261
No log	5.9444	428	1.2667	0.4706	1.2667	1.1255
No log	5.9722	430	1.3658	0.4706	1.3658	1.1687
No log	6.0	432	1.5065	0.4	1.5065	1.2274
No log	6.0278	434	1.5385	0.4	1.5385	1.2403
No log	6.0556	436	1.4121	0.4091	1.4121	1.1883
No log	6.0833	438	1.2781	0.4923	1.2781	1.1305
No log	6.1111	440	1.0910	0.5556	1.0910	1.0445
No log	6.1389	442	1.0411	0.544	1.0411	1.0203
No log	6.1667	444	1.1305	0.5496	1.1305	1.0632
No log	6.1944	446	1.3907	0.4412	1.3907	1.1793
No log	6.2222	448	1.5509	0.3913	1.5509	1.2454
No log	6.25	450	1.4949	0.4234	1.4949	1.2226
No log	6.2778	452	1.2670	0.4706	1.2670	1.1256
No log	6.3056	454	1.1735	0.6015	1.1735	1.0833
No log	6.3333	456	1.1689	0.6015	1.1689	1.0812
No log	6.3611	458	1.2183	0.4848	1.2183	1.1038
No log	6.3889	460	1.3775	0.4444	1.3775	1.1737
No log	6.4167	462	1.4242	0.4	1.4242	1.1934
No log	6.4444	464	1.2572	0.4478	1.2572	1.1212
No log	6.4722	466	1.0945	0.5649	1.0945	1.0462
No log	6.5	468	1.0560	0.5827	1.0560	1.0276
No log	6.5278	470	1.1119	0.5	1.1119	1.0545
No log	6.5556	472	1.1979	0.4921	1.1979	1.0945
No log	6.5833	474	1.2189	0.4724	1.2189	1.1040
No log	6.6111	476	1.2618	0.4733	1.2618	1.1233
No log	6.6389	478	1.2916	0.4733	1.2916	1.1365
No log	6.6667	480	1.1961	0.4921	1.1961	1.0937
No log	6.6944	482	1.1529	0.5512	1.1529	1.0737
No log	6.7222	484	1.2049	0.5469	1.2049	1.0977
No log	6.75	486	1.3647	0.4394	1.3647	1.1682
No log	6.7778	488	1.6275	0.3676	1.6275	1.2757
No log	6.8056	490	1.7423	0.3212	1.7423	1.3200
No log	6.8333	492	1.6000	0.3582	1.6000	1.2649
No log	6.8611	494	1.3885	0.5	1.3885	1.1784
No log	6.8889	496	1.3226	0.528	1.3226	1.1501
No log	6.9167	498	1.3651	0.5	1.3651	1.1684
0.4357	6.9444	500	1.4042	0.4615	1.4042	1.1850
0.4357	6.9722	502	1.4402	0.4275	1.4402	1.2001
0.4357	7.0	504	1.3087	0.4844	1.3087	1.1440
0.4357	7.0278	506	1.2241	0.496	1.2241	1.1064
0.4357	7.0556	508	1.1266	0.5	1.1266	1.0614
0.4357	7.0833	510	1.1092	0.4715	1.1092	1.0532
0.4357	7.1111	512	1.1312	0.5354	1.1312	1.0636
0.4357	7.1389	514	1.3193	0.4615	1.3193	1.1486
0.4357	7.1667	516	1.4647	0.4060	1.4647	1.2103
0.4357	7.1944	518	1.3771	0.4328	1.3771	1.1735
0.4357	7.2222	520	1.2636	0.5038	1.2636	1.1241
0.4357	7.25	522	1.2743	0.4848	1.2743	1.1288
0.4357	7.2778	524	1.4035	0.4328	1.4035	1.1847
0.4357	7.3056	526	1.4915	0.3852	1.4915	1.2213
0.4357	7.3333	528	1.3607	0.4545	1.3607	1.1665
0.4357	7.3611	530	1.2901	0.4651	1.2901	1.1358
0.4357	7.3889	532	1.3010	0.4651	1.3010	1.1406
0.4357	7.4167	534	1.3546	0.4580	1.3546	1.1639
0.4357	7.4444	536	1.5072	0.4091	1.5072	1.2277
0.4357	7.4722	538	1.6857	0.3382	1.6857	1.2983
0.4357	7.5	540	1.6623	0.3407	1.6623	1.2893
0.4357	7.5278	542	1.5745	0.3609	1.5745	1.2548

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1