ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6630
• Qwk: 0.3582
• Mse: 1.6630
• Rmse: 1.2896

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	6.8743	0.0116	6.8743	2.6219
No log	0.0556	4	4.6163	0.0917	4.6163	2.1486
No log	0.0833	6	3.5713	-0.0212	3.5713	1.8898
No log	0.1111	8	2.4010	0.2254	2.4010	1.5495
No log	0.1389	10	1.9682	0.2951	1.9682	1.4029
No log	0.1667	12	2.0748	0.1575	2.0748	1.4404
No log	0.1944	14	2.2708	0.1119	2.2708	1.5069
No log	0.2222	16	2.3306	0.0972	2.3306	1.5266
No log	0.25	18	2.2378	0.1127	2.2378	1.4959
No log	0.2778	20	1.8753	0.2521	1.8753	1.3694
No log	0.3056	22	1.6925	0.2241	1.6925	1.3009
No log	0.3333	24	1.8527	0.3810	1.8527	1.3611
No log	0.3611	26	1.9788	0.3088	1.9788	1.4067
No log	0.3889	28	1.5871	0.368	1.5871	1.2598
No log	0.4167	30	1.4117	0.2569	1.4117	1.1882
No log	0.4444	32	1.7661	0.2018	1.7661	1.3290
No log	0.4722	34	1.5367	0.1698	1.5367	1.2396
No log	0.5	36	1.3519	0.3333	1.3519	1.1627
No log	0.5278	38	1.3514	0.4390	1.3514	1.1625
No log	0.5556	40	1.3491	0.3810	1.3491	1.1615
No log	0.5833	42	1.2180	0.48	1.2180	1.1036
No log	0.6111	44	1.1629	0.4677	1.1629	1.0784
No log	0.6389	46	1.1778	0.4034	1.1778	1.0853
No log	0.6667	48	1.1365	0.4603	1.1365	1.0661
No log	0.6944	50	1.0843	0.4724	1.0843	1.0413
No log	0.7222	52	1.0515	0.4516	1.0515	1.0254
No log	0.75	54	1.1179	0.4959	1.1179	1.0573
No log	0.7778	56	1.0262	0.5802	1.0262	1.0130
No log	0.8056	58	1.0705	0.5455	1.0705	1.0346
No log	0.8333	60	1.0849	0.5693	1.0849	1.0416
No log	0.8611	62	1.0861	0.6015	1.0861	1.0421
No log	0.8889	64	1.5668	0.3651	1.5668	1.2517
No log	0.9167	66	1.3472	0.4769	1.3472	1.1607
No log	0.9444	68	0.8965	0.6418	0.8965	0.9468
No log	0.9722	70	1.0427	0.5692	1.0427	1.0211
No log	1.0	72	1.1167	0.5038	1.1167	1.0568
No log	1.0278	74	1.0754	0.5263	1.0754	1.0370
No log	1.0556	76	0.8481	0.6618	0.8481	0.9209
No log	1.0833	78	0.8877	0.6667	0.8877	0.9422
No log	1.1111	80	0.8609	0.6377	0.8609	0.9278
No log	1.1389	82	0.7850	0.6667	0.7850	0.8860
No log	1.1667	84	0.8171	0.6763	0.8171	0.9040
No log	1.1944	86	0.8704	0.6957	0.8704	0.9330
No log	1.2222	88	0.8779	0.7101	0.8779	0.9370
No log	1.25	90	1.0684	0.6370	1.0684	1.0336
No log	1.2778	92	1.1970	0.5538	1.1970	1.0941
No log	1.3056	94	1.3931	0.3937	1.3931	1.1803
No log	1.3333	96	1.6619	0.2927	1.6619	1.2892
No log	1.3611	98	1.5432	0.3333	1.5432	1.2422
No log	1.3889	100	1.3301	0.4228	1.3301	1.1533
No log	1.4167	102	1.2872	0.4762	1.2872	1.1345
No log	1.4444	104	1.1537	0.512	1.1537	1.0741
No log	1.4722	106	1.1444	0.4688	1.1444	1.0698
No log	1.5	108	1.0963	0.5827	1.0963	1.0470
No log	1.5278	110	1.1601	0.5231	1.1601	1.0771
No log	1.5556	112	1.1994	0.5354	1.1994	1.0952
No log	1.5833	114	1.1301	0.4615	1.1301	1.0630
No log	1.6111	116	1.1912	0.4274	1.1912	1.0914
No log	1.6389	118	1.1762	0.3684	1.1762	1.0845
No log	1.6667	120	1.1985	0.4576	1.1985	1.0948
No log	1.6944	122	1.2099	0.4878	1.2099	1.0999
No log	1.7222	124	1.0720	0.5041	1.0720	1.0354
No log	1.75	126	0.9309	0.5873	0.9309	0.9648
No log	1.7778	128	0.9126	0.6142	0.9126	0.9553
No log	1.8056	130	0.9821	0.5865	0.9821	0.9910
No log	1.8333	132	1.2015	0.5231	1.2015	1.0961
No log	1.8611	134	1.5060	0.4	1.5060	1.2272
No log	1.8889	136	1.4208	0.4444	1.4208	1.1920
No log	1.9167	138	1.0659	0.5891	1.0659	1.0324
No log	1.9444	140	1.0502	0.5484	1.0502	1.0248
No log	1.9722	142	1.0895	0.5124	1.0895	1.0438
No log	2.0	144	1.2259	0.544	1.2259	1.1072
No log	2.0278	146	1.4841	0.4559	1.4841	1.2182
No log	2.0556	148	1.4208	0.4662	1.4208	1.1920
No log	2.0833	150	1.2154	0.5469	1.2154	1.1024
No log	2.1111	152	1.0988	0.5736	1.0988	1.0482
No log	2.1389	154	1.1331	0.5469	1.1331	1.0645
No log	2.1667	156	1.2490	0.5271	1.2490	1.1176
No log	2.1944	158	1.6139	0.3333	1.6139	1.2704
No log	2.2222	160	1.7910	0.2429	1.7910	1.3383
No log	2.25	162	1.5982	0.3333	1.5982	1.2642
No log	2.2778	164	1.4828	0.3768	1.4828	1.2177
No log	2.3056	166	1.3001	0.5224	1.3001	1.1402
No log	2.3333	168	1.1274	0.5692	1.1274	1.0618
No log	2.3611	170	0.9726	0.6094	0.9726	0.9862
No log	2.3889	172	0.9710	0.6519	0.9710	0.9854
No log	2.4167	174	1.0677	0.6165	1.0677	1.0333
No log	2.4444	176	1.4016	0.4088	1.4016	1.1839
No log	2.4722	178	1.4981	0.3650	1.4981	1.2240
No log	2.5	180	1.2418	0.5271	1.2418	1.1144
No log	2.5278	182	0.9713	0.5984	0.9713	0.9856
No log	2.5556	184	0.9492	0.64	0.9492	0.9743
No log	2.5833	186	1.0347	0.6142	1.0347	1.0172
No log	2.6111	188	1.3287	0.5191	1.3287	1.1527
No log	2.6389	190	1.4793	0.4296	1.4793	1.2163
No log	2.6667	192	1.3827	0.5113	1.3827	1.1759
No log	2.6944	194	1.2632	0.5649	1.2632	1.1239
No log	2.7222	196	1.1863	0.6015	1.1863	1.0892
No log	2.75	198	1.1659	0.6119	1.1659	1.0798
No log	2.7778	200	1.0489	0.6015	1.0489	1.0242
No log	2.8056	202	1.0961	0.5758	1.0961	1.0470
No log	2.8333	204	1.4333	0.4412	1.4333	1.1972
No log	2.8611	206	1.6476	0.3478	1.6476	1.2836
No log	2.8889	208	1.4061	0.4179	1.4061	1.1858
No log	2.9167	210	1.0889	0.5891	1.0889	1.0435
No log	2.9444	212	1.0744	0.5484	1.0744	1.0365
No log	2.9722	214	1.1480	0.5210	1.1480	1.0715
No log	3.0	216	1.3145	0.5041	1.3145	1.1465
No log	3.0278	218	1.2711	0.528	1.2711	1.1274
No log	3.0556	220	1.2357	0.6047	1.2357	1.1116
No log	3.0833	222	1.2082	0.6047	1.2082	1.0992
No log	3.1111	224	1.1694	0.5938	1.1694	1.0814
No log	3.1389	226	1.2286	0.6047	1.2286	1.1084
No log	3.1667	228	1.2674	0.5538	1.2674	1.1258
No log	3.1944	230	1.2476	0.5781	1.2476	1.1170
No log	3.2222	232	1.1167	0.5920	1.1167	1.0568
No log	3.25	234	1.0856	0.5873	1.0856	1.0419
No log	3.2778	236	1.1765	0.5781	1.1765	1.0847
No log	3.3056	238	1.3801	0.4118	1.3801	1.1748
No log	3.3333	240	1.5313	0.3852	1.5313	1.2375
No log	3.3611	242	1.4282	0.4118	1.4282	1.1951
No log	3.3889	244	1.4478	0.4118	1.4478	1.2033
No log	3.4167	246	1.3077	0.4853	1.3077	1.1436
No log	3.4444	248	1.1386	0.5649	1.1386	1.0670
No log	3.4722	250	1.1834	0.5909	1.1834	1.0878
No log	3.5	252	1.3690	0.4361	1.3690	1.1700
No log	3.5278	254	1.4039	0.4265	1.4039	1.1848
No log	3.5556	256	1.2370	0.5077	1.2370	1.1122
No log	3.5833	258	1.0814	0.6165	1.0814	1.0399
No log	3.6111	260	0.9950	0.6165	0.9950	0.9975
No log	3.6389	262	1.0278	0.5538	1.0278	1.0138
No log	3.6667	264	1.1408	0.5191	1.1408	1.0681
No log	3.6944	266	1.0988	0.5455	1.0988	1.0482
No log	3.7222	268	0.9195	0.6308	0.9195	0.9589
No log	3.75	270	0.7676	0.6615	0.7676	0.8761
No log	3.7778	272	0.6992	0.6870	0.6992	0.8362
No log	3.8056	274	0.7475	0.6718	0.7475	0.8646
No log	3.8333	276	0.8413	0.6667	0.8413	0.9172
No log	3.8611	278	0.8686	0.5645	0.8686	0.9320
No log	3.8889	280	0.9617	0.4915	0.9617	0.9807
No log	3.9167	282	1.0578	0.4915	1.0578	1.0285
No log	3.9444	284	1.1851	0.5827	1.1851	1.0886
No log	3.9722	286	1.2644	0.5496	1.2644	1.1245
No log	4.0	288	1.4191	0.4580	1.4191	1.1913
No log	4.0278	290	1.3767	0.5113	1.3767	1.1733
No log	4.0556	292	1.0991	0.6061	1.0991	1.0484
No log	4.0833	294	1.0500	0.6418	1.0500	1.0247
No log	4.1111	296	1.2758	0.5224	1.2758	1.1295
No log	4.1389	298	1.6315	0.3609	1.6315	1.2773
No log	4.1667	300	2.0463	0.1353	2.0463	1.4305
No log	4.1944	302	1.9395	0.1515	1.9395	1.3926
No log	4.2222	304	1.5030	0.375	1.5030	1.2260
No log	4.25	306	1.1317	0.5556	1.1317	1.0638
No log	4.2778	308	1.0343	0.5620	1.0343	1.0170
No log	4.3056	310	1.0597	0.5806	1.0597	1.0294
No log	4.3333	312	1.2295	0.5191	1.2295	1.1088
No log	4.3611	314	1.3480	0.4733	1.3480	1.1610
No log	4.3889	316	1.2341	0.5	1.2341	1.1109
No log	4.4167	318	1.1085	0.5909	1.1085	1.0529
No log	4.4444	320	1.0203	0.6016	1.0203	1.0101
No log	4.4722	322	1.0681	0.6016	1.0681	1.0335
No log	4.5	324	1.1791	0.5156	1.1791	1.0859
No log	4.5278	326	1.2348	0.4844	1.2348	1.1112
No log	4.5556	328	1.2018	0.4921	1.2018	1.0963
No log	4.5833	330	1.1405	0.5	1.1405	1.0680
No log	4.6111	332	1.1577	0.5197	1.1577	1.0760
No log	4.6389	334	1.2673	0.4697	1.2673	1.1258
No log	4.6667	336	1.2188	0.4962	1.2188	1.1040
No log	4.6944	338	1.0474	0.6190	1.0474	1.0234
No log	4.7222	340	0.9932	0.5378	0.9932	0.9966
No log	4.75	342	1.0270	0.5085	1.0270	1.0134
No log	4.7778	344	1.1238	0.5299	1.1238	1.0601
No log	4.8056	346	1.2484	0.4522	1.2484	1.1173
No log	4.8333	348	1.4200	0.4407	1.4200	1.1916
No log	4.8611	350	1.5065	0.4031	1.5065	1.2274
No log	4.8889	352	1.4235	0.4427	1.4235	1.1931
No log	4.9167	354	1.2197	0.5312	1.2197	1.1044
No log	4.9444	356	0.9764	0.5691	0.9764	0.9882
No log	4.9722	358	0.9269	0.6299	0.9269	0.9628
No log	5.0	360	0.8689	0.6769	0.8689	0.9322
No log	5.0278	362	0.8423	0.6406	0.8423	0.9178
No log	5.0556	364	1.0728	0.6475	1.0728	1.0358
No log	5.0833	366	1.2336	0.4818	1.2336	1.1107
No log	5.1111	368	1.1522	0.5606	1.1522	1.0734
No log	5.1389	370	1.0483	0.6179	1.0483	1.0238
No log	5.1667	372	1.0668	0.5254	1.0668	1.0329
No log	5.1944	374	1.1254	0.4828	1.1254	1.0608
No log	5.2222	376	1.2095	0.5210	1.2095	1.0998
No log	5.25	378	1.3316	0.4882	1.3316	1.1539
No log	5.2778	380	1.3534	0.4885	1.3534	1.1633
No log	5.3056	382	1.3485	0.4697	1.3485	1.1612
No log	5.3333	384	1.2567	0.5152	1.2567	1.1210
No log	5.3611	386	1.0685	0.6260	1.0685	1.0337
No log	5.3889	388	1.0041	0.6047	1.0041	1.0021
No log	5.4167	390	1.0367	0.6142	1.0367	1.0182
No log	5.4444	392	1.1564	0.5736	1.1564	1.0753
No log	5.4722	394	1.3654	0.4427	1.3654	1.1685
No log	5.5	396	1.4832	0.4091	1.4832	1.2179
No log	5.5278	398	1.4654	0.4091	1.4654	1.2106
No log	5.5556	400	1.3551	0.4769	1.3551	1.1641
No log	5.5833	402	1.3279	0.5	1.3279	1.1523
No log	5.6111	404	1.3795	0.4769	1.3795	1.1745
No log	5.6389	406	1.4367	0.3817	1.4367	1.1986
No log	5.6667	408	1.4228	0.3636	1.4228	1.1928
No log	5.6944	410	1.3189	0.4806	1.3189	1.1484
No log	5.7222	412	1.1848	0.5714	1.1848	1.0885
No log	5.75	414	1.1514	0.5410	1.1514	1.0730
No log	5.7778	416	1.1606	0.5484	1.1606	1.0773
No log	5.8056	418	1.2638	0.5344	1.2638	1.1242
No log	5.8333	420	1.4272	0.4030	1.4272	1.1946
No log	5.8611	422	1.4285	0.4296	1.4285	1.1952
No log	5.8889	424	1.2430	0.5344	1.2430	1.1149
No log	5.9167	426	1.1906	0.5077	1.1906	1.0911
No log	5.9444	428	1.2950	0.4733	1.2950	1.1380
No log	5.9722	430	1.3304	0.4662	1.3304	1.1534
No log	6.0	432	1.2703	0.5077	1.2703	1.1271
No log	6.0278	434	1.2792	0.4733	1.2792	1.1310
No log	6.0556	436	1.4285	0.4242	1.4285	1.1952
No log	6.0833	438	1.6041	0.3852	1.6041	1.2665
No log	6.1111	440	1.5224	0.4030	1.5224	1.2339
No log	6.1389	442	1.3487	0.4511	1.3487	1.1613
No log	6.1667	444	1.2148	0.5	1.2148	1.1022
No log	6.1944	446	1.2255	0.5344	1.2255	1.1070
No log	6.2222	448	1.2421	0.5344	1.2421	1.1145
No log	6.25	450	1.2952	0.5077	1.2952	1.1381
No log	6.2778	452	1.3528	0.4806	1.3528	1.1631
No log	6.3056	454	1.4612	0.4545	1.4612	1.2088
No log	6.3333	456	1.4537	0.4545	1.4537	1.2057
No log	6.3611	458	1.2978	0.4923	1.2978	1.1392
No log	6.3889	460	1.0979	0.5366	1.0979	1.0478
No log	6.4167	462	0.9630	0.5920	0.9630	0.9813
No log	6.4444	464	0.9390	0.5920	0.9390	0.9690
No log	6.4722	466	1.0042	0.5645	1.0042	1.0021
No log	6.5	468	1.1948	0.4923	1.1948	1.0931
No log	6.5278	470	1.3385	0.4923	1.3385	1.1569
No log	6.5556	472	1.3264	0.4923	1.3264	1.1517
No log	6.5833	474	1.2129	0.4923	1.2129	1.1013
No log	6.6111	476	1.1085	0.5781	1.1085	1.0528
No log	6.6389	478	1.0693	0.6047	1.0693	1.0341
No log	6.6667	480	1.0078	0.5938	1.0078	1.0039
No log	6.6944	482	1.0951	0.5781	1.0951	1.0465
No log	6.7222	484	1.3836	0.5191	1.3836	1.1763
No log	6.75	486	1.5579	0.3817	1.5579	1.2481
No log	6.7778	488	1.4444	0.4697	1.4444	1.2018
No log	6.8056	490	1.3355	0.4923	1.3355	1.1557
No log	6.8333	492	1.2470	0.5116	1.2470	1.1167
No log	6.8611	494	1.2569	0.5116	1.2569	1.1211
No log	6.8889	496	1.1659	0.5469	1.1659	1.0798
No log	6.9167	498	1.1413	0.5469	1.1413	1.0683
0.3671	6.9444	500	1.2516	0.5191	1.2516	1.1187
0.3671	6.9722	502	1.4346	0.4394	1.4346	1.1978
0.3671	7.0	504	1.5741	0.3852	1.5741	1.2546
0.3671	7.0278	506	1.7685	0.2920	1.7685	1.3299
0.3671	7.0556	508	1.7300	0.2920	1.7300	1.3153
0.3671	7.0833	510	1.6630	0.3582	1.6630	1.2896

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1