ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8545
• Qwk: 0.6017
• Mse: 0.8545
• Rmse: 0.9244

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0294	2	5.0780	-0.0123	5.0780	2.2534
No log	0.0588	4	2.8860	0.0767	2.8860	1.6988
No log	0.0882	6	2.2751	-0.1011	2.2751	1.5083
No log	0.1176	8	2.1924	-0.0554	2.1924	1.4807
No log	0.1471	10	1.3148	0.1915	1.3148	1.1466
No log	0.1765	12	1.1908	0.2479	1.1908	1.0912
No log	0.2059	14	1.3452	0.1020	1.3452	1.1598
No log	0.2353	16	1.3923	0.1060	1.3923	1.1800
No log	0.2647	18	1.3994	0.1232	1.3994	1.1830
No log	0.2941	20	1.2788	0.2882	1.2788	1.1308
No log	0.3235	22	1.1054	0.3233	1.1054	1.0514
No log	0.3529	24	1.0602	0.3335	1.0602	1.0297
No log	0.3824	26	1.0216	0.3018	1.0216	1.0107
No log	0.4118	28	0.9907	0.3491	0.9907	0.9953
No log	0.4412	30	0.9961	0.4399	0.9961	0.9980
No log	0.4706	32	0.9805	0.3999	0.9805	0.9902
No log	0.5	34	1.0193	0.4088	1.0193	1.0096
No log	0.5294	36	1.1107	0.3626	1.1107	1.0539
No log	0.5588	38	1.0166	0.3630	1.0166	1.0082
No log	0.5882	40	0.9576	0.3104	0.9576	0.9786
No log	0.6176	42	0.9674	0.3366	0.9674	0.9835
No log	0.6471	44	0.9347	0.3550	0.9347	0.9668
No log	0.6765	46	0.9399	0.3649	0.9399	0.9695
No log	0.7059	48	0.9251	0.4576	0.9251	0.9618
No log	0.7353	50	0.8603	0.4381	0.8603	0.9275
No log	0.7647	52	0.8671	0.4480	0.8671	0.9312
No log	0.7941	54	0.8675	0.5199	0.8675	0.9314
No log	0.8235	56	0.7831	0.5627	0.7830	0.8849
No log	0.8529	58	0.8963	0.5300	0.8963	0.9468
No log	0.8824	60	0.8998	0.5549	0.8998	0.9486
No log	0.9118	62	0.8274	0.6632	0.8274	0.9096
No log	0.9412	64	0.9560	0.5625	0.9560	0.9777
No log	0.9706	66	1.2128	0.4958	1.2128	1.1013
No log	1.0	68	0.9403	0.6133	0.9403	0.9697
No log	1.0294	70	0.9039	0.5627	0.9039	0.9507
No log	1.0588	72	1.8532	0.1704	1.8532	1.3613
No log	1.0882	74	2.4424	-0.2590	2.4424	1.5628
No log	1.1176	76	2.2260	-0.1895	2.2260	1.4920
No log	1.1471	78	1.5009	0.2900	1.5009	1.2251
No log	1.1765	80	0.8394	0.6046	0.8394	0.9162
No log	1.2059	82	0.8369	0.6106	0.8369	0.9148
No log	1.2353	84	0.8469	0.6122	0.8469	0.9203
No log	1.2647	86	0.8242	0.5318	0.8242	0.9079
No log	1.2941	88	0.8137	0.5928	0.8137	0.9020
No log	1.3235	90	0.9036	0.5226	0.9036	0.9506
No log	1.3529	92	0.9835	0.5145	0.9835	0.9917
No log	1.3824	94	0.9398	0.5303	0.9398	0.9695
No log	1.4118	96	0.9332	0.5490	0.9332	0.9660
No log	1.4412	98	0.9681	0.5686	0.9681	0.9839
No log	1.4706	100	1.0733	0.5219	1.0733	1.0360
No log	1.5	102	1.0569	0.5461	1.0569	1.0280
No log	1.5294	104	1.1514	0.4976	1.1514	1.0731
No log	1.5588	106	1.5768	0.4245	1.5768	1.2557
No log	1.5882	108	1.8690	0.2931	1.8690	1.3671
No log	1.6176	110	1.7554	0.3185	1.7554	1.3249
No log	1.6471	112	1.3616	0.4642	1.3616	1.1669
No log	1.6765	114	0.9341	0.5181	0.9341	0.9665
No log	1.7059	116	0.8354	0.5761	0.8354	0.9140
No log	1.7353	118	0.7955	0.5774	0.7955	0.8919
No log	1.7647	120	0.8120	0.6420	0.8120	0.9011
No log	1.7941	122	1.0902	0.5122	1.0902	1.0441
No log	1.8235	124	1.3260	0.4217	1.3260	1.1515
No log	1.8529	126	1.3709	0.3806	1.3709	1.1709
No log	1.8824	128	1.3007	0.4490	1.3007	1.1405
No log	1.9118	130	1.1990	0.5063	1.1990	1.0950
No log	1.9412	132	1.0794	0.53	1.0794	1.0390
No log	1.9706	134	1.0538	0.5437	1.0538	1.0265
No log	2.0	136	0.9889	0.5524	0.9889	0.9944
No log	2.0294	138	1.0065	0.5327	1.0065	1.0032
No log	2.0588	140	0.9009	0.5215	0.9009	0.9492
No log	2.0882	142	0.8066	0.4706	0.8066	0.8981
No log	2.1176	144	0.7863	0.4879	0.7863	0.8867
No log	2.1471	146	0.7582	0.5623	0.7582	0.8707
No log	2.1765	148	0.7279	0.6236	0.7279	0.8532
No log	2.2059	150	0.7698	0.6722	0.7698	0.8774
No log	2.2353	152	1.0264	0.6013	1.0264	1.0131
No log	2.2647	154	1.0877	0.5651	1.0877	1.0429
No log	2.2941	156	0.8563	0.6577	0.8563	0.9254
No log	2.3235	158	0.7639	0.6571	0.7639	0.8740
No log	2.3529	160	0.7616	0.6553	0.7616	0.8727
No log	2.3824	162	0.8311	0.6747	0.8311	0.9116
No log	2.4118	164	1.0049	0.5479	1.0049	1.0024
No log	2.4412	166	0.9694	0.5740	0.9694	0.9846
No log	2.4706	168	0.8737	0.6003	0.8737	0.9347
No log	2.5	170	0.7736	0.6636	0.7736	0.8795
No log	2.5294	172	0.7216	0.6653	0.7216	0.8495
No log	2.5588	174	0.7328	0.6940	0.7328	0.8560
No log	2.5882	176	0.7889	0.6926	0.7889	0.8882
No log	2.6176	178	0.8189	0.6620	0.8189	0.9049
No log	2.6471	180	0.8457	0.6848	0.8457	0.9196
No log	2.6765	182	0.8217	0.6556	0.8217	0.9065
No log	2.7059	184	0.7084	0.6789	0.7084	0.8417
No log	2.7353	186	0.6788	0.6713	0.6788	0.8239
No log	2.7647	188	0.6735	0.6692	0.6735	0.8207
No log	2.7941	190	0.7425	0.6542	0.7425	0.8617
No log	2.8235	192	0.9127	0.5841	0.9127	0.9554
No log	2.8529	194	1.0059	0.5513	1.0059	1.0030
No log	2.8824	196	1.1348	0.5287	1.1348	1.0652
No log	2.9118	198	1.0478	0.5564	1.0478	1.0236
No log	2.9412	200	1.0495	0.5696	1.0495	1.0244
No log	2.9706	202	1.3545	0.4933	1.3545	1.1638
No log	3.0	204	1.4882	0.4539	1.4882	1.2199
No log	3.0294	206	1.2205	0.5040	1.2205	1.1047
No log	3.0588	208	0.8643	0.6043	0.8643	0.9297
No log	3.0882	210	0.7757	0.6530	0.7757	0.8807
No log	3.1176	212	0.8230	0.6345	0.8230	0.9072
No log	3.1471	214	0.9210	0.6027	0.9210	0.9597
No log	3.1765	216	1.0388	0.5801	1.0388	1.0192
No log	3.2059	218	0.9916	0.5992	0.9916	0.9958
No log	3.2353	220	0.8008	0.6704	0.8008	0.8949
No log	3.2647	222	0.7105	0.6826	0.7105	0.8429
No log	3.2941	224	0.7074	0.6950	0.7074	0.8410
No log	3.3235	226	0.7510	0.6886	0.7510	0.8666
No log	3.3529	228	0.8106	0.6765	0.8106	0.9003
No log	3.3824	230	0.7601	0.6830	0.7601	0.8718
No log	3.4118	232	0.7498	0.6878	0.7498	0.8659
No log	3.4412	234	0.8936	0.6237	0.8936	0.9453
No log	3.4706	236	0.9354	0.6020	0.9354	0.9672
No log	3.5	238	0.8145	0.6490	0.8145	0.9025
No log	3.5294	240	0.6839	0.6958	0.6839	0.8270
No log	3.5588	242	0.6493	0.7216	0.6493	0.8058
No log	3.5882	244	0.6707	0.7121	0.6707	0.8190
No log	3.6176	246	0.6928	0.7282	0.6928	0.8323
No log	3.6471	248	0.8330	0.6666	0.8330	0.9127
No log	3.6765	250	1.0887	0.5503	1.0887	1.0434
No log	3.7059	252	1.1435	0.5244	1.1435	1.0694
No log	3.7353	254	0.9802	0.5891	0.9802	0.9901
No log	3.7647	256	0.8869	0.6191	0.8869	0.9417
No log	3.7941	258	0.8428	0.6088	0.8428	0.9181
No log	3.8235	260	0.8189	0.6268	0.8189	0.9049
No log	3.8529	262	0.8580	0.6329	0.8580	0.9263
No log	3.8824	264	0.8476	0.6326	0.8476	0.9207
No log	3.9118	266	0.9938	0.5614	0.9938	0.9969
No log	3.9412	268	1.0824	0.5638	1.0824	1.0404
No log	3.9706	270	1.1241	0.5326	1.1241	1.0603
No log	4.0	272	0.9960	0.5671	0.9960	0.9980
No log	4.0294	274	0.8081	0.6444	0.8081	0.8989
No log	4.0588	276	0.6900	0.7116	0.6900	0.8306
No log	4.0882	278	0.7071	0.6891	0.7071	0.8409
No log	4.1176	280	0.7720	0.6810	0.7720	0.8787
No log	4.1471	282	0.8146	0.6609	0.8146	0.9025
No log	4.1765	284	0.8768	0.6023	0.8768	0.9364
No log	4.2059	286	0.8941	0.6072	0.8941	0.9456
No log	4.2353	288	0.9176	0.5976	0.9176	0.9579
No log	4.2647	290	0.9230	0.6459	0.9230	0.9607
No log	4.2941	292	0.8957	0.6528	0.8957	0.9464
No log	4.3235	294	0.8338	0.6641	0.8338	0.9131
No log	4.3529	296	0.9274	0.6399	0.9274	0.9630
No log	4.3824	298	1.3073	0.6093	1.3073	1.1434
No log	4.4118	300	1.7881	0.5185	1.7881	1.3372
No log	4.4412	302	1.9271	0.4684	1.9271	1.3882
No log	4.4706	304	1.5307	0.4834	1.5307	1.2372
No log	4.5	306	0.9399	0.5953	0.9399	0.9695
No log	4.5294	308	0.7190	0.6793	0.7190	0.8479
No log	4.5588	310	0.7117	0.6542	0.7117	0.8436
No log	4.5882	312	0.7872	0.6194	0.7872	0.8873
No log	4.6176	314	0.8469	0.5938	0.8469	0.9203
No log	4.6471	316	0.8195	0.6268	0.8195	0.9052
No log	4.6765	318	0.7021	0.6774	0.7021	0.8379
No log	4.7059	320	0.6645	0.6818	0.6645	0.8152
No log	4.7353	322	0.6831	0.6759	0.6831	0.8265
No log	4.7647	324	0.7041	0.6645	0.7041	0.8391
No log	4.7941	326	0.7814	0.6088	0.7814	0.8840
No log	4.8235	328	0.7765	0.5934	0.7765	0.8812
No log	4.8529	330	0.7302	0.5949	0.7302	0.8545
No log	4.8824	332	0.6776	0.6330	0.6776	0.8231
No log	4.9118	334	0.6602	0.6595	0.6602	0.8125
No log	4.9412	336	0.6866	0.6518	0.6866	0.8286
No log	4.9706	338	0.6804	0.6509	0.6804	0.8249
No log	5.0	340	0.6456	0.6584	0.6456	0.8035
No log	5.0294	342	0.6162	0.6540	0.6162	0.7850
No log	5.0588	344	0.6041	0.7373	0.6041	0.7772
No log	5.0882	346	0.6366	0.7384	0.6366	0.7979
No log	5.1176	348	0.6131	0.7433	0.6131	0.7830
No log	5.1471	350	0.5950	0.6860	0.5950	0.7714
No log	5.1765	352	0.6236	0.6424	0.6236	0.7897
No log	5.2059	354	0.6350	0.6400	0.6350	0.7969
No log	5.2353	356	0.6223	0.6476	0.6223	0.7889
No log	5.2647	358	0.6279	0.6455	0.6279	0.7924
No log	5.2941	360	0.6268	0.6403	0.6268	0.7917
No log	5.3235	362	0.6475	0.6113	0.6475	0.8046
No log	5.3529	364	0.7484	0.6353	0.7484	0.8651
No log	5.3824	366	0.7783	0.6062	0.7783	0.8822
No log	5.4118	368	0.7060	0.6094	0.7060	0.8403
No log	5.4412	370	0.6691	0.6307	0.6691	0.8180
No log	5.4706	372	0.6394	0.6524	0.6394	0.7996
No log	5.5	374	0.6459	0.6392	0.6459	0.8037
No log	5.5294	376	0.6623	0.6241	0.6623	0.8138
No log	5.5588	378	0.6564	0.6381	0.6564	0.8102
No log	5.5882	380	0.6433	0.6457	0.6433	0.8020
No log	5.6176	382	0.6130	0.6917	0.6130	0.7830
No log	5.6471	384	0.6311	0.7181	0.6311	0.7944
No log	5.6765	386	0.6284	0.7305	0.6284	0.7927
No log	5.7059	388	0.6096	0.7363	0.6096	0.7808
No log	5.7353	390	0.6240	0.6996	0.6240	0.7900
No log	5.7647	392	0.6514	0.6783	0.6514	0.8071
No log	5.7941	394	0.6289	0.6551	0.6289	0.7930
No log	5.8235	396	0.6259	0.6442	0.6259	0.7912
No log	5.8529	398	0.6826	0.6414	0.6826	0.8262
No log	5.8824	400	0.7816	0.6005	0.7816	0.8841
No log	5.9118	402	0.7846	0.5901	0.7846	0.8858
No log	5.9412	404	0.7107	0.6091	0.7107	0.8430
No log	5.9706	406	0.6704	0.6386	0.6704	0.8188
No log	6.0	408	0.6278	0.6929	0.6278	0.7924
No log	6.0294	410	0.6288	0.7145	0.6288	0.7930
No log	6.0588	412	0.6517	0.7005	0.6517	0.8073
No log	6.0882	414	0.7792	0.6647	0.7792	0.8827
No log	6.1176	416	0.9750	0.5998	0.9750	0.9874
No log	6.1471	418	0.9783	0.5824	0.9783	0.9891
No log	6.1765	420	0.8842	0.6082	0.8842	0.9403
No log	6.2059	422	0.7706	0.6470	0.7706	0.8778
No log	6.2353	424	0.6684	0.6361	0.6684	0.8176
No log	6.2647	426	0.6515	0.6562	0.6515	0.8071
No log	6.2941	428	0.6558	0.6401	0.6558	0.8098
No log	6.3235	430	0.6859	0.6405	0.6859	0.8282
No log	6.3529	432	0.7106	0.6385	0.7106	0.8429
No log	6.3824	434	0.6920	0.6587	0.6920	0.8319
No log	6.4118	436	0.6825	0.6771	0.6825	0.8261
No log	6.4412	438	0.6943	0.6665	0.6943	0.8332
No log	6.4706	440	0.6806	0.7032	0.6806	0.8250
No log	6.5	442	0.6882	0.7032	0.6882	0.8296
No log	6.5294	444	0.6804	0.7045	0.6804	0.8248
No log	6.5588	446	0.6485	0.7246	0.6485	0.8053
No log	6.5882	448	0.6902	0.6898	0.6902	0.8308
No log	6.6176	450	0.8566	0.6360	0.8566	0.9255
No log	6.6471	452	1.0872	0.5674	1.0872	1.0427
No log	6.6765	454	1.3179	0.5270	1.3179	1.1480
No log	6.7059	456	1.2724	0.5295	1.2724	1.1280
No log	6.7353	458	1.0977	0.5467	1.0977	1.0477
No log	6.7647	460	0.9230	0.6084	0.9230	0.9607
No log	6.7941	462	0.9042	0.6099	0.9042	0.9509
No log	6.8235	464	0.9500	0.6039	0.9500	0.9747
No log	6.8529	466	1.1016	0.5547	1.1016	1.0496
No log	6.8824	468	1.1316	0.5158	1.1316	1.0638
No log	6.9118	470	1.0457	0.5397	1.0457	1.0226
No log	6.9412	472	0.8711	0.5821	0.8711	0.9333
No log	6.9706	474	0.7641	0.6465	0.7641	0.8741
No log	7.0	476	0.7490	0.6515	0.7490	0.8654
No log	7.0294	478	0.8610	0.6142	0.8610	0.9279
No log	7.0588	480	1.0235	0.6166	1.0235	1.0117
No log	7.0882	482	0.9811	0.6174	0.9811	0.9905
No log	7.1176	484	0.8255	0.6344	0.8255	0.9086
No log	7.1471	486	0.7187	0.6804	0.7187	0.8477
No log	7.1765	488	0.7042	0.6825	0.7042	0.8392
No log	7.2059	490	0.7618	0.6233	0.7618	0.8728
No log	7.2353	492	0.9067	0.5871	0.9067	0.9522
No log	7.2647	494	1.1076	0.5430	1.1076	1.0524
No log	7.2941	496	1.1349	0.5161	1.1349	1.0653
No log	7.3235	498	0.9750	0.5743	0.9750	0.9874
0.4478	7.3529	500	0.8017	0.6389	0.8017	0.8954
0.4478	7.3824	502	0.7102	0.6786	0.7102	0.8427
0.4478	7.4118	504	0.7020	0.6703	0.7020	0.8378
0.4478	7.4412	506	0.7718	0.6399	0.7718	0.8785
0.4478	7.4706	508	0.8908	0.6461	0.8908	0.9438
0.4478	7.5	510	0.9216	0.6493	0.9216	0.9600
0.4478	7.5294	512	0.8640	0.6224	0.8640	0.9295
0.4478	7.5588	514	0.8101	0.6216	0.8101	0.9001
0.4478	7.5882	516	0.7982	0.6284	0.7982	0.8934
0.4478	7.6176	518	0.8096	0.6043	0.8096	0.8998
0.4478	7.6471	520	0.8545	0.6017	0.8545	0.9244

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1