ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6143
• Qwk: 0.5614
• Mse: 0.6143
• Rmse: 0.7838

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0208	2	4.3370	-0.0160	4.3370	2.0825
No log	0.0417	4	2.5650	-0.0155	2.5650	1.6016
No log	0.0625	6	1.7238	-0.0327	1.7238	1.3129
No log	0.0833	8	2.0218	0.0719	2.0218	1.4219
No log	0.1042	10	1.3999	0.0568	1.3999	1.1832
No log	0.125	12	1.1887	0.1296	1.1887	1.0903
No log	0.1458	14	1.4666	0.0232	1.4666	1.2110
No log	0.1667	16	1.5185	-0.0107	1.5185	1.2323
No log	0.1875	18	1.3140	0.0523	1.3140	1.1463
No log	0.2083	20	1.0511	0.1918	1.0511	1.0252
No log	0.2292	22	1.0005	0.3310	1.0005	1.0003
No log	0.25	24	1.0144	0.2288	1.0144	1.0072
No log	0.2708	26	1.0428	0.2042	1.0428	1.0212
No log	0.2917	28	1.0520	0.2441	1.0520	1.0256
No log	0.3125	30	1.1242	0.1361	1.1242	1.0603
No log	0.3333	32	1.2038	0.0287	1.2038	1.0972
No log	0.3542	34	1.2166	0.0201	1.2166	1.1030
No log	0.375	36	1.1680	0.1205	1.1680	1.0808
No log	0.3958	38	1.0380	0.2268	1.0380	1.0188
No log	0.4167	40	0.9972	0.2873	0.9972	0.9986
No log	0.4375	42	0.9840	0.3025	0.9840	0.9920
No log	0.4583	44	0.9861	0.2811	0.9861	0.9930
No log	0.4792	46	1.1135	0.1858	1.1135	1.0552
No log	0.5	48	1.1679	0.1233	1.1679	1.0807
No log	0.5208	50	1.1970	0.0996	1.1970	1.0941
No log	0.5417	52	1.0729	0.1884	1.0729	1.0358
No log	0.5625	54	0.9267	0.3583	0.9267	0.9626
No log	0.5833	56	0.8768	0.2667	0.8768	0.9364
No log	0.6042	58	0.9247	0.2873	0.9247	0.9616
No log	0.625	60	1.0027	0.1918	1.0027	1.0013
No log	0.6458	62	1.0120	0.2066	1.0120	1.0060
No log	0.6667	64	0.9266	0.2865	0.9266	0.9626
No log	0.6875	66	0.8664	0.2791	0.8664	0.9308
No log	0.7083	68	0.9006	0.3330	0.9006	0.9490
No log	0.7292	70	0.8855	0.3824	0.8855	0.9410
No log	0.75	72	0.8423	0.3958	0.8423	0.9178
No log	0.7708	74	0.7556	0.4660	0.7556	0.8693
No log	0.7917	76	0.7273	0.4151	0.7273	0.8528
No log	0.8125	78	0.7372	0.3713	0.7372	0.8586
No log	0.8333	80	0.8594	0.4248	0.8594	0.9270
No log	0.8542	82	0.7742	0.4285	0.7742	0.8799
No log	0.875	84	0.7484	0.3896	0.7484	0.8651
No log	0.8958	86	0.7342	0.4388	0.7342	0.8568
No log	0.9167	88	0.7617	0.4862	0.7617	0.8728
No log	0.9375	90	0.9026	0.4879	0.9026	0.9501
No log	0.9583	92	0.8388	0.5265	0.8388	0.9159
No log	0.9792	94	0.7081	0.4903	0.7081	0.8415
No log	1.0	96	0.7392	0.4941	0.7392	0.8598
No log	1.0208	98	0.7092	0.4903	0.7092	0.8421
No log	1.0417	100	0.7376	0.5088	0.7376	0.8588
No log	1.0625	102	0.7049	0.5463	0.7049	0.8396
No log	1.0833	104	0.6670	0.5415	0.6670	0.8167
No log	1.1042	106	0.6886	0.4826	0.6886	0.8298
No log	1.125	108	0.6578	0.5259	0.6578	0.8111
No log	1.1458	110	0.8346	0.5320	0.8346	0.9135
No log	1.1667	112	1.0035	0.4096	1.0035	1.0017
No log	1.1875	114	1.1536	0.4215	1.1536	1.0740
No log	1.2083	116	1.0438	0.4084	1.0438	1.0217
No log	1.2292	118	0.8475	0.3785	0.8475	0.9206
No log	1.25	120	0.8139	0.4041	0.8139	0.9022
No log	1.2708	122	0.8212	0.3921	0.8212	0.9062
No log	1.2917	124	0.8737	0.3954	0.8737	0.9347
No log	1.3125	126	0.8179	0.4186	0.8179	0.9044
No log	1.3333	128	0.7928	0.4713	0.7928	0.8904
No log	1.3542	130	0.7861	0.4494	0.7861	0.8866
No log	1.375	132	0.8133	0.4192	0.8133	0.9019
No log	1.3958	134	0.9515	0.3847	0.9515	0.9754
No log	1.4167	136	1.0010	0.4201	1.0010	1.0005
No log	1.4375	138	0.8510	0.4065	0.8510	0.9225
No log	1.4583	140	0.7094	0.5003	0.7094	0.8422
No log	1.4792	142	0.6877	0.5316	0.6877	0.8292
No log	1.5	144	0.6581	0.5796	0.6581	0.8112
No log	1.5208	146	0.6508	0.6165	0.6508	0.8067
No log	1.5417	148	0.6959	0.5504	0.6959	0.8342
No log	1.5625	150	0.6709	0.5666	0.6709	0.8191
No log	1.5833	152	0.6331	0.5786	0.6331	0.7957
No log	1.6042	154	0.6203	0.6286	0.6203	0.7876
No log	1.625	156	0.6656	0.5192	0.6656	0.8158
No log	1.6458	158	0.6792	0.5498	0.6792	0.8241
No log	1.6667	160	0.6768	0.5898	0.6768	0.8227
No log	1.6875	162	0.6445	0.5505	0.6445	0.8028
No log	1.7083	164	0.6591	0.5510	0.6591	0.8118
No log	1.7292	166	0.6214	0.6123	0.6214	0.7883
No log	1.75	168	0.6256	0.6143	0.6256	0.7909
No log	1.7708	170	0.6889	0.5395	0.6889	0.8300
No log	1.7917	172	0.7019	0.5858	0.7019	0.8378
No log	1.8125	174	0.6735	0.5894	0.6735	0.8207
No log	1.8333	176	0.6420	0.6067	0.6420	0.8013
No log	1.8542	178	0.6581	0.5902	0.6581	0.8112
No log	1.875	180	0.6446	0.6217	0.6446	0.8029
No log	1.8958	182	0.6394	0.5939	0.6394	0.7996
No log	1.9167	184	0.6456	0.5928	0.6456	0.8035
No log	1.9375	186	0.6819	0.5837	0.6819	0.8258
No log	1.9583	188	0.8502	0.5902	0.8502	0.9221
No log	1.9792	190	1.0694	0.4145	1.0694	1.0341
No log	2.0	192	1.0673	0.3830	1.0673	1.0331
No log	2.0208	194	0.8616	0.5588	0.8616	0.9282
No log	2.0417	196	0.7016	0.4692	0.7016	0.8376
No log	2.0625	198	0.6916	0.4914	0.6916	0.8316
No log	2.0833	200	0.6935	0.4692	0.6935	0.8328
No log	2.1042	202	0.6926	0.4456	0.6926	0.8322
No log	2.125	204	0.7447	0.4947	0.7447	0.8629
No log	2.1458	206	0.8705	0.5006	0.8705	0.9330
No log	2.1667	208	0.8125	0.5086	0.8125	0.9014
No log	2.1875	210	0.6781	0.5145	0.6781	0.8235
No log	2.2083	212	0.6360	0.5635	0.6360	0.7975
No log	2.2292	214	0.6522	0.5593	0.6522	0.8076
No log	2.25	216	0.6618	0.5811	0.6618	0.8135
No log	2.2708	218	0.6718	0.5642	0.6718	0.8196
No log	2.2917	220	0.6281	0.6063	0.6281	0.7925
No log	2.3125	222	0.5929	0.6311	0.5929	0.7700
No log	2.3333	224	0.5803	0.6772	0.5803	0.7617
No log	2.3542	226	0.6000	0.6347	0.6000	0.7746
No log	2.375	228	0.6494	0.5654	0.6494	0.8058
No log	2.3958	230	0.6217	0.5810	0.6217	0.7885
No log	2.4167	232	0.6290	0.5459	0.6290	0.7931
No log	2.4375	234	0.6353	0.5112	0.6353	0.7971
No log	2.4583	236	0.6003	0.5747	0.6003	0.7748
No log	2.4792	238	0.6333	0.5992	0.6333	0.7958
No log	2.5	240	0.6102	0.6045	0.6102	0.7811
No log	2.5208	242	0.5786	0.6518	0.5786	0.7607
No log	2.5417	244	0.6980	0.5902	0.6980	0.8355
No log	2.5625	246	0.7803	0.5488	0.7803	0.8833
No log	2.5833	248	0.6876	0.6182	0.6876	0.8292
No log	2.6042	250	0.7215	0.6084	0.7215	0.8494
No log	2.625	252	0.7390	0.5891	0.7390	0.8596
No log	2.6458	254	0.7085	0.6014	0.7085	0.8417
No log	2.6667	256	0.6790	0.5770	0.6790	0.8240
No log	2.6875	258	0.7206	0.5805	0.7206	0.8489
No log	2.7083	260	0.8137	0.5701	0.8137	0.9021
No log	2.7292	262	0.6985	0.5565	0.6985	0.8358
No log	2.75	264	0.6203	0.6185	0.6203	0.7876
No log	2.7708	266	0.6347	0.5894	0.6347	0.7967
No log	2.7917	268	0.6460	0.6167	0.6460	0.8037
No log	2.8125	270	0.6647	0.6157	0.6647	0.8153
No log	2.8333	272	0.6096	0.6499	0.6096	0.7808
No log	2.8542	274	0.5757	0.6405	0.5757	0.7587
No log	2.875	276	0.5735	0.6564	0.5735	0.7573
No log	2.8958	278	0.5711	0.6564	0.5711	0.7557
No log	2.9167	280	0.5726	0.6564	0.5726	0.7567
No log	2.9375	282	0.5938	0.6598	0.5938	0.7706
No log	2.9583	284	0.6287	0.5794	0.6287	0.7929
No log	2.9792	286	0.6196	0.5955	0.6196	0.7871
No log	3.0	288	0.6195	0.6014	0.6195	0.7871
No log	3.0208	290	0.6301	0.6014	0.6301	0.7938
No log	3.0417	292	0.6359	0.5797	0.6359	0.7975
No log	3.0625	294	0.6381	0.5274	0.6381	0.7988
No log	3.0833	296	0.6375	0.5048	0.6375	0.7984
No log	3.1042	298	0.6207	0.5510	0.6207	0.7878
No log	3.125	300	0.6086	0.5822	0.6086	0.7801
No log	3.1458	302	0.6193	0.5666	0.6193	0.7870
No log	3.1667	304	0.6608	0.5593	0.6608	0.8129
No log	3.1875	306	0.7051	0.5711	0.7051	0.8397
No log	3.2083	308	0.6858	0.5721	0.6858	0.8281
No log	3.2292	310	0.5951	0.6076	0.5951	0.7714
No log	3.25	312	0.5987	0.5891	0.5987	0.7738
No log	3.2708	314	0.6116	0.5316	0.6116	0.7820
No log	3.2917	316	0.6472	0.5855	0.6472	0.8045
No log	3.3125	318	0.6624	0.5731	0.6624	0.8139
No log	3.3333	320	0.6400	0.6081	0.6400	0.8000
No log	3.3542	322	0.5966	0.5871	0.5966	0.7724
No log	3.375	324	0.5996	0.5996	0.5996	0.7744
No log	3.3958	326	0.6096	0.6396	0.6096	0.7808
No log	3.4167	328	0.6083	0.5700	0.6083	0.7799
No log	3.4375	330	0.6262	0.5605	0.6262	0.7913
No log	3.4583	332	0.6301	0.5273	0.6301	0.7938
No log	3.4792	334	0.6334	0.5018	0.6334	0.7959
No log	3.5	336	0.6296	0.5631	0.6296	0.7935
No log	3.5208	338	0.6480	0.5428	0.6480	0.8050
No log	3.5417	340	0.6947	0.4626	0.6947	0.8335
No log	3.5625	342	0.7398	0.4763	0.7398	0.8601
No log	3.5833	344	0.6842	0.4721	0.6842	0.8271
No log	3.6042	346	0.6584	0.5822	0.6584	0.8114
No log	3.625	348	0.6702	0.5318	0.6702	0.8187
No log	3.6458	350	0.6693	0.5245	0.6693	0.8181
No log	3.6667	352	0.6774	0.5011	0.6774	0.8231
No log	3.6875	354	0.6718	0.5259	0.6718	0.8196
No log	3.7083	356	0.6588	0.5245	0.6588	0.8117
No log	3.7292	358	0.6303	0.4624	0.6303	0.7939
No log	3.75	360	0.6187	0.5171	0.6187	0.7866
No log	3.7708	362	0.6296	0.5450	0.6296	0.7934
No log	3.7917	364	0.6510	0.5450	0.6510	0.8068
No log	3.8125	366	0.6746	0.6272	0.6746	0.8213
No log	3.8333	368	0.6848	0.6161	0.6848	0.8275
No log	3.8542	370	0.6782	0.5451	0.6782	0.8235
No log	3.875	372	0.6468	0.6107	0.6468	0.8042
No log	3.8958	374	0.6734	0.5815	0.6734	0.8206
No log	3.9167	376	0.7458	0.5357	0.7458	0.8636
No log	3.9375	378	0.6931	0.5640	0.6931	0.8325
No log	3.9583	380	0.6609	0.5662	0.6609	0.8130
No log	3.9792	382	0.6395	0.5450	0.6395	0.7997
No log	4.0	384	0.6258	0.5450	0.6258	0.7911
No log	4.0208	386	0.6562	0.5384	0.6562	0.8101
No log	4.0417	388	0.7024	0.5270	0.7024	0.8381
No log	4.0625	390	0.7077	0.5387	0.7077	0.8413
No log	4.0833	392	0.6416	0.5667	0.6416	0.8010
No log	4.1042	394	0.6406	0.5873	0.6406	0.8004
No log	4.125	396	0.7150	0.5581	0.7150	0.8455
No log	4.1458	398	0.6967	0.5781	0.6967	0.8347
No log	4.1667	400	0.6214	0.6466	0.6214	0.7883
No log	4.1875	402	0.6028	0.6228	0.6028	0.7764
No log	4.2083	404	0.6186	0.6466	0.6186	0.7865
No log	4.2292	406	0.6481	0.6248	0.6481	0.8051
No log	4.25	408	0.6509	0.6140	0.6509	0.8068
No log	4.2708	410	0.6887	0.6130	0.6887	0.8299
No log	4.2917	412	0.7338	0.5664	0.7338	0.8566
No log	4.3125	414	0.7955	0.5186	0.7955	0.8919
No log	4.3333	416	0.8442	0.48	0.8442	0.9188
No log	4.3542	418	0.7289	0.5180	0.7289	0.8537
No log	4.375	420	0.5991	0.6139	0.5991	0.7740
No log	4.3958	422	0.5886	0.5556	0.5886	0.7672
No log	4.4167	424	0.6254	0.6139	0.6254	0.7908
No log	4.4375	426	0.6439	0.5988	0.6439	0.8024
No log	4.4583	428	0.6824	0.6215	0.6824	0.8261
No log	4.4792	430	0.6942	0.5536	0.6942	0.8332
No log	4.5	432	0.7167	0.5451	0.7167	0.8466
No log	4.5208	434	0.6327	0.5809	0.6327	0.7954
No log	4.5417	436	0.6426	0.5642	0.6426	0.8016
No log	4.5625	438	0.7076	0.5266	0.7076	0.8412
No log	4.5833	440	0.6732	0.5521	0.6732	0.8205
No log	4.6042	442	0.6317	0.5042	0.6317	0.7948
No log	4.625	444	0.6669	0.5491	0.6669	0.8167
No log	4.6458	446	0.6589	0.5491	0.6589	0.8117
No log	4.6667	448	0.6350	0.5317	0.6350	0.7969
No log	4.6875	450	0.6218	0.5653	0.6218	0.7885
No log	4.7083	452	0.6237	0.5509	0.6237	0.7897
No log	4.7292	454	0.6251	0.6255	0.6251	0.7906
No log	4.75	456	0.6026	0.6646	0.6026	0.7763
No log	4.7708	458	0.5782	0.5690	0.5782	0.7604
No log	4.7917	460	0.5986	0.4958	0.5986	0.7737
No log	4.8125	462	0.6021	0.5469	0.6021	0.7759
No log	4.8333	464	0.5839	0.5926	0.5839	0.7642
No log	4.8542	466	0.5909	0.6014	0.5909	0.7687
No log	4.875	468	0.5973	0.5894	0.5973	0.7728
No log	4.8958	470	0.5934	0.5859	0.5934	0.7703
No log	4.9167	472	0.6312	0.5477	0.6312	0.7945
No log	4.9375	474	0.6257	0.5716	0.6257	0.7910
No log	4.9583	476	0.6200	0.5469	0.6200	0.7874
No log	4.9792	478	0.6294	0.5469	0.6294	0.7933
No log	5.0	480	0.6232	0.4925	0.6232	0.7894
No log	5.0208	482	0.6172	0.4764	0.6172	0.7856
No log	5.0417	484	0.6064	0.5127	0.6064	0.7787
No log	5.0625	486	0.5915	0.5577	0.5915	0.7691
No log	5.0833	488	0.5845	0.6695	0.5845	0.7645
No log	5.1042	490	0.5793	0.6695	0.5793	0.7611
No log	5.125	492	0.6043	0.5948	0.6043	0.7774
No log	5.1458	494	0.6114	0.5740	0.6114	0.7819
No log	5.1667	496	0.5883	0.6102	0.5883	0.7670
No log	5.1875	498	0.5859	0.6681	0.5859	0.7654
0.3091	5.2083	500	0.5802	0.6354	0.5802	0.7617
0.3091	5.2292	502	0.5783	0.6849	0.5783	0.7605
0.3091	5.25	504	0.6198	0.5822	0.6198	0.7872
0.3091	5.2708	506	0.6640	0.6015	0.6640	0.8149
0.3091	5.2917	508	0.6653	0.6015	0.6653	0.8157
0.3091	5.3125	510	0.5866	0.6361	0.5866	0.7659
0.3091	5.3333	512	0.5628	0.6610	0.5628	0.7502
0.3091	5.3542	514	0.5720	0.6770	0.5720	0.7563
0.3091	5.375	516	0.5597	0.6849	0.5597	0.7481
0.3091	5.3958	518	0.6029	0.5938	0.6029	0.7765
0.3091	5.4167	520	0.6383	0.5822	0.6383	0.7990
0.3091	5.4375	522	0.5999	0.5408	0.5999	0.7745
0.3091	5.4583	524	0.5975	0.5728	0.5975	0.7730
0.3091	5.4792	526	0.6143	0.5614	0.6143	0.7838

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1