ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6897
• Qwk: 0.4461
• Mse: 0.6897
• Rmse: 0.8305

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	3.8491	0.0078	3.8491	1.9619
No log	0.0851	4	1.9839	-0.0055	1.9839	1.4085
No log	0.1277	6	1.2116	0.1296	1.2116	1.1007
No log	0.1702	8	1.0591	0.1864	1.0591	1.0291
No log	0.2128	10	1.0512	0.2108	1.0512	1.0253
No log	0.2553	12	1.0647	0.2697	1.0647	1.0319
No log	0.2979	14	1.0710	0.2239	1.0710	1.0349
No log	0.3404	16	1.1226	0.2687	1.1226	1.0595
No log	0.3830	18	1.0607	0.2171	1.0607	1.0299
No log	0.4255	20	1.0876	0.1537	1.0876	1.0429
No log	0.4681	22	1.0053	0.2591	1.0053	1.0026
No log	0.5106	24	0.9818	0.2746	0.9818	0.9909
No log	0.5532	26	0.9818	0.2746	0.9818	0.9908
No log	0.5957	28	1.0091	0.2366	1.0091	1.0045
No log	0.6383	30	1.0449	0.1752	1.0449	1.0222
No log	0.6809	32	0.9882	0.1370	0.9882	0.9941
No log	0.7234	34	1.0127	0.1603	1.0127	1.0063
No log	0.7660	36	1.0831	0.2733	1.0831	1.0407
No log	0.8085	38	1.0059	0.1333	1.0059	1.0030
No log	0.8511	40	0.9376	0.2316	0.9376	0.9683
No log	0.8936	42	0.9310	0.2217	0.9310	0.9649
No log	0.9362	44	0.9800	0.3208	0.9800	0.9900
No log	0.9787	46	1.0542	0.3250	1.0542	1.0268
No log	1.0213	48	1.2325	0.2062	1.2325	1.1102
No log	1.0638	50	1.0388	0.3229	1.0388	1.0192
No log	1.1064	52	0.8993	0.2094	0.8993	0.9483
No log	1.1489	54	0.9053	0.2541	0.9053	0.9514
No log	1.1915	56	0.8753	0.2991	0.8753	0.9356
No log	1.2340	58	1.0055	0.3073	1.0055	1.0028
No log	1.2766	60	0.9409	0.3149	0.9409	0.9700
No log	1.3191	62	0.9007	0.3332	0.9007	0.9490
No log	1.3617	64	0.9056	0.4025	0.9056	0.9516
No log	1.4043	66	0.9344	0.3185	0.9344	0.9666
No log	1.4468	68	0.8878	0.3348	0.8878	0.9422
No log	1.4894	70	1.0402	0.2377	1.0402	1.0199
No log	1.5319	72	1.2262	0.1138	1.2262	1.1073
No log	1.5745	74	1.1389	0.0883	1.1389	1.0672
No log	1.6170	76	0.9099	0.3570	0.9099	0.9539
No log	1.6596	78	0.8686	0.3797	0.8686	0.9320
No log	1.7021	80	0.8647	0.3922	0.8647	0.9299
No log	1.7447	82	0.8059	0.4398	0.8059	0.8977
No log	1.7872	84	0.8068	0.4903	0.8068	0.8982
No log	1.8298	86	0.8120	0.5010	0.8120	0.9011
No log	1.8723	88	0.8633	0.4954	0.8633	0.9291
No log	1.9149	90	0.8317	0.4854	0.8317	0.9120
No log	1.9574	92	0.8821	0.4197	0.8821	0.9392
No log	2.0	94	0.9535	0.3434	0.9535	0.9765
No log	2.0426	96	0.9760	0.3434	0.9760	0.9879
No log	2.0851	98	0.8219	0.5590	0.8219	0.9066
No log	2.1277	100	1.0421	0.4206	1.0421	1.0208
No log	2.1702	102	0.9248	0.3595	0.9248	0.9617
No log	2.2128	104	0.8977	0.4371	0.8977	0.9475
No log	2.2553	106	1.2028	0.3111	1.2028	1.0967
No log	2.2979	108	1.0771	0.3139	1.0771	1.0378
No log	2.3404	110	0.7952	0.5197	0.7952	0.8917
No log	2.3830	112	0.8714	0.4782	0.8714	0.9335
No log	2.4255	114	0.8150	0.4418	0.8150	0.9028
No log	2.4681	116	0.8137	0.4943	0.8137	0.9020
No log	2.5106	118	1.0058	0.3452	1.0058	1.0029
No log	2.5532	120	0.8761	0.4228	0.8761	0.9360
No log	2.5957	122	0.7509	0.5989	0.7509	0.8665
No log	2.6383	124	0.7549	0.4838	0.7549	0.8688
No log	2.6809	126	0.7414	0.6001	0.7414	0.8610
No log	2.7234	128	0.8235	0.4607	0.8235	0.9075
No log	2.7660	130	1.0206	0.4333	1.0206	1.0102
No log	2.8085	132	0.8760	0.4708	0.8760	0.9360
No log	2.8511	134	0.7879	0.5155	0.7879	0.8877
No log	2.8936	136	0.7784	0.5459	0.7784	0.8823
No log	2.9362	138	0.8161	0.5267	0.8161	0.9034
No log	2.9787	140	0.8903	0.5025	0.8903	0.9435
No log	3.0213	142	0.8012	0.4965	0.8012	0.8951
No log	3.0638	144	0.8999	0.4584	0.8999	0.9486
No log	3.1064	146	0.8626	0.4252	0.8626	0.9288
No log	3.1489	148	0.7887	0.4503	0.7887	0.8881
No log	3.1915	150	0.8344	0.4907	0.8344	0.9135
No log	3.2340	152	0.7222	0.5784	0.7222	0.8498
No log	3.2766	154	0.9646	0.4700	0.9646	0.9821
No log	3.3191	156	1.1427	0.3744	1.1427	1.0690
No log	3.3617	158	0.9755	0.4470	0.9755	0.9877
No log	3.4043	160	0.7155	0.5345	0.7155	0.8459
No log	3.4468	162	0.7690	0.5292	0.7690	0.8770
No log	3.4894	164	0.7699	0.5416	0.7699	0.8775
No log	3.5319	166	0.7026	0.5914	0.7026	0.8382
No log	3.5745	168	0.7270	0.5103	0.7270	0.8526
No log	3.6170	170	0.7654	0.5446	0.7654	0.8749
No log	3.6596	172	0.7109	0.5934	0.7109	0.8431
No log	3.7021	174	0.9461	0.4307	0.9461	0.9727
No log	3.7447	176	1.3446	0.3637	1.3446	1.1596
No log	3.7872	178	1.2802	0.3879	1.2802	1.1315
No log	3.8298	180	1.0028	0.4270	1.0028	1.0014
No log	3.8723	182	0.7885	0.5820	0.7885	0.8880
No log	3.9149	184	0.7763	0.5197	0.7763	0.8811
No log	3.9574	186	0.7676	0.5820	0.7676	0.8761
No log	4.0	188	0.9195	0.4799	0.9195	0.9589
No log	4.0426	190	0.9511	0.4898	0.9511	0.9752
No log	4.0851	192	0.8273	0.4268	0.8273	0.9096
No log	4.1277	194	0.7395	0.5928	0.7395	0.8599
No log	4.1702	196	0.7430	0.5517	0.7430	0.8620
No log	4.2128	198	0.7870	0.4780	0.7870	0.8871
No log	4.2553	200	0.7524	0.5174	0.7524	0.8674
No log	4.2979	202	0.7932	0.5065	0.7932	0.8906
No log	4.3404	204	0.8017	0.4711	0.8017	0.8954
No log	4.3830	206	0.7782	0.4957	0.7782	0.8822
No log	4.4255	208	0.8824	0.4240	0.8824	0.9394
No log	4.4681	210	0.8380	0.4777	0.8380	0.9154
No log	4.5106	212	0.8377	0.4956	0.8377	0.9152
No log	4.5532	214	0.9615	0.4577	0.9615	0.9805
No log	4.5957	216	0.9407	0.4489	0.9407	0.9699
No log	4.6383	218	0.8517	0.4875	0.8517	0.9229
No log	4.6809	220	0.8380	0.4721	0.8380	0.9154
No log	4.7234	222	0.8107	0.4563	0.8107	0.9004
No log	4.7660	224	0.8327	0.4712	0.8327	0.9125
No log	4.8085	226	0.8710	0.4710	0.8710	0.9333
No log	4.8511	228	0.8129	0.4711	0.8129	0.9016
No log	4.8936	230	0.7663	0.4629	0.7663	0.8754
No log	4.9362	232	0.7420	0.5644	0.7420	0.8614
No log	4.9787	234	0.7350	0.5856	0.7350	0.8573
No log	5.0213	236	0.7453	0.5648	0.7453	0.8633
No log	5.0638	238	0.7504	0.5314	0.7504	0.8663
No log	5.1064	240	0.7519	0.5451	0.7519	0.8671
No log	5.1489	242	0.7843	0.5291	0.7843	0.8856
No log	5.1915	244	0.8316	0.5736	0.8316	0.9119
No log	5.2340	246	0.7933	0.5603	0.7933	0.8907
No log	5.2766	248	0.7596	0.5534	0.7596	0.8716
No log	5.3191	250	0.7414	0.5840	0.7414	0.8611
No log	5.3617	252	0.7297	0.5863	0.7297	0.8542
No log	5.4043	254	0.7356	0.5843	0.7356	0.8577
No log	5.4468	256	0.7385	0.6164	0.7385	0.8593
No log	5.4894	258	0.7993	0.4518	0.7993	0.8940
No log	5.5319	260	1.0543	0.3787	1.0543	1.0268
No log	5.5745	262	1.0755	0.3416	1.0755	1.0371
No log	5.6170	264	0.8960	0.5256	0.8960	0.9466
No log	5.6596	266	0.8437	0.5030	0.8437	0.9185
No log	5.7021	268	0.8287	0.4784	0.8287	0.9103
No log	5.7447	270	0.8784	0.4247	0.8784	0.9372
No log	5.7872	272	0.9107	0.4020	0.9107	0.9543
No log	5.8298	274	0.8323	0.4385	0.8323	0.9123
No log	5.8723	276	0.8309	0.5199	0.8309	0.9115
No log	5.9149	278	0.8502	0.4962	0.8502	0.9221
No log	5.9574	280	0.8098	0.5030	0.8098	0.8999
No log	6.0	282	0.9320	0.4492	0.9320	0.9654
No log	6.0426	284	1.0049	0.4706	1.0049	1.0024
No log	6.0851	286	0.9055	0.4947	0.9055	0.9516
No log	6.1277	288	0.8118	0.5416	0.8118	0.9010
No log	6.1702	290	0.8045	0.5406	0.8045	0.8970
No log	6.2128	292	0.8934	0.4181	0.8934	0.9452
No log	6.2553	294	0.8257	0.5455	0.8257	0.9087
No log	6.2979	296	0.7724	0.4676	0.7724	0.8789
No log	6.3404	298	0.7961	0.4522	0.7961	0.8922
No log	6.3830	300	0.7969	0.4768	0.7969	0.8927
No log	6.4255	302	0.7999	0.5030	0.7999	0.8944
No log	6.4681	304	0.8888	0.4603	0.8888	0.9428
No log	6.5106	306	0.9307	0.4206	0.9307	0.9647
No log	6.5532	308	0.8644	0.5233	0.8644	0.9297
No log	6.5957	310	0.7594	0.5396	0.7594	0.8714
No log	6.6383	312	0.7575	0.5315	0.7575	0.8704
No log	6.6809	314	0.7513	0.4916	0.7513	0.8668
No log	6.7234	316	0.8016	0.5770	0.8016	0.8953
No log	6.7660	318	0.9643	0.3283	0.9643	0.9820
No log	6.8085	320	0.9443	0.4081	0.9443	0.9717
No log	6.8511	322	0.7751	0.5409	0.7751	0.8804
No log	6.8936	324	0.7839	0.5390	0.7839	0.8854
No log	6.9362	326	0.7731	0.5392	0.7731	0.8792
No log	6.9787	328	0.7336	0.5396	0.7336	0.8565
No log	7.0213	330	0.7526	0.5328	0.7526	0.8675
No log	7.0638	332	0.8073	0.5480	0.8073	0.8985
No log	7.1064	334	0.7826	0.5357	0.7826	0.8846
No log	7.1489	336	0.7049	0.5868	0.7049	0.8396
No log	7.1915	338	0.6939	0.5626	0.6939	0.8330
No log	7.2340	340	0.6958	0.5626	0.6958	0.8342
No log	7.2766	342	0.7119	0.5795	0.7119	0.8437
No log	7.3191	344	0.7181	0.5795	0.7181	0.8474
No log	7.3617	346	0.7268	0.5795	0.7268	0.8526
No log	7.4043	348	0.7244	0.4787	0.7244	0.8511
No log	7.4468	350	0.7900	0.4926	0.7900	0.8888
No log	7.4894	352	0.7780	0.4926	0.7780	0.8820
No log	7.5319	354	0.7222	0.4898	0.7222	0.8498
No log	7.5745	356	0.7463	0.5581	0.7463	0.8639
No log	7.6170	358	0.7204	0.5669	0.7204	0.8488
No log	7.6596	360	0.7369	0.5220	0.7369	0.8585
No log	7.7021	362	0.7745	0.4724	0.7745	0.8801
No log	7.7447	364	0.8043	0.4606	0.8043	0.8968
No log	7.7872	366	0.7639	0.4522	0.7639	0.8740
No log	7.8298	368	0.7380	0.5644	0.7380	0.8591
No log	7.8723	370	0.7318	0.5859	0.7318	0.8554
No log	7.9149	372	0.7232	0.5610	0.7232	0.8504
No log	7.9574	374	0.7149	0.5859	0.7149	0.8455
No log	8.0	376	0.7088	0.5859	0.7088	0.8419
No log	8.0426	378	0.7053	0.5590	0.7053	0.8398
No log	8.0851	380	0.6913	0.5622	0.6913	0.8314
No log	8.1277	382	0.7314	0.5794	0.7314	0.8552
No log	8.1702	384	0.7288	0.5554	0.7288	0.8537
No log	8.2128	386	0.7236	0.5843	0.7236	0.8507
No log	8.2553	388	0.7247	0.5843	0.7247	0.8513
No log	8.2979	390	0.7271	0.5534	0.7271	0.8527
No log	8.3404	392	0.7768	0.5628	0.7768	0.8814
No log	8.3830	394	0.7865	0.5328	0.7865	0.8868
No log	8.4255	396	0.7332	0.5352	0.7332	0.8563
No log	8.4681	398	0.6972	0.5885	0.6972	0.8350
No log	8.5106	400	0.6503	0.6157	0.6503	0.8064
No log	8.5532	402	0.6327	0.6770	0.6327	0.7954
No log	8.5957	404	0.6322	0.6625	0.6322	0.7951
No log	8.6383	406	0.6521	0.5894	0.6521	0.8075
No log	8.6809	408	0.6757	0.5894	0.6757	0.8220
No log	8.7234	410	0.7451	0.5123	0.7451	0.8632
No log	8.7660	412	0.7906	0.5127	0.7906	0.8892
No log	8.8085	414	0.7782	0.4990	0.7782	0.8822
No log	8.8511	416	0.7944	0.4885	0.7944	0.8913
No log	8.8936	418	0.8499	0.5094	0.8499	0.9219
No log	8.9362	420	0.8725	0.5122	0.8725	0.9341
No log	8.9787	422	0.8400	0.5204	0.8400	0.9165
No log	9.0213	424	0.8008	0.5016	0.8008	0.8949
No log	9.0638	426	0.8090	0.4874	0.8090	0.8994
No log	9.1064	428	0.8022	0.4640	0.8022	0.8956
No log	9.1489	430	0.7367	0.4377	0.7367	0.8583
No log	9.1915	432	0.7190	0.4918	0.7190	0.8479
No log	9.2340	434	0.7127	0.5032	0.7127	0.8442
No log	9.2766	436	0.7435	0.5085	0.7435	0.8622
No log	9.3191	438	0.7582	0.5207	0.7582	0.8707
No log	9.3617	440	0.7359	0.5517	0.7359	0.8578
No log	9.4043	442	0.7520	0.5787	0.7520	0.8672
No log	9.4468	444	0.7381	0.5317	0.7381	0.8591
No log	9.4894	446	0.7278	0.5188	0.7278	0.8531
No log	9.5319	448	0.7562	0.4752	0.7562	0.8696
No log	9.5745	450	0.7402	0.4864	0.7402	0.8603
No log	9.6170	452	0.7052	0.5354	0.7052	0.8397
No log	9.6596	454	0.7160	0.6275	0.7160	0.8462
No log	9.7021	456	0.7665	0.5698	0.7665	0.8755
No log	9.7447	458	0.7653	0.5492	0.7653	0.8748
No log	9.7872	460	0.7168	0.5819	0.7168	0.8467
No log	9.8298	462	0.6662	0.6226	0.6662	0.8162
No log	9.8723	464	0.6613	0.6048	0.6613	0.8132
No log	9.9149	466	0.6849	0.6443	0.6849	0.8276
No log	9.9574	468	0.7178	0.5842	0.7178	0.8472
No log	10.0	470	0.6590	0.6157	0.6590	0.8118
No log	10.0426	472	0.6374	0.6575	0.6374	0.7984
No log	10.0851	474	0.6637	0.6259	0.6637	0.8147
No log	10.1277	476	0.7833	0.5283	0.7833	0.8851
No log	10.1702	478	0.8269	0.5170	0.8269	0.9093
No log	10.2128	480	0.7726	0.52	0.7726	0.8790
No log	10.2553	482	0.6840	0.6259	0.6840	0.8271
No log	10.2979	484	0.6915	0.6249	0.6915	0.8316
No log	10.3404	486	0.7024	0.6104	0.7024	0.8381
No log	10.3830	488	0.7145	0.5473	0.7145	0.8453
No log	10.4255	490	0.7466	0.5735	0.7466	0.8641
No log	10.4681	492	0.6903	0.6241	0.6903	0.8308
No log	10.5106	494	0.7043	0.5681	0.7043	0.8392
No log	10.5532	496	0.7248	0.5459	0.7248	0.8514
No log	10.5957	498	0.6940	0.5845	0.6940	0.8330
0.3429	10.6383	500	0.7349	0.5602	0.7349	0.8573
0.3429	10.6809	502	0.8172	0.5198	0.8172	0.9040
0.3429	10.7234	504	0.8153	0.5295	0.8153	0.9029
0.3429	10.7660	506	0.7171	0.5256	0.7171	0.8468
0.3429	10.8085	508	0.6933	0.5894	0.6933	0.8326
0.3429	10.8511	510	0.7514	0.4769	0.7514	0.8668
0.3429	10.8936	512	0.7051	0.5012	0.7051	0.8397
0.3429	10.9362	514	0.6248	0.6786	0.6248	0.7904
0.3429	10.9787	516	0.7331	0.5443	0.7331	0.8562
0.3429	11.0213	518	0.9876	0.3941	0.9876	0.9938
0.3429	11.0638	520	1.0397	0.4159	1.0397	1.0196
0.3429	11.1064	522	0.9377	0.3927	0.9377	0.9683
0.3429	11.1489	524	0.7527	0.5628	0.7527	0.8676
0.3429	11.1915	526	0.6536	0.5809	0.6536	0.8085
0.3429	11.2340	528	0.6449	0.6317	0.6449	0.8030
0.3429	11.2766	530	0.6482	0.6196	0.6482	0.8051
0.3429	11.3191	532	0.6908	0.5255	0.6908	0.8311
0.3429	11.3617	534	0.7459	0.5435	0.7459	0.8637
0.3429	11.4043	536	0.7119	0.5033	0.7119	0.8438
0.3429	11.4468	538	0.6943	0.5231	0.6943	0.8332
0.3429	11.4894	540	0.6867	0.5614	0.6867	0.8287
0.3429	11.5319	542	0.6912	0.5787	0.6912	0.8314
0.3429	11.5745	544	0.6831	0.5334	0.6831	0.8265
0.3429	11.6170	546	0.6552	0.5960	0.6552	0.8094
0.3429	11.6596	548	0.6649	0.5542	0.6649	0.8154
0.3429	11.7021	550	0.6789	0.5498	0.6789	0.8239
0.3429	11.7447	552	0.6840	0.5346	0.6840	0.8271
0.3429	11.7872	554	0.6947	0.4981	0.6947	0.8335
0.3429	11.8298	556	0.6897	0.4461	0.6897	0.8305

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1