ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5480
• Qwk: 0.3649
• Mse: 0.5480
• Rmse: 0.7403

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0230	2	2.6022	-0.0593	2.6022	1.6131
No log	0.0460	4	1.2771	0.0982	1.2771	1.1301
No log	0.0690	6	1.1344	-0.1722	1.1344	1.0651
No log	0.0920	8	0.8741	0.2440	0.8741	0.9349
No log	0.1149	10	0.8190	0.2892	0.8190	0.9050
No log	0.1379	12	0.7367	0.2328	0.7367	0.8583
No log	0.1609	14	0.7738	0.3562	0.7738	0.8796
No log	0.1839	16	0.6925	0.3318	0.6925	0.8322
No log	0.2069	18	0.7289	0.3691	0.7289	0.8537
No log	0.2299	20	0.6592	0.3280	0.6592	0.8119
No log	0.2529	22	0.7692	0.1734	0.7692	0.8770
No log	0.2759	24	0.7201	0.3261	0.7201	0.8486
No log	0.2989	26	0.6306	0.3863	0.6306	0.7941
No log	0.3218	28	0.7161	0.2132	0.7161	0.8462
No log	0.3448	30	0.9145	0.2908	0.9145	0.9563
No log	0.3678	32	0.8827	0.2046	0.8827	0.9395
No log	0.3908	34	0.7751	0.1786	0.7751	0.8804
No log	0.4138	36	0.6926	0.0	0.6926	0.8322
No log	0.4368	38	0.6497	0.1617	0.6497	0.8061
No log	0.4598	40	0.6492	0.3926	0.6492	0.8057
No log	0.4828	42	0.6401	0.3546	0.6401	0.8000
No log	0.5057	44	0.6047	0.2786	0.6047	0.7776
No log	0.5287	46	0.7073	0.3040	0.7073	0.8410
No log	0.5517	48	0.6228	0.3093	0.6228	0.7892
No log	0.5747	50	0.6083	0.3572	0.6083	0.7799
No log	0.5977	52	0.7773	0.3960	0.7773	0.8816
No log	0.6207	54	1.3923	0.2273	1.3923	1.1800
No log	0.6437	56	1.2046	0.2868	1.2046	1.0976
No log	0.6667	58	0.7264	0.3519	0.7264	0.8523
No log	0.6897	60	0.6142	0.2748	0.6142	0.7837
No log	0.7126	62	0.6125	0.3153	0.6125	0.7826
No log	0.7356	64	0.8591	0.3665	0.8591	0.9269
No log	0.7586	66	1.6882	0.1309	1.6882	1.2993
No log	0.7816	68	1.9733	0.0065	1.9733	1.4047
No log	0.8046	70	1.8415	-0.0143	1.8415	1.3570
No log	0.8276	72	1.4221	0.1732	1.4221	1.1925
No log	0.8506	74	0.8111	0.4113	0.8111	0.9006
No log	0.8736	76	0.6827	0.4409	0.6827	0.8262
No log	0.8966	78	0.7814	0.3777	0.7814	0.8840
No log	0.9195	80	0.8382	0.4092	0.8382	0.9155
No log	0.9425	82	0.7570	0.3918	0.7570	0.8700
No log	0.9655	84	0.7292	0.3918	0.7292	0.8539
No log	0.9885	86	0.6731	0.4307	0.6731	0.8204
No log	1.0115	88	0.6653	0.3819	0.6653	0.8157
No log	1.0345	90	0.7188	0.4307	0.7188	0.8478
No log	1.0575	92	0.7753	0.3042	0.7753	0.8805
No log	1.0805	94	0.7309	0.3699	0.7309	0.8549
No log	1.1034	96	0.6848	0.4036	0.6848	0.8275
No log	1.1264	98	0.6133	0.3867	0.6133	0.7831
No log	1.1494	100	0.5596	0.3970	0.5596	0.7480
No log	1.1724	102	0.5900	0.4393	0.5900	0.7681
No log	1.1954	104	0.7654	0.4549	0.7654	0.8749
No log	1.2184	106	0.8279	0.4400	0.8279	0.9099
No log	1.2414	108	0.7846	0.3913	0.7846	0.8858
No log	1.2644	110	0.6400	0.4036	0.6400	0.8000
No log	1.2874	112	0.5606	0.5232	0.5606	0.7488
No log	1.3103	114	0.5680	0.4697	0.5680	0.7536
No log	1.3333	116	0.5644	0.4904	0.5644	0.7513
No log	1.3563	118	0.5685	0.5437	0.5685	0.7540
No log	1.3793	120	0.5492	0.5455	0.5492	0.7411
No log	1.4023	122	0.5558	0.5648	0.5558	0.7455
No log	1.4253	124	0.5663	0.4437	0.5663	0.7525
No log	1.4483	126	0.6232	0.4576	0.6232	0.7895
No log	1.4713	128	0.6676	0.4409	0.6676	0.8171
No log	1.4943	130	0.6557	0.4815	0.6557	0.8097
No log	1.5172	132	0.8698	0.3247	0.8698	0.9326
No log	1.5402	134	1.0602	0.2914	1.0602	1.0296
No log	1.5632	136	0.8332	0.3913	0.8332	0.9128
No log	1.5862	138	0.5206	0.4945	0.5206	0.7215
No log	1.6092	140	0.5908	0.3851	0.5908	0.7686
No log	1.6322	142	0.6729	0.3663	0.6729	0.8203
No log	1.6552	144	0.5257	0.5877	0.5257	0.7251
No log	1.6782	146	0.5588	0.4576	0.5588	0.7475
No log	1.7011	148	0.8938	0.3538	0.8938	0.9454
No log	1.7241	150	0.9457	0.3010	0.9457	0.9725
No log	1.7471	152	0.7421	0.4230	0.7421	0.8615
No log	1.7701	154	0.6178	0.1922	0.6178	0.7860
No log	1.7931	156	0.6720	0.2156	0.6720	0.8198
No log	1.8161	158	0.7234	0.3173	0.7234	0.8505
No log	1.8391	160	0.6489	0.2846	0.6489	0.8055
No log	1.8621	162	0.5850	0.2852	0.5850	0.7648
No log	1.8851	164	0.6461	0.4154	0.6461	0.8038
No log	1.9080	166	0.6640	0.4384	0.6640	0.8149
No log	1.9310	168	0.6215	0.3918	0.6215	0.7883
No log	1.9540	170	0.6338	0.4384	0.6338	0.7961
No log	1.9770	172	0.7561	0.4530	0.7561	0.8696
No log	2.0	174	0.8288	0.3739	0.8288	0.9104
No log	2.0230	176	0.6994	0.4530	0.6994	0.8363
No log	2.0460	178	0.5801	0.4911	0.5801	0.7616
No log	2.0690	180	0.6085	0.4424	0.6085	0.7801
No log	2.0920	182	0.7515	0.4162	0.7515	0.8669
No log	2.1149	184	0.7711	0.3804	0.7711	0.8781
No log	2.1379	186	0.7144	0.4234	0.7144	0.8452
No log	2.1609	188	0.6259	0.4307	0.6259	0.7911
No log	2.1839	190	0.5694	0.4815	0.5694	0.7546
No log	2.2069	192	0.5397	0.5289	0.5397	0.7347
No log	2.2299	194	0.5099	0.5003	0.5099	0.7140
No log	2.2529	196	0.5111	0.5003	0.5111	0.7149
No log	2.2759	198	0.5363	0.5516	0.5363	0.7323
No log	2.2989	200	0.5830	0.4424	0.5830	0.7635
No log	2.3218	202	0.5964	0.4424	0.5964	0.7722
No log	2.3448	204	0.5936	0.4502	0.5936	0.7704
No log	2.3678	206	0.5783	0.5219	0.5783	0.7605
No log	2.3908	208	0.5877	0.5452	0.5877	0.7666
No log	2.4138	210	0.6614	0.4175	0.6614	0.8133
No log	2.4368	212	0.8456	0.3579	0.8456	0.9196
No log	2.4598	214	0.9009	0.3516	0.9009	0.9491
No log	2.4828	216	0.7967	0.3643	0.7967	0.8926
No log	2.5057	218	0.6448	0.4158	0.6448	0.8030
No log	2.5287	220	0.6318	0.3622	0.6318	0.7949
No log	2.5517	222	0.6733	0.3637	0.6733	0.8206
No log	2.5747	224	0.7591	0.3777	0.7591	0.8713
No log	2.5977	226	0.8896	0.3395	0.8896	0.9432
No log	2.6207	228	0.8657	0.3455	0.8657	0.9304
No log	2.6437	230	0.7112	0.3777	0.7112	0.8433
No log	2.6667	232	0.6488	0.4123	0.6488	0.8055
No log	2.6897	234	0.5930	0.5786	0.5930	0.7701
No log	2.7126	236	0.6092	0.5219	0.6092	0.7805
No log	2.7356	238	0.6136	0.4582	0.6136	0.7833
No log	2.7586	240	0.5489	0.4555	0.5489	0.7409
No log	2.7816	242	0.5747	0.4517	0.5747	0.7581
No log	2.8046	244	0.5744	0.4517	0.5744	0.7579
No log	2.8276	246	0.5774	0.4294	0.5774	0.7599
No log	2.8506	248	0.5327	0.4839	0.5327	0.7298
No log	2.8736	250	0.6173	0.4815	0.6173	0.7857
No log	2.8966	252	0.6346	0.4562	0.6346	0.7966
No log	2.9195	254	0.5675	0.5252	0.5675	0.7533
No log	2.9425	256	0.5697	0.5252	0.5697	0.7548
No log	2.9655	258	0.6334	0.4409	0.6334	0.7959
No log	2.9885	260	0.7356	0.4113	0.7356	0.8577
No log	3.0115	262	0.8823	0.3909	0.8823	0.9393
No log	3.0345	264	0.7641	0.3933	0.7641	0.8742
No log	3.0575	266	0.6359	0.4512	0.6359	0.7975
No log	3.0805	268	0.5547	0.4513	0.5547	0.7448
No log	3.1034	270	0.5223	0.5326	0.5223	0.7227
No log	3.1264	272	0.5237	0.5404	0.5237	0.7236
No log	3.1494	274	0.5193	0.3677	0.5193	0.7206
No log	3.1724	276	0.5265	0.5307	0.5265	0.7256
No log	3.1954	278	0.5310	0.5195	0.5310	0.7287
No log	3.2184	280	0.5612	0.4112	0.5612	0.7491
No log	3.2414	282	0.5216	0.5095	0.5216	0.7222
No log	3.2644	284	0.5191	0.5286	0.5191	0.7205
No log	3.2874	286	0.5227	0.5361	0.5227	0.7230
No log	3.3103	288	0.5252	0.5672	0.5252	0.7247
No log	3.3333	290	0.5725	0.4949	0.5725	0.7567
No log	3.3563	292	0.5912	0.4204	0.5912	0.7689
No log	3.3793	294	0.5937	0.4204	0.5937	0.7705
No log	3.4023	296	0.5183	0.5361	0.5183	0.7199
No log	3.4253	298	0.5212	0.5980	0.5212	0.7219
No log	3.4483	300	0.5095	0.5868	0.5095	0.7138
No log	3.4713	302	0.5268	0.4367	0.5268	0.7258
No log	3.4943	304	0.5759	0.4044	0.5759	0.7589
No log	3.5172	306	0.5487	0.5317	0.5487	0.7407
No log	3.5402	308	0.4970	0.5986	0.4970	0.7050
No log	3.5632	310	0.5393	0.5017	0.5393	0.7343
No log	3.5862	312	0.5408	0.5017	0.5408	0.7354
No log	3.6092	314	0.4991	0.5868	0.4991	0.7065
No log	3.6322	316	0.4958	0.5868	0.4958	0.7042
No log	3.6552	318	0.4950	0.5357	0.4950	0.7036
No log	3.6782	320	0.4941	0.6517	0.4941	0.7029
No log	3.7011	322	0.5971	0.4664	0.5971	0.7727
No log	3.7241	324	0.6542	0.4947	0.6542	0.8088
No log	3.7471	326	0.5611	0.5271	0.5611	0.7491
No log	3.7701	328	0.5113	0.5752	0.5113	0.7151
No log	3.7931	330	0.5245	0.5516	0.5245	0.7242
No log	3.8161	332	0.5573	0.5017	0.5573	0.7465
No log	3.8391	334	0.5658	0.5017	0.5658	0.7522
No log	3.8621	336	0.5925	0.5252	0.5925	0.7698
No log	3.8851	338	0.5256	0.5271	0.5256	0.7250
No log	3.9080	340	0.4958	0.4858	0.4958	0.7041
No log	3.9310	342	0.4961	0.4858	0.4961	0.7044
No log	3.9540	344	0.4968	0.4934	0.4968	0.7048
No log	3.9770	346	0.5082	0.5614	0.5082	0.7129
No log	4.0	348	0.5472	0.5017	0.5472	0.7397
No log	4.0230	350	0.5569	0.5252	0.5569	0.7463
No log	4.0460	352	0.5249	0.5111	0.5249	0.7245
No log	4.0690	354	0.4971	0.4194	0.4971	0.7050
No log	4.0920	356	0.5320	0.4466	0.5320	0.7294
No log	4.1149	358	0.5079	0.4105	0.5079	0.7126
No log	4.1379	360	0.5176	0.5036	0.5176	0.7195
No log	4.1609	362	0.6402	0.5029	0.6402	0.8001
No log	4.1839	364	0.7249	0.4462	0.7249	0.8514
No log	4.2069	366	0.6366	0.4959	0.6366	0.7978
No log	4.2299	368	0.5251	0.4774	0.5251	0.7247
No log	4.2529	370	0.4984	0.5386	0.4984	0.7060
No log	4.2759	372	0.5018	0.5131	0.5018	0.7084
No log	4.2989	374	0.5018	0.5214	0.5018	0.7084
No log	4.3218	376	0.4962	0.5307	0.4962	0.7044
No log	4.3448	378	0.5165	0.5036	0.5165	0.7187
No log	4.3678	380	0.5099	0.5131	0.5099	0.7141
No log	4.3908	382	0.5360	0.4845	0.5360	0.7321
No log	4.4138	384	0.5251	0.5039	0.5251	0.7246
No log	4.4368	386	0.5280	0.3782	0.5280	0.7266
No log	4.4598	388	0.5314	0.4273	0.5314	0.7290
No log	4.4828	390	0.5339	0.4273	0.5339	0.7307
No log	4.5057	392	0.5102	0.4276	0.5102	0.7143
No log	4.5287	394	0.4899	0.3890	0.4899	0.6999
No log	4.5517	396	0.4956	0.5195	0.4956	0.7040
No log	4.5747	398	0.5292	0.4925	0.5292	0.7275
No log	4.5977	400	0.5149	0.4855	0.5149	0.7176
No log	4.6207	402	0.5001	0.5671	0.5001	0.7072
No log	4.6437	404	0.4774	0.4722	0.4774	0.6909
No log	4.6667	406	0.5019	0.5189	0.5019	0.7085
No log	4.6897	408	0.4911	0.4991	0.4911	0.7008
No log	4.7126	410	0.4860	0.4953	0.4860	0.6971
No log	4.7356	412	0.5049	0.5516	0.5049	0.7105
No log	4.7586	414	0.5045	0.5752	0.5045	0.7103
No log	4.7816	416	0.4732	0.6010	0.4732	0.6879
No log	4.8046	418	0.4656	0.5061	0.4656	0.6823
No log	4.8276	420	0.4661	0.5061	0.4661	0.6828
No log	4.8506	422	0.4649	0.5505	0.4649	0.6818
No log	4.8736	424	0.4804	0.6096	0.4804	0.6931
No log	4.8966	426	0.5012	0.5752	0.5012	0.7079
No log	4.9195	428	0.5244	0.5639	0.5244	0.7241
No log	4.9425	430	0.5368	0.5677	0.5368	0.7327
No log	4.9655	432	0.4791	0.6252	0.4791	0.6922
No log	4.9885	434	0.4796	0.5875	0.4796	0.6926
No log	5.0115	436	0.4926	0.5092	0.4926	0.7019
No log	5.0345	438	0.4900	0.5734	0.4900	0.7000
No log	5.0575	440	0.5172	0.5017	0.5172	0.7192
No log	5.0805	442	0.6138	0.4644	0.6138	0.7834
No log	5.1034	444	0.5912	0.5139	0.5912	0.7689
No log	5.1264	446	0.5456	0.5330	0.5456	0.7386
No log	5.1494	448	0.4840	0.5883	0.4840	0.6957
No log	5.1724	450	0.4956	0.5321	0.4956	0.7040
No log	5.1954	452	0.4952	0.5098	0.4952	0.7037
No log	5.2184	454	0.4915	0.5675	0.4915	0.7011
No log	5.2414	456	0.4937	0.5227	0.4937	0.7026
No log	5.2644	458	0.5002	0.4857	0.5002	0.7072
No log	5.2874	460	0.5001	0.4970	0.5001	0.7072
No log	5.3103	462	0.4981	0.5714	0.4981	0.7058
No log	5.3333	464	0.5116	0.5627	0.5116	0.7153
No log	5.3563	466	0.4986	0.6020	0.4986	0.7061
No log	5.3793	468	0.4844	0.5707	0.4844	0.6960
No log	5.4023	470	0.4933	0.5846	0.4933	0.7024
No log	5.4253	472	0.4941	0.5782	0.4941	0.7030
No log	5.4483	474	0.5000	0.5703	0.5000	0.7071
No log	5.4713	476	0.5149	0.4964	0.5149	0.7176
No log	5.4943	478	0.5523	0.5271	0.5523	0.7432
No log	5.5172	480	0.6254	0.4978	0.6254	0.7908
No log	5.5402	482	0.6227	0.4978	0.6227	0.7891
No log	5.5632	484	0.5531	0.5271	0.5531	0.7437
No log	5.5862	486	0.5170	0.5306	0.5170	0.7191
No log	5.6092	488	0.5161	0.5472	0.5161	0.7184
No log	5.6322	490	0.5329	0.5271	0.5329	0.7300
No log	5.6552	492	0.5345	0.5349	0.5345	0.7311
No log	5.6782	494	0.5210	0.5111	0.5210	0.7218
No log	5.7011	496	0.5065	0.5151	0.5065	0.7117
No log	5.7241	498	0.5001	0.5250	0.5001	0.7072
0.3558	5.7471	500	0.5217	0.4595	0.5217	0.7223
0.3558	5.7701	502	0.5491	0.4997	0.5491	0.7410
0.3558	5.7931	504	0.5212	0.4832	0.5212	0.7219
0.3558	5.8161	506	0.4967	0.5003	0.4967	0.7048
0.3558	5.8391	508	0.4991	0.5228	0.4991	0.7065
0.3558	5.8621	510	0.5058	0.4484	0.5058	0.7112
0.3558	5.8851	512	0.5151	0.4349	0.5151	0.7177
0.3558	5.9080	514	0.5033	0.5075	0.5033	0.7095
0.3558	5.9310	516	0.5141	0.5349	0.5141	0.7170
0.3558	5.9540	518	0.5950	0.4815	0.5950	0.7714
0.3558	5.9770	520	0.6000	0.4905	0.6000	0.7746
0.3558	6.0	522	0.5480	0.5349	0.5480	0.7403
0.3558	6.0230	524	0.5282	0.5349	0.5282	0.7268
0.3558	6.0460	526	0.5272	0.5349	0.5272	0.7261
0.3558	6.0690	528	0.5487	0.4824	0.5487	0.7408
0.3558	6.0920	530	0.5594	0.4824	0.5594	0.7479
0.3558	6.1149	532	0.5444	0.5349	0.5444	0.7379
0.3558	6.1379	534	0.5096	0.5386	0.5096	0.7138
0.3558	6.1609	536	0.5093	0.4795	0.5093	0.7137
0.3558	6.1839	538	0.5123	0.4795	0.5123	0.7157
0.3558	6.2069	540	0.5014	0.5656	0.5014	0.7081
0.3558	6.2299	542	0.5006	0.5505	0.5006	0.7076
0.3558	6.2529	544	0.5038	0.5076	0.5038	0.7098
0.3558	6.2759	546	0.5100	0.4463	0.5100	0.7141
0.3558	6.2989	548	0.5166	0.5309	0.5166	0.7188
0.3558	6.3218	550	0.5271	0.5209	0.5271	0.7260
0.3558	6.3448	552	0.5249	0.5228	0.5249	0.7245
0.3558	6.3678	554	0.5319	0.5092	0.5319	0.7293
0.3558	6.3908	556	0.5943	0.4527	0.5943	0.7709
0.3558	6.4138	558	0.6213	0.4492	0.6213	0.7882
0.3558	6.4368	560	0.5783	0.4980	0.5783	0.7604
0.3558	6.4598	562	0.5542	0.5589	0.5542	0.7444
0.3558	6.4828	564	0.5715	0.4966	0.5715	0.7559
0.3558	6.5057	566	0.6069	0.5158	0.6069	0.7790
0.3558	6.5287	568	0.5979	0.4824	0.5979	0.7733
0.3558	6.5517	570	0.6054	0.4731	0.6054	0.7781
0.3558	6.5747	572	0.6081	0.4731	0.6081	0.7798
0.3558	6.5977	574	0.5890	0.4824	0.5890	0.7675
0.3558	6.6207	576	0.5684	0.4774	0.5684	0.7539
0.3558	6.6437	578	0.5750	0.4774	0.5750	0.7583
0.3558	6.6667	580	0.5681	0.4243	0.5681	0.7537
0.3558	6.6897	582	0.5826	0.3950	0.5826	0.7633
0.3558	6.7126	584	0.5774	0.3387	0.5774	0.7598
0.3558	6.7356	586	0.5580	0.3701	0.5580	0.7470
0.3558	6.7586	588	0.5480	0.3649	0.5480	0.7403

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1