ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6002
• Qwk: 0.3890
• Mse: 0.6002
• Rmse: 0.7747

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	2.5016	-0.0262	2.5016	1.5816
No log	0.1429	4	1.1997	0.1262	1.1997	1.0953
No log	0.2143	6	0.8010	0.0535	0.8010	0.8950
No log	0.2857	8	0.9134	0.1103	0.9134	0.9557
No log	0.3571	10	0.8531	0.2810	0.8531	0.9236
No log	0.4286	12	0.6547	0.2748	0.6547	0.8092
No log	0.5	14	0.6720	0.2019	0.6720	0.8197
No log	0.5714	16	0.6422	0.2002	0.6422	0.8014
No log	0.6429	18	0.6646	0.2418	0.6646	0.8152
No log	0.7143	20	0.6434	0.2374	0.6434	0.8021
No log	0.7857	22	0.8279	0.2982	0.8279	0.9099
No log	0.8571	24	0.9994	0.2651	0.9994	0.9997
No log	0.9286	26	0.9688	0.2726	0.9688	0.9843
No log	1.0	28	0.7905	0.1918	0.7905	0.8891
No log	1.0714	30	0.7551	0.1699	0.7551	0.8689
No log	1.1429	32	0.6881	0.2121	0.6881	0.8295
No log	1.2143	34	0.6863	0.2981	0.6863	0.8284
No log	1.2857	36	0.8012	0.4144	0.8012	0.8951
No log	1.3571	38	0.7703	0.4144	0.7703	0.8777
No log	1.4286	40	0.6812	0.3267	0.6812	0.8254
No log	1.5	42	0.6751	0.2007	0.6751	0.8217
No log	1.5714	44	0.6968	0.2558	0.6968	0.8348
No log	1.6429	46	0.6786	0.2558	0.6786	0.8237
No log	1.7143	48	0.6614	0.2712	0.6614	0.8132
No log	1.7857	50	0.6541	0.2537	0.6541	0.8088
No log	1.8571	52	0.8763	0.3869	0.8763	0.9361
No log	1.9286	54	1.0119	0.3012	1.0119	1.0059
No log	2.0	56	1.1965	0.0270	1.1965	1.0938
No log	2.0714	58	1.0897	0.1330	1.0897	1.0439
No log	2.1429	60	0.7219	0.3569	0.7219	0.8497
No log	2.2143	62	0.6640	0.3961	0.6640	0.8149
No log	2.2857	64	0.7286	0.4239	0.7286	0.8536
No log	2.3571	66	0.9292	0.3827	0.9292	0.9640
No log	2.4286	68	0.9334	0.3719	0.9334	0.9661
No log	2.5	70	0.7582	0.4089	0.7582	0.8707
No log	2.5714	72	0.7218	0.4089	0.7218	0.8496
No log	2.6429	74	0.6437	0.5362	0.6437	0.8023
No log	2.7143	76	0.6355	0.3409	0.6355	0.7972
No log	2.7857	78	0.6280	0.4910	0.6280	0.7924
No log	2.8571	80	0.6501	0.4901	0.6501	0.8063
No log	2.9286	82	0.6530	0.4901	0.6530	0.8081
No log	3.0	84	0.6446	0.4719	0.6446	0.8029
No log	3.0714	86	0.6642	0.4892	0.6642	0.8150
No log	3.1429	88	0.7406	0.4585	0.7406	0.8606
No log	3.2143	90	0.7931	0.4339	0.7931	0.8906
No log	3.2857	92	0.7282	0.4871	0.7282	0.8534
No log	3.3571	94	0.8163	0.4338	0.8163	0.9035
No log	3.4286	96	0.7996	0.4614	0.7996	0.8942
No log	3.5	98	0.6481	0.5133	0.6481	0.8050
No log	3.5714	100	0.7209	0.3512	0.7209	0.8491
No log	3.6429	102	0.6922	0.3550	0.6922	0.8320
No log	3.7143	104	0.6071	0.3834	0.6071	0.7792
No log	3.7857	106	0.6434	0.5395	0.6434	0.8021
No log	3.8571	108	0.6448	0.5485	0.6448	0.8030
No log	3.9286	110	0.6150	0.4128	0.6150	0.7842
No log	4.0	112	0.7844	0.3807	0.7844	0.8856
No log	4.0714	114	0.8544	0.3988	0.8544	0.9243
No log	4.1429	116	0.6837	0.4215	0.6837	0.8269
No log	4.2143	118	0.6748	0.5433	0.6748	0.8215
No log	4.2857	120	0.8045	0.4018	0.8045	0.8970
No log	4.3571	122	0.8834	0.3953	0.8834	0.9399
No log	4.4286	124	0.9065	0.3381	0.9065	0.9521
No log	4.5	126	0.8117	0.3371	0.8117	0.9009
No log	4.5714	128	0.7018	0.4582	0.7018	0.8377
No log	4.6429	130	0.7022	0.5063	0.7022	0.8380
No log	4.7143	132	0.6770	0.5149	0.6770	0.8228
No log	4.7857	134	0.6460	0.5874	0.6460	0.8037
No log	4.8571	136	0.7111	0.4076	0.7111	0.8433
No log	4.9286	138	0.7665	0.4157	0.7665	0.8755
No log	5.0	140	0.6713	0.4121	0.6713	0.8193
No log	5.0714	142	0.6304	0.5533	0.6304	0.7940
No log	5.1429	144	0.6173	0.5683	0.6173	0.7857
No log	5.2143	146	0.6631	0.3666	0.6631	0.8143
No log	5.2857	148	0.6322	0.4766	0.6322	0.7951
No log	5.3571	150	0.5781	0.5070	0.5781	0.7604
No log	5.4286	152	0.5847	0.5845	0.5847	0.7646
No log	5.5	154	0.6978	0.5259	0.6978	0.8353
No log	5.5714	156	0.6522	0.5801	0.6522	0.8076
No log	5.6429	158	0.5828	0.5235	0.5828	0.7634
No log	5.7143	160	0.6012	0.5859	0.6012	0.7754
No log	5.7857	162	0.6709	0.5884	0.6709	0.8191
No log	5.8571	164	0.7164	0.5561	0.7164	0.8464
No log	5.9286	166	0.6540	0.5871	0.6540	0.8087
No log	6.0	168	0.5620	0.5860	0.5620	0.7497
No log	6.0714	170	0.5467	0.4883	0.5467	0.7394
No log	6.1429	172	0.6111	0.5779	0.6111	0.7817
No log	6.2143	174	0.5843	0.4752	0.5843	0.7644
No log	6.2857	176	0.5392	0.5413	0.5392	0.7343
No log	6.3571	178	0.6034	0.6101	0.6034	0.7768
No log	6.4286	180	0.6283	0.5871	0.6283	0.7927
No log	6.5	182	0.5792	0.5574	0.5792	0.7611
No log	6.5714	184	0.5902	0.5174	0.5902	0.7683
No log	6.6429	186	0.6083	0.5872	0.6083	0.7799
No log	6.7143	188	0.6795	0.5510	0.6795	0.8243
No log	6.7857	190	0.6808	0.5259	0.6808	0.8251
No log	6.8571	192	0.6309	0.5682	0.6309	0.7943
No log	6.9286	194	0.6452	0.4225	0.6452	0.8032
No log	7.0	196	0.6811	0.3484	0.6811	0.8253
No log	7.0714	198	0.6838	0.4315	0.6838	0.8269
No log	7.1429	200	0.6820	0.4550	0.6820	0.8258
No log	7.2143	202	0.7518	0.5619	0.7518	0.8671
No log	7.2857	204	0.9232	0.3194	0.9232	0.9608
No log	7.3571	206	0.9961	0.3442	0.9961	0.9980
No log	7.4286	208	0.8247	0.3806	0.8247	0.9081
No log	7.5	210	0.6976	0.4542	0.6976	0.8352
No log	7.5714	212	0.6655	0.4437	0.6655	0.8158
No log	7.6429	214	0.6994	0.4513	0.6994	0.8363
No log	7.7143	216	0.7538	0.3520	0.7538	0.8682
No log	7.7857	218	0.7204	0.4389	0.7204	0.8487
No log	7.8571	220	0.6514	0.4864	0.6514	0.8071
No log	7.9286	222	0.6040	0.4615	0.6040	0.7772
No log	8.0	224	0.6068	0.4795	0.6068	0.7790
No log	8.0714	226	0.6169	0.5533	0.6169	0.7855
No log	8.1429	228	0.6795	0.4845	0.6795	0.8243
No log	8.2143	230	0.7604	0.4152	0.7604	0.8720
No log	8.2857	232	0.6411	0.5368	0.6411	0.8007
No log	8.3571	234	0.6122	0.5244	0.6122	0.7824
No log	8.4286	236	0.6334	0.5634	0.6334	0.7959
No log	8.5	238	0.6432	0.5666	0.6432	0.8020
No log	8.5714	240	0.6635	0.5463	0.6635	0.8145
No log	8.6429	242	0.7149	0.4913	0.7149	0.8455
No log	8.7143	244	0.6918	0.4789	0.6918	0.8317
No log	8.7857	246	0.5697	0.5882	0.5697	0.7548
No log	8.8571	248	0.5505	0.4615	0.5505	0.7419
No log	8.9286	250	0.6318	0.4939	0.6318	0.7948
No log	9.0	252	0.6219	0.4841	0.6219	0.7886
No log	9.0714	254	0.6244	0.5433	0.6244	0.7902
No log	9.1429	256	0.6794	0.4920	0.6794	0.8243
No log	9.2143	258	0.6088	0.5886	0.6088	0.7803
No log	9.2857	260	0.6215	0.5098	0.6215	0.7884
No log	9.3571	262	0.6235	0.4638	0.6235	0.7896
No log	9.4286	264	0.6085	0.5840	0.6085	0.7801
No log	9.5	266	0.6108	0.4295	0.6108	0.7815
No log	9.5714	268	0.5982	0.4402	0.5982	0.7735
No log	9.6429	270	0.6138	0.5071	0.6138	0.7835
No log	9.7143	272	0.6025	0.4847	0.6025	0.7762
No log	9.7857	274	0.5841	0.5089	0.5841	0.7643
No log	9.8571	276	0.5981	0.4596	0.5981	0.7734
No log	9.9286	278	0.6435	0.5516	0.6435	0.8022
No log	10.0	280	0.6125	0.4964	0.6125	0.7826
No log	10.0714	282	0.6215	0.4964	0.6215	0.7884
No log	10.1429	284	0.6896	0.4582	0.6896	0.8304
No log	10.2143	286	0.7041	0.4385	0.7041	0.8391
No log	10.2857	288	0.6429	0.5158	0.6429	0.8018
No log	10.3571	290	0.6349	0.5403	0.6349	0.7968
No log	10.4286	292	0.6386	0.4911	0.6386	0.7991
No log	10.5	294	0.6039	0.5271	0.6039	0.7771
No log	10.5714	296	0.5819	0.3651	0.5819	0.7629
No log	10.6429	298	0.5774	0.3603	0.5774	0.7598
No log	10.7143	300	0.5861	0.5516	0.5861	0.7656
No log	10.7857	302	0.6311	0.5410	0.6311	0.7944
No log	10.8571	304	0.6291	0.5179	0.6291	0.7931
No log	10.9286	306	0.5686	0.5447	0.5686	0.7541
No log	11.0	308	0.5475	0.5874	0.5475	0.7400
No log	11.0714	310	0.5241	0.6001	0.5241	0.7240
No log	11.1429	312	0.5032	0.5619	0.5032	0.7093
No log	11.2143	314	0.4915	0.6001	0.4915	0.7011
No log	11.2857	316	0.4926	0.5988	0.4926	0.7019
No log	11.3571	318	0.5004	0.6173	0.5004	0.7074
No log	11.4286	320	0.4924	0.6252	0.4924	0.7017
No log	11.5	322	0.4812	0.6467	0.4812	0.6937
No log	11.5714	324	0.5036	0.6313	0.5036	0.7096
No log	11.6429	326	0.5005	0.6007	0.5005	0.7075
No log	11.7143	328	0.4990	0.6096	0.4990	0.7064
No log	11.7857	330	0.5241	0.5836	0.5241	0.7240
No log	11.8571	332	0.5215	0.5836	0.5215	0.7222
No log	11.9286	334	0.5230	0.5980	0.5230	0.7232
No log	12.0	336	0.5235	0.5656	0.5235	0.7236
No log	12.0714	338	0.5378	0.4973	0.5378	0.7333
No log	12.1429	340	0.5572	0.5070	0.5572	0.7465
No log	12.2143	342	0.5703	0.5466	0.5703	0.7552
No log	12.2857	344	0.5748	0.5587	0.5748	0.7581
No log	12.3571	346	0.6280	0.5161	0.6280	0.7925
No log	12.4286	348	0.5929	0.5620	0.5929	0.7700
No log	12.5	350	0.5505	0.5853	0.5505	0.7420
No log	12.5714	352	0.5281	0.5722	0.5281	0.7267
No log	12.6429	354	0.5121	0.5286	0.5121	0.7156
No log	12.7143	356	0.5166	0.5671	0.5166	0.7187
No log	12.7857	358	0.5460	0.5516	0.5460	0.7390
No log	12.8571	360	0.6157	0.4350	0.6157	0.7846
No log	12.9286	362	0.6245	0.4350	0.6245	0.7902
No log	13.0	364	0.5978	0.5086	0.5978	0.7732
No log	13.0714	366	0.5565	0.4419	0.5565	0.7460
No log	13.1429	368	0.5625	0.4427	0.5625	0.7500
No log	13.2143	370	0.5695	0.4427	0.5695	0.7547
No log	13.2857	372	0.5554	0.4973	0.5554	0.7453
No log	13.3571	374	0.5642	0.4808	0.5642	0.7511
No log	13.4286	376	0.6024	0.4997	0.6024	0.7761
No log	13.5	378	0.5840	0.4524	0.5840	0.7642
No log	13.5714	380	0.5451	0.4888	0.5451	0.7383
No log	13.6429	382	0.5307	0.4949	0.5307	0.7285
No log	13.7143	384	0.5244	0.5305	0.5244	0.7241
No log	13.7857	386	0.5335	0.5071	0.5335	0.7304
No log	13.8571	388	0.5928	0.5223	0.5928	0.7699
No log	13.9286	390	0.6356	0.5223	0.6356	0.7973
No log	14.0	392	0.5931	0.5125	0.5931	0.7702
No log	14.0714	394	0.5922	0.5626	0.5922	0.7695
No log	14.1429	396	0.5905	0.5518	0.5905	0.7684
No log	14.2143	398	0.6027	0.4801	0.6027	0.7764
No log	14.2857	400	0.6455	0.5223	0.6455	0.8034
No log	14.3571	402	0.6231	0.5223	0.6231	0.7894
No log	14.4286	404	0.6076	0.4721	0.6076	0.7795
No log	14.5	406	0.5967	0.4875	0.5967	0.7724
No log	14.5714	408	0.5728	0.4964	0.5728	0.7569
No log	14.6429	410	0.5566	0.4681	0.5566	0.7461
No log	14.7143	412	0.5561	0.4801	0.5561	0.7457
No log	14.7857	414	0.5605	0.4910	0.5605	0.7486
No log	14.8571	416	0.5681	0.5009	0.5681	0.7537
No log	14.9286	418	0.5712	0.5009	0.5712	0.7558
No log	15.0	420	0.5642	0.4738	0.5642	0.7511
No log	15.0714	422	0.5769	0.4964	0.5769	0.7595
No log	15.1429	424	0.6113	0.4948	0.6113	0.7818
No log	15.2143	426	0.6641	0.4916	0.6641	0.8149
No log	15.2857	428	0.6695	0.4916	0.6695	0.8183
No log	15.3571	430	0.6299	0.4582	0.6299	0.7936
No log	15.4286	432	0.6102	0.4419	0.6102	0.7812
No log	15.5	434	0.6019	0.3628	0.6019	0.7758
No log	15.5714	436	0.6034	0.3363	0.6034	0.7768
No log	15.6429	438	0.6105	0.4419	0.6105	0.7813
No log	15.7143	440	0.6433	0.4801	0.6433	0.8020
No log	15.7857	442	0.6420	0.4801	0.6420	0.8012
No log	15.8571	444	0.6097	0.4964	0.6097	0.7808
No log	15.9286	446	0.5862	0.4482	0.5862	0.7656
No log	16.0	448	0.5577	0.4358	0.5577	0.7468
No log	16.0714	450	0.5388	0.4904	0.5388	0.7340
No log	16.1429	452	0.5425	0.4782	0.5425	0.7366
No log	16.2143	454	0.5809	0.5034	0.5809	0.7622
No log	16.2857	456	0.6435	0.5223	0.6435	0.8022
No log	16.3571	458	0.6254	0.4721	0.6254	0.7908
No log	16.4286	460	0.5694	0.4985	0.5694	0.7546
No log	16.5	462	0.5636	0.4726	0.5636	0.7507
No log	16.5714	464	0.5819	0.4705	0.5819	0.7628
No log	16.6429	466	0.5735	0.4459	0.5735	0.7573
No log	16.7143	468	0.5491	0.4314	0.5491	0.7410
No log	16.7857	470	0.5520	0.3890	0.5520	0.7429
No log	16.8571	472	0.5778	0.4964	0.5778	0.7601
No log	16.9286	474	0.5987	0.4948	0.5987	0.7737
No log	17.0	476	0.5841	0.4721	0.5841	0.7643
No log	17.0714	478	0.5513	0.5071	0.5513	0.7425
No log	17.1429	480	0.5371	0.5141	0.5371	0.7329
No log	17.2143	482	0.5391	0.4964	0.5391	0.7342
No log	17.2857	484	0.5714	0.4875	0.5714	0.7559
No log	17.3571	486	0.5815	0.4875	0.5815	0.7626
No log	17.4286	488	0.5632	0.4964	0.5632	0.7505
No log	17.5	490	0.5558	0.4964	0.5558	0.7455
No log	17.5714	492	0.5550	0.4726	0.5550	0.7450
No log	17.6429	494	0.5675	0.4964	0.5675	0.7533
No log	17.7143	496	0.5898	0.4964	0.5898	0.7680
No log	17.7857	498	0.5750	0.4726	0.5750	0.7583
0.3301	17.8571	500	0.5786	0.4482	0.5786	0.7607
0.3301	17.9286	502	0.5936	0.5034	0.5936	0.7705
0.3301	18.0	504	0.6259	0.5237	0.6259	0.7912
0.3301	18.0714	506	0.6139	0.4705	0.6139	0.7835
0.3301	18.1429	508	0.5791	0.4964	0.5791	0.7610
0.3301	18.2143	510	0.5661	0.4964	0.5661	0.7524
0.3301	18.2857	512	0.5475	0.4895	0.5475	0.7399
0.3301	18.3571	514	0.5501	0.5222	0.5501	0.7417
0.3301	18.4286	516	0.5485	0.5586	0.5485	0.7406
0.3301	18.5	518	0.5472	0.5663	0.5472	0.7397
0.3301	18.5714	520	0.5305	0.5663	0.5305	0.7284
0.3301	18.6429	522	0.5216	0.5235	0.5216	0.7222
0.3301	18.7143	524	0.5652	0.5420	0.5652	0.7518
0.3301	18.7857	526	0.5770	0.5420	0.5770	0.7596
0.3301	18.8571	528	0.5415	0.5437	0.5415	0.7359
0.3301	18.9286	530	0.5216	0.5118	0.5216	0.7222
0.3301	19.0	532	0.5305	0.4963	0.5305	0.7283
0.3301	19.0714	534	0.5593	0.5348	0.5593	0.7479
0.3301	19.1429	536	0.5401	0.4980	0.5401	0.7349
0.3301	19.2143	538	0.5213	0.4904	0.5213	0.7220
0.3301	19.2857	540	0.5286	0.5021	0.5286	0.7271
0.3301	19.3571	542	0.5695	0.5177	0.5695	0.7547
0.3301	19.4286	544	0.6053	0.4997	0.6053	0.7780
0.3301	19.5	546	0.5856	0.4997	0.5856	0.7653
0.3301	19.5714	548	0.5609	0.5206	0.5609	0.7489
0.3301	19.6429	550	0.5403	0.5167	0.5403	0.7350
0.3301	19.7143	552	0.5541	0.4980	0.5541	0.7444
0.3301	19.7857	554	0.5787	0.4918	0.5787	0.7607
0.3301	19.8571	556	0.5603	0.5221	0.5603	0.7485
0.3301	19.9286	558	0.5447	0.5533	0.5447	0.7380
0.3301	20.0	560	0.5501	0.5543	0.5501	0.7417
0.3301	20.0714	562	0.5729	0.5223	0.5729	0.7569
0.3301	20.1429	564	0.5725	0.5379	0.5725	0.7567
0.3301	20.2143	566	0.5609	0.5379	0.5609	0.7489
0.3301	20.2857	568	0.5196	0.5577	0.5196	0.7208
0.3301	20.3571	570	0.5281	0.4919	0.5281	0.7267
0.3301	20.4286	572	0.5570	0.5288	0.5570	0.7463
0.3301	20.5	574	0.5813	0.5288	0.5813	0.7624
0.3301	20.5714	576	0.5939	0.5142	0.5939	0.7707
0.3301	20.6429	578	0.5866	0.4985	0.5866	0.7659
0.3301	20.7143	580	0.5848	0.4535	0.5848	0.7647
0.3301	20.7857	582	0.5807	0.4535	0.5807	0.7620
0.3301	20.8571	584	0.5725	0.5214	0.5725	0.7566
0.3301	20.9286	586	0.5940	0.5420	0.5940	0.7707
0.3301	21.0	588	0.6673	0.5177	0.6673	0.8169
0.3301	21.0714	590	0.6898	0.5063	0.6898	0.8305
0.3301	21.1429	592	0.6419	0.5468	0.6419	0.8012
0.3301	21.2143	594	0.5713	0.5655	0.5713	0.7558
0.3301	21.2857	596	0.5552	0.5389	0.5552	0.7451
0.3301	21.3571	598	0.5573	0.5604	0.5573	0.7466
0.3301	21.4286	600	0.5536	0.5619	0.5536	0.7440
0.3301	21.5	602	0.5520	0.5184	0.5520	0.7430
0.3301	21.5714	604	0.5628	0.4964	0.5628	0.7502
0.3301	21.6429	606	0.6173	0.5177	0.6173	0.7857
0.3301	21.7143	608	0.7111	0.4562	0.7111	0.8433
0.3301	21.7857	610	0.7194	0.4562	0.7194	0.8481
0.3301	21.8571	612	0.6651	0.4576	0.6651	0.8155
0.3301	21.9286	614	0.5925	0.4158	0.5925	0.7698
0.3301	22.0	616	0.5738	0.4437	0.5738	0.7575
0.3301	22.0714	618	0.5717	0.4459	0.5717	0.7561
0.3301	22.1429	620	0.5819	0.3890	0.5819	0.7628
0.3301	22.2143	622	0.6002	0.3890	0.6002	0.7747

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1