ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6070
• Qwk: 0.4930
• Mse: 0.6070
• Rmse: 0.7791

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.2134	-0.0329	4.2134	2.0527
No log	0.0909	4	2.5122	0.0475	2.5122	1.5850
No log	0.1364	6	1.7181	-0.0306	1.7181	1.3108
No log	0.1818	8	0.9977	-0.0545	0.9977	0.9989
No log	0.2273	10	0.8508	0.2136	0.8508	0.9224
No log	0.2727	12	0.8035	0.2693	0.8035	0.8964
No log	0.3182	14	0.8792	0.0856	0.8792	0.9377
No log	0.3636	16	0.9289	0.1073	0.9289	0.9638
No log	0.4091	18	0.9970	0.1107	0.9970	0.9985
No log	0.4545	20	0.8386	0.1533	0.8386	0.9157
No log	0.5	22	0.8142	0.2669	0.8142	0.9023
No log	0.5455	24	0.7965	0.1933	0.7965	0.8925
No log	0.5909	26	0.7787	0.2350	0.7787	0.8824
No log	0.6364	28	0.7836	0.2258	0.7836	0.8852
No log	0.6818	30	0.7930	0.2646	0.7930	0.8905
No log	0.7273	32	0.7722	0.2552	0.7722	0.8787
No log	0.7727	34	0.7279	0.2598	0.7279	0.8531
No log	0.8182	36	0.7809	0.3297	0.7809	0.8837
No log	0.8636	38	0.7802	0.3297	0.7802	0.8833
No log	0.9091	40	0.7330	0.2915	0.7330	0.8561
No log	0.9545	42	0.7437	0.3006	0.7437	0.8624
No log	1.0	44	0.7982	0.2964	0.7982	0.8934
No log	1.0455	46	0.8986	0.1885	0.8986	0.9480
No log	1.0909	48	0.9627	0.1292	0.9627	0.9812
No log	1.1364	50	0.8809	0.1470	0.8809	0.9385
No log	1.1818	52	0.8269	0.2468	0.8269	0.9094
No log	1.2273	54	0.7796	0.3163	0.7796	0.8830
No log	1.2727	56	0.7467	0.2693	0.7467	0.8641
No log	1.3182	58	0.7813	0.1383	0.7813	0.8839
No log	1.3636	60	0.7866	0.2513	0.7866	0.8869
No log	1.4091	62	0.8338	0.2741	0.8338	0.9131
No log	1.4545	64	0.9445	0.2232	0.9445	0.9719
No log	1.5	66	0.9690	0.2921	0.9690	0.9844
No log	1.5455	68	0.8451	0.3334	0.8451	0.9193
No log	1.5909	70	0.8047	0.3326	0.8047	0.8970
No log	1.6364	72	0.8384	0.3295	0.8384	0.9156
No log	1.6818	74	0.7901	0.3789	0.7901	0.8889
No log	1.7273	76	0.7386	0.3718	0.7386	0.8594
No log	1.7727	78	0.7428	0.4	0.7428	0.8619
No log	1.8182	80	0.7700	0.3881	0.7700	0.8775
No log	1.8636	82	0.7675	0.4123	0.7675	0.8761
No log	1.9091	84	0.8626	0.3782	0.8626	0.9288
No log	1.9545	86	0.9209	0.3365	0.9209	0.9597
No log	2.0	88	0.7254	0.4101	0.7254	0.8517
No log	2.0455	90	0.7523	0.3215	0.7523	0.8674
No log	2.0909	92	0.8101	0.3812	0.8101	0.9000
No log	2.1364	94	0.7158	0.3055	0.7158	0.8460
No log	2.1818	96	0.6817	0.4276	0.6817	0.8256
No log	2.2273	98	0.8512	0.3921	0.8512	0.9226
No log	2.2727	100	1.0522	0.3557	1.0522	1.0258
No log	2.3182	102	0.9579	0.4010	0.9579	0.9787
No log	2.3636	104	0.8826	0.4003	0.8826	0.9395
No log	2.4091	106	0.8532	0.4165	0.8532	0.9237
No log	2.4545	108	0.8630	0.4411	0.8630	0.9290
No log	2.5	110	0.9055	0.4065	0.9055	0.9516
No log	2.5455	112	0.8943	0.4430	0.8943	0.9457
No log	2.5909	114	0.8591	0.4328	0.8591	0.9269
No log	2.6364	116	0.8641	0.4874	0.8641	0.9296
No log	2.6818	118	0.8761	0.4909	0.8761	0.9360
No log	2.7273	120	0.8803	0.4823	0.8803	0.9383
No log	2.7727	122	0.8450	0.4916	0.8450	0.9192
No log	2.8182	124	0.8002	0.4993	0.8002	0.8946
No log	2.8636	126	0.7813	0.5087	0.7813	0.8839
No log	2.9091	128	0.8206	0.4841	0.8206	0.9059
No log	2.9545	130	0.7992	0.4382	0.7992	0.8940
No log	3.0	132	0.7113	0.4855	0.7113	0.8434
No log	3.0455	134	0.6716	0.4650	0.6716	0.8195
No log	3.0909	136	0.6976	0.4784	0.6976	0.8352
No log	3.1364	138	0.9340	0.3960	0.9340	0.9664
No log	3.1818	140	0.9521	0.3938	0.9521	0.9758
No log	3.2273	142	0.7104	0.4844	0.7104	0.8429
No log	3.2727	144	0.7134	0.4701	0.7134	0.8447
No log	3.3182	146	0.7537	0.4666	0.7537	0.8681
No log	3.3636	148	0.7434	0.4236	0.7434	0.8622
No log	3.4091	150	0.6706	0.4890	0.6706	0.8189
No log	3.4545	152	0.6421	0.5344	0.6421	0.8013
No log	3.5	154	0.6635	0.5369	0.6635	0.8146
No log	3.5455	156	0.7626	0.4680	0.7626	0.8733
No log	3.5909	158	0.7690	0.4766	0.7690	0.8769
No log	3.6364	160	0.6628	0.4926	0.6628	0.8141
No log	3.6818	162	0.6860	0.5543	0.6860	0.8283
No log	3.7273	164	0.6927	0.5577	0.6927	0.8323
No log	3.7727	166	0.7105	0.5767	0.7105	0.8429
No log	3.8182	168	0.7093	0.5220	0.7093	0.8422
No log	3.8636	170	0.6870	0.5514	0.6870	0.8289
No log	3.9091	172	0.7050	0.4827	0.7050	0.8397
No log	3.9545	174	0.6903	0.5404	0.6903	0.8308
No log	4.0	176	0.6714	0.5257	0.6714	0.8194
No log	4.0455	178	0.6628	0.4978	0.6628	0.8141
No log	4.0909	180	0.6489	0.4650	0.6489	0.8056
No log	4.1364	182	0.6449	0.5082	0.6449	0.8031
No log	4.1818	184	0.6843	0.5050	0.6843	0.8272
No log	4.2273	186	0.6674	0.5181	0.6674	0.8169
No log	4.2727	188	0.7404	0.4468	0.7404	0.8604
No log	4.3182	190	0.7319	0.4474	0.7319	0.8555
No log	4.3636	192	0.7275	0.5410	0.7275	0.8530
No log	4.4091	194	0.8180	0.4490	0.8180	0.9045
No log	4.4545	196	0.9551	0.3967	0.9551	0.9773
No log	4.5	198	0.8439	0.4598	0.8439	0.9186
No log	4.5455	200	0.6741	0.496	0.6741	0.8210
No log	4.5909	202	0.6386	0.4955	0.6386	0.7992
No log	4.6364	204	0.6210	0.4635	0.6210	0.7881
No log	4.6818	206	0.6323	0.4732	0.6323	0.7951
No log	4.7273	208	0.7151	0.4688	0.7151	0.8456
No log	4.7727	210	0.8688	0.4087	0.8688	0.9321
No log	4.8182	212	0.8131	0.4516	0.8131	0.9017
No log	4.8636	214	0.6852	0.4192	0.6852	0.8278
No log	4.9091	216	0.6989	0.4187	0.6989	0.8360
No log	4.9545	218	0.7324	0.4450	0.7324	0.8558
No log	5.0	220	0.7032	0.4091	0.7032	0.8386
No log	5.0455	222	0.6622	0.4180	0.6622	0.8138
No log	5.0909	224	0.6590	0.4361	0.6590	0.8118
No log	5.1364	226	0.6829	0.4945	0.6829	0.8263
No log	5.1818	228	0.7215	0.4559	0.7215	0.8494
No log	5.2273	230	0.6951	0.4614	0.6951	0.8337
No log	5.2727	232	0.6702	0.4722	0.6702	0.8187
No log	5.3182	234	0.6648	0.4647	0.6648	0.8154
No log	5.3636	236	0.6728	0.4838	0.6728	0.8203
No log	5.4091	238	0.6762	0.4507	0.6762	0.8223
No log	5.4545	240	0.6592	0.4854	0.6592	0.8119
No log	5.5	242	0.6481	0.4825	0.6481	0.8051
No log	5.5455	244	0.6659	0.4888	0.6659	0.8160
No log	5.5909	246	0.6772	0.4658	0.6772	0.8229
No log	5.6364	248	0.7431	0.4608	0.7431	0.8620
No log	5.6818	250	0.6734	0.4785	0.6734	0.8206
No log	5.7273	252	0.6106	0.5638	0.6106	0.7814
No log	5.7727	254	0.6448	0.4662	0.6448	0.8030
No log	5.8182	256	0.6234	0.5257	0.6234	0.7896
No log	5.8636	258	0.6436	0.4916	0.6436	0.8022
No log	5.9091	260	0.6940	0.4912	0.6940	0.8331
No log	5.9545	262	0.6665	0.4904	0.6665	0.8164
No log	6.0	264	0.6288	0.5349	0.6288	0.7930
No log	6.0455	266	0.6177	0.5314	0.6177	0.7860
No log	6.0909	268	0.5964	0.5182	0.5964	0.7723
No log	6.1364	270	0.6197	0.5105	0.6197	0.7872
No log	6.1818	272	0.6182	0.5013	0.6182	0.7863
No log	6.2273	274	0.6060	0.4977	0.6060	0.7784
No log	6.2727	276	0.6203	0.4828	0.6203	0.7876
No log	6.3182	278	0.6056	0.4886	0.6056	0.7782
No log	6.3636	280	0.5999	0.4913	0.5999	0.7745
No log	6.4091	282	0.6279	0.4684	0.6279	0.7924
No log	6.4545	284	0.6089	0.5595	0.6089	0.7803
No log	6.5	286	0.6448	0.4791	0.6448	0.8030
No log	6.5455	288	0.6310	0.5025	0.6310	0.7944
No log	6.5909	290	0.6074	0.5492	0.6074	0.7794
No log	6.6364	292	0.6068	0.5409	0.6068	0.7790
No log	6.6818	294	0.5972	0.4529	0.5972	0.7728
No log	6.7273	296	0.5964	0.4663	0.5964	0.7723
No log	6.7727	298	0.5952	0.4673	0.5952	0.7715
No log	6.8182	300	0.5948	0.4710	0.5948	0.7712
No log	6.8636	302	0.6414	0.5003	0.6414	0.8009
No log	6.9091	304	0.7323	0.4604	0.7323	0.8558
No log	6.9545	306	0.6861	0.5347	0.6861	0.8283
No log	7.0	308	0.6391	0.4710	0.6391	0.7994
No log	7.0455	310	0.7044	0.48	0.7044	0.8393
No log	7.0909	312	0.6578	0.4619	0.6578	0.8111
No log	7.1364	314	0.5961	0.5181	0.5961	0.7721
No log	7.1818	316	0.6105	0.4621	0.6105	0.7814
No log	7.2273	318	0.5932	0.5095	0.5932	0.7702
No log	7.2727	320	0.5881	0.5547	0.5881	0.7669
No log	7.3182	322	0.6924	0.5215	0.6924	0.8321
No log	7.3636	324	0.8235	0.4467	0.8235	0.9075
No log	7.4091	326	0.7985	0.4555	0.7985	0.8936
No log	7.4545	328	0.6611	0.5143	0.6611	0.8131
No log	7.5	330	0.5828	0.5310	0.5828	0.7634
No log	7.5455	332	0.5832	0.4832	0.5832	0.7637
No log	7.5909	334	0.5881	0.5361	0.5881	0.7669
No log	7.6364	336	0.6486	0.5026	0.6486	0.8054
No log	7.6818	338	0.7584	0.4782	0.7584	0.8709
No log	7.7273	340	0.7394	0.5039	0.7394	0.8599
No log	7.7727	342	0.6313	0.5325	0.6313	0.7945
No log	7.8182	344	0.5940	0.5365	0.5940	0.7707
No log	7.8636	346	0.5865	0.4297	0.5865	0.7658
No log	7.9091	348	0.5846	0.4170	0.5846	0.7646
No log	7.9545	350	0.6003	0.5515	0.6003	0.7748
No log	8.0	352	0.6352	0.5323	0.6352	0.7970
No log	8.0455	354	0.6212	0.5063	0.6212	0.7882
No log	8.0909	356	0.6206	0.5882	0.6206	0.7878
No log	8.1364	358	0.6264	0.5662	0.6264	0.7915
No log	8.1818	360	0.6113	0.5365	0.6113	0.7819
No log	8.2273	362	0.6029	0.5357	0.6029	0.7765
No log	8.2727	364	0.5879	0.4861	0.5879	0.7668
No log	8.3182	366	0.5889	0.4861	0.5889	0.7674
No log	8.3636	368	0.6136	0.4793	0.6136	0.7833
No log	8.4091	370	0.6643	0.4889	0.6643	0.8150
No log	8.4545	372	0.6410	0.4946	0.6410	0.8006
No log	8.5	374	0.6011	0.4693	0.6011	0.7753
No log	8.5455	376	0.6598	0.5239	0.6598	0.8123
No log	8.5909	378	0.7358	0.4668	0.7358	0.8578
No log	8.6364	380	0.6975	0.4837	0.6975	0.8352
No log	8.6818	382	0.6211	0.4985	0.6211	0.7881
No log	8.7273	384	0.5859	0.4821	0.5859	0.7654
No log	8.7727	386	0.6093	0.4537	0.6093	0.7806
No log	8.8182	388	0.6205	0.4828	0.6205	0.7877
No log	8.8636	390	0.5971	0.5061	0.5971	0.7728
No log	8.9091	392	0.6863	0.5132	0.6863	0.8284
No log	8.9545	394	0.7948	0.4598	0.7948	0.8915
No log	9.0	396	0.7604	0.5039	0.7604	0.8720
No log	9.0455	398	0.6332	0.5263	0.6332	0.7957
No log	9.0909	400	0.5844	0.4977	0.5844	0.7645
No log	9.1364	402	0.5868	0.4677	0.5868	0.7661
No log	9.1818	404	0.6049	0.4823	0.6049	0.7778
No log	9.2273	406	0.6879	0.5423	0.6879	0.8294
No log	9.2727	408	0.8739	0.4004	0.8739	0.9348
No log	9.3182	410	0.9873	0.3057	0.9873	0.9936
No log	9.3636	412	0.9486	0.3790	0.9486	0.9740
No log	9.4091	414	0.7995	0.4515	0.7995	0.8941
No log	9.4545	416	0.6741	0.5275	0.6741	0.8211
No log	9.5	418	0.6277	0.5668	0.6277	0.7923
No log	9.5455	420	0.6157	0.5649	0.6157	0.7847
No log	9.5909	422	0.6132	0.5707	0.6132	0.7831
No log	9.6364	424	0.5987	0.5384	0.5987	0.7737
No log	9.6818	426	0.5663	0.4887	0.5663	0.7526
No log	9.7273	428	0.5914	0.5076	0.5914	0.7690
No log	9.7727	430	0.6416	0.4996	0.6416	0.8010
No log	9.8182	432	0.6318	0.5296	0.6318	0.7949
No log	9.8636	434	0.5957	0.6007	0.5957	0.7718
No log	9.9091	436	0.6009	0.5957	0.6009	0.7752
No log	9.9545	438	0.6046	0.6052	0.6046	0.7775
No log	10.0	440	0.6144	0.5778	0.6144	0.7838
No log	10.0455	442	0.6410	0.5582	0.6410	0.8006
No log	10.0909	444	0.6408	0.4879	0.6408	0.8005
No log	10.1364	446	0.6053	0.4555	0.6053	0.7780
No log	10.1818	448	0.5748	0.5100	0.5748	0.7582
No log	10.2273	450	0.5771	0.6040	0.5771	0.7596
No log	10.2727	452	0.5774	0.6040	0.5774	0.7599
No log	10.3182	454	0.5664	0.4868	0.5664	0.7526
No log	10.3636	456	0.5774	0.4489	0.5774	0.7599
No log	10.4091	458	0.5791	0.4810	0.5791	0.7610
No log	10.4545	460	0.5914	0.5914	0.5914	0.7690
No log	10.5	462	0.6109	0.5689	0.6109	0.7816
No log	10.5455	464	0.6235	0.5499	0.6235	0.7896
No log	10.5909	466	0.6195	0.5534	0.6195	0.7871
No log	10.6364	468	0.6312	0.5142	0.6312	0.7945
No log	10.6818	470	0.6680	0.4794	0.6680	0.8173
No log	10.7273	472	0.7254	0.4283	0.7254	0.8517
No log	10.7727	474	0.6839	0.4174	0.6839	0.8270
No log	10.8182	476	0.6230	0.4339	0.6230	0.7893
No log	10.8636	478	0.5787	0.4413	0.5787	0.7607
No log	10.9091	480	0.6010	0.5851	0.6010	0.7752
No log	10.9545	482	0.6633	0.5422	0.6633	0.8144
No log	11.0	484	0.6699	0.5587	0.6699	0.8185
No log	11.0455	486	0.6290	0.5613	0.6290	0.7931
No log	11.0909	488	0.6307	0.4857	0.6307	0.7942
No log	11.1364	490	0.6316	0.5163	0.6316	0.7947
No log	11.1818	492	0.6237	0.5474	0.6237	0.7897
No log	11.2273	494	0.6546	0.5549	0.6546	0.8091
No log	11.2727	496	0.7243	0.5153	0.7243	0.8511
No log	11.3182	498	0.7391	0.5061	0.7391	0.8597
0.3567	11.3636	500	0.6799	0.5262	0.6799	0.8245
0.3567	11.4091	502	0.6323	0.5422	0.6323	0.7952
0.3567	11.4545	504	0.6467	0.5420	0.6467	0.8042
0.3567	11.5	506	0.6791	0.5325	0.6791	0.8241
0.3567	11.5455	508	0.6844	0.5092	0.6844	0.8273
0.3567	11.5909	510	0.6981	0.5589	0.6981	0.8356
0.3567	11.6364	512	0.7115	0.5132	0.7115	0.8435
0.3567	11.6818	514	0.6951	0.5214	0.6951	0.8338
0.3567	11.7273	516	0.6807	0.5229	0.6807	0.8250
0.3567	11.7727	518	0.6735	0.5316	0.6735	0.8207
0.3567	11.8182	520	0.6462	0.5208	0.6462	0.8039
0.3567	11.8636	522	0.6724	0.5330	0.6724	0.8200
0.3567	11.9091	524	0.6939	0.5265	0.6939	0.8330
0.3567	11.9545	526	0.6815	0.5157	0.6815	0.8255
0.3567	12.0	528	0.7306	0.5164	0.7306	0.8548
0.3567	12.0455	530	0.7844	0.4877	0.7844	0.8857
0.3567	12.0909	532	0.7542	0.4848	0.7542	0.8685
0.3567	12.1364	534	0.6655	0.5411	0.6655	0.8158
0.3567	12.1818	536	0.6089	0.5640	0.6089	0.7803
0.3567	12.2273	538	0.6010	0.5453	0.6010	0.7753
0.3567	12.2727	540	0.6269	0.5597	0.6269	0.7917
0.3567	12.3182	542	0.6924	0.5019	0.6924	0.8321
0.3567	12.3636	544	0.7128	0.4633	0.7128	0.8443
0.3567	12.4091	546	0.6771	0.5147	0.6771	0.8229
0.3567	12.4545	548	0.6412	0.5942	0.6412	0.8007
0.3567	12.5	550	0.6626	0.5397	0.6626	0.8140
0.3567	12.5455	552	0.6609	0.5084	0.6609	0.8130
0.3567	12.5909	554	0.6274	0.5011	0.6274	0.7921
0.3567	12.6364	556	0.5962	0.5193	0.5962	0.7722
0.3567	12.6818	558	0.6030	0.4958	0.6030	0.7765
0.3567	12.7273	560	0.6070	0.4930	0.6070	0.7791

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1