ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5159
• Qwk: 0.5081
• Mse: 0.5159
• Rmse: 0.7182

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.025	2	2.6899	-0.0262	2.6899	1.6401
No log	0.05	4	1.6747	0.0372	1.6747	1.2941
No log	0.075	6	0.8475	0.2435	0.8475	0.9206
No log	0.1	8	0.8280	-0.0127	0.8280	0.9099
No log	0.125	10	0.9942	0.2635	0.9942	0.9971
No log	0.15	12	1.0991	0.2160	1.0991	1.0484
No log	0.175	14	1.0782	0.2543	1.0782	1.0384
No log	0.2	16	1.0594	0.2020	1.0594	1.0293
No log	0.225	18	0.9534	0.1747	0.9534	0.9764
No log	0.25	20	0.8771	0.1867	0.8771	0.9365
No log	0.275	22	0.7187	0.1187	0.7187	0.8478
No log	0.3	24	0.7247	0.0481	0.7247	0.8513
No log	0.325	26	0.7815	0.1372	0.7815	0.8840
No log	0.35	28	0.7237	0.0937	0.7237	0.8507
No log	0.375	30	0.6828	0.1232	0.6828	0.8263
No log	0.4	32	0.8143	0.0966	0.8143	0.9024
No log	0.425	34	0.9097	0.2012	0.9097	0.9538
No log	0.45	36	0.7688	0.3746	0.7688	0.8768
No log	0.475	38	0.6275	0.3976	0.6275	0.7922
No log	0.5	40	0.5763	0.3745	0.5763	0.7592
No log	0.525	42	0.5611	0.4151	0.5611	0.7490
No log	0.55	44	0.5536	0.4457	0.5536	0.7441
No log	0.575	46	0.5116	0.4569	0.5116	0.7153
No log	0.6	48	0.4855	0.5765	0.4855	0.6968
No log	0.625	50	0.4534	0.5782	0.4534	0.6734
No log	0.65	52	0.4671	0.5714	0.4671	0.6835
No log	0.675	54	0.4516	0.6852	0.4516	0.6720
No log	0.7	56	0.4628	0.6395	0.4628	0.6803
No log	0.725	58	0.4741	0.6389	0.4741	0.6886
No log	0.75	60	0.5063	0.6741	0.5063	0.7116
No log	0.775	62	0.5718	0.5948	0.5718	0.7562
No log	0.8	64	0.5809	0.5948	0.5809	0.7622
No log	0.825	66	0.5056	0.6411	0.5056	0.7110
No log	0.85	68	0.6552	0.4884	0.6552	0.8094
No log	0.875	70	0.9743	0.2944	0.9743	0.9870
No log	0.9	72	0.9822	0.3139	0.9822	0.9911
No log	0.925	74	0.7462	0.4901	0.7462	0.8638
No log	0.95	76	0.5128	0.5479	0.5128	0.7161
No log	0.975	78	0.5205	0.4617	0.5205	0.7215
No log	1.0	80	0.5585	0.4428	0.5585	0.7473
No log	1.025	82	0.5440	0.5158	0.5440	0.7376
No log	1.05	84	0.5361	0.5769	0.5361	0.7322
No log	1.075	86	0.5536	0.6003	0.5536	0.7441
No log	1.1	88	0.5378	0.6540	0.5378	0.7334
No log	1.125	90	0.5077	0.6796	0.5077	0.7125
No log	1.15	92	0.4958	0.6484	0.4958	0.7041
No log	1.175	94	0.5120	0.6699	0.5120	0.7155
No log	1.2	96	0.6293	0.5584	0.6293	0.7933
No log	1.225	98	0.6488	0.4870	0.6488	0.8055
No log	1.25	100	0.5156	0.5327	0.5156	0.7180
No log	1.275	102	0.4924	0.5042	0.4924	0.7017
No log	1.3	104	0.5124	0.5127	0.5124	0.7158
No log	1.325	106	0.5972	0.5378	0.5972	0.7728
No log	1.35	108	0.5945	0.5448	0.5945	0.7710
No log	1.375	110	0.6955	0.5869	0.6955	0.8340
No log	1.4	112	0.9524	0.5244	0.9524	0.9759
No log	1.425	114	0.8990	0.5359	0.8990	0.9481
No log	1.45	116	0.6841	0.6040	0.6841	0.8271
No log	1.475	118	0.5830	0.5891	0.5830	0.7636
No log	1.5	120	0.5632	0.5701	0.5632	0.7505
No log	1.525	122	0.5613	0.5660	0.5613	0.7492
No log	1.55	124	0.6125	0.4853	0.6125	0.7826
No log	1.575	126	0.6441	0.4321	0.6441	0.8026
No log	1.6	128	0.5680	0.5335	0.5680	0.7537
No log	1.625	130	0.5352	0.5669	0.5352	0.7316
No log	1.65	132	0.5509	0.5634	0.5509	0.7422
No log	1.675	134	0.6170	0.5592	0.6170	0.7855
No log	1.7	136	0.7300	0.5586	0.7300	0.8544
No log	1.725	138	0.6821	0.5555	0.6821	0.8259
No log	1.75	140	0.5470	0.5888	0.5470	0.7396
No log	1.775	142	0.5190	0.6087	0.5190	0.7204
No log	1.8	144	0.5153	0.6289	0.5153	0.7179
No log	1.825	146	0.5246	0.6474	0.5246	0.7243
No log	1.85	148	0.5682	0.6241	0.5682	0.7538
No log	1.875	150	0.5546	0.6174	0.5546	0.7447
No log	1.9	152	0.5277	0.5891	0.5277	0.7264
No log	1.925	154	0.5054	0.6083	0.5054	0.7109
No log	1.95	156	0.6701	0.4735	0.6701	0.8186
No log	1.975	158	0.6653	0.4667	0.6653	0.8157
No log	2.0	160	0.5592	0.5524	0.5592	0.7478
No log	2.025	162	0.5125	0.6083	0.5125	0.7159
No log	2.05	164	0.5154	0.6009	0.5154	0.7179
No log	2.075	166	0.5314	0.5594	0.5314	0.7290
No log	2.1	168	0.5759	0.5524	0.5759	0.7589
No log	2.125	170	0.5942	0.5523	0.5942	0.7709
No log	2.15	172	0.5448	0.5586	0.5448	0.7381
No log	2.175	174	0.5164	0.5098	0.5164	0.7186
No log	2.2	176	0.4923	0.6032	0.4923	0.7016
No log	2.225	178	0.4843	0.6158	0.4843	0.6959
No log	2.25	180	0.5046	0.6174	0.5046	0.7104
No log	2.275	182	0.5030	0.6174	0.5030	0.7092
No log	2.3	184	0.4961	0.6494	0.4961	0.7043
No log	2.325	186	0.5342	0.5868	0.5342	0.7309
No log	2.35	188	0.5020	0.5929	0.5020	0.7085
No log	2.375	190	0.5282	0.5872	0.5282	0.7268
No log	2.4	192	0.6313	0.4837	0.6313	0.7945
No log	2.425	194	0.6770	0.4442	0.6770	0.8228
No log	2.45	196	0.5898	0.4966	0.5898	0.7680
No log	2.475	198	0.4936	0.6228	0.4936	0.7026
No log	2.5	200	0.4865	0.6395	0.4865	0.6975
No log	2.525	202	0.4804	0.6479	0.4804	0.6931
No log	2.55	204	0.4893	0.6632	0.4893	0.6995
No log	2.575	206	0.5280	0.5552	0.5280	0.7266
No log	2.6	208	0.5234	0.6070	0.5234	0.7235
No log	2.625	210	0.4901	0.6639	0.4901	0.7001
No log	2.65	212	0.4881	0.6092	0.4881	0.6987
No log	2.675	214	0.5020	0.5799	0.5020	0.7085
No log	2.7	216	0.5452	0.5587	0.5452	0.7384
No log	2.725	218	0.4990	0.5729	0.4990	0.7064
No log	2.75	220	0.4914	0.5729	0.4914	0.7010
No log	2.775	222	0.5266	0.5786	0.5266	0.7256
No log	2.8	224	0.5780	0.5470	0.5780	0.7603
No log	2.825	226	0.5647	0.5906	0.5647	0.7515
No log	2.85	228	0.5124	0.6032	0.5124	0.7158
No log	2.875	230	0.5087	0.5894	0.5087	0.7132
No log	2.9	232	0.4886	0.5708	0.4886	0.6990
No log	2.925	234	0.4810	0.5632	0.4810	0.6935
No log	2.95	236	0.4785	0.5647	0.4785	0.6917
No log	2.975	238	0.5261	0.5668	0.5261	0.7253
No log	3.0	240	0.5106	0.5729	0.5106	0.7146
No log	3.025	242	0.5051	0.6053	0.5051	0.7107
No log	3.05	244	0.5488	0.6017	0.5488	0.7408
No log	3.075	246	0.5056	0.5634	0.5056	0.7111
No log	3.1	248	0.5148	0.5899	0.5148	0.7175
No log	3.125	250	0.5101	0.5389	0.5101	0.7142
No log	3.15	252	0.5189	0.5173	0.5189	0.7203
No log	3.175	254	0.4957	0.6065	0.4957	0.7041
No log	3.2	256	0.5001	0.5322	0.5001	0.7072
No log	3.225	258	0.5432	0.5382	0.5432	0.7370
No log	3.25	260	0.5480	0.5574	0.5480	0.7402
No log	3.275	262	0.5893	0.5222	0.5893	0.7676
No log	3.3	264	0.5145	0.6084	0.5145	0.7173
No log	3.325	266	0.5126	0.6245	0.5126	0.7160
No log	3.35	268	0.4996	0.5939	0.4996	0.7068
No log	3.375	270	0.4928	0.6346	0.4928	0.7020
No log	3.4	272	0.4773	0.5941	0.4773	0.6908
No log	3.425	274	0.4723	0.6010	0.4723	0.6873
No log	3.45	276	0.4970	0.5497	0.4970	0.7050
No log	3.475	278	0.5172	0.5538	0.5172	0.7192
No log	3.5	280	0.4883	0.5758	0.4883	0.6988
No log	3.525	282	0.4600	0.6186	0.4600	0.6782
No log	3.55	284	0.4727	0.6112	0.4727	0.6876
No log	3.575	286	0.4652	0.6070	0.4652	0.6821
No log	3.6	288	0.4682	0.5741	0.4682	0.6843
No log	3.625	290	0.4677	0.6082	0.4677	0.6839
No log	3.65	292	0.4852	0.5340	0.4852	0.6965
No log	3.675	294	0.5003	0.5118	0.5003	0.7073
No log	3.7	296	0.5131	0.5142	0.5131	0.7163
No log	3.725	298	0.5087	0.5947	0.5087	0.7132
No log	3.75	300	0.5387	0.5452	0.5387	0.7340
No log	3.775	302	0.5518	0.5275	0.5518	0.7428
No log	3.8	304	0.4912	0.5786	0.4912	0.7008
No log	3.825	306	0.4729	0.6029	0.4729	0.6877
No log	3.85	308	0.4516	0.6303	0.4516	0.6720
No log	3.875	310	0.4557	0.5765	0.4557	0.6751
No log	3.9	312	0.5007	0.5569	0.5007	0.7076
No log	3.925	314	0.5200	0.5497	0.5200	0.7211
No log	3.95	316	0.4951	0.6973	0.4951	0.7036
No log	3.975	318	0.5542	0.6200	0.5542	0.7445
No log	4.0	320	0.7317	0.5649	0.7317	0.8554
No log	4.025	322	0.6922	0.5620	0.6922	0.8320
No log	4.05	324	0.5282	0.5678	0.5282	0.7268
No log	4.075	326	0.4522	0.6082	0.4522	0.6724
No log	4.1	328	0.4381	0.6303	0.4381	0.6619
No log	4.125	330	0.4396	0.6321	0.4396	0.6630
No log	4.15	332	0.4901	0.6150	0.4901	0.7001
No log	4.175	334	0.4834	0.6162	0.4834	0.6953
No log	4.2	336	0.4378	0.7101	0.4378	0.6616
No log	4.225	338	0.4603	0.6526	0.4603	0.6785
No log	4.25	340	0.4797	0.6092	0.4797	0.6926
No log	4.275	342	0.4533	0.7128	0.4533	0.6733
No log	4.3	344	0.4557	0.6484	0.4557	0.6751
No log	4.325	346	0.4902	0.6487	0.4902	0.7002
No log	4.35	348	0.4854	0.6560	0.4854	0.6967
No log	4.375	350	0.4744	0.6186	0.4744	0.6888
No log	4.4	352	0.4666	0.6158	0.4666	0.6831
No log	4.425	354	0.4705	0.5956	0.4705	0.6859
No log	4.45	356	0.4836	0.5708	0.4836	0.6954
No log	4.475	358	0.5291	0.5512	0.5291	0.7274
No log	4.5	360	0.5453	0.5719	0.5453	0.7384
No log	4.525	362	0.5114	0.5741	0.5114	0.7151
No log	4.55	364	0.4956	0.5057	0.4956	0.7040
No log	4.575	366	0.5028	0.5523	0.5028	0.7091
No log	4.6	368	0.5108	0.4678	0.5108	0.7147
No log	4.625	370	0.5354	0.5827	0.5354	0.7317
No log	4.65	372	0.5365	0.5633	0.5365	0.7325
No log	4.675	374	0.5442	0.5801	0.5442	0.7377
No log	4.7	376	0.5140	0.5708	0.5140	0.7169
No log	4.725	378	0.5017	0.5786	0.5017	0.7083
No log	4.75	380	0.4762	0.6096	0.4762	0.6901
No log	4.775	382	0.4646	0.6142	0.4646	0.6816
No log	4.8	384	0.4641	0.6455	0.4641	0.6813
No log	4.825	386	0.4720	0.6295	0.4720	0.6870
No log	4.85	388	0.5123	0.6062	0.5123	0.7157
No log	4.875	390	0.5264	0.5985	0.5264	0.7255
No log	4.9	392	0.4870	0.6371	0.4870	0.6979
No log	4.925	394	0.4763	0.5974	0.4763	0.6902
No log	4.95	396	0.4920	0.5467	0.4920	0.7015
No log	4.975	398	0.4916	0.5538	0.4916	0.7012
No log	5.0	400	0.4788	0.5640	0.4788	0.6920
No log	5.025	402	0.4951	0.5970	0.4951	0.7036
No log	5.05	404	0.5207	0.6063	0.5207	0.7216
No log	5.075	406	0.5338	0.6189	0.5338	0.7306
No log	5.1	408	0.4790	0.6175	0.4790	0.6921
No log	5.125	410	0.4539	0.6398	0.4539	0.6738
No log	5.15	412	0.4686	0.6006	0.4686	0.6845
No log	5.175	414	0.4602	0.5891	0.4602	0.6784
No log	5.2	416	0.4529	0.6173	0.4529	0.6730
No log	5.225	418	0.4721	0.6135	0.4721	0.6871
No log	5.25	420	0.4849	0.6135	0.4849	0.6964
No log	5.275	422	0.5040	0.6011	0.5040	0.7099
No log	5.3	424	0.4607	0.5923	0.4607	0.6787
No log	5.325	426	0.4337	0.6365	0.4337	0.6585
No log	5.35	428	0.4617	0.6582	0.4617	0.6795
No log	5.375	430	0.4827	0.5795	0.4827	0.6948
No log	5.4	432	0.4766	0.5795	0.4766	0.6904
No log	5.425	434	0.4577	0.6383	0.4577	0.6765
No log	5.45	436	0.4577	0.6132	0.4577	0.6765
No log	5.475	438	0.4990	0.5726	0.4990	0.7064
No log	5.5	440	0.5189	0.5831	0.5189	0.7204
No log	5.525	442	0.4926	0.5528	0.4926	0.7018
No log	5.55	444	0.4716	0.6240	0.4716	0.6867
No log	5.575	446	0.5003	0.6162	0.5003	0.7073
No log	5.6	448	0.5259	0.6298	0.5260	0.7252
No log	5.625	450	0.4986	0.6232	0.4986	0.7061
No log	5.65	452	0.4754	0.6325	0.4754	0.6895
No log	5.675	454	0.4740	0.6423	0.4740	0.6885
No log	5.7	456	0.4832	0.5970	0.4832	0.6951
No log	5.725	458	0.4673	0.6235	0.4673	0.6836
No log	5.75	460	0.4440	0.6841	0.4440	0.6664
No log	5.775	462	0.4600	0.6326	0.4600	0.6783
No log	5.8	464	0.4916	0.5970	0.4916	0.7011
No log	5.825	466	0.5109	0.6221	0.5109	0.7148
No log	5.85	468	0.4889	0.6477	0.4889	0.6992
No log	5.875	470	0.4757	0.6398	0.4757	0.6897
No log	5.9	472	0.4711	0.6472	0.4711	0.6863
No log	5.925	474	0.4642	0.6286	0.4642	0.6813
No log	5.95	476	0.4674	0.6132	0.4674	0.6837
No log	5.975	478	0.4492	0.6132	0.4492	0.6702
No log	6.0	480	0.4386	0.6923	0.4386	0.6623
No log	6.025	482	0.4899	0.5095	0.4899	0.6999
No log	6.05	484	0.5562	0.5315	0.5562	0.7458
No log	6.075	486	0.5429	0.5095	0.5429	0.7368
No log	6.1	488	0.4788	0.6582	0.4788	0.6919
No log	6.125	490	0.4513	0.6484	0.4513	0.6718
No log	6.15	492	0.4363	0.6551	0.4363	0.6605
No log	6.175	494	0.4452	0.6240	0.4452	0.6672
No log	6.2	496	0.4516	0.5882	0.4516	0.6720
No log	6.225	498	0.4679	0.6029	0.4679	0.6840
0.3245	6.25	500	0.4889	0.5252	0.4889	0.6992
0.3245	6.275	502	0.5228	0.4815	0.5228	0.7230
0.3245	6.3	504	0.5328	0.5158	0.5328	0.7299
0.3245	6.325	506	0.5501	0.5410	0.5501	0.7417
0.3245	6.35	508	0.5542	0.5117	0.5542	0.7445
0.3245	6.375	510	0.5494	0.5931	0.5494	0.7412
0.3245	6.4	512	0.5044	0.5906	0.5044	0.7102
0.3245	6.425	514	0.4518	0.6018	0.4518	0.6722
0.3245	6.45	516	0.4354	0.6359	0.4354	0.6599
0.3245	6.475	518	0.4281	0.6650	0.4281	0.6543
0.3245	6.5	520	0.4399	0.6198	0.4399	0.6632
0.3245	6.525	522	0.4630	0.6198	0.4630	0.6804
0.3245	6.55	524	0.4938	0.6127	0.4938	0.7027
0.3245	6.575	526	0.4927	0.6127	0.4927	0.7020
0.3245	6.6	528	0.4642	0.6472	0.4642	0.6813
0.3245	6.625	530	0.4523	0.6469	0.4523	0.6725
0.3245	6.65	532	0.4468	0.6839	0.4468	0.6684
0.3245	6.675	534	0.4419	0.6650	0.4419	0.6648
0.3245	6.7	536	0.4612	0.5501	0.4612	0.6791
0.3245	6.725	538	0.4670	0.5770	0.4670	0.6834
0.3245	6.75	540	0.4535	0.6278	0.4535	0.6734
0.3245	6.775	542	0.4468	0.5882	0.4468	0.6684
0.3245	6.8	544	0.4393	0.5882	0.4393	0.6628
0.3245	6.825	546	0.4321	0.5882	0.4321	0.6573
0.3245	6.85	548	0.4208	0.6145	0.4208	0.6487
0.3245	6.875	550	0.4360	0.7042	0.4360	0.6603
0.3245	6.9	552	0.4365	0.7042	0.4365	0.6606
0.3245	6.925	554	0.4287	0.6032	0.4287	0.6547
0.3245	6.95	556	0.4774	0.5586	0.4774	0.6910
0.3245	6.975	558	0.6136	0.4862	0.6136	0.7833
0.3245	7.0	560	0.6274	0.4862	0.6274	0.7921
0.3245	7.025	562	0.5313	0.5329	0.5313	0.7289
0.3245	7.05	564	0.4591	0.5271	0.4591	0.6776
0.3245	7.075	566	0.4534	0.6169	0.4534	0.6733
0.3245	7.1	568	0.4548	0.5915	0.4548	0.6744
0.3245	7.125	570	0.4496	0.6142	0.4496	0.6705
0.3245	7.15	572	0.4756	0.6719	0.4756	0.6897
0.3245	7.175	574	0.5359	0.6325	0.5359	0.7321
0.3245	7.2	576	0.5562	0.6392	0.5562	0.7458
0.3245	7.225	578	0.5313	0.6548	0.5313	0.7289
0.3245	7.25	580	0.4989	0.6559	0.4989	0.7063
0.3245	7.275	582	0.4831	0.5596	0.4831	0.6950
0.3245	7.3	584	0.4879	0.4876	0.4879	0.6985
0.3245	7.325	586	0.4916	0.4615	0.4916	0.7012
0.3245	7.35	588	0.4918	0.5488	0.4918	0.7013
0.3245	7.375	590	0.4827	0.5003	0.4827	0.6948
0.3245	7.4	592	0.4826	0.5003	0.4826	0.6947
0.3245	7.425	594	0.4816	0.5250	0.4816	0.6940
0.3245	7.45	596	0.4775	0.5550	0.4775	0.6910
0.3245	7.475	598	0.4835	0.5455	0.4835	0.6953
0.3245	7.5	600	0.4963	0.5671	0.4963	0.7045
0.3245	7.525	602	0.5309	0.5845	0.5309	0.7287
0.3245	7.55	604	0.5526	0.5845	0.5526	0.7434
0.3245	7.575	606	0.5621	0.5845	0.5621	0.7497
0.3245	7.6	608	0.5649	0.4147	0.5649	0.7516
0.3245	7.625	610	0.5762	0.3665	0.5762	0.7591
0.3245	7.65	612	0.6098	0.5773	0.6098	0.7809
0.3245	7.675	614	0.6413	0.5113	0.6413	0.8008
0.3245	7.7	616	0.6194	0.5048	0.6194	0.7870
0.3245	7.725	618	0.5570	0.5330	0.5570	0.7463
0.3245	7.75	620	0.5221	0.5091	0.5221	0.7226
0.3245	7.775	622	0.4928	0.5091	0.4928	0.7020
0.3245	7.8	624	0.4917	0.5091	0.4917	0.7012
0.3245	7.825	626	0.5027	0.5017	0.5027	0.7090
0.3245	7.85	628	0.5159	0.5081	0.5159	0.7182

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1