ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5697
• Qwk: 0.3197
• Mse: 0.5697
• Rmse: 0.7548

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	2.6336	-0.0924	2.6336	1.6228
No log	0.1	4	1.3909	0.0771	1.3909	1.1794
No log	0.15	6	0.7278	0.1770	0.7278	0.8531
No log	0.2	8	0.8823	0.1461	0.8823	0.9393
No log	0.25	10	0.8859	0.2552	0.8859	0.9412
No log	0.3	12	0.7289	0.3294	0.7289	0.8537
No log	0.35	14	0.5648	0.4136	0.5648	0.7515
No log	0.4	16	0.5881	0.4698	0.5881	0.7669
No log	0.45	18	0.6265	0.5095	0.6265	0.7915
No log	0.5	20	0.7034	0.4615	0.7034	0.8387
No log	0.55	22	0.8492	0.2772	0.8492	0.9215
No log	0.6	24	0.6848	0.4725	0.6848	0.8275
No log	0.65	26	0.5430	0.6168	0.5430	0.7369
No log	0.7	28	0.5496	0.5379	0.5496	0.7414
No log	0.75	30	0.5735	0.4437	0.5735	0.7573
No log	0.8	32	0.5274	0.5189	0.5274	0.7262
No log	0.85	34	0.5245	0.4970	0.5245	0.7242
No log	0.9	36	0.5197	0.4801	0.5197	0.7209
No log	0.95	38	0.5395	0.5195	0.5395	0.7345
No log	1.0	40	0.6273	0.5721	0.6273	0.7920
No log	1.05	42	0.5554	0.6183	0.5554	0.7453
No log	1.1	44	0.5524	0.5288	0.5524	0.7432
No log	1.15	46	0.5586	0.5428	0.5586	0.7474
No log	1.2	48	0.6068	0.5368	0.6068	0.7790
No log	1.25	50	0.5857	0.5041	0.5857	0.7653
No log	1.3	52	0.6138	0.5399	0.6138	0.7835
No log	1.35	54	0.6864	0.5077	0.6864	0.8285
No log	1.4	56	0.5627	0.4824	0.5627	0.7501
No log	1.45	58	0.6290	0.5208	0.6290	0.7931
No log	1.5	60	0.6395	0.5336	0.6395	0.7997
No log	1.55	62	0.5975	0.5111	0.5975	0.7730
No log	1.6	64	0.4944	0.6301	0.4944	0.7032
No log	1.65	66	0.6147	0.5450	0.6147	0.7840
No log	1.7	68	0.7688	0.4852	0.7688	0.8768
No log	1.75	70	0.6704	0.5017	0.6704	0.8188
No log	1.8	72	0.5089	0.6740	0.5089	0.7134
No log	1.85	74	0.5161	0.6088	0.5161	0.7184
No log	1.9	76	0.5229	0.6918	0.5229	0.7231
No log	1.95	78	0.5655	0.5552	0.5655	0.7520
No log	2.0	80	0.5135	0.5553	0.5135	0.7166
No log	2.05	82	0.4590	0.6587	0.4590	0.6775
No log	2.1	84	0.4876	0.6150	0.4876	0.6983
No log	2.15	86	0.4814	0.5786	0.4814	0.6939
No log	2.2	88	0.4458	0.5782	0.4458	0.6677
No log	2.25	90	0.5102	0.5226	0.5102	0.7143
No log	2.3	92	0.5554	0.5153	0.5554	0.7453
No log	2.35	94	0.5269	0.5883	0.5269	0.7259
No log	2.4	96	0.5633	0.5393	0.5633	0.7505
No log	2.45	98	0.6456	0.5538	0.6456	0.8035
No log	2.5	100	0.5618	0.5672	0.5618	0.7495
No log	2.55	102	0.5617	0.6207	0.5617	0.7495
No log	2.6	104	0.5406	0.6467	0.5406	0.7353
No log	2.65	106	0.5273	0.5996	0.5273	0.7262
No log	2.7	108	0.5232	0.6115	0.5232	0.7233
No log	2.75	110	0.5209	0.6139	0.5209	0.7217
No log	2.8	112	0.5573	0.6129	0.5573	0.7465
No log	2.85	114	0.5139	0.6136	0.5139	0.7169
No log	2.9	116	0.5962	0.5190	0.5962	0.7721
No log	2.95	118	0.5442	0.5712	0.5442	0.7377
No log	3.0	120	0.4848	0.5141	0.4848	0.6963
No log	3.05	122	0.4705	0.6087	0.4705	0.6859
No log	3.1	124	0.5159	0.5345	0.5159	0.7183
No log	3.15	126	0.5706	0.6067	0.5706	0.7554
No log	3.2	128	0.5783	0.6019	0.5783	0.7605
No log	3.25	130	0.6330	0.5511	0.6330	0.7956
No log	3.3	132	0.7973	0.4686	0.7973	0.8929
No log	3.35	134	0.7804	0.4946	0.7804	0.8834
No log	3.4	136	0.5851	0.5511	0.5851	0.7649
No log	3.45	138	0.6248	0.5788	0.6248	0.7904
No log	3.5	140	0.6859	0.5267	0.6859	0.8282
No log	3.55	142	0.5218	0.4925	0.5218	0.7224
No log	3.6	144	0.4810	0.4838	0.4810	0.6936
No log	3.65	146	0.5486	0.5083	0.5486	0.7407
No log	3.7	148	0.5296	0.5300	0.5296	0.7277
No log	3.75	150	0.4759	0.5432	0.4759	0.6898
No log	3.8	152	0.4814	0.6214	0.4814	0.6938
No log	3.85	154	0.5075	0.5652	0.5075	0.7124
No log	3.9	156	0.4882	0.6334	0.4882	0.6987
No log	3.95	158	0.4855	0.5390	0.4855	0.6968
No log	4.0	160	0.5496	0.5584	0.5496	0.7413
No log	4.05	162	0.5469	0.5692	0.5469	0.7395
No log	4.1	164	0.4862	0.6222	0.4862	0.6973
No log	4.15	166	0.4868	0.5860	0.4868	0.6977
No log	4.2	168	0.5499	0.5595	0.5499	0.7415
No log	4.25	170	0.6440	0.5777	0.6440	0.8025
No log	4.3	172	0.7232	0.6017	0.7232	0.8504
No log	4.35	174	0.6308	0.5598	0.6308	0.7942
No log	4.4	176	0.5145	0.5674	0.5145	0.7173
No log	4.45	178	0.5684	0.4997	0.5684	0.7539
No log	4.5	180	0.6192	0.5599	0.6192	0.7869
No log	4.55	182	0.5306	0.4832	0.5306	0.7284
No log	4.6	184	0.4804	0.6129	0.4804	0.6931
No log	4.65	186	0.4913	0.5831	0.4913	0.7009
No log	4.7	188	0.4977	0.5436	0.4977	0.7055
No log	4.75	190	0.5284	0.5494	0.5284	0.7269
No log	4.8	192	0.5502	0.6013	0.5502	0.7417
No log	4.85	194	0.5543	0.5835	0.5543	0.7445
No log	4.9	196	0.5598	0.5633	0.5598	0.7482
No log	4.95	198	0.5815	0.5233	0.5815	0.7625
No log	5.0	200	0.5460	0.5034	0.5460	0.7389
No log	5.05	202	0.5321	0.5034	0.5321	0.7295
No log	5.1	204	0.5671	0.5081	0.5671	0.7531
No log	5.15	206	0.5971	0.5042	0.5971	0.7727
No log	5.2	208	0.5677	0.5591	0.5677	0.7535
No log	5.25	210	0.5615	0.6137	0.5615	0.7493
No log	5.3	212	0.5521	0.5067	0.5521	0.7430
No log	5.35	214	0.5849	0.5082	0.5849	0.7648
No log	5.4	216	0.5881	0.5260	0.5881	0.7669
No log	5.45	218	0.5899	0.4869	0.5899	0.7681
No log	5.5	220	0.5643	0.5067	0.5643	0.7512
No log	5.55	222	0.5362	0.4945	0.5362	0.7322
No log	5.6	224	0.4962	0.4182	0.4962	0.7044
No log	5.65	226	0.4887	0.5657	0.4887	0.6991
No log	5.7	228	0.4990	0.5209	0.4990	0.7064
No log	5.75	230	0.5274	0.5252	0.5274	0.7262
No log	5.8	232	0.5103	0.5166	0.5103	0.7143
No log	5.85	234	0.5120	0.6145	0.5120	0.7156
No log	5.9	236	0.5143	0.4915	0.5143	0.7171
No log	5.95	238	0.5346	0.5568	0.5346	0.7312
No log	6.0	240	0.5412	0.5845	0.5412	0.7356
No log	6.05	242	0.5191	0.5341	0.5191	0.7205
No log	6.1	244	0.5073	0.4273	0.5073	0.7123
No log	6.15	246	0.5119	0.4161	0.5119	0.7155
No log	6.2	248	0.5309	0.4397	0.5309	0.7286
No log	6.25	250	0.5503	0.5395	0.5503	0.7418
No log	6.3	252	0.5191	0.5845	0.5191	0.7205
No log	6.35	254	0.5522	0.5399	0.5522	0.7431
No log	6.4	256	0.6118	0.5706	0.6118	0.7822
No log	6.45	258	0.5784	0.5399	0.5784	0.7605
No log	6.5	260	0.5325	0.5288	0.5325	0.7297
No log	6.55	262	0.5287	0.5884	0.5287	0.7271
No log	6.6	264	0.5258	0.4929	0.5258	0.7251
No log	6.65	266	0.5274	0.4597	0.5274	0.7262
No log	6.7	268	0.5456	0.4911	0.5456	0.7386
No log	6.75	270	0.5393	0.5326	0.5393	0.7343
No log	6.8	272	0.5037	0.5895	0.5037	0.7097
No log	6.85	274	0.4782	0.6322	0.4782	0.6915
No log	6.9	276	0.4937	0.6643	0.4937	0.7027
No log	6.95	278	0.5106	0.6480	0.5106	0.7145
No log	7.0	280	0.5060	0.6187	0.5060	0.7113
No log	7.05	282	0.4758	0.6065	0.4758	0.6898
No log	7.1	284	0.4676	0.6170	0.4676	0.6838
No log	7.15	286	0.4732	0.5538	0.4732	0.6879
No log	7.2	288	0.4845	0.5753	0.4845	0.6960
No log	7.25	290	0.5970	0.5626	0.5970	0.7727
No log	7.3	292	0.6922	0.5549	0.6922	0.8320
No log	7.35	294	0.6022	0.6167	0.6022	0.7760
No log	7.4	296	0.5570	0.5469	0.5570	0.7463
No log	7.45	298	0.5720	0.5442	0.5720	0.7563
No log	7.5	300	0.5343	0.5008	0.5343	0.7309
No log	7.55	302	0.5562	0.5462	0.5562	0.7458
No log	7.6	304	0.6115	0.5692	0.6115	0.7820
No log	7.65	306	0.5858	0.5445	0.5858	0.7654
No log	7.7	308	0.5365	0.6009	0.5365	0.7325
No log	7.75	310	0.5564	0.4913	0.5564	0.7459
No log	7.8	312	0.6021	0.4633	0.6021	0.7759
No log	7.85	314	0.5389	0.4913	0.5389	0.7341
No log	7.9	316	0.5158	0.6021	0.5158	0.7182
No log	7.95	318	0.6245	0.5870	0.6245	0.7903
No log	8.0	320	0.6432	0.5893	0.6432	0.8020
No log	8.05	322	0.5840	0.5275	0.5840	0.7642
No log	8.1	324	0.5247	0.6001	0.5247	0.7244
No log	8.15	326	0.5071	0.5270	0.5071	0.7121
No log	8.2	328	0.5360	0.4913	0.5360	0.7321
No log	8.25	330	0.5379	0.4913	0.5379	0.7334
No log	8.3	332	0.5200	0.4813	0.5200	0.7211
No log	8.35	334	0.5290	0.5503	0.5290	0.7273
No log	8.4	336	0.5810	0.5246	0.5810	0.7623
No log	8.45	338	0.5616	0.4864	0.5616	0.7494
No log	8.5	340	0.5144	0.5071	0.5144	0.7172
No log	8.55	342	0.4956	0.4857	0.4956	0.7040
No log	8.6	344	0.4914	0.4929	0.4914	0.7010
No log	8.65	346	0.5175	0.4352	0.5175	0.7194
No log	8.7	348	0.5612	0.4749	0.5612	0.7491
No log	8.75	350	0.5463	0.5659	0.5463	0.7391
No log	8.8	352	0.4917	0.6139	0.4917	0.7012
No log	8.85	354	0.5040	0.6071	0.5040	0.7099
No log	8.9	356	0.5307	0.5748	0.5307	0.7285
No log	8.95	358	0.5028	0.5300	0.5028	0.7091
No log	9.0	360	0.4738	0.4548	0.4738	0.6883
No log	9.05	362	0.4885	0.5122	0.4885	0.6989
No log	9.1	364	0.5421	0.4352	0.5421	0.7363
No log	9.15	366	0.5838	0.4997	0.5838	0.7641
No log	9.2	368	0.5594	0.4451	0.5594	0.7479
No log	9.25	370	0.5066	0.5122	0.5066	0.7118
No log	9.3	372	0.4875	0.4367	0.4875	0.6982
No log	9.35	374	0.4901	0.5300	0.4901	0.7001
No log	9.4	376	0.4837	0.5300	0.4837	0.6955
No log	9.45	378	0.4837	0.4991	0.4837	0.6955
No log	9.5	380	0.5465	0.5576	0.5465	0.7392
No log	9.55	382	0.7054	0.5564	0.7054	0.8399
No log	9.6	384	0.7646	0.5186	0.7646	0.8744
No log	9.65	386	0.6789	0.5131	0.6789	0.8239
No log	9.7	388	0.5400	0.5045	0.5400	0.7348
No log	9.75	390	0.4555	0.6643	0.4555	0.6749
No log	9.8	392	0.4660	0.5283	0.4660	0.6826
No log	9.85	394	0.4814	0.5300	0.4814	0.6938
No log	9.9	396	0.4841	0.4813	0.4841	0.6957
No log	9.95	398	0.5062	0.5413	0.5062	0.7115
No log	10.0	400	0.5108	0.5270	0.5108	0.7147
No log	10.05	402	0.5072	0.5725	0.5072	0.7122
No log	10.1	404	0.5158	0.5974	0.5158	0.7182
No log	10.15	406	0.5159	0.4661	0.5159	0.7183
No log	10.2	408	0.5127	0.4067	0.5127	0.7161
No log	10.25	410	0.5146	0.4493	0.5146	0.7174
No log	10.3	412	0.4977	0.4337	0.4977	0.7055
No log	10.35	414	0.4902	0.5373	0.4902	0.7001
No log	10.4	416	0.4804	0.5118	0.4804	0.6931
No log	10.45	418	0.4826	0.5827	0.4826	0.6947
No log	10.5	420	0.4814	0.5958	0.4814	0.6938
No log	10.55	422	0.4695	0.5655	0.4695	0.6852
No log	10.6	424	0.4754	0.5168	0.4754	0.6895
No log	10.65	426	0.4696	0.5234	0.4696	0.6853
No log	10.7	428	0.4758	0.5195	0.4758	0.6898
No log	10.75	430	0.5228	0.4555	0.5228	0.7231
No log	10.8	432	0.5631	0.5544	0.5631	0.7504
No log	10.85	434	0.5797	0.5219	0.5797	0.7614
No log	10.9	436	0.5438	0.5327	0.5438	0.7374
No log	10.95	438	0.4941	0.4361	0.4941	0.7029
No log	11.0	440	0.4838	0.5030	0.4838	0.6955
No log	11.05	442	0.4906	0.4958	0.4906	0.7005
No log	11.1	444	0.4859	0.4958	0.4859	0.6970
No log	11.15	446	0.4950	0.4423	0.4950	0.7035
No log	11.2	448	0.5476	0.4997	0.5476	0.7400
No log	11.25	450	0.6822	0.5429	0.6822	0.8260
No log	11.3	452	0.7121	0.5032	0.7121	0.8438
No log	11.35	454	0.6527	0.5429	0.6527	0.8079
No log	11.4	456	0.5879	0.4218	0.5879	0.7667
No log	11.45	458	0.5485	0.4451	0.5485	0.7406
No log	11.5	460	0.5218	0.4086	0.5218	0.7223
No log	11.55	462	0.5328	0.4451	0.5328	0.7299
No log	11.6	464	0.5567	0.4827	0.5567	0.7461
No log	11.65	466	0.5558	0.4898	0.5558	0.7455
No log	11.7	468	0.5403	0.5123	0.5403	0.7350
No log	11.75	470	0.4924	0.5860	0.4924	0.7017
No log	11.8	472	0.4809	0.5692	0.4809	0.6935
No log	11.85	474	0.4906	0.5756	0.4906	0.7004
No log	11.9	476	0.4877	0.5655	0.4877	0.6984
No log	11.95	478	0.4871	0.5465	0.4871	0.6979
No log	12.0	480	0.4809	0.5533	0.4809	0.6935
No log	12.05	482	0.4874	0.5996	0.4874	0.6981
No log	12.1	484	0.5060	0.5859	0.5060	0.7113
No log	12.15	486	0.5317	0.5104	0.5317	0.7291
No log	12.2	488	0.5467	0.5086	0.5467	0.7394
No log	12.25	490	0.5327	0.5597	0.5327	0.7298
No log	12.3	492	0.5293	0.5726	0.5293	0.7275
No log	12.35	494	0.5241	0.5726	0.5241	0.7240
No log	12.4	496	0.5135	0.5543	0.5135	0.7166
No log	12.45	498	0.5095	0.4747	0.5095	0.7138
0.2665	12.5	500	0.5180	0.4555	0.5180	0.7197
0.2665	12.55	502	0.5133	0.4267	0.5133	0.7165
0.2665	12.6	504	0.5192	0.4238	0.5192	0.7206
0.2665	12.65	506	0.5406	0.4148	0.5406	0.7352
0.2665	12.7	508	0.5522	0.4502	0.5522	0.7431
0.2665	12.75	510	0.5730	0.4576	0.5730	0.7569
0.2665	12.8	512	0.5611	0.4827	0.5611	0.7491
0.2665	12.85	514	0.5365	0.5560	0.5365	0.7324
0.2665	12.9	516	0.5143	0.5034	0.5143	0.7172
0.2665	12.95	518	0.5214	0.5560	0.5214	0.7221
0.2665	13.0	520	0.5137	0.5034	0.5137	0.7167
0.2665	13.05	522	0.4968	0.5687	0.4968	0.7048
0.2665	13.1	524	0.4930	0.5143	0.4930	0.7021
0.2665	13.15	526	0.4929	0.5143	0.4929	0.7021
0.2665	13.2	528	0.4972	0.5899	0.4972	0.7051
0.2665	13.25	530	0.5181	0.6272	0.5181	0.7198
0.2665	13.3	532	0.5209	0.5597	0.5209	0.7218
0.2665	13.35	534	0.5123	0.5206	0.5123	0.7157
0.2665	13.4	536	0.5044	0.5518	0.5044	0.7102
0.2665	13.45	538	0.4971	0.5008	0.4971	0.7051
0.2665	13.5	540	0.5004	0.5168	0.5004	0.7074
0.2665	13.55	542	0.5073	0.4963	0.5073	0.7123
0.2665	13.6	544	0.5067	0.4963	0.5067	0.7118
0.2665	13.65	546	0.5093	0.5205	0.5093	0.7137
0.2665	13.7	548	0.5611	0.5732	0.5611	0.7491
0.2665	13.75	550	0.5986	0.5688	0.5986	0.7737
0.2665	13.8	552	0.5640	0.6164	0.5640	0.7510
0.2665	13.85	554	0.5377	0.5729	0.5377	0.7333
0.2665	13.9	556	0.5115	0.5318	0.5115	0.7152
0.2665	13.95	558	0.5011	0.5398	0.5011	0.7079
0.2665	14.0	560	0.4998	0.5270	0.4998	0.7070
0.2665	14.05	562	0.5018	0.5465	0.5018	0.7084
0.2665	14.1	564	0.5029	0.5465	0.5029	0.7091
0.2665	14.15	566	0.5181	0.5594	0.5181	0.7198
0.2665	14.2	568	0.5201	0.5594	0.5201	0.7212
0.2665	14.25	570	0.5128	0.5288	0.5128	0.7161
0.2665	14.3	572	0.5163	0.5149	0.5163	0.7185
0.2665	14.35	574	0.5178	0.5273	0.5178	0.7196
0.2665	14.4	576	0.5330	0.5729	0.5330	0.7300
0.2665	14.45	578	0.5216	0.5273	0.5216	0.7222
0.2665	14.5	580	0.5153	0.5079	0.5153	0.7178
0.2665	14.55	582	0.5360	0.5799	0.5360	0.7321
0.2665	14.6	584	0.5656	0.5538	0.5656	0.7521
0.2665	14.65	586	0.5434	0.4815	0.5434	0.7372
0.2665	14.7	588	0.4922	0.5214	0.4922	0.7016
0.2665	14.75	590	0.4820	0.4817	0.4820	0.6943
0.2665	14.8	592	0.4954	0.5105	0.4954	0.7038
0.2665	14.85	594	0.4958	0.5105	0.4958	0.7042
0.2665	14.9	596	0.5046	0.4322	0.5046	0.7103
0.2665	14.95	598	0.5961	0.5495	0.5961	0.7721
0.2665	15.0	600	0.6884	0.5132	0.6884	0.8297
0.2665	15.05	602	0.6866	0.5443	0.6866	0.8286
0.2665	15.1	604	0.6172	0.5243	0.6172	0.7856
0.2665	15.15	606	0.5474	0.4294	0.5474	0.7399
0.2665	15.2	608	0.5144	0.4875	0.5144	0.7172
0.2665	15.25	610	0.5031	0.5361	0.5031	0.7093
0.2665	15.3	612	0.5066	0.5030	0.5066	0.7117
0.2665	15.35	614	0.5067	0.4345	0.5067	0.7118
0.2665	15.4	616	0.5196	0.4681	0.5197	0.7209
0.2665	15.45	618	0.5580	0.5140	0.5580	0.7470
0.2665	15.5	620	0.6120	0.4684	0.6120	0.7823
0.2665	15.55	622	0.6649	0.4755	0.6649	0.8154
0.2665	15.6	624	0.6428	0.4606	0.6428	0.8018
0.2665	15.65	626	0.5887	0.4190	0.5887	0.7673
0.2665	15.7	628	0.5520	0.4267	0.5520	0.7430
0.2665	15.75	630	0.5395	0.4111	0.5395	0.7345
0.2665	15.8	632	0.5483	0.2890	0.5483	0.7405
0.2665	15.85	634	0.5697	0.3197	0.5697	0.7548

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1