ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k9_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5794
• Qwk: 0.4618
• Mse: 0.5794
• Rmse: 0.7612

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0444	2	2.6040	0.0070	2.6040	1.6137
No log	0.0889	4	1.4040	0.1468	1.4040	1.1849
No log	0.1333	6	0.7268	0.1372	0.7268	0.8525
No log	0.1778	8	0.9369	-0.0970	0.9369	0.9679
No log	0.2222	10	1.0302	0.1734	1.0302	1.0150
No log	0.2667	12	1.0489	0.1981	1.0489	1.0242
No log	0.3111	14	0.8684	0.3516	0.8684	0.9319
No log	0.3556	16	0.6917	0.3894	0.6917	0.8317
No log	0.4	18	0.6258	0.2206	0.6258	0.7911
No log	0.4444	20	0.6440	0.2407	0.6440	0.8025
No log	0.4889	22	0.7649	0.1183	0.7649	0.8746
No log	0.5333	24	0.8349	0.0608	0.8349	0.9137
No log	0.5778	26	0.8036	0.1139	0.8036	0.8964
No log	0.6222	28	0.7185	0.1094	0.7185	0.8476
No log	0.6667	30	0.6712	0.1407	0.6712	0.8193
No log	0.7111	32	0.6065	0.2572	0.6065	0.7788
No log	0.7556	34	0.5815	0.3289	0.5815	0.7626
No log	0.8	36	0.5704	0.3366	0.5704	0.7553
No log	0.8444	38	0.5554	0.4339	0.5554	0.7452
No log	0.8889	40	0.5455	0.4229	0.5455	0.7386
No log	0.9333	42	0.6269	0.3372	0.6269	0.7918
No log	0.9778	44	0.6650	0.3092	0.6650	0.8154
No log	1.0222	46	0.7479	0.1752	0.7479	0.8648
No log	1.0667	48	0.7462	0.2206	0.7462	0.8638
No log	1.1111	50	0.7233	0.2270	0.7233	0.8505
No log	1.1556	52	0.6938	0.1863	0.6938	0.8330
No log	1.2	54	0.7115	0.3092	0.7115	0.8435
No log	1.2444	56	0.7363	0.3819	0.7363	0.8581
No log	1.2889	58	0.8760	0.3933	0.8760	0.9359
No log	1.3333	60	0.8202	0.4228	0.8202	0.9057
No log	1.3778	62	0.5930	0.4227	0.5930	0.7700
No log	1.4222	64	0.5316	0.4973	0.5316	0.7291
No log	1.4667	66	0.5035	0.4776	0.5035	0.7096
No log	1.5111	68	0.4896	0.6198	0.4896	0.6997
No log	1.5556	70	0.5583	0.5152	0.5583	0.7472
No log	1.6	72	0.5825	0.4834	0.5825	0.7632
No log	1.6444	74	0.5107	0.6542	0.5107	0.7146
No log	1.6889	76	0.5425	0.5719	0.5425	0.7366
No log	1.7333	78	0.5556	0.5652	0.5556	0.7454
No log	1.7778	80	0.5376	0.5701	0.5376	0.7332
No log	1.8222	82	0.5397	0.5742	0.5397	0.7347
No log	1.8667	84	0.5419	0.5742	0.5419	0.7361
No log	1.9111	86	0.5463	0.5933	0.5463	0.7391
No log	1.9556	88	0.5551	0.6092	0.5551	0.7451
No log	2.0	90	0.6756	0.5098	0.6756	0.8219
No log	2.0444	92	0.7399	0.4965	0.7399	0.8602
No log	2.0889	94	0.5669	0.5470	0.5669	0.7529
No log	2.1333	96	0.5282	0.5753	0.5282	0.7268
No log	2.1778	98	0.5201	0.5485	0.5201	0.7212
No log	2.2222	100	0.5708	0.4738	0.5708	0.7555
No log	2.2667	102	0.7114	0.4580	0.7114	0.8434
No log	2.3111	104	0.7099	0.4650	0.7099	0.8425
No log	2.3556	106	0.6282	0.4521	0.6282	0.7926
No log	2.4	108	0.5368	0.5674	0.5368	0.7326
No log	2.4444	110	0.6236	0.4909	0.6236	0.7897
No log	2.4889	112	0.6587	0.4868	0.6587	0.8116
No log	2.5333	114	0.6009	0.4071	0.6009	0.7752
No log	2.5778	116	0.6016	0.5827	0.6016	0.7756
No log	2.6222	118	0.6844	0.5140	0.6844	0.8273
No log	2.6667	120	0.6222	0.5201	0.6222	0.7888
No log	2.7111	122	0.6109	0.4719	0.6109	0.7816
No log	2.7556	124	0.6180	0.3779	0.6180	0.7861
No log	2.8	126	0.6065	0.5032	0.6065	0.7788
No log	2.8444	128	0.7508	0.5364	0.7508	0.8665
No log	2.8889	130	0.7506	0.5226	0.7506	0.8664
No log	2.9333	132	0.6357	0.6067	0.6357	0.7973
No log	2.9778	134	0.5553	0.5529	0.5553	0.7452
No log	3.0222	136	0.5276	0.6173	0.5276	0.7264
No log	3.0667	138	0.5377	0.5831	0.5377	0.7333
No log	3.1111	140	0.5593	0.5184	0.5593	0.7478
No log	3.1556	142	0.5605	0.4722	0.5605	0.7487
No log	3.2	144	0.5576	0.4526	0.5576	0.7467
No log	3.2444	146	0.5636	0.4562	0.5636	0.7507
No log	3.2889	148	0.6094	0.5101	0.6094	0.7806
No log	3.3333	150	0.7958	0.4604	0.7958	0.8921
No log	3.3778	152	0.7172	0.5237	0.7172	0.8469
No log	3.4222	154	0.5643	0.5290	0.5643	0.7512
No log	3.4667	156	0.5779	0.4873	0.5779	0.7602
No log	3.5111	158	0.5839	0.5156	0.5839	0.7641
No log	3.5556	160	0.6588	0.5416	0.6588	0.8116
No log	3.6	162	0.7096	0.5219	0.7096	0.8424
No log	3.6444	164	0.6359	0.5620	0.6359	0.7974
No log	3.6889	166	0.5747	0.5886	0.5747	0.7581
No log	3.7333	168	0.5746	0.5910	0.5746	0.7580
No log	3.7778	170	0.5768	0.5082	0.5768	0.7595
No log	3.8222	172	0.6326	0.4997	0.6326	0.7953
No log	3.8667	174	0.6382	0.4939	0.6382	0.7989
No log	3.9111	176	0.6131	0.4280	0.6131	0.7830
No log	3.9556	178	0.7588	0.4592	0.7588	0.8711
No log	4.0	180	0.8926	0.3923	0.8926	0.9448
No log	4.0444	182	0.7494	0.4400	0.7494	0.8657
No log	4.0889	184	0.6177	0.5109	0.6177	0.7859
No log	4.1333	186	0.6051	0.5383	0.6051	0.7779
No log	4.1778	188	0.6003	0.5373	0.6003	0.7748
No log	4.2222	190	0.5841	0.5084	0.5841	0.7643
No log	4.2667	192	0.5765	0.4985	0.5765	0.7593
No log	4.3111	194	0.6042	0.4522	0.6042	0.7773
No log	4.3556	196	0.6744	0.4502	0.6744	0.8212
No log	4.4	198	0.6038	0.4167	0.6038	0.7770
No log	4.4444	200	0.5562	0.4101	0.5562	0.7458
No log	4.4889	202	0.5685	0.3779	0.5685	0.7540
No log	4.5333	204	0.5408	0.3754	0.5408	0.7354
No log	4.5778	206	0.5303	0.5665	0.5303	0.7282
No log	4.6222	208	0.5624	0.5619	0.5624	0.7499
No log	4.6667	210	0.5918	0.5185	0.5918	0.7693
No log	4.7111	212	0.6296	0.5264	0.6296	0.7935
No log	4.7556	214	0.5619	0.5195	0.5619	0.7496
No log	4.8	216	0.5204	0.4914	0.5204	0.7214
No log	4.8444	218	0.5238	0.5324	0.5238	0.7237
No log	4.8889	220	0.5623	0.5510	0.5623	0.7498
No log	4.9333	222	0.5392	0.5223	0.5392	0.7343
No log	4.9778	224	0.5311	0.5254	0.5311	0.7288
No log	5.0222	226	0.5136	0.5883	0.5136	0.7166
No log	5.0667	228	0.5168	0.5868	0.5168	0.7189
No log	5.1111	230	0.5181	0.5868	0.5181	0.7198
No log	5.1556	232	0.5435	0.5484	0.5435	0.7372
No log	5.2	234	0.5380	0.5305	0.5380	0.7335
No log	5.2444	236	0.5243	0.5320	0.5243	0.7241
No log	5.2889	238	0.5350	0.5244	0.5350	0.7315
No log	5.3333	240	0.5744	0.5053	0.5744	0.7579
No log	5.3778	242	0.6233	0.4369	0.6233	0.7895
No log	5.4222	244	0.5725	0.4625	0.5725	0.7566
No log	5.4667	246	0.5810	0.4389	0.5810	0.7622
No log	5.5111	248	0.5762	0.4294	0.5762	0.7591
No log	5.5556	250	0.5811	0.3914	0.5811	0.7623
No log	5.6	252	0.5514	0.4270	0.5514	0.7426
No log	5.6444	254	0.5490	0.4371	0.5490	0.7410
No log	5.6889	256	0.5948	0.4404	0.5948	0.7712
No log	5.7333	258	0.6591	0.4684	0.6591	0.8118
No log	5.7778	260	0.6926	0.4496	0.6926	0.8322
No log	5.8222	262	0.6250	0.4334	0.6250	0.7906
No log	5.8667	264	0.5191	0.5668	0.5191	0.7205
No log	5.9111	266	0.5106	0.6395	0.5106	0.7146
No log	5.9556	268	0.5132	0.5923	0.5132	0.7164
No log	6.0	270	0.5341	0.4795	0.5341	0.7308
No log	6.0444	272	0.5813	0.4315	0.5813	0.7625
No log	6.0889	274	0.5680	0.4444	0.5680	0.7536
No log	6.1333	276	0.5408	0.5189	0.5408	0.7354
No log	6.1778	278	0.5441	0.5448	0.5441	0.7377
No log	6.2222	280	0.5537	0.4721	0.5537	0.7441
No log	6.2667	282	0.6079	0.4684	0.6079	0.7797
No log	6.3111	284	0.7234	0.4784	0.7234	0.8505
No log	6.3556	286	0.7323	0.4784	0.7323	0.8557
No log	6.4	288	0.6193	0.4812	0.6193	0.7870
No log	6.4444	290	0.5113	0.5304	0.5113	0.7150
No log	6.4889	292	0.5410	0.5352	0.5410	0.7355
No log	6.5333	294	0.5396	0.5498	0.5396	0.7346
No log	6.5778	296	0.5038	0.6046	0.5038	0.7098
No log	6.6222	298	0.4954	0.6121	0.4954	0.7038
No log	6.6667	300	0.5012	0.6650	0.5012	0.7080
No log	6.7111	302	0.5207	0.5419	0.5207	0.7216
No log	6.7556	304	0.5321	0.5306	0.5321	0.7295
No log	6.8	306	0.5282	0.5306	0.5282	0.7268
No log	6.8444	308	0.5588	0.5034	0.5588	0.7475
No log	6.8889	310	0.6312	0.4702	0.6312	0.7945
No log	6.9333	312	0.5980	0.4625	0.5980	0.7733
No log	6.9778	314	0.5297	0.4782	0.5297	0.7278
No log	7.0222	316	0.5350	0.5627	0.5350	0.7315
No log	7.0667	318	0.5327	0.4858	0.5327	0.7299
No log	7.1111	320	0.5804	0.5223	0.5804	0.7619
No log	7.1556	322	0.7488	0.4305	0.7488	0.8653
No log	7.2	324	0.7450	0.4250	0.7450	0.8631
No log	7.2444	326	0.6353	0.4745	0.6353	0.7970
No log	7.2889	328	0.5228	0.5379	0.5228	0.7230
No log	7.3333	330	0.5206	0.5009	0.5206	0.7215
No log	7.3778	332	0.5174	0.5231	0.5174	0.7193
No log	7.4222	334	0.5140	0.5874	0.5140	0.7169
No log	7.4667	336	0.5271	0.6065	0.5271	0.7260
No log	7.5111	338	0.5342	0.5827	0.5342	0.7309
No log	7.5556	340	0.5344	0.5867	0.5344	0.7310
No log	7.6	342	0.5377	0.6265	0.5377	0.7333
No log	7.6444	344	0.5822	0.5473	0.5822	0.7630
No log	7.6889	346	0.5387	0.5872	0.5387	0.7340
No log	7.7333	348	0.5058	0.6001	0.5058	0.7112
No log	7.7778	350	0.5050	0.6146	0.5050	0.7106
No log	7.8222	352	0.4941	0.6210	0.4941	0.7029
No log	7.8667	354	0.4933	0.6001	0.4933	0.7023
No log	7.9111	356	0.5005	0.5816	0.5005	0.7075
No log	7.9556	358	0.5148	0.5632	0.5148	0.7175
No log	8.0	360	0.5549	0.5223	0.5549	0.7449
No log	8.0444	362	0.5452	0.5741	0.5452	0.7384
No log	8.0889	364	0.5526	0.4795	0.5526	0.7433
No log	8.1333	366	0.5409	0.5373	0.5409	0.7355
No log	8.1778	368	0.5008	0.5252	0.5008	0.7077
No log	8.2222	370	0.4939	0.6007	0.4939	0.7028
No log	8.2667	372	0.5000	0.5860	0.5000	0.7071
No log	8.3111	374	0.5974	0.5219	0.5974	0.7729
No log	8.3556	376	0.6523	0.4883	0.6523	0.8076
No log	8.4	378	0.5640	0.5445	0.5640	0.7510
No log	8.4444	380	0.4864	0.5974	0.4864	0.6974
No log	8.4889	382	0.4796	0.6279	0.4796	0.6925
No log	8.5333	384	0.4826	0.6228	0.4826	0.6947
No log	8.5778	386	0.5174	0.5272	0.5174	0.7193
No log	8.6222	388	0.5745	0.4665	0.5745	0.7580
No log	8.6667	390	0.5951	0.4582	0.5951	0.7715
No log	8.7111	392	0.5405	0.4875	0.5405	0.7352
No log	8.7556	394	0.5320	0.5386	0.5320	0.7294
No log	8.8	396	0.5134	0.5609	0.5134	0.7165
No log	8.8444	398	0.5462	0.5433	0.5462	0.7391
No log	8.8889	400	0.5952	0.5567	0.5952	0.7715
No log	8.9333	402	0.6461	0.5239	0.6461	0.8038
No log	8.9778	404	0.6034	0.5350	0.6034	0.7768
No log	9.0222	406	0.5336	0.5799	0.5336	0.7305
No log	9.0667	408	0.5124	0.5965	0.5124	0.7158
No log	9.1111	410	0.5084	0.5831	0.5084	0.7131
No log	9.1556	412	0.5116	0.5379	0.5116	0.7152
No log	9.2	414	0.5159	0.5053	0.5159	0.7183
No log	9.2444	416	0.5250	0.5034	0.5250	0.7246
No log	9.2889	418	0.5580	0.4764	0.5580	0.7470
No log	9.3333	420	0.5634	0.4997	0.5634	0.7506
No log	9.3778	422	0.5218	0.5473	0.5218	0.7224
No log	9.4222	424	0.5231	0.5406	0.5231	0.7233
No log	9.4667	426	0.5377	0.5127	0.5377	0.7333
No log	9.5111	428	0.5146	0.6154	0.5146	0.7174
No log	9.5556	430	0.5854	0.4684	0.5854	0.7651
No log	9.6	432	0.7136	0.4296	0.7136	0.8447
No log	9.6444	434	0.7697	0.4081	0.7697	0.8773
No log	9.6889	436	0.6981	0.4153	0.6981	0.8355
No log	9.7333	438	0.5698	0.4854	0.5698	0.7549
No log	9.7778	440	0.5228	0.6186	0.5228	0.7231
No log	9.8222	442	0.5258	0.6452	0.5258	0.7251
No log	9.8667	444	0.5248	0.6100	0.5248	0.7244
No log	9.9111	446	0.5428	0.5226	0.5428	0.7368
No log	9.9556	448	0.5964	0.4665	0.5964	0.7723
No log	10.0	450	0.6002	0.4409	0.6002	0.7748
No log	10.0444	452	0.5823	0.4307	0.5823	0.7631
No log	10.0889	454	0.5751	0.4576	0.5751	0.7583
No log	10.1333	456	0.5579	0.4835	0.5579	0.7470
No log	10.1778	458	0.5399	0.4845	0.5399	0.7348
No log	10.2222	460	0.5351	0.5484	0.5351	0.7315
No log	10.2667	462	0.5437	0.5377	0.5437	0.7374
No log	10.3111	464	0.5508	0.5651	0.5508	0.7422
No log	10.3556	466	0.5310	0.5335	0.5310	0.7287
No log	10.4	468	0.5046	0.5473	0.5046	0.7104
No log	10.4444	470	0.5091	0.5632	0.5091	0.7135
No log	10.4889	472	0.4892	0.6010	0.4892	0.6994
No log	10.5333	474	0.5088	0.5272	0.5088	0.7133
No log	10.5778	476	0.4923	0.5533	0.4923	0.7016
No log	10.6222	478	0.4873	0.6452	0.4873	0.6980
No log	10.6667	480	0.4883	0.6184	0.4883	0.6988
No log	10.7111	482	0.4918	0.5725	0.4918	0.7013
No log	10.7556	484	0.5172	0.5597	0.5172	0.7191
No log	10.8	486	0.6319	0.4684	0.6319	0.7949
No log	10.8444	488	0.6764	0.4719	0.6764	0.8224
No log	10.8889	490	0.6320	0.4568	0.6320	0.7950
No log	10.9333	492	0.5723	0.4769	0.5723	0.7565
No log	10.9778	494	0.5486	0.4966	0.5486	0.7407
No log	11.0222	496	0.5835	0.4815	0.5835	0.7638
No log	11.0667	498	0.6152	0.4502	0.6152	0.7843
0.3152	11.1111	500	0.5866	0.4854	0.5866	0.7659
0.3152	11.1556	502	0.5003	0.5574	0.5003	0.7073
0.3152	11.2	504	0.4859	0.5672	0.4859	0.6971
0.3152	11.2444	506	0.4869	0.5750	0.4869	0.6978
0.3152	11.2889	508	0.5036	0.5379	0.5036	0.7096
0.3152	11.3333	510	0.5957	0.4502	0.5957	0.7718
0.3152	11.3778	512	0.6910	0.4783	0.6910	0.8313
0.3152	11.4222	514	0.6487	0.4349	0.6487	0.8054
0.3152	11.4667	516	0.5637	0.4664	0.5637	0.7508
0.3152	11.5111	518	0.5228	0.5271	0.5228	0.7230
0.3152	11.5556	520	0.5214	0.4855	0.5214	0.7221
0.3152	11.6	522	0.5223	0.4855	0.5223	0.7227
0.3152	11.6444	524	0.5537	0.4898	0.5537	0.7441
0.3152	11.6889	526	0.5452	0.5072	0.5452	0.7384
0.3152	11.7333	528	0.5201	0.5242	0.5201	0.7212
0.3152	11.7778	530	0.5193	0.5242	0.5193	0.7206
0.3152	11.8222	532	0.5302	0.5290	0.5302	0.7281
0.3152	11.8667	534	0.5477	0.5200	0.5477	0.7400
0.3152	11.9111	536	0.5288	0.5157	0.5288	0.7272
0.3152	11.9556	538	0.5096	0.5239	0.5096	0.7139
0.3152	12.0	540	0.4977	0.6111	0.4977	0.7055
0.3152	12.0444	542	0.5051	0.5883	0.5051	0.7107
0.3152	12.0889	544	0.5336	0.4562	0.5336	0.7305
0.3152	12.1333	546	0.5215	0.5123	0.5215	0.7221
0.3152	12.1778	548	0.5351	0.5104	0.5351	0.7315
0.3152	12.2222	550	0.5906	0.4522	0.5906	0.7685
0.3152	12.2667	552	0.6689	0.4867	0.6689	0.8179
0.3152	12.3111	554	0.6233	0.4531	0.6233	0.7895
0.3152	12.3556	556	0.5603	0.5149	0.5603	0.7485
0.3152	12.4	558	0.5707	0.4911	0.5707	0.7554
0.3152	12.4444	560	0.5432	0.5544	0.5432	0.7370
0.3152	12.4889	562	0.5418	0.5544	0.5418	0.7361
0.3152	12.5333	564	0.5144	0.5671	0.5144	0.7172
0.3152	12.5778	566	0.4992	0.5768	0.4992	0.7065
0.3152	12.6222	568	0.5239	0.5516	0.5239	0.7238
0.3152	12.6667	570	0.6201	0.4522	0.6201	0.7874
0.3152	12.7111	572	0.6661	0.5068	0.6661	0.8162
0.3152	12.7556	574	0.6081	0.4522	0.6081	0.7798
0.3152	12.8	576	0.5223	0.5272	0.5223	0.7227
0.3152	12.8444	578	0.4781	0.6142	0.4781	0.6914
0.3152	12.8889	580	0.4795	0.5430	0.4795	0.6925
0.3152	12.9333	582	0.4803	0.5800	0.4803	0.6931
0.3152	12.9778	584	0.5198	0.5271	0.5198	0.7210
0.3152	13.0222	586	0.6592	0.4349	0.6592	0.8119
0.3152	13.0667	588	0.7514	0.4977	0.7514	0.8668
0.3152	13.1111	590	0.7106	0.4650	0.7106	0.8429
0.3152	13.1556	592	0.5926	0.4576	0.5926	0.7698
0.3152	13.2	594	0.5220	0.5017	0.5220	0.7225
0.3152	13.2444	596	0.4995	0.5868	0.4995	0.7068
0.3152	13.2889	598	0.4968	0.5868	0.4968	0.7048
0.3152	13.3333	600	0.5187	0.5271	0.5187	0.7202
0.3152	13.3778	602	0.5404	0.5310	0.5404	0.7351
0.3152	13.4222	604	0.5217	0.5271	0.5217	0.7223
0.3152	13.4667	606	0.4920	0.5631	0.4920	0.7014
0.3152	13.5111	608	0.4899	0.6010	0.4899	0.6999
0.3152	13.5556	610	0.4991	0.6228	0.4991	0.7065
0.3152	13.6	612	0.5060	0.6228	0.5060	0.7114
0.3152	13.6444	614	0.5076	0.6643	0.5076	0.7124
0.3152	13.6889	616	0.5147	0.6643	0.5147	0.7174
0.3152	13.7333	618	0.5455	0.5860	0.5455	0.7386
0.3152	13.7778	620	0.5780	0.5072	0.5780	0.7603
0.3152	13.8222	622	0.5692	0.5761	0.5692	0.7545
0.3152	13.8667	624	0.5429	0.6174	0.5429	0.7369
0.3152	13.9111	626	0.5179	0.5782	0.5179	0.7197
0.3152	13.9556	628	0.5265	0.6228	0.5265	0.7256
0.3152	14.0	630	0.5656	0.5081	0.5656	0.7520
0.3152	14.0444	632	0.5764	0.5016	0.5764	0.7592
0.3152	14.0889	634	0.6122	0.4430	0.6122	0.7824
0.3152	14.1333	636	0.6524	0.4014	0.6524	0.8077
0.3152	14.1778	638	0.6756	0.4123	0.6756	0.8220
0.3152	14.2222	640	0.6442	0.4036	0.6442	0.8026
0.3152	14.2667	642	0.5794	0.4618	0.5794	0.7612

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1