ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9349
• Qwk: 0.3119
• Mse: 0.9349
• Rmse: 0.9669

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.0739	-0.0153	4.0739	2.0184
No log	0.0769	4	1.9009	0.0429	1.9009	1.3787
No log	0.1154	6	1.1246	0.2734	1.1246	1.0605
No log	0.1538	8	1.2176	0.0671	1.2176	1.1035
No log	0.1923	10	1.2352	0.0520	1.2352	1.1114
No log	0.2308	12	1.5432	-0.0171	1.5432	1.2423
No log	0.2692	14	2.2979	0.0790	2.2979	1.5159
No log	0.3077	16	2.2166	0.0790	2.2166	1.4888
No log	0.3462	18	1.4053	0.0471	1.4053	1.1854
No log	0.3846	20	1.0221	0.2265	1.0221	1.0110
No log	0.4231	22	1.0124	0.1629	1.0124	1.0062
No log	0.4615	24	0.9846	0.2061	0.9846	0.9923
No log	0.5	26	1.0148	0.2023	1.0148	1.0074
No log	0.5385	28	1.0498	0.2049	1.0498	1.0246
No log	0.5769	30	1.1274	0.1498	1.1274	1.0618
No log	0.6154	32	1.1308	0.1498	1.1308	1.0634
No log	0.6538	34	1.0339	0.2074	1.0339	1.0168
No log	0.6923	36	0.9449	0.3370	0.9449	0.9721
No log	0.7308	38	0.9448	0.2849	0.9448	0.9720
No log	0.7692	40	0.9030	0.3198	0.9030	0.9503
No log	0.8077	42	0.8628	0.4204	0.8628	0.9289
No log	0.8462	44	0.8513	0.4344	0.8513	0.9227
No log	0.8846	46	0.8067	0.3994	0.8067	0.8982
No log	0.9231	48	0.7969	0.4676	0.7969	0.8927
No log	0.9615	50	0.7766	0.4550	0.7766	0.8813
No log	1.0	52	0.7504	0.4787	0.7504	0.8663
No log	1.0385	54	0.7358	0.5117	0.7358	0.8578
No log	1.0769	56	0.7601	0.5183	0.7601	0.8718
No log	1.1154	58	0.8353	0.4450	0.8353	0.9140
No log	1.1538	60	0.9660	0.3663	0.9660	0.9828
No log	1.1923	62	0.7537	0.5098	0.7537	0.8682
No log	1.2308	64	0.7401	0.5098	0.7401	0.8603
No log	1.2692	66	0.7298	0.5093	0.7298	0.8543
No log	1.3077	68	0.6901	0.5746	0.6901	0.8307
No log	1.3462	70	0.7410	0.4843	0.7410	0.8608
No log	1.3846	72	0.6671	0.5221	0.6671	0.8167
No log	1.4231	74	0.6325	0.6117	0.6325	0.7953
No log	1.4615	76	0.6308	0.6117	0.6308	0.7942
No log	1.5	78	0.6255	0.6117	0.6255	0.7909
No log	1.5385	80	0.6801	0.5463	0.6801	0.8247
No log	1.5769	82	0.8370	0.4175	0.8370	0.9149
No log	1.6154	84	0.7263	0.5178	0.7263	0.8523
No log	1.6538	86	0.6319	0.5926	0.6319	0.7949
No log	1.6923	88	0.8631	0.3679	0.8631	0.9290
No log	1.7308	90	0.8533	0.3679	0.8533	0.9237
No log	1.7692	92	0.8128	0.4769	0.8128	0.9015
No log	1.8077	94	0.6288	0.6496	0.6288	0.7929
No log	1.8462	96	0.6174	0.6209	0.6174	0.7858
No log	1.8846	98	0.6318	0.5752	0.6318	0.7948
No log	1.9231	100	0.6734	0.5679	0.6734	0.8206
No log	1.9615	102	0.6812	0.6091	0.6812	0.8253
No log	2.0	104	0.6729	0.6129	0.6729	0.8203
No log	2.0385	106	0.7158	0.5784	0.7158	0.8460
No log	2.0769	108	0.7075	0.5498	0.7075	0.8412
No log	2.1154	110	0.8500	0.4006	0.8500	0.9220
No log	2.1538	112	0.9827	0.3041	0.9827	0.9913
No log	2.1923	114	0.9488	0.3629	0.9488	0.9741
No log	2.2308	116	0.7935	0.5416	0.7935	0.8908
No log	2.2692	118	0.7764	0.5167	0.7764	0.8811
No log	2.3077	120	0.7700	0.4954	0.7700	0.8775
No log	2.3462	122	0.7982	0.5255	0.7982	0.8934
No log	2.3846	124	0.9273	0.4668	0.9273	0.9630
No log	2.4231	126	0.8050	0.4681	0.8050	0.8972
No log	2.4615	128	0.7356	0.4612	0.7356	0.8576
No log	2.5	130	0.7764	0.5080	0.7764	0.8811
No log	2.5385	132	0.8045	0.4657	0.8045	0.8969
No log	2.5769	134	0.7512	0.4930	0.7512	0.8667
No log	2.6154	136	0.9118	0.4450	0.9118	0.9549
No log	2.6538	138	1.1127	0.3881	1.1127	1.0549
No log	2.6923	140	0.9857	0.3863	0.9857	0.9928
No log	2.7308	142	0.8038	0.4136	0.8038	0.8965
No log	2.7692	144	0.7701	0.5633	0.7701	0.8776
No log	2.8077	146	0.8183	0.5614	0.8183	0.9046
No log	2.8462	148	0.7550	0.5524	0.7550	0.8689
No log	2.8846	150	0.7331	0.5120	0.7331	0.8562
No log	2.9231	152	0.7876	0.5522	0.7876	0.8875
No log	2.9615	154	0.7706	0.5052	0.7706	0.8778
No log	3.0	156	0.7148	0.6610	0.7148	0.8455
No log	3.0385	158	0.7392	0.5547	0.7392	0.8598
No log	3.0769	160	0.7490	0.5547	0.7490	0.8655
No log	3.1154	162	0.7284	0.5081	0.7284	0.8534
No log	3.1538	164	0.7310	0.5287	0.7310	0.8550
No log	3.1923	166	0.7819	0.5268	0.7819	0.8843
No log	3.2308	168	0.8047	0.5073	0.8047	0.8970
No log	3.2692	170	0.8463	0.5239	0.8463	0.9199
No log	3.3077	172	0.8866	0.5038	0.8866	0.9416
No log	3.3462	174	0.9043	0.5510	0.9043	0.9509
No log	3.3846	176	0.8174	0.5137	0.8174	0.9041
No log	3.4231	178	0.7459	0.4244	0.7459	0.8637
No log	3.4615	180	0.7466	0.6109	0.7466	0.8640
No log	3.5	182	0.7523	0.5875	0.7523	0.8673
No log	3.5385	184	0.7542	0.6305	0.7542	0.8684
No log	3.5769	186	0.8079	0.5690	0.8079	0.8988
No log	3.6154	188	0.9086	0.5327	0.9086	0.9532
No log	3.6538	190	1.0047	0.5137	1.0047	1.0024
No log	3.6923	192	0.9097	0.4972	0.9097	0.9538
No log	3.7308	194	0.7946	0.5110	0.7946	0.8914
No log	3.7692	196	0.6852	0.5495	0.6852	0.8278
No log	3.8077	198	0.6892	0.5455	0.6892	0.8302
No log	3.8462	200	0.6948	0.4909	0.6948	0.8335
No log	3.8846	202	0.7792	0.5056	0.7792	0.8828
No log	3.9231	204	0.9405	0.5161	0.9405	0.9698
No log	3.9615	206	1.0270	0.5145	1.0270	1.0134
No log	4.0	208	1.0047	0.4715	1.0047	1.0024
No log	4.0385	210	1.0514	0.4524	1.0514	1.0254
No log	4.0769	212	1.1157	0.4390	1.1157	1.0563
No log	4.1154	214	1.0630	0.4326	1.0630	1.0310
No log	4.1538	216	1.1513	0.3283	1.1513	1.0730
No log	4.1923	218	1.2629	0.2906	1.2629	1.1238
No log	4.2308	220	1.3019	0.3218	1.3019	1.1410
No log	4.2692	222	1.2165	0.3218	1.2165	1.1030
No log	4.3077	224	1.0814	0.3721	1.0814	1.0399
No log	4.3462	226	1.1223	0.4012	1.1223	1.0594
No log	4.3846	228	1.2453	0.3743	1.2453	1.1159
No log	4.4231	230	1.4650	0.3275	1.4650	1.2104
No log	4.4615	232	1.5147	0.3298	1.5147	1.2307
No log	4.5	234	1.4001	0.3229	1.4001	1.1833
No log	4.5385	236	1.1918	0.3600	1.1918	1.0917
No log	4.5769	238	0.9699	0.4988	0.9699	0.9848
No log	4.6154	240	0.8550	0.5254	0.8550	0.9247
No log	4.6538	242	0.8712	0.5178	0.8712	0.9334
No log	4.6923	244	0.9058	0.3782	0.9058	0.9517
No log	4.7308	246	0.9458	0.3383	0.9458	0.9725
No log	4.7692	248	0.9457	0.4057	0.9457	0.9725
No log	4.8077	250	0.9186	0.4264	0.9186	0.9584
No log	4.8462	252	0.8356	0.5251	0.8356	0.9141
No log	4.8846	254	0.8368	0.5045	0.8368	0.9148
No log	4.9231	256	0.8366	0.5291	0.8366	0.9147
No log	4.9615	258	1.0109	0.5179	1.0109	1.0054
No log	5.0	260	1.1136	0.4260	1.1136	1.0553
No log	5.0385	262	1.0196	0.4907	1.0196	1.0098
No log	5.0769	264	0.8232	0.4597	0.8232	0.9073
No log	5.1154	266	0.7571	0.4269	0.7571	0.8701
No log	5.1538	268	0.7631	0.4456	0.7631	0.8736
No log	5.1923	270	0.7281	0.4659	0.7281	0.8533
No log	5.2308	272	0.7502	0.4851	0.7502	0.8662
No log	5.2692	274	0.8886	0.4928	0.8886	0.9427
No log	5.3077	276	0.9145	0.5143	0.9145	0.9563
No log	5.3462	278	0.8043	0.5074	0.8043	0.8968
No log	5.3846	280	0.7543	0.5098	0.7543	0.8685
No log	5.4231	282	0.7354	0.5248	0.7354	0.8575
No log	5.4615	284	0.7402	0.5248	0.7402	0.8604
No log	5.5	286	0.7662	0.5763	0.7662	0.8753
No log	5.5385	288	0.7803	0.5552	0.7803	0.8834
No log	5.5769	290	0.7780	0.4851	0.7780	0.8820
No log	5.6154	292	0.8138	0.4180	0.8138	0.9021
No log	5.6538	294	0.8201	0.4180	0.8201	0.9056
No log	5.6923	296	0.7815	0.5912	0.7815	0.8841
No log	5.7308	298	0.7487	0.5912	0.7487	0.8653
No log	5.7692	300	0.7076	0.5523	0.7076	0.8412
No log	5.8077	302	0.6877	0.5742	0.6877	0.8293
No log	5.8462	304	0.6807	0.5580	0.6807	0.8250
No log	5.8846	306	0.6696	0.5391	0.6696	0.8183
No log	5.9231	308	0.7214	0.4714	0.7214	0.8493
No log	5.9615	310	0.7416	0.4450	0.7416	0.8612
No log	6.0	312	0.7428	0.4327	0.7428	0.8618
No log	6.0385	314	0.7583	0.4628	0.7583	0.8708
No log	6.0769	316	0.7977	0.4180	0.7977	0.8931
No log	6.1154	318	0.8829	0.4174	0.8829	0.9396
No log	6.1538	320	0.9617	0.3511	0.9617	0.9807
No log	6.1923	322	0.9345	0.3511	0.9345	0.9667
No log	6.2308	324	0.8603	0.4039	0.8603	0.9275
No log	6.2692	326	0.7698	0.4597	0.7698	0.8774
No log	6.3077	328	0.7114	0.5359	0.7114	0.8434
No log	6.3462	330	0.6802	0.5587	0.6802	0.8247
No log	6.3846	332	0.6716	0.6407	0.6716	0.8195
No log	6.4231	334	0.6760	0.6439	0.6760	0.8222
No log	6.4615	336	0.6710	0.6439	0.6710	0.8191
No log	6.5	338	0.6688	0.6206	0.6688	0.8178
No log	6.5385	340	0.6872	0.5603	0.6872	0.8290
No log	6.5769	342	0.7868	0.5017	0.7868	0.8870
No log	6.6154	344	0.8057	0.5235	0.8057	0.8976
No log	6.6538	346	0.7044	0.5412	0.7044	0.8393
No log	6.6923	348	0.6972	0.5704	0.6972	0.8350
No log	6.7308	350	0.7015	0.5517	0.7015	0.8376
No log	6.7692	352	0.7055	0.5517	0.7055	0.8400
No log	6.8077	354	0.7267	0.6297	0.7267	0.8525
No log	6.8462	356	0.7520	0.5666	0.7520	0.8672
No log	6.8846	358	0.7696	0.4873	0.7696	0.8773
No log	6.9231	360	0.7523	0.4776	0.7523	0.8674
No log	6.9615	362	0.7493	0.4736	0.7493	0.8656
No log	7.0	364	0.7426	0.4893	0.7426	0.8617
No log	7.0385	366	0.7233	0.5415	0.7233	0.8505
No log	7.0769	368	0.7308	0.6046	0.7308	0.8548
No log	7.1154	370	0.8063	0.5170	0.8063	0.8980
No log	7.1538	372	0.8079	0.5292	0.8079	0.8989
No log	7.1923	374	0.7491	0.5074	0.7491	0.8655
No log	7.2308	376	0.6954	0.5734	0.6954	0.8339
No log	7.2692	378	0.6692	0.5399	0.6692	0.8181
No log	7.3077	380	0.6635	0.5647	0.6635	0.8146
No log	7.3462	382	0.6552	0.6133	0.6552	0.8094
No log	7.3846	384	0.6527	0.6207	0.6527	0.8079
No log	7.4231	386	0.6452	0.6297	0.6452	0.8033
No log	7.4615	388	0.6632	0.5412	0.6632	0.8144
No log	7.5	390	0.6628	0.5629	0.6628	0.8141
No log	7.5385	392	0.6556	0.6060	0.6556	0.8097
No log	7.5769	394	0.6565	0.5831	0.6565	0.8102
No log	7.6154	396	0.6795	0.5810	0.6795	0.8243
No log	7.6538	398	0.6948	0.5810	0.6948	0.8335
No log	7.6923	400	0.6939	0.5149	0.6939	0.8330
No log	7.7308	402	0.7009	0.5274	0.7009	0.8372
No log	7.7692	404	0.7064	0.5274	0.7064	0.8405
No log	7.8077	406	0.7131	0.4774	0.7131	0.8445
No log	7.8462	408	0.7400	0.5107	0.7400	0.8602
No log	7.8846	410	0.7548	0.5116	0.7548	0.8688
No log	7.9231	412	0.7896	0.4612	0.7896	0.8886
No log	7.9615	414	0.8619	0.5046	0.8619	0.9284
No log	8.0	416	0.9585	0.4885	0.9585	0.9790
No log	8.0385	418	0.9671	0.4568	0.9671	0.9834
No log	8.0769	420	0.8728	0.5368	0.8728	0.9343
No log	8.1154	422	0.7899	0.5291	0.7899	0.8888
No log	8.1538	424	0.7738	0.4881	0.7738	0.8796
No log	8.1923	426	0.7807	0.5494	0.7807	0.8835
No log	8.2308	428	0.7932	0.5279	0.7932	0.8906
No log	8.2692	430	0.7676	0.5319	0.7676	0.8761
No log	8.3077	432	0.7479	0.4847	0.7479	0.8648
No log	8.3462	434	0.7198	0.4468	0.7198	0.8484
No log	8.3846	436	0.7293	0.5089	0.7293	0.8540
No log	8.4231	438	0.7446	0.4502	0.7446	0.8629
No log	8.4615	440	0.7453	0.4486	0.7453	0.8633
No log	8.5	442	0.7331	0.5036	0.7331	0.8562
No log	8.5385	444	0.7536	0.5588	0.7536	0.8681
No log	8.5769	446	0.7496	0.5318	0.7496	0.8658
No log	8.6154	448	0.7323	0.4776	0.7323	0.8557
No log	8.6538	450	0.7336	0.4914	0.7336	0.8565
No log	8.6923	452	0.7364	0.4776	0.7364	0.8582
No log	8.7308	454	0.7670	0.3940	0.7670	0.8758
No log	8.7692	456	0.7631	0.4385	0.7631	0.8736
No log	8.8077	458	0.7530	0.4524	0.7530	0.8677
No log	8.8462	460	0.7624	0.4560	0.7624	0.8732
No log	8.8846	462	0.7827	0.4126	0.7827	0.8847
No log	8.9231	464	0.7913	0.3874	0.7913	0.8895
No log	8.9615	466	0.8079	0.4118	0.8079	0.8989
No log	9.0	468	0.8007	0.4239	0.8007	0.8948
No log	9.0385	470	0.8067	0.4575	0.8067	0.8982
No log	9.0769	472	0.8152	0.5637	0.8152	0.9029
No log	9.1154	474	0.7887	0.4995	0.7887	0.8881
No log	9.1538	476	0.7491	0.4163	0.7491	0.8655
No log	9.1923	478	0.7756	0.4990	0.7756	0.8807
No log	9.2308	480	0.8012	0.4656	0.8012	0.8951
No log	9.2692	482	0.7655	0.4656	0.7655	0.8750
No log	9.3077	484	0.7164	0.5202	0.7164	0.8464
No log	9.3462	486	0.7089	0.5693	0.7089	0.8419
No log	9.3846	488	0.7115	0.5943	0.7115	0.8435
No log	9.4231	490	0.7006	0.5735	0.7006	0.8370
No log	9.4615	492	0.7013	0.5735	0.7013	0.8374
No log	9.5	494	0.7139	0.4874	0.7139	0.8449
No log	9.5385	496	0.8194	0.5024	0.8194	0.9052
No log	9.5769	498	0.8550	0.4460	0.8550	0.9247
0.2896	9.6154	500	0.8512	0.4208	0.8512	0.9226
0.2896	9.6538	502	0.7664	0.4853	0.7664	0.8754
0.2896	9.6923	504	0.7291	0.5156	0.7291	0.8539
0.2896	9.7308	506	0.7746	0.5397	0.7746	0.8801
0.2896	9.7692	508	0.7796	0.5397	0.7796	0.8829
0.2896	9.8077	510	0.7560	0.4988	0.7560	0.8695
0.2896	9.8462	512	0.7377	0.5436	0.7377	0.8589
0.2896	9.8846	514	0.7611	0.4983	0.7611	0.8724
0.2896	9.9231	516	0.7617	0.4750	0.7617	0.8728
0.2896	9.9615	518	0.7326	0.5215	0.7326	0.8559
0.2896	10.0	520	0.7096	0.5955	0.7096	0.8424
0.2896	10.0385	522	0.7061	0.5955	0.7061	0.8403
0.2896	10.0769	524	0.7121	0.5955	0.7121	0.8439
0.2896	10.1154	526	0.7286	0.5713	0.7286	0.8536
0.2896	10.1538	528	0.7404	0.5368	0.7404	0.8605
0.2896	10.1923	530	0.7516	0.5431	0.7516	0.8670
0.2896	10.2308	532	0.7555	0.5129	0.7555	0.8692
0.2896	10.2692	534	0.7565	0.5120	0.7565	0.8698
0.2896	10.3077	536	0.7453	0.5328	0.7453	0.8633
0.2896	10.3462	538	0.7460	0.5407	0.7460	0.8637
0.2896	10.3846	540	0.7142	0.5969	0.7142	0.8451
0.2896	10.4231	542	0.6915	0.6301	0.6915	0.8316
0.2896	10.4615	544	0.6713	0.6207	0.6713	0.8193
0.2896	10.5	546	0.6671	0.5644	0.6671	0.8168
0.2896	10.5385	548	0.6731	0.5522	0.6731	0.8204
0.2896	10.5769	550	0.6736	0.5405	0.6736	0.8207
0.2896	10.6154	552	0.6745	0.5529	0.6745	0.8213
0.2896	10.6538	554	0.6902	0.5288	0.6902	0.8308
0.2896	10.6923	556	0.7195	0.5146	0.7195	0.8483
0.2896	10.7308	558	0.8002	0.5395	0.8002	0.8946
0.2896	10.7692	560	0.9455	0.5094	0.9455	0.9724
0.2896	10.8077	562	1.0361	0.5075	1.0361	1.0179
0.2896	10.8462	564	1.0072	0.5192	1.0072	1.0036
0.2896	10.8846	566	0.8679	0.5236	0.8679	0.9316
0.2896	10.9231	568	0.8206	0.5192	0.8206	0.9058
0.2896	10.9615	570	0.8519	0.5494	0.8519	0.9230
0.2896	11.0	572	0.9512	0.4907	0.9512	0.9753
0.2896	11.0385	574	1.1440	0.3722	1.1440	1.0696
0.2896	11.0769	576	1.2111	0.3651	1.2111	1.1005
0.2896	11.1154	578	1.1960	0.3688	1.1960	1.0936
0.2896	11.1538	580	1.1181	0.3670	1.1181	1.0574
0.2896	11.1923	582	0.9709	0.4551	0.9709	0.9854
0.2896	11.2308	584	0.8405	0.4560	0.8405	0.9168
0.2896	11.2692	586	0.7697	0.4836	0.7697	0.8773
0.2896	11.3077	588	0.7749	0.5291	0.7749	0.8803
0.2896	11.3462	590	0.8112	0.5140	0.8112	0.9007
0.2896	11.3846	592	0.8724	0.4994	0.8724	0.9340
0.2896	11.4231	594	0.8869	0.5208	0.8869	0.9418
0.2896	11.4615	596	0.8912	0.5	0.8912	0.9440
0.2896	11.5	598	0.8098	0.5602	0.8098	0.8999
0.2896	11.5385	600	0.7526	0.5565	0.7526	0.8675
0.2896	11.5769	602	0.7292	0.5427	0.7292	0.8539
0.2896	11.6154	604	0.7236	0.6022	0.7236	0.8506
0.2896	11.6538	606	0.6919	0.6298	0.6919	0.8318
0.2896	11.6923	608	0.6807	0.6053	0.6807	0.8251
0.2896	11.7308	610	0.6640	0.5931	0.6640	0.8148
0.2896	11.7692	612	0.6595	0.6076	0.6595	0.8121
0.2896	11.8077	614	0.6688	0.5455	0.6688	0.8178
0.2896	11.8462	616	0.6813	0.5192	0.6813	0.8254
0.2896	11.8846	618	0.6882	0.5192	0.6882	0.8296
0.2896	11.9231	620	0.6971	0.4783	0.6971	0.8349
0.2896	11.9615	622	0.7041	0.4925	0.7041	0.8391
0.2896	12.0	624	0.7209	0.4230	0.7209	0.8491
0.2896	12.0385	626	0.7902	0.4839	0.7902	0.8889
0.2896	12.0769	628	0.8936	0.4169	0.8936	0.9453
0.2896	12.1154	630	0.9495	0.4036	0.9495	0.9744
0.2896	12.1538	632	0.9513	0.3222	0.9513	0.9754
0.2896	12.1923	634	0.9608	0.2820	0.9608	0.9802
0.2896	12.2308	636	0.9349	0.3119	0.9349	0.9669

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1