ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9344
• Qwk: 0.6714
• Mse: 0.9344
• Rmse: 0.9666

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	5.5289	-0.0008	5.5289	2.3514
No log	0.0625	4	3.1761	0.0362	3.1761	1.7822
No log	0.0938	6	2.2631	-0.0310	2.2631	1.5044
No log	0.125	8	1.7654	0.1664	1.7654	1.3287
No log	0.1562	10	1.2401	0.1888	1.2401	1.1136
No log	0.1875	12	1.4515	0.1517	1.4515	1.2048
No log	0.2188	14	2.2758	0.0512	2.2758	1.5086
No log	0.25	16	2.0276	0.0875	2.0276	1.4239
No log	0.2812	18	1.4642	0.0527	1.4642	1.2100
No log	0.3125	20	1.1554	0.2557	1.1554	1.0749
No log	0.3438	22	1.0923	0.2729	1.0923	1.0451
No log	0.375	24	1.1057	0.2965	1.1057	1.0515
No log	0.4062	26	1.2948	0.1806	1.2948	1.1379
No log	0.4375	28	1.7807	0.0439	1.7807	1.3344
No log	0.4688	30	1.8487	-0.0317	1.8487	1.3597
No log	0.5	32	1.8185	-0.0588	1.8185	1.3485
No log	0.5312	34	1.3992	0.1183	1.3992	1.1829
No log	0.5625	36	1.0006	0.4379	1.0006	1.0003
No log	0.5938	38	1.0270	0.3745	1.0270	1.0134
No log	0.625	40	0.9632	0.4759	0.9632	0.9814
No log	0.6562	42	0.9228	0.5028	0.9228	0.9606
No log	0.6875	44	1.0314	0.4238	1.0314	1.0156
No log	0.7188	46	1.0103	0.4238	1.0103	1.0052
No log	0.75	48	0.8779	0.5219	0.8779	0.9370
No log	0.7812	50	0.8395	0.5524	0.8395	0.9162
No log	0.8125	52	0.8288	0.5772	0.8288	0.9104
No log	0.8438	54	0.8037	0.6263	0.8037	0.8965
No log	0.875	56	0.9242	0.5638	0.9242	0.9613
No log	0.9062	58	1.2713	0.4572	1.2713	1.1275
No log	0.9375	60	1.5902	0.3512	1.5902	1.2610
No log	0.9688	62	1.3687	0.3896	1.3687	1.1699
No log	1.0	64	0.9903	0.5209	0.9903	0.9951
No log	1.0312	66	0.7921	0.5903	0.7921	0.8900
No log	1.0625	68	0.8391	0.5224	0.8391	0.9160
No log	1.0938	70	0.8157	0.5488	0.8157	0.9032
No log	1.125	72	0.7763	0.5658	0.7763	0.8811
No log	1.1562	74	0.8511	0.5142	0.8511	0.9225
No log	1.1875	76	0.9960	0.5333	0.9960	0.9980
No log	1.2188	78	0.9879	0.5194	0.9879	0.9939
No log	1.25	80	1.0095	0.4737	1.0095	1.0047
No log	1.2812	82	0.9254	0.6017	0.9254	0.9620
No log	1.3125	84	0.9693	0.5401	0.9693	0.9845
No log	1.3438	86	0.9942	0.5029	0.9942	0.9971
No log	1.375	88	1.0961	0.4624	1.0961	1.0470
No log	1.4062	90	1.1380	0.4294	1.1380	1.0668
No log	1.4375	92	1.0256	0.4592	1.0256	1.0127
No log	1.4688	94	0.9049	0.5057	0.9049	0.9513
No log	1.5	96	0.8714	0.5187	0.8714	0.9335
No log	1.5312	98	0.8538	0.5353	0.8538	0.9240
No log	1.5625	100	0.8466	0.5828	0.8466	0.9201
No log	1.5938	102	0.9887	0.5536	0.9887	0.9943
No log	1.625	104	1.0913	0.5208	1.0913	1.0447
No log	1.6562	106	1.0046	0.5960	1.0046	1.0023
No log	1.6875	108	0.9383	0.6050	0.9383	0.9686
No log	1.7188	110	0.9226	0.5965	0.9226	0.9605
No log	1.75	112	1.0354	0.5704	1.0354	1.0176
No log	1.7812	114	1.3753	0.3982	1.3753	1.1727
No log	1.8125	116	1.4782	0.3815	1.4782	1.2158
No log	1.8438	118	1.3362	0.4151	1.3362	1.1559
No log	1.875	120	1.0660	0.4920	1.0660	1.0325
No log	1.9062	122	0.8371	0.5883	0.8371	0.9149
No log	1.9375	124	0.8064	0.4830	0.8064	0.8980
No log	1.9688	126	0.7962	0.4981	0.7962	0.8923
No log	2.0	128	0.7960	0.5196	0.7960	0.8922
No log	2.0312	130	0.8127	0.5892	0.8127	0.9015
No log	2.0625	132	0.9388	0.5557	0.9388	0.9689
No log	2.0938	134	1.1140	0.4761	1.1140	1.0555
No log	2.125	136	1.2407	0.4600	1.2407	1.1139
No log	2.1562	138	1.2150	0.4487	1.2150	1.1023
No log	2.1875	140	0.9744	0.5290	0.9744	0.9871
No log	2.2188	142	0.8621	0.5995	0.8621	0.9285
No log	2.25	144	0.9393	0.5615	0.9393	0.9692
No log	2.2812	146	0.9939	0.5295	0.9939	0.9969
No log	2.3125	148	0.9591	0.5566	0.9591	0.9793
No log	2.3438	150	0.9865	0.5124	0.9865	0.9932
No log	2.375	152	0.9183	0.6001	0.9183	0.9583
No log	2.4062	154	0.7881	0.6370	0.7881	0.8877
No log	2.4375	156	0.7416	0.6592	0.7416	0.8612
No log	2.4688	158	0.7492	0.6300	0.7492	0.8656
No log	2.5	160	0.7094	0.6757	0.7094	0.8422
No log	2.5312	162	0.7871	0.6265	0.7871	0.8872
No log	2.5625	164	0.8867	0.6032	0.8867	0.9416
No log	2.5938	166	0.8027	0.6330	0.8027	0.8960
No log	2.625	168	0.6758	0.6932	0.6758	0.8221
No log	2.6562	170	0.6629	0.6792	0.6629	0.8142
No log	2.6875	172	0.6610	0.6537	0.6610	0.8130
No log	2.7188	174	0.6908	0.6542	0.6908	0.8311
No log	2.75	176	0.7405	0.5929	0.7405	0.8605
No log	2.7812	178	0.7248	0.5985	0.7248	0.8513
No log	2.8125	180	0.7179	0.6298	0.7179	0.8473
No log	2.8438	182	0.7482	0.6552	0.7482	0.8650
No log	2.875	184	0.7595	0.6676	0.7595	0.8715
No log	2.9062	186	0.7987	0.6382	0.7987	0.8937
No log	2.9375	188	0.7755	0.6768	0.7755	0.8806
No log	2.9688	190	0.6702	0.6878	0.6702	0.8187
No log	3.0	192	0.6482	0.6823	0.6482	0.8051
No log	3.0312	194	0.7010	0.6623	0.7010	0.8373
No log	3.0625	196	0.7317	0.6460	0.7317	0.8554
No log	3.0938	198	0.6738	0.6437	0.6738	0.8209
No log	3.125	200	0.6651	0.6850	0.6651	0.8155
No log	3.1562	202	0.6917	0.6827	0.6917	0.8317
No log	3.1875	204	0.6788	0.6817	0.6788	0.8239
No log	3.2188	206	0.6450	0.7003	0.6450	0.8031
No log	3.25	208	0.6563	0.6959	0.6563	0.8101
No log	3.2812	210	0.6658	0.6963	0.6658	0.8160
No log	3.3125	212	0.6784	0.6899	0.6784	0.8236
No log	3.3438	214	0.6949	0.6844	0.6949	0.8336
No log	3.375	216	0.7194	0.6747	0.7194	0.8482
No log	3.4062	218	0.7522	0.6575	0.7522	0.8673
No log	3.4375	220	0.7620	0.6744	0.7620	0.8729
No log	3.4688	222	0.7599	0.6589	0.7599	0.8717
No log	3.5	224	0.8505	0.6034	0.8505	0.9222
No log	3.5312	226	0.9147	0.5754	0.9147	0.9564
No log	3.5625	228	0.8749	0.5793	0.8749	0.9354
No log	3.5938	230	0.7554	0.6563	0.7554	0.8692
No log	3.625	232	0.7176	0.6415	0.7176	0.8471
No log	3.6562	234	0.7317	0.6412	0.7317	0.8554
No log	3.6875	236	0.7996	0.6359	0.7996	0.8942
No log	3.7188	238	0.8844	0.5716	0.8844	0.9404
No log	3.75	240	1.0728	0.5357	1.0728	1.0358
No log	3.7812	242	1.1367	0.5343	1.1367	1.0662
No log	3.8125	244	1.1079	0.5443	1.1079	1.0526
No log	3.8438	246	1.0064	0.5793	1.0064	1.0032
No log	3.875	248	0.8587	0.6204	0.8587	0.9267
No log	3.9062	250	0.8181	0.6702	0.8181	0.9045
No log	3.9375	252	0.8573	0.5884	0.8573	0.9259
No log	3.9688	254	0.7801	0.6774	0.7801	0.8832
No log	4.0	256	0.7122	0.6533	0.7122	0.8439
No log	4.0312	258	0.7246	0.5767	0.7246	0.8512
No log	4.0625	260	0.7086	0.5861	0.7086	0.8418
No log	4.0938	262	0.6929	0.6941	0.6929	0.8324
No log	4.125	264	0.7130	0.7099	0.7130	0.8444
No log	4.1562	266	0.7007	0.7150	0.7007	0.8371
No log	4.1875	268	0.6707	0.6717	0.6707	0.8190
No log	4.2188	270	0.6741	0.6792	0.6741	0.8210
No log	4.25	272	0.6880	0.6931	0.6880	0.8294
No log	4.2812	274	0.7328	0.6128	0.7328	0.8560
No log	4.3125	276	0.7751	0.6081	0.7751	0.8804
No log	4.3438	278	0.8239	0.5937	0.8239	0.9077
No log	4.375	280	0.7874	0.6075	0.7874	0.8874
No log	4.4062	282	0.7495	0.6421	0.7495	0.8657
No log	4.4375	284	0.7180	0.6822	0.7180	0.8474
No log	4.4688	286	0.7371	0.6725	0.7371	0.8586
No log	4.5	288	0.7693	0.6301	0.7693	0.8771
No log	4.5312	290	0.8308	0.5855	0.8308	0.9115
No log	4.5625	292	0.8388	0.5856	0.8388	0.9158
No log	4.5938	294	0.7763	0.6208	0.7763	0.8811
No log	4.625	296	0.7335	0.6266	0.7335	0.8564
No log	4.6562	298	0.7438	0.6352	0.7438	0.8624
No log	4.6875	300	0.7959	0.6059	0.7959	0.8921
No log	4.7188	302	0.7350	0.6295	0.7350	0.8573
No log	4.75	304	0.6539	0.6558	0.6539	0.8086
No log	4.7812	306	0.6588	0.6704	0.6588	0.8117
No log	4.8125	308	0.6776	0.6598	0.6776	0.8231
No log	4.8438	310	0.7161	0.6465	0.7161	0.8462
No log	4.875	312	0.8072	0.6016	0.8072	0.8985
No log	4.9062	314	0.8935	0.5500	0.8935	0.9452
No log	4.9375	316	0.8535	0.6119	0.8535	0.9239
No log	4.9688	318	0.8080	0.6198	0.8080	0.8989
No log	5.0	320	0.7702	0.6380	0.7702	0.8776
No log	5.0312	322	0.7609	0.6573	0.7609	0.8723
No log	5.0625	324	0.7084	0.6704	0.7084	0.8417
No log	5.0938	326	0.6757	0.6175	0.6757	0.8220
No log	5.125	328	0.6775	0.6301	0.6775	0.8231
No log	5.1562	330	0.6774	0.6383	0.6774	0.8231
No log	5.1875	332	0.6398	0.6810	0.6398	0.7999
No log	5.2188	334	0.6132	0.7002	0.6132	0.7831
No log	5.25	336	0.6415	0.7133	0.6415	0.8009
No log	5.2812	338	0.7150	0.7169	0.7150	0.8456
No log	5.3125	340	0.7732	0.6930	0.7732	0.8793
No log	5.3438	342	0.7735	0.6945	0.7735	0.8795
No log	5.375	344	0.7546	0.7075	0.7546	0.8687
No log	5.4062	346	0.7801	0.6672	0.7801	0.8832
No log	5.4375	348	0.8033	0.6604	0.8033	0.8963
No log	5.4688	350	0.8612	0.6225	0.8612	0.9280
No log	5.5	352	0.8234	0.6213	0.8234	0.9074
No log	5.5312	354	0.7020	0.7088	0.7020	0.8378
No log	5.5625	356	0.6446	0.7068	0.6446	0.8029
No log	5.5938	358	0.6392	0.6927	0.6392	0.7995
No log	5.625	360	0.6298	0.6964	0.6298	0.7936
No log	5.6562	362	0.6383	0.6962	0.6383	0.7990
No log	5.6875	364	0.6429	0.6926	0.6429	0.8018
No log	5.7188	366	0.6848	0.6884	0.6848	0.8275
No log	5.75	368	0.7965	0.6813	0.7965	0.8925
No log	5.7812	370	0.8718	0.6701	0.8718	0.9337
No log	5.8125	372	0.8237	0.6737	0.8237	0.9076
No log	5.8438	374	0.7684	0.6793	0.7684	0.8766
No log	5.875	376	0.7272	0.6952	0.7272	0.8527
No log	5.9062	378	0.7002	0.6668	0.7002	0.8368
No log	5.9375	380	0.6926	0.6535	0.6926	0.8322
No log	5.9688	382	0.6786	0.6728	0.6786	0.8237
No log	6.0	384	0.6793	0.6849	0.6793	0.8242
No log	6.0312	386	0.7212	0.6799	0.7212	0.8492
No log	6.0625	388	0.7650	0.6558	0.7650	0.8747
No log	6.0938	390	0.7284	0.6675	0.7284	0.8535
No log	6.125	392	0.6542	0.6850	0.6542	0.8088
No log	6.1562	394	0.6373	0.6902	0.6373	0.7983
No log	6.1875	396	0.6241	0.6843	0.6241	0.7900
No log	6.2188	398	0.6381	0.6728	0.6381	0.7988
No log	6.25	400	0.6256	0.6728	0.6256	0.7909
No log	6.2812	402	0.6306	0.6947	0.6306	0.7941
No log	6.3125	404	0.7042	0.6744	0.7042	0.8392
No log	6.3438	406	0.7210	0.6744	0.7210	0.8491
No log	6.375	408	0.6806	0.6744	0.6806	0.8250
No log	6.4062	410	0.6391	0.6872	0.6391	0.7994
No log	6.4375	412	0.6724	0.6031	0.6724	0.8200
No log	6.4688	414	0.7044	0.5872	0.7044	0.8393
No log	6.5	416	0.7315	0.5607	0.7315	0.8553
No log	6.5312	418	0.7484	0.6125	0.7484	0.8651
No log	6.5625	420	0.7992	0.6196	0.7992	0.8940
No log	6.5938	422	0.7984	0.6359	0.7984	0.8935
No log	6.625	424	0.7896	0.6726	0.7896	0.8886
No log	6.6562	426	0.7472	0.6705	0.7472	0.8644
No log	6.6875	428	0.7785	0.6769	0.7785	0.8823
No log	6.7188	430	0.8429	0.6891	0.8429	0.9181
No log	6.75	432	0.8738	0.6667	0.8738	0.9348
No log	6.7812	434	0.8558	0.6538	0.8558	0.9251
No log	6.8125	436	0.7265	0.7160	0.7265	0.8523
No log	6.8438	438	0.6539	0.7455	0.6539	0.8086
No log	6.875	440	0.6268	0.7451	0.6268	0.7917
No log	6.9062	442	0.6181	0.7284	0.6181	0.7862
No log	6.9375	444	0.6695	0.6878	0.6695	0.8182
No log	6.9688	446	0.7827	0.6476	0.7827	0.8847
No log	7.0	448	0.8258	0.6342	0.8258	0.9087
No log	7.0312	450	0.8114	0.6426	0.8114	0.9008
No log	7.0625	452	0.7163	0.6805	0.7163	0.8463
No log	7.0938	454	0.6161	0.6934	0.6161	0.7849
No log	7.125	456	0.6470	0.7226	0.6470	0.8044
No log	7.1562	458	0.6786	0.6985	0.6786	0.8238
No log	7.1875	460	0.6334	0.7421	0.6334	0.7958
No log	7.2188	462	0.6365	0.6804	0.6365	0.7978
No log	7.25	464	0.7577	0.6635	0.7577	0.8705
No log	7.2812	466	0.8766	0.6430	0.8766	0.9363
No log	7.3125	468	0.8912	0.6263	0.8912	0.9440
No log	7.3438	470	0.7895	0.6407	0.7895	0.8886
No log	7.375	472	0.6998	0.6573	0.6998	0.8366
No log	7.4062	474	0.6858	0.6501	0.6858	0.8281
No log	7.4375	476	0.7018	0.6308	0.7018	0.8377
No log	7.4688	478	0.7546	0.625	0.7546	0.8687
No log	7.5	480	0.8648	0.5909	0.8648	0.9300
No log	7.5312	482	0.8987	0.5824	0.8987	0.9480
No log	7.5625	484	0.8021	0.6396	0.8021	0.8956
No log	7.5938	486	0.7052	0.6511	0.7052	0.8398
No log	7.625	488	0.6642	0.6772	0.6642	0.8150
No log	7.6562	490	0.6767	0.6731	0.6767	0.8226
No log	7.6875	492	0.6735	0.6711	0.6735	0.8207
No log	7.7188	494	0.6407	0.7163	0.6407	0.8004
No log	7.75	496	0.6323	0.7281	0.6323	0.7951
No log	7.7812	498	0.6597	0.7063	0.6597	0.8122
0.3982	7.8125	500	0.6473	0.7126	0.6473	0.8045
0.3982	7.8438	502	0.6492	0.6991	0.6492	0.8058
0.3982	7.875	504	0.6483	0.6926	0.6483	0.8052
0.3982	7.9062	506	0.6395	0.7138	0.6395	0.7997
0.3982	7.9375	508	0.6308	0.7258	0.6308	0.7943
0.3982	7.9688	510	0.6314	0.7091	0.6314	0.7946
0.3982	8.0	512	0.6329	0.7054	0.6329	0.7956
0.3982	8.0312	514	0.6614	0.6854	0.6614	0.8133
0.3982	8.0625	516	0.8012	0.6656	0.8012	0.8951
0.3982	8.0938	518	0.9344	0.6714	0.9344	0.9666

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1