ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9556
• Qwk: 0.5706
• Mse: 0.9556
• Rmse: 0.9775

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0217	2	5.6606	-0.0267	5.6606	2.3792
No log	0.0435	4	3.6099	0.0374	3.6099	1.9000
No log	0.0652	6	3.0009	-0.0893	3.0009	1.7323
No log	0.0870	8	3.1295	-0.1004	3.1295	1.7690
No log	0.1087	10	2.9577	-0.1068	2.9577	1.7198
No log	0.1304	12	1.6012	0.0510	1.6012	1.2654
No log	0.1522	14	1.1980	0.2203	1.1980	1.0945
No log	0.1739	16	1.3298	0.2070	1.3298	1.1532
No log	0.1957	18	1.4917	0.0751	1.4917	1.2214
No log	0.2174	20	1.3741	0.0696	1.3741	1.1722
No log	0.2391	22	1.3264	0.0972	1.3264	1.1517
No log	0.2609	24	1.2906	0.1339	1.2906	1.1360
No log	0.2826	26	1.2862	0.1805	1.2862	1.1341
No log	0.3043	28	1.2703	0.1674	1.2703	1.1271
No log	0.3261	30	1.2232	0.1571	1.2232	1.1060
No log	0.3478	32	1.2142	0.1435	1.2142	1.1019
No log	0.3696	34	1.2479	0.1805	1.2479	1.1171
No log	0.3913	36	1.2950	0.2023	1.2950	1.1380
No log	0.4130	38	1.2585	0.2451	1.2585	1.1218
No log	0.4348	40	1.1764	0.2554	1.1764	1.0846
No log	0.4565	42	1.1088	0.1902	1.1088	1.0530
No log	0.4783	44	1.0821	0.2505	1.0821	1.0402
No log	0.5	46	1.1390	0.2850	1.1390	1.0672
No log	0.5217	48	1.3527	0.2301	1.3527	1.1631
No log	0.5435	50	1.2495	0.2773	1.2495	1.1178
No log	0.5652	52	1.0562	0.3135	1.0562	1.0277
No log	0.5870	54	1.0586	0.2666	1.0586	1.0289
No log	0.6087	56	1.0825	0.2433	1.0825	1.0404
No log	0.6304	58	1.0545	0.3179	1.0545	1.0269
No log	0.6522	60	1.0802	0.3366	1.0802	1.0393
No log	0.6739	62	1.0740	0.3643	1.0740	1.0363
No log	0.6957	64	1.1154	0.2863	1.1154	1.0561
No log	0.7174	66	1.1183	0.2723	1.1183	1.0575
No log	0.7391	68	0.9428	0.4059	0.9428	0.9710
No log	0.7609	70	0.9151	0.4331	0.9151	0.9566
No log	0.7826	72	0.9668	0.4462	0.9668	0.9833
No log	0.8043	74	1.1689	0.3675	1.1689	1.0812
No log	0.8261	76	1.2331	0.3118	1.2331	1.1105
No log	0.8478	78	0.9687	0.4652	0.9687	0.9842
No log	0.8696	80	0.7307	0.6163	0.7307	0.8548
No log	0.8913	82	0.8606	0.5152	0.8606	0.9277
No log	0.9130	84	0.8154	0.4867	0.8154	0.9030
No log	0.9348	86	0.7228	0.6018	0.7228	0.8502
No log	0.9565	88	0.7593	0.5981	0.7593	0.8714
No log	0.9783	90	0.7596	0.5817	0.7596	0.8716
No log	1.0	92	0.7641	0.5207	0.7641	0.8741
No log	1.0217	94	0.7956	0.4898	0.7956	0.8920
No log	1.0435	96	0.8106	0.4936	0.8106	0.9004
No log	1.0652	98	0.7727	0.5248	0.7727	0.8790
No log	1.0870	100	0.8144	0.6468	0.8144	0.9025
No log	1.1087	102	1.0397	0.4737	1.0397	1.0197
No log	1.1304	104	1.1139	0.4731	1.1139	1.0554
No log	1.1522	106	0.9984	0.4667	0.9984	0.9992
No log	1.1739	108	0.8559	0.5703	0.8559	0.9251
No log	1.1957	110	1.0975	0.4574	1.0975	1.0476
No log	1.2174	112	1.1014	0.4576	1.1014	1.0495
No log	1.2391	114	0.9798	0.4266	0.9798	0.9899
No log	1.2609	116	1.2198	0.3451	1.2198	1.1044
No log	1.2826	118	1.3112	0.3198	1.3112	1.1451
No log	1.3043	120	1.2145	0.3412	1.2145	1.1021
No log	1.3261	122	1.0539	0.3543	1.0539	1.0266
No log	1.3478	124	1.0101	0.3850	1.0101	1.0051
No log	1.3696	126	1.0341	0.3829	1.0341	1.0169
No log	1.3913	128	1.0341	0.4356	1.0341	1.0169
No log	1.4130	130	1.1282	0.3959	1.1282	1.0622
No log	1.4348	132	1.2779	0.3450	1.2779	1.1304
No log	1.4565	134	1.2688	0.2812	1.2688	1.1264
No log	1.4783	136	1.1740	0.2921	1.1740	1.0835
No log	1.5	138	1.1154	0.4255	1.1154	1.0561
No log	1.5217	140	1.0890	0.4514	1.0890	1.0436
No log	1.5435	142	1.0266	0.4467	1.0266	1.0132
No log	1.5652	144	1.0440	0.4012	1.0440	1.0217
No log	1.5870	146	1.1997	0.3574	1.1997	1.0953
No log	1.6087	148	1.1768	0.2611	1.1768	1.0848
No log	1.6304	150	1.0566	0.3574	1.0566	1.0279
No log	1.6522	152	0.9922	0.4055	0.9922	0.9961
No log	1.6739	154	1.1195	0.3804	1.1195	1.0581
No log	1.6957	156	1.2390	0.4296	1.2390	1.1131
No log	1.7174	158	1.1303	0.4010	1.1303	1.0632
No log	1.7391	160	0.9863	0.4945	0.9863	0.9931
No log	1.7609	162	1.0658	0.3817	1.0658	1.0324
No log	1.7826	164	1.1950	0.2721	1.1950	1.0932
No log	1.8043	166	1.2589	0.2632	1.2589	1.1220
No log	1.8261	168	1.2325	0.2571	1.2325	1.1102
No log	1.8478	170	1.1520	0.2858	1.1520	1.0733
No log	1.8696	172	1.0668	0.3642	1.0668	1.0329
No log	1.8913	174	0.9669	0.5011	0.9669	0.9833
No log	1.9130	176	0.8444	0.5518	0.8444	0.9189
No log	1.9348	178	0.8015	0.5947	0.8015	0.8953
No log	1.9565	180	0.8995	0.5979	0.8995	0.9484
No log	1.9783	182	1.0457	0.5622	1.0457	1.0226
No log	2.0	184	0.9741	0.5844	0.9741	0.9870
No log	2.0217	186	0.7892	0.6569	0.7892	0.8884
No log	2.0435	188	0.7437	0.6613	0.7437	0.8624
No log	2.0652	190	0.7965	0.6360	0.7965	0.8925
No log	2.0870	192	0.8157	0.6251	0.8157	0.9032
No log	2.1087	194	0.8734	0.6161	0.8734	0.9345
No log	2.1304	196	0.8550	0.6229	0.8550	0.9247
No log	2.1522	198	0.8005	0.6109	0.8005	0.8947
No log	2.1739	200	0.8925	0.5985	0.8925	0.9447
No log	2.1957	202	0.9697	0.5496	0.9697	0.9847
No log	2.2174	204	1.0181	0.5493	1.0181	1.0090
No log	2.2391	206	0.9532	0.5595	0.9532	0.9763
No log	2.2609	208	0.9782	0.5300	0.9782	0.9890
No log	2.2826	210	0.8505	0.6050	0.8505	0.9222
No log	2.3043	212	0.7958	0.6433	0.7958	0.8921
No log	2.3261	214	0.8021	0.6426	0.8021	0.8956
No log	2.3478	216	0.9437	0.5681	0.9437	0.9715
No log	2.3696	218	1.1082	0.5280	1.1082	1.0527
No log	2.3913	220	0.9889	0.5718	0.9889	0.9945
No log	2.4130	222	0.8131	0.6477	0.8131	0.9017
No log	2.4348	224	0.8056	0.6372	0.8056	0.8975
No log	2.4565	226	0.8385	0.5810	0.8385	0.9157
No log	2.4783	228	0.7329	0.6329	0.7329	0.8561
No log	2.5	230	0.6865	0.6608	0.6865	0.8285
No log	2.5217	232	0.6625	0.6929	0.6625	0.8140
No log	2.5435	234	0.6580	0.7061	0.6580	0.8112
No log	2.5652	236	0.6573	0.6879	0.6573	0.8107
No log	2.5870	238	0.7176	0.6280	0.7176	0.8471
No log	2.6087	240	0.7536	0.6416	0.7536	0.8681
No log	2.6304	242	0.7237	0.6441	0.7237	0.8507
No log	2.6522	244	0.7948	0.6317	0.7948	0.8915
No log	2.6739	246	0.7588	0.6645	0.7588	0.8711
No log	2.6957	248	0.7291	0.6812	0.7291	0.8539
No log	2.7174	250	0.7841	0.6558	0.7841	0.8855
No log	2.7391	252	0.9555	0.5811	0.9555	0.9775
No log	2.7609	254	1.0308	0.5523	1.0308	1.0153
No log	2.7826	256	0.9941	0.5694	0.9941	0.9971
No log	2.8043	258	0.8939	0.5971	0.8939	0.9455
No log	2.8261	260	0.7888	0.6456	0.7888	0.8881
No log	2.8478	262	0.8126	0.6104	0.8126	0.9015
No log	2.8696	264	0.8617	0.5774	0.8617	0.9283
No log	2.8913	266	0.9562	0.5541	0.9562	0.9779
No log	2.9130	268	0.9388	0.5638	0.9388	0.9689
No log	2.9348	270	0.8022	0.6044	0.8022	0.8956
No log	2.9565	272	0.7862	0.6200	0.7862	0.8867
No log	2.9783	274	0.8837	0.5944	0.8837	0.9401
No log	3.0	276	1.0532	0.5111	1.0532	1.0263
No log	3.0217	278	1.1349	0.5053	1.1349	1.0653
No log	3.0435	280	1.0730	0.5017	1.0730	1.0359
No log	3.0652	282	0.9069	0.5719	0.9069	0.9523
No log	3.0870	284	0.7797	0.5543	0.7797	0.8830
No log	3.1087	286	0.7353	0.5787	0.7353	0.8575
No log	3.1304	288	0.7700	0.6040	0.7700	0.8775
No log	3.1522	290	0.9038	0.5568	0.9038	0.9507
No log	3.1739	292	0.9260	0.5568	0.9260	0.9623
No log	3.1957	294	0.8566	0.5620	0.8566	0.9255
No log	3.2174	296	0.7885	0.6111	0.7885	0.8880
No log	3.2391	298	0.7609	0.6057	0.7609	0.8723
No log	3.2609	300	0.7826	0.5952	0.7826	0.8847
No log	3.2826	302	0.9361	0.5268	0.9361	0.9675
No log	3.3043	304	1.0750	0.5038	1.0750	1.0368
No log	3.3261	306	1.0024	0.5046	1.0024	1.0012
No log	3.3478	308	0.8485	0.5714	0.8485	0.9211
No log	3.3696	310	0.8227	0.5543	0.8227	0.9071
No log	3.3913	312	0.8528	0.5386	0.8528	0.9235
No log	3.4130	314	0.8806	0.5106	0.8806	0.9384
No log	3.4348	316	0.9350	0.5020	0.9350	0.9670
No log	3.4565	318	0.9990	0.5059	0.9990	0.9995
No log	3.4783	320	0.9991	0.5143	0.9991	0.9995
No log	3.5	322	0.9998	0.5143	0.9998	0.9999
No log	3.5217	324	1.0239	0.5030	1.0239	1.0119
No log	3.5435	326	1.0367	0.5015	1.0367	1.0182
No log	3.5652	328	0.8534	0.6032	0.8534	0.9238
No log	3.5870	330	0.8072	0.6440	0.8072	0.8985
No log	3.6087	332	0.8529	0.6076	0.8529	0.9235
No log	3.6304	334	0.8659	0.5971	0.8659	0.9306
No log	3.6522	336	0.8001	0.6328	0.8001	0.8945
No log	3.6739	338	0.6785	0.6769	0.6785	0.8237
No log	3.6957	340	0.6321	0.7003	0.6321	0.7950
No log	3.7174	342	0.6209	0.6828	0.6209	0.7880
No log	3.7391	344	0.6730	0.7118	0.6730	0.8204
No log	3.7609	346	0.7257	0.6991	0.7257	0.8519
No log	3.7826	348	0.7198	0.7034	0.7198	0.8484
No log	3.8043	350	0.7105	0.6928	0.7105	0.8429
No log	3.8261	352	0.6560	0.6891	0.6560	0.8100
No log	3.8478	354	0.6488	0.6742	0.6488	0.8055
No log	3.8696	356	0.6739	0.6862	0.6739	0.8209
No log	3.8913	358	0.7275	0.6593	0.7275	0.8530
No log	3.9130	360	0.7304	0.6586	0.7304	0.8546
No log	3.9348	362	0.6972	0.6777	0.6972	0.8350
No log	3.9565	364	0.6693	0.6969	0.6693	0.8181
No log	3.9783	366	0.6415	0.7215	0.6415	0.8009
No log	4.0	368	0.6417	0.7245	0.6417	0.8010
No log	4.0217	370	0.6699	0.6863	0.6699	0.8185
No log	4.0435	372	0.7151	0.6730	0.7151	0.8457
No log	4.0652	374	0.6661	0.6885	0.6661	0.8162
No log	4.0870	376	0.6260	0.7196	0.6260	0.7912
No log	4.1087	378	0.6262	0.7250	0.6262	0.7913
No log	4.1304	380	0.6282	0.7074	0.6282	0.7926
No log	4.1522	382	0.6269	0.6724	0.6269	0.7918
No log	4.1739	384	0.6834	0.6748	0.6834	0.8267
No log	4.1957	386	0.8532	0.6126	0.8532	0.9237
No log	4.2174	388	0.8927	0.5957	0.8927	0.9448
No log	4.2391	390	0.8001	0.6231	0.8001	0.8945
No log	4.2609	392	0.6868	0.6564	0.6868	0.8287
No log	4.2826	394	0.6751	0.6671	0.6751	0.8216
No log	4.3043	396	0.6961	0.6724	0.6961	0.8343
No log	4.3261	398	0.7770	0.6624	0.7770	0.8815
No log	4.3478	400	0.9639	0.5681	0.9639	0.9818
No log	4.3696	402	0.9963	0.5029	0.9963	0.9981
No log	4.3913	404	1.0700	0.4986	1.0700	1.0344
No log	4.4130	406	1.0932	0.4753	1.0932	1.0456
No log	4.4348	408	1.0040	0.4969	1.0040	1.0020
No log	4.4565	410	0.9961	0.5076	0.9961	0.9981
No log	4.4783	412	1.0781	0.5038	1.0781	1.0383
No log	4.5	414	1.0932	0.5030	1.0932	1.0455
No log	4.5217	416	1.2161	0.4722	1.2161	1.1028
No log	4.5435	418	1.1833	0.4727	1.1833	1.0878
No log	4.5652	420	1.0989	0.5086	1.0989	1.0483
No log	4.5870	422	1.0491	0.5156	1.0491	1.0243
No log	4.6087	424	1.0802	0.5128	1.0802	1.0393
No log	4.6304	426	1.0595	0.5181	1.0595	1.0293
No log	4.6522	428	0.9452	0.5354	0.9452	0.9722
No log	4.6739	430	0.8631	0.5379	0.8631	0.9290
No log	4.6957	432	0.8522	0.5793	0.8522	0.9231
No log	4.7174	434	0.7705	0.6585	0.7705	0.8778
No log	4.7391	436	0.7543	0.6703	0.7543	0.8685
No log	4.7609	438	0.6972	0.7080	0.6972	0.8350
No log	4.7826	440	0.7009	0.6156	0.7009	0.8372
No log	4.8043	442	0.6863	0.6228	0.6863	0.8285
No log	4.8261	444	0.7025	0.6830	0.7025	0.8382
No log	4.8478	446	0.6932	0.6640	0.6932	0.8326
No log	4.8696	448	0.7012	0.5989	0.7012	0.8374
No log	4.8913	450	0.7188	0.5948	0.7188	0.8478
No log	4.9130	452	0.6787	0.6586	0.6787	0.8238
No log	4.9348	454	0.7730	0.6875	0.7730	0.8792
No log	4.9565	456	0.8678	0.6107	0.8678	0.9316
No log	4.9783	458	0.8034	0.6508	0.8034	0.8963
No log	5.0	460	0.6930	0.6710	0.6930	0.8325
No log	5.0217	462	0.7423	0.5999	0.7423	0.8616
No log	5.0435	464	0.7749	0.6050	0.7749	0.8803
No log	5.0652	466	0.7238	0.6149	0.7238	0.8507
No log	5.0870	468	0.6975	0.6718	0.6975	0.8352
No log	5.1087	470	0.7627	0.6518	0.7627	0.8734
No log	5.1304	472	0.9111	0.6031	0.9111	0.9545
No log	5.1522	474	1.0183	0.5958	1.0183	1.0091
No log	5.1739	476	0.9721	0.6079	0.9721	0.9859
No log	5.1957	478	0.8113	0.6123	0.8113	0.9007
No log	5.2174	480	0.7066	0.6786	0.7066	0.8406
No log	5.2391	482	0.6985	0.671	0.6984	0.8357
No log	5.2609	484	0.7125	0.6031	0.7125	0.8441
No log	5.2826	486	0.7502	0.6070	0.7502	0.8661
No log	5.3043	488	0.8070	0.6592	0.8070	0.8983
No log	5.3261	490	0.8428	0.6025	0.8428	0.9180
No log	5.3478	492	0.9142	0.5839	0.9142	0.9561
No log	5.3696	494	0.8823	0.5766	0.8823	0.9393
No log	5.3913	496	0.7849	0.6626	0.7849	0.8859
No log	5.4130	498	0.7010	0.7057	0.7010	0.8373
0.4793	5.4348	500	0.6878	0.7315	0.6878	0.8294
0.4793	5.4565	502	0.7033	0.7079	0.7033	0.8386
0.4793	5.4783	504	0.7651	0.6703	0.7651	0.8747
0.4793	5.5	506	0.8700	0.5968	0.8700	0.9327
0.4793	5.5217	508	0.9746	0.5694	0.9746	0.9872
0.4793	5.5435	510	0.9556	0.5706	0.9556	0.9775

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1