ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k1_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7910
• Qwk: 0.1212
• Mse: 0.7910
• Rmse: 0.8894

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	3.5134	0.0070	3.5134	1.8744
No log	0.6667	4	1.7066	0.0624	1.7066	1.3064
No log	1.0	6	1.0941	0.0909	1.0941	1.0460
No log	1.3333	8	1.2555	0.0137	1.2555	1.1205
No log	1.6667	10	1.0458	-0.0966	1.0458	1.0226
No log	2.0	12	1.2131	-0.0422	1.2131	1.1014
No log	2.3333	14	0.9880	-0.0648	0.9880	0.9940
No log	2.6667	16	0.8222	0.0409	0.8222	0.9067
No log	3.0	18	0.7415	0.1318	0.7415	0.8611
No log	3.3333	20	0.6960	0.0374	0.6960	0.8343
No log	3.6667	22	0.6825	0.0964	0.6825	0.8262
No log	4.0	24	0.8207	0.0442	0.8207	0.9059
No log	4.3333	26	0.8146	-0.0316	0.8146	0.9025
No log	4.6667	28	0.7899	0.0152	0.7899	0.8887
No log	5.0	30	0.7525	0.0355	0.7525	0.8675
No log	5.3333	32	0.7655	-0.0627	0.7655	0.8749
No log	5.6667	34	0.8307	-0.0228	0.8307	0.9114
No log	6.0	36	1.2009	-0.0820	1.2009	1.0959
No log	6.3333	38	1.1530	-0.0452	1.1530	1.0738
No log	6.6667	40	0.8409	0.0	0.8409	0.9170
No log	7.0	42	0.7881	0.1081	0.7881	0.8878
No log	7.3333	44	0.7802	0.1552	0.7802	0.8833
No log	7.6667	46	0.8940	0.1329	0.8940	0.9455
No log	8.0	48	1.2249	-0.0500	1.2249	1.1068
No log	8.3333	50	0.8578	0.0956	0.8578	0.9262
No log	8.6667	52	0.7038	-0.0069	0.7038	0.8389
No log	9.0	54	0.7010	0.0621	0.7010	0.8372
No log	9.3333	56	0.6981	0.0460	0.6981	0.8355
No log	9.6667	58	0.7894	0.0670	0.7894	0.8885
No log	10.0	60	0.8368	0.0670	0.8368	0.9148
No log	10.3333	62	0.7764	0.0	0.7764	0.8811
No log	10.6667	64	0.7988	0.0570	0.7988	0.8938
No log	11.0	66	0.9508	0.0470	0.9508	0.9751
No log	11.3333	68	1.0439	-0.0760	1.0439	1.0217
No log	11.6667	70	0.8543	0.0955	0.8543	0.9243
No log	12.0	72	0.9419	0.1111	0.9419	0.9705
No log	12.3333	74	0.9908	0.1422	0.9908	0.9954
No log	12.6667	76	0.9262	0.1209	0.9262	0.9624
No log	13.0	78	1.4448	0.0220	1.4448	1.2020
No log	13.3333	80	1.4559	0.0447	1.4559	1.2066
No log	13.6667	82	0.9198	0.1699	0.9198	0.9590
No log	14.0	84	0.9068	0.0391	0.9068	0.9523
No log	14.3333	86	0.8885	0.0378	0.8885	0.9426
No log	14.6667	88	0.8213	0.0344	0.8213	0.9063
No log	15.0	90	1.2541	-0.0842	1.2541	1.1199
No log	15.3333	92	1.5502	0.0583	1.5502	1.2451
No log	15.6667	94	1.1265	0.1146	1.1265	1.0614
No log	16.0	96	0.8728	0.0842	0.8728	0.9342
No log	16.3333	98	0.9383	0.1249	0.9383	0.9687
No log	16.6667	100	0.9581	0.0724	0.9581	0.9788
No log	17.0	102	1.2177	0.0779	1.2177	1.1035
No log	17.3333	104	1.3971	0.0231	1.3971	1.1820
No log	17.6667	106	1.0815	0.0324	1.0815	1.0399
No log	18.0	108	0.9491	0.0753	0.9491	0.9742
No log	18.3333	110	0.9506	0.0253	0.9506	0.9750
No log	18.6667	112	0.9346	0.0768	0.9346	0.9667
No log	19.0	114	1.1233	0.0211	1.1233	1.0599
No log	19.3333	116	1.1925	0.0497	1.1925	1.0920
No log	19.6667	118	1.0386	0.1103	1.0386	1.0191
No log	20.0	120	0.9872	0.0262	0.9872	0.9936
No log	20.3333	122	0.9443	0.1078	0.9443	0.9718
No log	20.6667	124	0.9185	0.0728	0.9185	0.9584
No log	21.0	126	0.8311	0.0796	0.8311	0.9116
No log	21.3333	128	0.8756	0.0377	0.8756	0.9357
No log	21.6667	130	0.9285	0.0676	0.9285	0.9636
No log	22.0	132	0.8849	0.0896	0.8849	0.9407
No log	22.3333	134	0.9323	0.1125	0.9323	0.9655
No log	22.6667	136	0.9254	0.0656	0.9254	0.9620
No log	23.0	138	0.9286	0.1560	0.9286	0.9636
No log	23.3333	140	0.9839	0.0324	0.9839	0.9919
No log	23.6667	142	1.0091	-0.0676	1.0091	1.0045
No log	24.0	144	0.9839	0.0117	0.9839	0.9919
No log	24.3333	146	1.0411	0.0970	1.0411	1.0204
No log	24.6667	148	0.9442	0.1237	0.9442	0.9717
No log	25.0	150	0.9340	0.0933	0.9340	0.9664
No log	25.3333	152	0.9552	0.0060	0.9552	0.9773
No log	25.6667	154	0.9131	0.1904	0.9131	0.9556
No log	26.0	156	0.9133	0.2016	0.9133	0.9557
No log	26.3333	158	0.9041	0.1385	0.9041	0.9509
No log	26.6667	160	0.8618	0.1164	0.8618	0.9283
No log	27.0	162	0.7968	-0.0500	0.7968	0.8926
No log	27.3333	164	0.7870	-0.0500	0.7870	0.8871
No log	27.6667	166	0.8373	0.0916	0.8373	0.9150
No log	28.0	168	0.8922	0.1379	0.8922	0.9446
No log	28.3333	170	0.9115	0.1379	0.9115	0.9547
No log	28.6667	172	0.9414	0.0589	0.9414	0.9703
No log	29.0	174	1.0021	0.0680	1.0021	1.0011
No log	29.3333	176	0.9303	0.0665	0.9303	0.9645
No log	29.6667	178	0.8347	-0.0167	0.8347	0.9136
No log	30.0	180	0.8628	0.0551	0.8628	0.9289
No log	30.3333	182	0.9278	0.0336	0.9278	0.9632
No log	30.6667	184	0.9251	0.1550	0.9251	0.9618
No log	31.0	186	0.9595	0.0521	0.9595	0.9795
No log	31.3333	188	0.9990	0.0970	0.9990	0.9995
No log	31.6667	190	0.9222	0.0847	0.9222	0.9603
No log	32.0	192	0.9300	0.0659	0.9300	0.9644
No log	32.3333	194	0.9902	-0.0500	0.9902	0.9951
No log	32.6667	196	0.8630	0.0277	0.8630	0.9290
No log	33.0	198	0.8064	0.0538	0.8064	0.8980
No log	33.3333	200	0.8225	0.0	0.8225	0.9069
No log	33.6667	202	0.8603	0.1304	0.8603	0.9275
No log	34.0	204	0.8986	0.1172	0.8986	0.9479
No log	34.3333	206	0.9454	0.0705	0.9454	0.9723
No log	34.6667	208	0.9545	0.0968	0.9545	0.9770
No log	35.0	210	0.8863	0.1093	0.8863	0.9414
No log	35.3333	212	0.8162	0.0804	0.8162	0.9034
No log	35.6667	214	0.8389	0.0518	0.8389	0.9159
No log	36.0	216	0.8870	0.0560	0.8870	0.9418
No log	36.3333	218	0.8826	0.1500	0.8826	0.9395
No log	36.6667	220	0.8932	0.1393	0.8932	0.9451
No log	37.0	222	0.9218	0.1432	0.9218	0.9601
No log	37.3333	224	0.9813	0.1153	0.9813	0.9906
No log	37.6667	226	1.0029	0.0355	1.0029	1.0014
No log	38.0	228	0.9631	0.0687	0.9631	0.9814
No log	38.3333	230	0.8863	0.0649	0.8863	0.9414
No log	38.6667	232	0.8582	0.0488	0.8582	0.9264
No log	39.0	234	0.8800	0.1410	0.8800	0.9381
No log	39.3333	236	0.9005	0.1410	0.9005	0.9489
No log	39.6667	238	0.8992	0.1052	0.8992	0.9483
No log	40.0	240	0.9001	0.1404	0.9001	0.9488
No log	40.3333	242	0.8895	0.1447	0.8895	0.9432
No log	40.6667	244	0.8634	0.1455	0.8634	0.9292
No log	41.0	246	0.8667	0.1128	0.8667	0.9310
No log	41.3333	248	0.9190	0.0598	0.9190	0.9586
No log	41.6667	250	0.8866	0.0643	0.8866	0.9416
No log	42.0	252	0.8020	-0.0762	0.8020	0.8956
No log	42.3333	254	0.7700	-0.0859	0.7700	0.8775
No log	42.6667	256	0.7814	-0.0831	0.7814	0.8840
No log	43.0	258	0.8334	0.0761	0.8334	0.9129
No log	43.3333	260	0.9094	0.1716	0.9094	0.9536
No log	43.6667	262	0.9553	0.1693	0.9553	0.9774
No log	44.0	264	0.9956	0.1225	0.9956	0.9978
No log	44.3333	266	0.9743	0.0939	0.9743	0.9870
No log	44.6667	268	0.8789	0.0964	0.8789	0.9375
No log	45.0	270	0.7901	0.1139	0.7901	0.8889
No log	45.3333	272	0.7745	0.0639	0.7745	0.8801
No log	45.6667	274	0.7670	0.0783	0.7670	0.8758
No log	46.0	276	0.8177	0.0139	0.8177	0.9042
No log	46.3333	278	0.9042	0.0286	0.9042	0.9509
No log	46.6667	280	0.9033	0.0600	0.9033	0.9504
No log	47.0	282	0.8657	0.0506	0.8657	0.9304
No log	47.3333	284	0.8523	0.1093	0.8523	0.9232
No log	47.6667	286	0.9014	-0.0359	0.9014	0.9494
No log	48.0	288	0.8983	-0.0809	0.8983	0.9478
No log	48.3333	290	0.8399	0.0670	0.8399	0.9164
No log	48.6667	292	0.8508	0.0119	0.8508	0.9224
No log	49.0	294	0.8930	-0.0079	0.8930	0.9450
No log	49.3333	296	0.9022	-0.0079	0.9022	0.9499
No log	49.6667	298	0.8715	0.0922	0.8715	0.9335
No log	50.0	300	0.8685	0.1093	0.8685	0.9319
No log	50.3333	302	0.8981	-0.1152	0.8981	0.9477
No log	50.6667	304	0.8787	0.0161	0.8787	0.9374
No log	51.0	306	0.8695	0.1050	0.8695	0.9325
No log	51.3333	308	0.8780	0.1093	0.8780	0.9370
No log	51.6667	310	0.8966	0.1426	0.8966	0.9469
No log	52.0	312	0.9103	0.1419	0.9103	0.9541
No log	52.3333	314	0.9523	0.1419	0.9523	0.9758
No log	52.6667	316	0.9893	0.1413	0.9893	0.9947
No log	53.0	318	1.0139	0.1446	1.0139	1.0069
No log	53.3333	320	0.9958	0.1122	0.9958	0.9979
No log	53.6667	322	0.9266	0.1460	0.9266	0.9626
No log	54.0	324	0.8729	0.1093	0.8729	0.9343
No log	54.3333	326	0.8738	0.0597	0.8738	0.9348
No log	54.6667	328	0.8506	0.0586	0.8506	0.9223
No log	55.0	330	0.8094	0.1138	0.8094	0.8997
No log	55.3333	332	0.8171	0.1558	0.8171	0.9040
No log	55.6667	334	0.8781	0.0579	0.8781	0.9371
No log	56.0	336	0.9266	0.0340	0.9266	0.9626
No log	56.3333	338	0.9276	0.0351	0.9276	0.9631
No log	56.6667	340	0.8730	0.0569	0.8730	0.9343
No log	57.0	342	0.8396	0.0784	0.8396	0.9163
No log	57.3333	344	0.8603	0.0226	0.8603	0.9275
No log	57.6667	346	0.9371	-0.0322	0.9371	0.9680
No log	58.0	348	0.9877	-0.0378	0.9877	0.9938
No log	58.3333	350	0.9703	0.0618	0.9703	0.9851
No log	58.6667	352	0.9598	0.1432	0.9598	0.9797
No log	59.0	354	0.9232	0.1455	0.9232	0.9608
No log	59.3333	356	0.9101	0.1091	0.9101	0.9540
No log	59.6667	358	0.9112	0.0705	0.9112	0.9546
No log	60.0	360	0.9061	0.0670	0.9061	0.9519
No log	60.3333	362	0.9009	0.1051	0.9009	0.9492
No log	60.6667	364	0.8948	0.0705	0.8948	0.9459
No log	61.0	366	0.8866	0.1130	0.8866	0.9416
No log	61.3333	368	0.8695	0.1164	0.8695	0.9325
No log	61.6667	370	0.8515	0.0407	0.8515	0.9228
No log	62.0	372	0.8396	0.0741	0.8396	0.9163
No log	62.3333	374	0.8765	0.0643	0.8765	0.9362
No log	62.6667	376	0.9371	0.0109	0.9371	0.9680
No log	63.0	378	0.9454	-0.0251	0.9454	0.9723
No log	63.3333	380	0.9325	0.1010	0.9325	0.9656
No log	63.6667	382	0.9415	0.0637	0.9415	0.9703
No log	64.0	384	0.9824	0.0168	0.9824	0.9912
No log	64.3333	386	0.9713	0.0563	0.9713	0.9855
No log	64.6667	388	0.9549	0.0532	0.9549	0.9772
No log	65.0	390	0.8957	0.1051	0.8957	0.9464
No log	65.3333	392	0.8544	0.0362	0.8544	0.9243
No log	65.6667	394	0.8196	0.0771	0.8196	0.9053
No log	66.0	396	0.8010	0.0377	0.8010	0.8950
No log	66.3333	398	0.7999	0.0377	0.7999	0.8943
No log	66.6667	400	0.8069	-0.0357	0.8069	0.8983
No log	67.0	402	0.8210	0.0570	0.8210	0.9061
No log	67.3333	404	0.8230	0.0807	0.8230	0.9072
No log	67.6667	406	0.8284	0.0377	0.8284	0.9101
No log	68.0	408	0.8591	0.0347	0.8591	0.9269
No log	68.3333	410	0.8756	0.0318	0.8756	0.9357
No log	68.6667	412	0.8961	0.0761	0.8961	0.9467
No log	69.0	414	0.9254	0.1460	0.9254	0.9620
No log	69.3333	416	0.9379	0.1460	0.9379	0.9684
No log	69.6667	418	0.9198	0.1468	0.9198	0.9591
No log	70.0	420	0.8771	0.0720	0.8771	0.9365
No log	70.3333	422	0.8482	0.1092	0.8482	0.9210
No log	70.6667	424	0.8252	0.1093	0.8252	0.9084
No log	71.0	426	0.8067	0.1093	0.8067	0.8982
No log	71.3333	428	0.8002	0.0784	0.8002	0.8946
No log	71.6667	430	0.7969	0.0784	0.7969	0.8927
No log	72.0	432	0.7828	0.1591	0.7828	0.8848
No log	72.3333	434	0.7797	0.0784	0.7797	0.8830
No log	72.6667	436	0.7738	0.0784	0.7738	0.8797
No log	73.0	438	0.7720	0.1591	0.7720	0.8786
No log	73.3333	440	0.7778	0.0790	0.7778	0.8819
No log	73.6667	442	0.7980	0.1212	0.7980	0.8933
No log	74.0	444	0.8107	0.1212	0.8107	0.9004
No log	74.3333	446	0.8069	0.1212	0.8069	0.8983
No log	74.6667	448	0.7902	0.1174	0.7902	0.8890
No log	75.0	450	0.7798	0.1184	0.7798	0.8831
No log	75.3333	452	0.7766	0.0757	0.7766	0.8813
No log	75.6667	454	0.7731	0.0757	0.7731	0.8793
No log	76.0	456	0.7782	0.1580	0.7782	0.8822
No log	76.3333	458	0.7965	0.1660	0.7965	0.8925
No log	76.6667	460	0.8086	0.0996	0.8086	0.8992
No log	77.0	462	0.8137	0.0682	0.8137	0.9020
No log	77.3333	464	0.8106	0.0682	0.8106	0.9003
No log	77.6667	466	0.7988	-0.0208	0.7988	0.8938
No log	78.0	468	0.8033	0.0165	0.8033	0.8963
No log	78.3333	470	0.8093	0.0570	0.8093	0.8996
No log	78.6667	472	0.8095	0.0165	0.8095	0.8997
No log	79.0	474	0.8237	0.1379	0.8237	0.9076
No log	79.3333	476	0.8242	0.1379	0.8242	0.9079
No log	79.6667	478	0.8119	0.0842	0.8119	0.9011
No log	80.0	480	0.8029	0.0451	0.8029	0.8961
No log	80.3333	482	0.7933	0.1184	0.7933	0.8907
No log	80.6667	484	0.7879	0.1184	0.7879	0.8876
No log	81.0	486	0.7840	0.1184	0.7840	0.8854
No log	81.3333	488	0.7826	0.1184	0.7826	0.8846
No log	81.6667	490	0.7871	0.0822	0.7871	0.8872
No log	82.0	492	0.7932	0.1212	0.7932	0.8906
No log	82.3333	494	0.8015	0.0842	0.8015	0.8952
No log	82.6667	496	0.8096	0.0842	0.8096	0.8998
No log	83.0	498	0.8037	0.0842	0.8037	0.8965
0.2079	83.3333	500	0.7932	0.1212	0.7932	0.8906
0.2079	83.6667	502	0.7840	0.1212	0.7840	0.8854
0.2079	84.0	504	0.7836	0.1212	0.7836	0.8852
0.2079	84.3333	506	0.7816	0.0827	0.7816	0.8841
0.2079	84.6667	508	0.7852	0.0827	0.7852	0.8861
0.2079	85.0	510	0.7910	0.1212	0.7910	0.8894

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1