ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k1_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8505
• Qwk: 0.1571
• Mse: 0.8505
• Rmse: 0.9222

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	3.7384	0.0017	3.7384	1.9335
No log	0.6667	4	1.9398	-0.0284	1.9398	1.3928
No log	1.0	6	1.0285	-0.0930	1.0285	1.0142
No log	1.3333	8	2.5059	-0.0176	2.5059	1.5830
No log	1.6667	10	2.1925	-0.0076	2.1925	1.4807
No log	2.0	12	0.8554	-0.0033	0.8554	0.9249
No log	2.3333	14	0.6904	0.0	0.6904	0.8309
No log	2.6667	16	0.6882	-0.0069	0.6882	0.8296
No log	3.0	18	0.7085	0.0416	0.7085	0.8418
No log	3.3333	20	0.8389	0.0609	0.8389	0.9159
No log	3.6667	22	0.7366	0.0759	0.7366	0.8583
No log	4.0	24	0.6728	0.0	0.6728	0.8202
No log	4.3333	26	0.6853	0.0	0.6853	0.8279
No log	4.6667	28	0.7001	0.0260	0.7001	0.8367
No log	5.0	30	2.2986	0.0344	2.2986	1.5161
No log	5.3333	32	3.2197	0.0148	3.2197	1.7944
No log	5.6667	34	2.6423	0.0096	2.6423	1.6255
No log	6.0	36	1.4121	0.0735	1.4121	1.1883
No log	6.3333	38	0.7388	0.0374	0.7388	0.8595
No log	6.6667	40	0.6955	0.1082	0.6955	0.8340
No log	7.0	42	0.7123	0.0506	0.7123	0.8440
No log	7.3333	44	0.8801	0.0346	0.8801	0.9381
No log	7.6667	46	1.5506	-0.0247	1.5506	1.2452
No log	8.0	48	1.9332	0.0	1.9332	1.3904
No log	8.3333	50	1.7062	-0.0247	1.7062	1.3062
No log	8.6667	52	1.0876	0.0217	1.0876	1.0429
No log	9.0	54	0.7337	0.0416	0.7337	0.8566
No log	9.3333	56	0.7750	0.0085	0.7750	0.8804
No log	9.6667	58	0.7763	0.0106	0.7763	0.8811
No log	10.0	60	0.9378	0.0719	0.9378	0.9684
No log	10.3333	62	1.1151	0.0175	1.1151	1.0560
No log	10.6667	64	0.9047	0.1613	0.9047	0.9512
No log	11.0	66	0.8486	0.0134	0.8486	0.9212
No log	11.3333	68	0.8393	0.1647	0.8393	0.9161
No log	11.6667	70	0.9355	0.0676	0.9355	0.9672
No log	12.0	72	0.9151	0.1577	0.9151	0.9566
No log	12.3333	74	0.9252	0.0680	0.9252	0.9618
No log	12.6667	76	0.9840	0.0707	0.9840	0.9920
No log	13.0	78	0.9080	0.1053	0.9080	0.9529
No log	13.3333	80	0.9821	0.1525	0.9821	0.9910
No log	13.6667	82	0.9103	0.1196	0.9103	0.9541
No log	14.0	84	0.9219	0.1612	0.9219	0.9602
No log	14.3333	86	0.8543	0.1313	0.8543	0.9243
No log	14.6667	88	0.9002	0.1102	0.9002	0.9488
No log	15.0	90	1.0999	0.0390	1.0999	1.0487
No log	15.3333	92	0.9796	0.0891	0.9796	0.9898
No log	15.6667	94	0.8096	0.0514	0.8096	0.8998
No log	16.0	96	0.9065	0.0643	0.9065	0.9521
No log	16.3333	98	0.9012	0.0968	0.9012	0.9493
No log	16.6667	100	0.9069	0.1835	0.9069	0.9523
No log	17.0	102	1.0792	0.1014	1.0792	1.0389
No log	17.3333	104	0.9401	0.1452	0.9401	0.9696
No log	17.6667	106	0.8992	0.0643	0.8992	0.9482
No log	18.0	108	0.9888	0.1044	0.9888	0.9944
No log	18.3333	110	0.8868	0.0643	0.8868	0.9417
No log	18.6667	112	0.8530	0.1903	0.8530	0.9236
No log	19.0	114	1.4078	0.0898	1.4078	1.1865
No log	19.3333	116	1.6357	0.0310	1.6357	1.2789
No log	19.6667	118	1.1771	0.0736	1.1771	1.0849
No log	20.0	120	0.9299	0.1685	0.9299	0.9643
No log	20.3333	122	1.0454	0.0762	1.0454	1.0224
No log	20.6667	124	0.9807	0.0492	0.9807	0.9903
No log	21.0	126	0.8112	0.0947	0.8112	0.9007
No log	21.3333	128	0.9484	-0.0008	0.9484	0.9739
No log	21.6667	130	1.1334	0.0612	1.1334	1.0646
No log	22.0	132	0.9703	-0.0138	0.9703	0.9850
No log	22.3333	134	0.8527	0.1532	0.8527	0.9234
No log	22.6667	136	0.7836	0.0949	0.7836	0.8852
No log	23.0	138	0.8282	0.0970	0.8282	0.9100
No log	23.3333	140	0.7915	0.1259	0.7915	0.8897
No log	23.6667	142	0.8112	0.2063	0.8112	0.9007
No log	24.0	144	0.8571	0.1628	0.8571	0.9258
No log	24.3333	146	0.8023	0.2471	0.8023	0.8957
No log	24.6667	148	0.7616	0.1580	0.7616	0.8727
No log	25.0	150	0.8087	0.1941	0.8087	0.8993
No log	25.3333	152	0.8129	0.0886	0.8129	0.9016
No log	25.6667	154	0.8230	0.1132	0.8230	0.9072
No log	26.0	156	0.8856	0.1577	0.8856	0.9411
No log	26.3333	158	0.8602	0.1011	0.8602	0.9275
No log	26.6667	160	0.8477	0.1231	0.8477	0.9207
No log	27.0	162	0.8430	0.1231	0.8430	0.9182
No log	27.3333	164	0.8181	0.1011	0.8181	0.9045
No log	27.6667	166	0.9107	0.2173	0.9107	0.9543
No log	28.0	168	0.8770	0.2193	0.8770	0.9365
No log	28.3333	170	0.7801	0.1272	0.7801	0.8832
No log	28.6667	172	0.7822	0.1290	0.7822	0.8844
No log	29.0	174	0.8295	0.0970	0.8295	0.9108
No log	29.3333	176	0.7820	0.1328	0.7820	0.8843
No log	29.6667	178	0.7697	0.1267	0.7697	0.8773
No log	30.0	180	0.8220	0.1569	0.8220	0.9066
No log	30.3333	182	0.8676	0.0893	0.8676	0.9315
No log	30.6667	184	0.9534	0.1228	0.9534	0.9764
No log	31.0	186	0.9551	0.1892	0.9551	0.9773
No log	31.3333	188	0.9767	0.1806	0.9767	0.9883
No log	31.6667	190	0.8919	0.1767	0.8919	0.9444
No log	32.0	192	0.8425	0.1277	0.8425	0.9179
No log	32.3333	194	0.8312	0.1269	0.8312	0.9117
No log	32.6667	196	0.7527	0.1729	0.7527	0.8676
No log	33.0	198	0.7419	0.2511	0.7419	0.8614
No log	33.3333	200	0.7868	0.2678	0.7868	0.8870
No log	33.6667	202	0.7539	0.2046	0.7539	0.8683
No log	34.0	204	0.7684	0.0909	0.7684	0.8766
No log	34.3333	206	0.7678	0.2103	0.7678	0.8762
No log	34.6667	208	0.8008	0.1829	0.8008	0.8949
No log	35.0	210	0.9535	0.2590	0.9535	0.9765
No log	35.3333	212	0.9974	0.1549	0.9974	0.9987
No log	35.6667	214	0.8779	0.2471	0.8779	0.9370
No log	36.0	216	0.7942	0.1558	0.7942	0.8912
No log	36.3333	218	0.8328	0.0966	0.8328	0.9126
No log	36.6667	220	0.8163	0.0511	0.8163	0.9035
No log	37.0	222	0.8401	0.2158	0.8401	0.9166
No log	37.3333	224	0.9526	0.1954	0.9526	0.9760
No log	37.6667	226	0.9432	0.1998	0.9432	0.9712
No log	38.0	228	0.8523	0.1746	0.8523	0.9232
No log	38.3333	230	0.8546	0.1511	0.8546	0.9245
No log	38.6667	232	0.8511	0.1818	0.8511	0.9225
No log	39.0	234	0.8071	0.1981	0.8071	0.8984
No log	39.3333	236	0.7804	0.0822	0.7804	0.8834
No log	39.6667	238	0.7904	0.0916	0.7904	0.8891
No log	40.0	240	0.8055	0.0916	0.8055	0.8975
No log	40.3333	242	0.8240	0.0347	0.8240	0.9078
No log	40.6667	244	0.8448	0.1846	0.8448	0.9192
No log	41.0	246	0.8478	0.0687	0.8478	0.9207
No log	41.3333	248	0.8857	0.1581	0.8857	0.9411
No log	41.6667	250	0.8899	0.1581	0.8899	0.9433
No log	42.0	252	0.8889	0.1546	0.8889	0.9428
No log	42.3333	254	0.8823	0.1601	0.8823	0.9393
No log	42.6667	256	0.8713	0.0378	0.8713	0.9334
No log	43.0	258	0.8880	0.2040	0.8880	0.9423
No log	43.3333	260	0.8947	0.2335	0.8947	0.9459
No log	43.6667	262	0.8504	0.2319	0.8504	0.9222
No log	44.0	264	0.8030	0.0851	0.8030	0.8961
No log	44.3333	266	0.7986	0.0469	0.7986	0.8936
No log	44.6667	268	0.8048	0.1649	0.8048	0.8971
No log	45.0	270	0.7815	0.1673	0.7815	0.8840
No log	45.3333	272	0.7599	0.1689	0.7599	0.8717
No log	45.6667	274	0.7749	0.2511	0.7749	0.8803
No log	46.0	276	0.8026	0.2791	0.8026	0.8959
No log	46.3333	278	0.8248	0.2791	0.8248	0.9082
No log	46.6667	280	0.8225	0.1962	0.8225	0.9069
No log	47.0	282	0.8302	0.1962	0.8302	0.9112
No log	47.3333	284	0.8295	0.1922	0.8295	0.9108
No log	47.6667	286	0.8504	0.1740	0.8504	0.9222
No log	48.0	288	0.8558	0.1740	0.8558	0.9251
No log	48.3333	290	0.7961	0.2298	0.7961	0.8923
No log	48.6667	292	0.7620	0.2070	0.7620	0.8729
No log	49.0	294	0.7416	0.2209	0.7416	0.8612
No log	49.3333	296	0.7300	0.1395	0.7300	0.8544
No log	49.6667	298	0.7267	0.1815	0.7267	0.8525
No log	50.0	300	0.7596	0.2096	0.7596	0.8715
No log	50.3333	302	0.8011	0.2714	0.8011	0.8951
No log	50.6667	304	0.7954	0.1922	0.7954	0.8919
No log	51.0	306	0.8160	0.1471	0.8160	0.9033
No log	51.3333	308	0.8647	0.1629	0.8647	0.9299
No log	51.6667	310	0.8832	0.1905	0.8832	0.9398
No log	52.0	312	0.8998	0.2049	0.8998	0.9486
No log	52.3333	314	0.8795	0.1277	0.8795	0.9378
No log	52.6667	316	0.8385	0.1638	0.8385	0.9157
No log	53.0	318	0.7878	0.2024	0.7878	0.8876
No log	53.3333	320	0.7590	0.1734	0.7590	0.8712
No log	53.6667	322	0.7535	0.2222	0.7535	0.8681
No log	54.0	324	0.7691	0.1744	0.7691	0.8770
No log	54.3333	326	0.7833	0.1687	0.7833	0.8850
No log	54.6667	328	0.8099	0.1733	0.8099	0.9000
No log	55.0	330	0.8645	0.1539	0.8645	0.9298
No log	55.3333	332	0.9194	0.1264	0.9194	0.9588
No log	55.6667	334	0.9289	0.1036	0.9289	0.9638
No log	56.0	336	0.9247	0.1779	0.9247	0.9616
No log	56.3333	338	0.9306	0.1433	0.9306	0.9647
No log	56.6667	340	0.8857	0.1520	0.8857	0.9411
No log	57.0	342	0.8214	0.1923	0.8214	0.9063
No log	57.3333	344	0.8000	0.1336	0.8000	0.8944
No log	57.6667	346	0.8321	0.1373	0.8321	0.9122
No log	58.0	348	0.8498	0.1628	0.8498	0.9219
No log	58.3333	350	0.8138	0.1815	0.8138	0.9021
No log	58.6667	352	0.7947	0.2345	0.7947	0.8915
No log	59.0	354	0.7822	0.1136	0.7822	0.8844
No log	59.3333	356	0.8144	0.1724	0.8144	0.9024
No log	59.6667	358	0.8470	0.1334	0.8470	0.9203
No log	60.0	360	0.8464	0.1334	0.8464	0.9200
No log	60.3333	362	0.8306	0.1558	0.8306	0.9114
No log	60.6667	364	0.8095	0.1184	0.8095	0.8997
No log	61.0	366	0.8202	0.1621	0.8202	0.9057
No log	61.3333	368	0.8261	0.1621	0.8261	0.9089
No log	61.6667	370	0.8457	0.1954	0.8457	0.9196
No log	62.0	372	0.8141	0.1621	0.8141	0.9023
No log	62.3333	374	0.7879	0.1617	0.7879	0.8876
No log	62.6667	376	0.7964	0.1181	0.7964	0.8924
No log	63.0	378	0.8010	0.1181	0.8010	0.8950
No log	63.3333	380	0.8114	0.1580	0.8114	0.9008
No log	63.6667	382	0.8260	0.1011	0.8260	0.9088
No log	64.0	384	0.8542	0.0506	0.8542	0.9242
No log	64.3333	386	0.8574	0.0872	0.8574	0.9260
No log	64.6667	388	0.8557	0.0839	0.8557	0.9251
No log	65.0	390	0.8603	0.0839	0.8603	0.9275
No log	65.3333	392	0.8478	0.0839	0.8478	0.9207
No log	65.6667	394	0.8319	0.0839	0.8319	0.9121
No log	66.0	396	0.8244	0.1386	0.8244	0.9080
No log	66.3333	398	0.8270	0.1529	0.8270	0.9094
No log	66.6667	400	0.8249	0.1136	0.8249	0.9082
No log	67.0	402	0.8207	0.1093	0.8207	0.9059
No log	67.3333	404	0.8306	0.1093	0.8306	0.9114
No log	67.6667	406	0.8419	0.1092	0.8419	0.9175
No log	68.0	408	0.8503	0.1289	0.8503	0.9221
No log	68.3333	410	0.8416	0.1012	0.8416	0.9174
No log	68.6667	412	0.8449	0.1012	0.8449	0.9192
No log	69.0	414	0.8548	0.0839	0.8548	0.9246
No log	69.3333	416	0.8679	0.0839	0.8679	0.9316
No log	69.6667	418	0.8808	0.1773	0.8808	0.9385
No log	70.0	420	0.8919	0.1946	0.8919	0.9444
No log	70.3333	422	0.8906	0.1946	0.8906	0.9437
No log	70.6667	424	0.8852	0.1946	0.8852	0.9409
No log	71.0	426	0.8485	0.1727	0.8485	0.9211
No log	71.3333	428	0.8175	0.1673	0.8175	0.9041
No log	71.6667	430	0.7899	0.1646	0.7899	0.8888
No log	72.0	432	0.7817	0.1272	0.7817	0.8841
No log	72.3333	434	0.7814	0.1272	0.7814	0.8840
No log	72.6667	436	0.7824	0.1646	0.7824	0.8845
No log	73.0	438	0.7928	0.0697	0.7928	0.8904
No log	73.3333	440	0.8056	0.1313	0.8056	0.8976
No log	73.6667	442	0.8007	0.1713	0.8007	0.8948
No log	74.0	444	0.8122	0.1660	0.8122	0.9012
No log	74.3333	446	0.8225	0.1954	0.8225	0.9069
No log	74.6667	448	0.8502	0.1846	0.8502	0.9220
No log	75.0	450	0.8539	0.1954	0.8539	0.9241
No log	75.3333	452	0.8418	0.2401	0.8418	0.9175
No log	75.6667	454	0.8143	0.1308	0.8143	0.9024
No log	76.0	456	0.8111	0.1179	0.8111	0.9006
No log	76.3333	458	0.8111	0.1179	0.8111	0.9006
No log	76.6667	460	0.8069	0.1179	0.8069	0.8983
No log	77.0	462	0.7969	0.1181	0.7969	0.8927
No log	77.3333	464	0.7969	0.1962	0.7969	0.8927
No log	77.6667	466	0.8102	0.1448	0.8102	0.9001
No log	78.0	468	0.8127	0.1400	0.8127	0.9015
No log	78.3333	470	0.8230	0.1648	0.8230	0.9072
No log	78.6667	472	0.8339	0.1648	0.8339	0.9132
No log	79.0	474	0.8407	0.1264	0.8407	0.9169
No log	79.3333	476	0.8499	0.1264	0.8499	0.9219
No log	79.6667	478	0.8508	0.1393	0.8508	0.9224
No log	80.0	480	0.8475	0.1432	0.8475	0.9206
No log	80.3333	482	0.8425	0.1432	0.8425	0.9179
No log	80.6667	484	0.8390	0.1432	0.8390	0.9160
No log	81.0	486	0.8399	0.1432	0.8399	0.9164
No log	81.3333	488	0.8438	0.1386	0.8438	0.9186
No log	81.6667	490	0.8500	0.1341	0.8500	0.9220
No log	82.0	492	0.8515	0.1613	0.8515	0.9228
No log	82.3333	494	0.8522	0.1613	0.8522	0.9231
No log	82.6667	496	0.8449	0.1347	0.8449	0.9192
No log	83.0	498	0.8304	0.1393	0.8304	0.9112
0.2528	83.3333	500	0.8108	0.1432	0.8108	0.9004
0.2528	83.6667	502	0.8020	0.1432	0.8020	0.8956
0.2528	84.0	504	0.7976	0.1884	0.7976	0.8931
0.2528	84.3333	506	0.7955	0.1400	0.7955	0.8919
0.2528	84.6667	508	0.7961	0.1807	0.7961	0.8923
0.2528	85.0	510	0.8063	0.1752	0.8063	0.8980
0.2528	85.3333	512	0.8231	0.1752	0.8231	0.9072
0.2528	85.6667	514	0.8279	0.2007	0.8279	0.9099
0.2528	86.0	516	0.8243	0.2007	0.8243	0.9079
0.2528	86.3333	518	0.8259	0.1624	0.8259	0.9088
0.2528	86.6667	520	0.8275	0.1813	0.8275	0.9096
0.2528	87.0	522	0.8315	0.1867	0.8315	0.9119
0.2528	87.3333	524	0.8400	0.1649	0.8400	0.9165
0.2528	87.6667	526	0.8437	0.1603	0.8437	0.9185
0.2528	88.0	528	0.8383	0.1624	0.8383	0.9156
0.2528	88.3333	530	0.8346	0.1624	0.8346	0.9136
0.2528	88.6667	532	0.8362	0.1624	0.8362	0.9144
0.2528	89.0	534	0.8403	0.1624	0.8403	0.9167
0.2528	89.3333	536	0.8440	0.1901	0.8440	0.9187
0.2528	89.6667	538	0.8502	0.1901	0.8502	0.9220
0.2528	90.0	540	0.8512	0.1550	0.8512	0.9226
0.2528	90.3333	542	0.8618	0.1815	0.8618	0.9283
0.2528	90.6667	544	0.8666	0.1815	0.8666	0.9309
0.2528	91.0	546	0.8654	0.1882	0.8654	0.9302
0.2528	91.3333	548	0.8636	0.1882	0.8636	0.9293
0.2528	91.6667	550	0.8619	0.2227	0.8619	0.9284
0.2528	92.0	552	0.8632	0.1815	0.8632	0.9291
0.2528	92.3333	554	0.8608	0.1560	0.8608	0.9278
0.2528	92.6667	556	0.8599	0.1560	0.8599	0.9273
0.2528	93.0	558	0.8576	0.1560	0.8576	0.9261
0.2528	93.3333	560	0.8504	0.1598	0.8504	0.9222
0.2528	93.6667	562	0.8473	0.1598	0.8473	0.9205
0.2528	94.0	564	0.8417	0.1598	0.8417	0.9174
0.2528	94.3333	566	0.8382	0.1648	0.8382	0.9155
0.2528	94.6667	568	0.8385	0.1648	0.8385	0.9157
0.2528	95.0	570	0.8410	0.1598	0.8410	0.9171
0.2528	95.3333	572	0.8455	0.1598	0.8455	0.9195
0.2528	95.6667	574	0.8477	0.1598	0.8477	0.9207
0.2528	96.0	576	0.8515	0.1598	0.8515	0.9228
0.2528	96.3333	578	0.8573	0.1560	0.8573	0.9259
0.2528	96.6667	580	0.8591	0.1571	0.8591	0.9269
0.2528	97.0	582	0.8575	0.1571	0.8575	0.9260
0.2528	97.3333	584	0.8566	0.1571	0.8566	0.9255
0.2528	97.6667	586	0.8568	0.1571	0.8568	0.9257
0.2528	98.0	588	0.8557	0.1571	0.8557	0.9250
0.2528	98.3333	590	0.8543	0.1571	0.8543	0.9243
0.2528	98.6667	592	0.8529	0.1571	0.8529	0.9235
0.2528	99.0	594	0.8521	0.1571	0.8521	0.9231
0.2528	99.3333	596	0.8509	0.1571	0.8509	0.9225
0.2528	99.6667	598	0.8505	0.1571	0.8505	0.9222
0.2528	100.0	600	0.8505	0.1571	0.8505	0.9222

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1