ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8379
• Qwk: 0.0469
• Mse: 0.8379
• Rmse: 0.9154

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	3.7077	-0.0058	3.7077	1.9255
No log	0.0702	4	1.9603	-0.0713	1.9603	1.4001
No log	0.1053	6	1.0089	-0.0894	1.0089	1.0044
No log	0.1404	8	1.2638	-0.0638	1.2638	1.1242
No log	0.1754	10	1.9484	0.0196	1.9484	1.3958
No log	0.2105	12	0.9249	-0.0486	0.9249	0.9617
No log	0.2456	14	0.9148	-0.0442	0.9148	0.9565
No log	0.2807	16	0.8632	0.1188	0.8632	0.9291
No log	0.3158	18	0.7254	0.0	0.7254	0.8517
No log	0.3509	20	0.7387	-0.1227	0.7387	0.8595
No log	0.3860	22	1.1059	0.0338	1.1059	1.0516
No log	0.4211	24	1.5010	0.0	1.5010	1.2251
No log	0.4561	26	1.4474	0.0	1.4474	1.2031
No log	0.4912	28	1.0959	0.0156	1.0959	1.0469
No log	0.5263	30	0.8835	0.0609	0.8835	0.9400
No log	0.5614	32	0.8973	0.0609	0.8973	0.9473
No log	0.5965	34	1.1805	0.0790	1.1805	1.0865
No log	0.6316	36	1.1455	0.0217	1.1455	1.0703
No log	0.6667	38	0.7808	0.0260	0.7808	0.8836
No log	0.7018	40	0.7286	0.0909	0.7286	0.8536
No log	0.7368	42	0.7300	0.0909	0.7300	0.8544
No log	0.7719	44	0.9673	-0.1217	0.9673	0.9835
No log	0.8070	46	0.9826	-0.1212	0.9826	0.9913
No log	0.8421	48	1.2407	0.0078	1.2407	1.1139
No log	0.8772	50	1.2766	0.0078	1.2766	1.1299
No log	0.9123	52	0.8321	0.1146	0.8321	0.9122
No log	0.9474	54	0.7505	0.0964	0.7505	0.8663
No log	0.9825	56	0.7076	0.1082	0.7076	0.8412
No log	1.0175	58	0.7468	0.0159	0.7468	0.8641
No log	1.0526	60	0.9335	0.0515	0.9335	0.9662
No log	1.0877	62	0.7430	0.1395	0.7430	0.8620
No log	1.1228	64	0.6478	0.0374	0.6478	0.8049
No log	1.1579	66	0.6667	0.0374	0.6667	0.8165
No log	1.1930	68	0.6875	0.1758	0.6875	0.8292
No log	1.2281	70	0.7077	0.1691	0.7077	0.8413
No log	1.2632	72	0.7106	0.1691	0.7106	0.8430
No log	1.2982	74	0.6920	0.1627	0.6920	0.8318
No log	1.3333	76	0.8988	0.1429	0.8988	0.9481
No log	1.3684	78	0.8545	0.1593	0.8545	0.9244
No log	1.4035	80	0.7206	0.1249	0.7206	0.8489
No log	1.4386	82	0.7259	0.2166	0.7259	0.8520
No log	1.4737	84	0.7545	0.2138	0.7545	0.8686
No log	1.5088	86	0.7785	0.3392	0.7785	0.8823
No log	1.5439	88	0.7568	0.1986	0.7568	0.8699
No log	1.5789	90	0.6163	0.0964	0.6163	0.7851
No log	1.6140	92	0.6115	0.1444	0.6115	0.7820
No log	1.6491	94	0.6241	0.1856	0.6241	0.7900
No log	1.6842	96	0.8977	0.1026	0.8977	0.9475
No log	1.7193	98	1.2024	0.0894	1.2024	1.0966
No log	1.7544	100	0.8825	0.1190	0.8825	0.9394
No log	1.7895	102	0.8860	0.1008	0.8860	0.9413
No log	1.8246	104	1.0815	0.0832	1.0815	1.0400
No log	1.8596	106	0.9047	0.0050	0.9047	0.9511
No log	1.8947	108	0.7266	0.1146	0.7266	0.8524
No log	1.9298	110	0.9141	0.0277	0.9141	0.9561
No log	1.9649	112	0.8652	0.0377	0.8652	0.9302
No log	2.0	114	0.9252	0.1159	0.9252	0.9619
No log	2.0351	116	1.0600	0.0896	1.0600	1.0296
No log	2.0702	118	1.1413	0.0710	1.1413	1.0683
No log	2.1053	120	1.0602	0.0735	1.0602	1.0296
No log	2.1404	122	1.0465	0.1291	1.0465	1.0230
No log	2.1754	124	0.9404	0.1088	0.9404	0.9697
No log	2.2105	126	1.0947	0.1014	1.0947	1.0463
No log	2.2456	128	1.1179	0.1076	1.1179	1.0573
No log	2.2807	130	0.8574	0.0265	0.8574	0.9260
No log	2.3158	132	0.7419	0.1689	0.7419	0.8613
No log	2.3509	134	0.8165	0.1605	0.8165	0.9036
No log	2.3860	136	0.7819	0.1660	0.7819	0.8842
No log	2.4211	138	0.6638	0.0454	0.6638	0.8147
No log	2.4561	140	0.7015	0.1028	0.7015	0.8376
No log	2.4912	142	0.7336	0.2628	0.7336	0.8565
No log	2.5263	144	0.7884	0.2481	0.7884	0.8879
No log	2.5614	146	1.0350	0.1542	1.0350	1.0173
No log	2.5965	148	1.0274	0.2518	1.0274	1.0136
No log	2.6316	150	0.9685	0.1089	0.9685	0.9841
No log	2.6667	152	0.9672	0.1089	0.9672	0.9835
No log	2.7018	154	0.9843	0.1192	0.9843	0.9921
No log	2.7368	156	0.9363	0.0852	0.9363	0.9676
No log	2.7719	158	0.9265	0.1201	0.9265	0.9625
No log	2.8070	160	0.9086	0.2491	0.9086	0.9532
No log	2.8421	162	0.9313	0.1198	0.9313	0.9650
No log	2.8772	164	0.9718	0.0560	0.9718	0.9858
No log	2.9123	166	0.9107	0.1196	0.9107	0.9543
No log	2.9474	168	0.8476	0.1448	0.8476	0.9207
No log	2.9825	170	0.8186	0.1961	0.8186	0.9047
No log	3.0175	172	0.8234	0.1206	0.8234	0.9074
No log	3.0526	174	0.8593	0.1240	0.8593	0.9270
No log	3.0877	176	0.8414	0.2264	0.8414	0.9173
No log	3.1228	178	0.9072	0.2465	0.9072	0.9525
No log	3.1579	180	0.9796	0.2045	0.9796	0.9897
No log	3.1930	182	1.0474	0.1219	1.0474	1.0234
No log	3.2281	184	1.0674	0.1727	1.0674	1.0331
No log	3.2632	186	1.0103	0.1652	1.0103	1.0051
No log	3.2982	188	1.0608	0.0950	1.0608	1.0300
No log	3.3333	190	1.0662	0.0413	1.0662	1.0326
No log	3.3684	192	0.8605	0.1857	0.8605	0.9277
No log	3.4035	194	0.8226	0.2181	0.8226	0.9070
No log	3.4386	196	0.8583	0.0781	0.8583	0.9265
No log	3.4737	198	0.8288	0.2280	0.8288	0.9104
No log	3.5088	200	0.9353	0.1262	0.9353	0.9671
No log	3.5439	202	0.9327	0.1262	0.9327	0.9658
No log	3.5789	204	0.8004	0.2170	0.8004	0.8946
No log	3.6140	206	1.0163	0.1590	1.0163	1.0081
No log	3.6491	208	1.0117	0.1840	1.0117	1.0059
No log	3.6842	210	0.8528	0.1733	0.8528	0.9235
No log	3.7193	212	1.0146	0.1836	1.0146	1.0073
No log	3.7544	214	1.0551	0.2047	1.0551	1.0272
No log	3.7895	216	0.8866	0.1651	0.8866	0.9416
No log	3.8246	218	1.0184	0.2147	1.0184	1.0092
No log	3.8596	220	0.9885	0.2147	0.9885	0.9943
No log	3.8947	222	0.8091	0.1347	0.8091	0.8995
No log	3.9298	224	0.9108	0.1568	0.9108	0.9543
No log	3.9649	226	0.9104	0.1568	0.9104	0.9541
No log	4.0	228	0.7744	0.1608	0.7744	0.8800
No log	4.0351	230	0.8087	0.1582	0.8087	0.8993
No log	4.0702	232	0.9457	0.1189	0.9457	0.9725
No log	4.1053	234	0.8783	0.1306	0.8783	0.9372
No log	4.1404	236	0.8088	0.1580	0.8088	0.8994
No log	4.1754	238	0.8396	0.1201	0.8396	0.9163
No log	4.2105	240	0.8074	0.1094	0.8074	0.8986
No log	4.2456	242	0.8399	0.1272	0.8399	0.9165
No log	4.2807	244	0.8526	0.1308	0.8526	0.9234
No log	4.3158	246	0.8557	0.1723	0.8557	0.9250
No log	4.3509	248	0.8808	0.1341	0.8808	0.9385
No log	4.3860	250	0.9093	0.2019	0.9093	0.9536
No log	4.4211	252	0.9424	0.1055	0.9424	0.9708
No log	4.4561	254	0.9432	0.1088	0.9432	0.9712
No log	4.4912	256	0.9151	0.1769	0.9151	0.9566
No log	4.5263	258	0.8511	0.1448	0.8511	0.9226
No log	4.5614	260	0.8733	0.0961	0.8733	0.9345
No log	4.5965	262	0.8225	0.1004	0.8225	0.9069
No log	4.6316	264	0.8038	0.1604	0.8038	0.8966
No log	4.6667	266	0.9436	-0.0214	0.9436	0.9714
No log	4.7018	268	0.9808	-0.0133	0.9808	0.9903
No log	4.7368	270	0.8279	0.0570	0.8279	0.9099
No log	4.7719	272	0.7746	0.2005	0.7746	0.8801
No log	4.8070	274	0.8850	0.0015	0.8850	0.9407
No log	4.8421	276	0.9293	0.1103	0.9293	0.9640
No log	4.8772	278	0.9068	0.1285	0.9068	0.9523
No log	4.9123	280	1.0043	0.1421	1.0043	1.0022
No log	4.9474	282	0.9812	0.1427	0.9812	0.9905
No log	4.9825	284	0.8920	0.1336	0.8920	0.9444
No log	5.0175	286	0.8821	0.1213	0.8821	0.9392
No log	5.0526	288	0.8315	0.1529	0.8315	0.9119
No log	5.0877	290	0.8129	0.1092	0.8129	0.9016
No log	5.1228	292	0.7976	0.1136	0.7976	0.8931
No log	5.1579	294	0.7987	0.1136	0.7987	0.8937
No log	5.1930	296	0.8246	0.0687	0.8246	0.9080
No log	5.2281	298	0.8817	0.0892	0.8817	0.9390
No log	5.2632	300	0.9740	0.1029	0.9740	0.9869
No log	5.2982	302	1.0466	0.1435	1.0466	1.0230
No log	5.3333	304	0.9094	0.1571	0.9094	0.9536
No log	5.3684	306	0.8073	0.1407	0.8073	0.8985
No log	5.4035	308	0.7793	0.1051	0.7793	0.8828
No log	5.4386	310	0.8312	0.1924	0.8312	0.9117
No log	5.4737	312	0.7967	0.0818	0.7967	0.8926
No log	5.5088	314	0.8213	0.1373	0.8213	0.9063
No log	5.5439	316	0.8562	0.1331	0.8562	0.9253
No log	5.5789	318	0.8400	0.0935	0.8400	0.9165
No log	5.6140	320	0.8455	0.1705	0.8455	0.9195
No log	5.6491	322	0.8065	0.1424	0.8065	0.8980
No log	5.6842	324	0.7927	0.0149	0.7927	0.8903
No log	5.7193	326	0.8557	0.0762	0.8557	0.9251
No log	5.7544	328	0.7937	0.0880	0.7937	0.8909
No log	5.7895	330	0.7674	0.2080	0.7674	0.8760
No log	5.8246	332	0.7934	0.1623	0.7934	0.8907
No log	5.8596	334	0.7361	0.1292	0.7361	0.8580
No log	5.8947	336	0.7382	0.1573	0.7382	0.8592
No log	5.9298	338	0.7425	0.1573	0.7425	0.8617
No log	5.9649	340	0.7913	0.1324	0.7913	0.8895
No log	6.0	342	0.9069	0.0692	0.9069	0.9523
No log	6.0351	344	0.7897	0.1329	0.7897	0.8887
No log	6.0702	346	0.7650	0.1315	0.7650	0.8746
No log	6.1053	348	0.7921	0.0526	0.7921	0.8900
No log	6.1404	350	0.7680	0.1702	0.7680	0.8763
No log	6.1754	352	0.7822	0.1049	0.7822	0.8844
No log	6.2105	354	0.8504	0.0424	0.8504	0.9222
No log	6.2456	356	0.8158	0.1004	0.8158	0.9032
No log	6.2807	358	0.8795	0.1247	0.8795	0.9378
No log	6.3158	360	0.9671	0.1284	0.9671	0.9834
No log	6.3509	362	0.9033	0.1300	0.9033	0.9504
No log	6.3860	364	0.7721	0.1604	0.7721	0.8787
No log	6.4211	366	0.8311	0.1188	0.8311	0.9116
No log	6.4561	368	0.8824	0.1105	0.8824	0.9394
No log	6.4912	370	0.8145	0.1225	0.8145	0.9025
No log	6.5263	372	0.8856	0.1520	0.8856	0.9411
No log	6.5614	374	1.0207	0.1265	1.0207	1.0103
No log	6.5965	376	0.9032	0.0975	0.9032	0.9504
No log	6.6316	378	0.7503	0.2490	0.7503	0.8662
No log	6.6667	380	0.7526	0.1800	0.7526	0.8675
No log	6.7018	382	0.8390	0.1105	0.8390	0.9160
No log	6.7368	384	0.8399	0.1027	0.8399	0.9165
No log	6.7719	386	0.8628	0.1969	0.8628	0.9289
No log	6.8070	388	1.0312	0.2499	1.0312	1.0155
No log	6.8421	390	1.0764	0.2059	1.0764	1.0375
No log	6.8772	392	1.0317	0.2202	1.0317	1.0157
No log	6.9123	394	0.9730	0.1702	0.9730	0.9864
No log	6.9474	396	0.8766	0.0787	0.8766	0.9363
No log	6.9825	398	0.8050	0.1713	0.8050	0.8972
No log	7.0175	400	0.7989	0.1365	0.7989	0.8938
No log	7.0526	402	0.8050	0.1998	0.8050	0.8972
No log	7.0877	404	0.8152	0.1906	0.8152	0.9029
No log	7.1228	406	0.8315	0.1838	0.8315	0.9119
No log	7.1579	408	0.8307	0.1135	0.8307	0.9114
No log	7.1930	410	0.8217	0.1135	0.8217	0.9065
No log	7.2281	412	0.8049	0.0670	0.8049	0.8971
No log	7.2632	414	0.8043	0.0709	0.8043	0.8969
No log	7.2982	416	0.8111	0.1232	0.8111	0.9006
No log	7.3333	418	0.8830	0.1908	0.8830	0.9397
No log	7.3684	420	1.0197	0.0980	1.0197	1.0098
No log	7.4035	422	1.0247	0.0982	1.0247	1.0123
No log	7.4386	424	0.9038	0.2122	0.9038	0.9507
No log	7.4737	426	0.8369	0.1673	0.8369	0.9148
No log	7.5088	428	0.8257	0.1713	0.8257	0.9087
No log	7.5439	430	0.8091	0.1713	0.8091	0.8995
No log	7.5789	432	0.7792	0.1287	0.7792	0.8827
No log	7.6140	434	0.7919	0.1232	0.7919	0.8899
No log	7.6491	436	0.8602	0.1626	0.8602	0.9275
No log	7.6842	438	0.8885	0.1273	0.8885	0.9426
No log	7.7193	440	0.8462	0.0879	0.8462	0.9199
No log	7.7544	442	0.8259	0.1539	0.8259	0.9088
No log	7.7895	444	0.8457	0.1168	0.8457	0.9196
No log	7.8246	446	0.8874	0.1626	0.8874	0.9420
No log	7.8596	448	0.8684	0.1615	0.8684	0.9319
No log	7.8947	450	0.8028	0.1620	0.8028	0.8960
No log	7.9298	452	0.8071	0.1471	0.8071	0.8984
No log	7.9649	454	0.8406	0.1463	0.8406	0.9168
No log	8.0	456	0.8873	0.2461	0.8873	0.9420
No log	8.0351	458	0.9311	0.1801	0.9311	0.9649
No log	8.0702	460	0.9081	0.2268	0.9081	0.9530
No log	8.1053	462	0.8807	0.2268	0.8807	0.9385
No log	8.1404	464	0.8222	0.2126	0.8222	0.9067
No log	8.1754	466	0.7795	0.1846	0.7795	0.8829
No log	8.2105	468	0.7845	0.1737	0.7845	0.8857
No log	8.2456	470	0.7874	0.1797	0.7874	0.8873
No log	8.2807	472	0.8380	0.1716	0.8380	0.9154
No log	8.3158	474	0.8785	0.2332	0.8785	0.9373
No log	8.3509	476	0.8737	0.1672	0.8737	0.9347
No log	8.3860	478	0.8649	0.2355	0.8649	0.9300
No log	8.4211	480	0.9085	0.2363	0.9085	0.9531
No log	8.4561	482	0.8417	0.1639	0.8417	0.9175
No log	8.4912	484	0.7664	0.1724	0.7664	0.8755
No log	8.5263	486	0.7196	0.1769	0.7196	0.8483
No log	8.5614	488	0.7228	0.1144	0.7228	0.8501
No log	8.5965	490	0.7521	0.1336	0.7521	0.8672
No log	8.6316	492	0.7478	0.1336	0.7478	0.8648
No log	8.6667	494	0.7222	0.0828	0.7222	0.8498
No log	8.7018	496	0.7656	0.1339	0.7656	0.8750
No log	8.7368	498	0.7593	0.0952	0.7593	0.8714
0.3592	8.7719	500	0.7006	0.0874	0.7006	0.8370
0.3592	8.8070	502	0.7319	0.1336	0.7319	0.8555
0.3592	8.8421	504	0.7933	0.1336	0.7933	0.8907
0.3592	8.8772	506	0.7644	0.1336	0.7644	0.8743
0.3592	8.9123	508	0.7610	0.1415	0.7610	0.8724
0.3592	8.9474	510	0.7882	0.0455	0.7882	0.8878
0.3592	8.9825	512	0.8065	0.0518	0.8065	0.8980
0.3592	9.0175	514	0.7639	0.0313	0.7639	0.8740
0.3592	9.0526	516	0.7651	0.1387	0.7651	0.8747
0.3592	9.0877	518	0.7947	0.1336	0.7947	0.8915
0.3592	9.1228	520	0.7730	0.1006	0.7730	0.8792
0.3592	9.1579	522	0.7606	0.1179	0.7606	0.8721
0.3592	9.1930	524	0.7639	0.1215	0.7639	0.8740
0.3592	9.2281	526	0.7650	0.1050	0.7650	0.8747
0.3592	9.2632	528	0.8186	0.1235	0.8186	0.9048
0.3592	9.2982	530	0.8646	0.1846	0.8646	0.9298
0.3592	9.3333	532	0.8337	0.0842	0.8337	0.9131
0.3592	9.3684	534	0.7858	0.0679	0.7858	0.8864
0.3592	9.4035	536	0.7830	0.1215	0.7830	0.8849
0.3592	9.4386	538	0.8080	0.1209	0.8080	0.8989
0.3592	9.4737	540	0.7930	0.1212	0.7930	0.8905
0.3592	9.5088	542	0.7844	0.1093	0.7844	0.8856
0.3592	9.5439	544	0.7906	0.0964	0.7906	0.8891
0.3592	9.5789	546	0.7758	0.1006	0.7758	0.8808
0.3592	9.6140	548	0.7845	0.1359	0.7845	0.8857
0.3592	9.6491	550	0.7785	0.1807	0.7785	0.8823
0.3592	9.6842	552	0.8010	0.1359	0.8010	0.8950
0.3592	9.7193	554	0.8230	0.1313	0.8230	0.9072
0.3592	9.7544	556	0.7910	0.1359	0.7910	0.8894
0.3592	9.7895	558	0.7961	0.0802	0.7961	0.8922
0.3592	9.8246	560	0.8357	0.1612	0.8357	0.9142
0.3592	9.8596	562	0.8175	0.1168	0.8175	0.9042
0.3592	9.8947	564	0.7949	0.1138	0.7949	0.8916
0.3592	9.9298	566	0.7782	0.1007	0.7782	0.8822
0.3592	9.9649	568	0.7912	0.0964	0.7912	0.8895
0.3592	10.0	570	0.8352	0.1145	0.8352	0.9139
0.3592	10.0351	572	0.8411	0.1188	0.8411	0.9171
0.3592	10.0702	574	0.7861	0.1007	0.7861	0.8866
0.3592	10.1053	576	0.7882	0.0810	0.7882	0.8878
0.3592	10.1404	578	0.8059	0.0913	0.8059	0.8977
0.3592	10.1754	580	0.7782	0.0393	0.7782	0.8822
0.3592	10.2105	582	0.7593	0.1048	0.7593	0.8714
0.3592	10.2456	584	0.7799	0.1048	0.7799	0.8831
0.3592	10.2807	586	0.7866	0.1456	0.7866	0.8869
0.3592	10.3158	588	0.8326	0.0570	0.8326	0.9125
0.3592	10.3509	590	0.9005	0.1329	0.9005	0.9490
0.3592	10.3860	592	0.8513	-0.0153	0.8513	0.9227
0.3592	10.4211	594	0.8085	0.1133	0.8085	0.8992
0.3592	10.4561	596	0.7954	0.1181	0.7954	0.8919
0.3592	10.4912	598	0.7994	0.1310	0.7994	0.8941
0.3592	10.5263	600	0.8433	0.0211	0.8433	0.9183
0.3592	10.5614	602	0.8142	0.0559	0.8142	0.9023
0.3592	10.5965	604	0.8029	0.1790	0.8029	0.8960
0.3592	10.6316	606	0.8447	0.1264	0.8447	0.9191
0.3592	10.6667	608	0.8361	0.1737	0.8361	0.9144
0.3592	10.7018	610	0.8308	0.0875	0.8308	0.9115
0.3592	10.7368	612	0.8675	0.1373	0.8675	0.9314
0.3592	10.7719	614	0.8540	0.1483	0.8540	0.9241
0.3592	10.8070	616	0.8794	0.1710	0.8794	0.9378
0.3592	10.8421	618	0.9107	0.0896	0.9107	0.9543
0.3592	10.8772	620	0.9148	0.0851	0.9148	0.9564
0.3592	10.9123	622	0.9742	-0.0028	0.9742	0.9870
0.3592	10.9474	624	0.9671	-0.0028	0.9671	0.9834
0.3592	10.9825	626	0.8713	0.0129	0.8713	0.9334
0.3592	11.0175	628	0.8379	0.0469	0.8379	0.9154

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1