ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k11_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2725
• Qwk: 0.1497
• Mse: 1.2725
• Rmse: 1.1280

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	2.5880	-0.0262	2.5880	1.6087
No log	0.1538	4	1.3290	0.0511	1.3290	1.1528
No log	0.2308	6	1.0293	-0.1255	1.0293	1.0145
No log	0.3077	8	0.9372	0.0	0.9372	0.9681
No log	0.3846	10	0.9429	-0.0425	0.9429	0.9710
No log	0.4615	12	0.9954	-0.0392	0.9954	0.9977
No log	0.5385	14	0.9280	-0.0070	0.9280	0.9633
No log	0.6154	16	0.9033	0.1504	0.9033	0.9504
No log	0.6923	18	0.9861	0.1962	0.9861	0.9930
No log	0.7692	20	1.0962	-0.0128	1.0962	1.0470
No log	0.8462	22	1.1395	-0.0281	1.1395	1.0675
No log	0.9231	24	1.1856	-0.2126	1.1856	1.0889
No log	1.0	26	1.0757	-0.0472	1.0757	1.0372
No log	1.0769	28	1.0227	0.1217	1.0227	1.0113
No log	1.1538	30	1.0181	0.0982	1.0181	1.0090
No log	1.2308	32	0.9611	0.1542	0.9611	0.9804
No log	1.3077	34	0.9876	0.1918	0.9876	0.9938
No log	1.3846	36	1.0594	-0.0634	1.0594	1.0293
No log	1.4615	38	1.0132	-0.0479	1.0132	1.0066
No log	1.5385	40	0.9048	0.0966	0.9048	0.9512
No log	1.6154	42	0.8778	0.2171	0.8778	0.9369
No log	1.6923	44	0.8321	0.1972	0.8321	0.9122
No log	1.7692	46	0.7792	0.1407	0.7792	0.8827
No log	1.8462	48	0.7523	0.1508	0.7523	0.8673
No log	1.9231	50	0.7500	0.1236	0.7500	0.8661
No log	2.0	52	0.7803	0.0	0.7803	0.8833
No log	2.0769	54	0.8039	0.0	0.8039	0.8966
No log	2.1538	56	0.8265	0.0359	0.8265	0.9091
No log	2.2308	58	0.8628	0.1094	0.8628	0.9289
No log	2.3077	60	0.9631	0.1504	0.9631	0.9814
No log	2.3846	62	1.1027	0.0487	1.1027	1.0501
No log	2.4615	64	1.1507	-0.0103	1.1507	1.0727
No log	2.5385	66	1.1130	0.1183	1.1130	1.0550
No log	2.6154	68	1.0896	0.0573	1.0896	1.0439
No log	2.6923	70	1.1578	-0.1665	1.1578	1.0760
No log	2.7692	72	1.1796	-0.0345	1.1796	1.0861
No log	2.8462	74	1.0470	-0.0960	1.0470	1.0232
No log	2.9231	76	0.9014	0.1737	0.9014	0.9494
No log	3.0	78	0.8859	0.1313	0.8859	0.9412
No log	3.0769	80	0.9550	0.1268	0.9550	0.9773
No log	3.1538	82	1.0242	0.0933	1.0242	1.0120
No log	3.2308	84	1.0977	-0.0197	1.0977	1.0477
No log	3.3077	86	1.1815	0.0236	1.1815	1.0870
No log	3.3846	88	1.1975	0.0563	1.1975	1.0943
No log	3.4615	90	1.1961	-0.0160	1.1961	1.0936
No log	3.5385	92	1.1858	-0.0358	1.1858	1.0890
No log	3.6154	94	1.1988	0.1348	1.1988	1.0949
No log	3.6923	96	1.1991	0.1384	1.1991	1.0950
No log	3.7692	98	1.1142	0.0205	1.1142	1.0556
No log	3.8462	100	1.0679	0.0616	1.0679	1.0334
No log	3.9231	102	1.0353	0.0839	1.0353	1.0175
No log	4.0	104	1.0270	0.0134	1.0270	1.0134
No log	4.0769	106	1.0919	0.1781	1.0919	1.0449
No log	4.1538	108	1.1002	0.1113	1.1002	1.0489
No log	4.2308	110	0.9776	0.0112	0.9776	0.9888
No log	4.3077	112	0.9881	0.1672	0.9881	0.9940
No log	4.3846	114	1.0446	0.1209	1.0446	1.0221
No log	4.4615	116	1.0382	0.1201	1.0382	1.0189
No log	4.5385	118	0.8993	0.1733	0.8993	0.9483
No log	4.6154	120	0.8918	0.1835	0.8918	0.9443
No log	4.6923	122	1.0720	0.1550	1.0720	1.0354
No log	4.7692	124	1.1172	0.1058	1.1172	1.0570
No log	4.8462	126	1.0092	0.0691	1.0092	1.0046
No log	4.9231	128	0.9939	0.1091	0.9939	0.9969
No log	5.0	130	1.1074	0.1814	1.1074	1.0523
No log	5.0769	132	1.0850	0.0753	1.0850	1.0416
No log	5.1538	134	1.0663	0.0682	1.0663	1.0326
No log	5.2308	136	1.1592	0.0904	1.1592	1.0767
No log	5.3077	138	1.1171	0.0784	1.1171	1.0569
No log	5.3846	140	1.0340	0.0379	1.0340	1.0169
No log	5.4615	142	1.0183	0.1500	1.0183	1.0091
No log	5.5385	144	1.0498	0.2193	1.0498	1.0246
No log	5.6154	146	0.9950	0.0748	0.9950	0.9975
No log	5.6923	148	1.0192	0.0031	1.0192	1.0095
No log	5.7692	150	1.0541	0.0600	1.0541	1.0267
No log	5.8462	152	1.0698	0.0934	1.0698	1.0343
No log	5.9231	154	1.0586	0.0934	1.0586	1.0289
No log	6.0	156	0.9983	0.0442	0.9983	0.9991
No log	6.0769	158	1.0270	0.0934	1.0270	1.0134
No log	6.1538	160	1.0252	0.1205	1.0252	1.0125
No log	6.2308	162	1.1064	0.2081	1.1064	1.0518
No log	6.3077	164	1.1990	0.0763	1.1990	1.0950
No log	6.3846	166	1.1675	0.0421	1.1675	1.0805
No log	6.4615	168	1.1031	0.1267	1.1031	1.0503
No log	6.5385	170	1.0497	0.0758	1.0497	1.0246
No log	6.6154	172	1.0380	0.1033	1.0380	1.0188
No log	6.6923	174	1.0331	0.0696	1.0331	1.0164
No log	6.7692	176	1.0045	0.0724	1.0045	1.0023
No log	6.8462	178	0.9824	0.0724	0.9824	0.9911
No log	6.9231	180	0.9414	0.0839	0.9414	0.9702
No log	7.0	182	0.9232	0.0899	0.9232	0.9608
No log	7.0769	184	0.9531	0.1031	0.9531	0.9763
No log	7.1538	186	0.9784	0.1031	0.9784	0.9892
No log	7.2308	188	1.0060	0.0968	1.0060	1.0030
No log	7.3077	190	1.0908	0.1615	1.0908	1.0444
No log	7.3846	192	1.0782	0.1615	1.0782	1.0384
No log	7.4615	194	1.0124	0.2026	1.0124	1.0062
No log	7.5385	196	1.0139	0.1771	1.0139	1.0069
No log	7.6154	198	1.0536	0.1472	1.0536	1.0264
No log	7.6923	200	1.1895	0.1310	1.1895	1.0906
No log	7.7692	202	1.2772	0.1462	1.2772	1.1301
No log	7.8462	204	1.2817	0.1307	1.2817	1.1321
No log	7.9231	206	1.2388	0.1230	1.2388	1.1130
No log	8.0	208	1.1612	0.0275	1.1612	1.0776
No log	8.0769	210	1.2015	0.1370	1.2015	1.0961
No log	8.1538	212	1.2220	0.1169	1.2220	1.1055
No log	8.2308	214	1.0821	0.2070	1.0821	1.0402
No log	8.3077	216	0.9369	0.2857	0.9369	0.9679
No log	8.3846	218	0.9066	0.3221	0.9066	0.9521
No log	8.4615	220	0.9160	0.2967	0.9160	0.9571
No log	8.5385	222	0.9793	0.2781	0.9793	0.9896
No log	8.6154	224	1.0682	0.2220	1.0682	1.0335
No log	8.6923	226	1.0427	0.2364	1.0427	1.0211
No log	8.7692	228	1.0549	0.1859	1.0549	1.0271
No log	8.8462	230	1.0550	0.2081	1.0550	1.0271
No log	8.9231	232	1.0520	0.1961	1.0520	1.0257
No log	9.0	234	0.9981	0.2310	0.9981	0.9990
No log	9.0769	236	0.9468	0.2099	0.9468	0.9731
No log	9.1538	238	0.9866	0.1899	0.9866	0.9933
No log	9.2308	240	1.0632	0.2014	1.0632	1.0311
No log	9.3077	242	1.0937	0.1636	1.0937	1.0458
No log	9.3846	244	0.9715	0.2633	0.9715	0.9857
No log	9.4615	246	0.8899	0.2270	0.8899	0.9433
No log	9.5385	248	0.8661	0.2135	0.8661	0.9306
No log	9.6154	250	0.8964	0.1970	0.8964	0.9468
No log	9.6923	252	1.1055	0.1569	1.1055	1.0514
No log	9.7692	254	1.2708	0.0861	1.2708	1.1273
No log	9.8462	256	1.1493	0.1031	1.1493	1.0721
No log	9.9231	258	0.9836	0.2498	0.9836	0.9918
No log	10.0	260	0.9285	0.2838	0.9285	0.9636
No log	10.0769	262	0.9052	0.2564	0.9052	0.9514
No log	10.1538	264	0.9367	0.2888	0.9367	0.9679
No log	10.2308	266	1.0791	0.1141	1.0791	1.0388
No log	10.3077	268	1.1145	0.1530	1.1145	1.0557
No log	10.3846	270	0.9867	0.2420	0.9867	0.9933
No log	10.4615	272	0.9728	0.2471	0.9728	0.9863
No log	10.5385	274	0.9952	0.2301	0.9952	0.9976
No log	10.6154	276	1.0330	0.1265	1.0330	1.0164
No log	10.6923	278	1.1188	0.1814	1.1188	1.0577
No log	10.7692	280	1.1027	0.0931	1.1027	1.0501
No log	10.8462	282	1.0163	0.1242	1.0163	1.0081
No log	10.9231	284	1.0520	0.1207	1.0520	1.0257
No log	11.0	286	1.1820	0.0852	1.1820	1.0872
No log	11.0769	288	1.1824	0.1085	1.1824	1.0874
No log	11.1538	290	1.0389	0.2116	1.0389	1.0193
No log	11.2308	292	0.9184	0.1886	0.9184	0.9584
No log	11.3077	294	0.8912	0.1592	0.8912	0.9440
No log	11.3846	296	0.9435	0.2359	0.9435	0.9713
No log	11.4615	298	1.0659	0.1998	1.0659	1.0324
No log	11.5385	300	1.1165	0.1113	1.1165	1.0567
No log	11.6154	302	1.0759	0.1681	1.0759	1.0373
No log	11.6923	304	1.1140	0.1620	1.1140	1.0555
No log	11.7692	306	1.0790	0.1494	1.0790	1.0388
No log	11.8462	308	1.0459	0.1606	1.0459	1.0227
No log	11.9231	310	0.9533	0.1651	0.9533	0.9764
No log	12.0	312	0.9501	0.1945	0.9501	0.9748
No log	12.0769	314	0.9727	0.2212	0.9727	0.9863
No log	12.1538	316	1.0478	0.1662	1.0478	1.0236
No log	12.2308	318	1.0816	0.1764	1.0816	1.0400
No log	12.3077	320	1.0384	0.2589	1.0384	1.0190
No log	12.3846	322	0.9470	0.3195	0.9470	0.9731
No log	12.4615	324	0.9089	0.2605	0.9089	0.9533
No log	12.5385	326	0.9739	0.2617	0.9739	0.9869
No log	12.6154	328	1.0920	0.1803	1.0920	1.0450
No log	12.6923	330	1.2393	0.1525	1.2393	1.1132
No log	12.7692	332	1.2031	0.1578	1.2031	1.0969
No log	12.8462	334	1.0994	0.1140	1.0994	1.0485
No log	12.9231	336	1.0377	0.1265	1.0377	1.0187
No log	13.0	338	1.0615	0.2044	1.0615	1.0303
No log	13.0769	340	1.1483	0.1870	1.1483	1.0716
No log	13.1538	342	1.1549	0.2141	1.1549	1.0747
No log	13.2308	344	1.0842	0.2626	1.0842	1.0412
No log	13.3077	346	1.0019	0.3043	1.0019	1.0010
No log	13.3846	348	1.0251	0.2975	1.0251	1.0125
No log	13.4615	350	1.0723	0.1926	1.0723	1.0355
No log	13.5385	352	1.1779	0.1468	1.1779	1.0853
No log	13.6154	354	1.2477	0.1196	1.2477	1.1170
No log	13.6923	356	1.2466	0.1196	1.2466	1.1165
No log	13.7692	358	1.1993	0.1536	1.1993	1.0951
No log	13.8462	360	1.1113	0.2029	1.1113	1.0542
No log	13.9231	362	1.0695	0.2348	1.0695	1.0342
No log	14.0	364	1.0972	0.2303	1.0972	1.0475
No log	14.0769	366	1.1402	0.2200	1.1402	1.0678
No log	14.1538	368	1.2260	0.1468	1.2260	1.1072
No log	14.2308	370	1.1719	0.1779	1.1719	1.0825
No log	14.3077	372	1.1355	0.1898	1.1355	1.0656
No log	14.3846	374	1.0978	0.2070	1.0978	1.0478
No log	14.4615	376	1.0772	0.2113	1.0772	1.0379
No log	14.5385	378	1.1238	0.2070	1.1238	1.0601
No log	14.6154	380	1.1039	0.2113	1.1039	1.0507
No log	14.6923	382	1.0236	0.1662	1.0236	1.0117
No log	14.7692	384	1.0151	0.2059	1.0151	1.0075
No log	14.8462	386	0.9724	0.2839	0.9724	0.9861
No log	14.9231	388	0.9189	0.2576	0.9189	0.9586
No log	15.0	390	0.9004	0.1961	0.9004	0.9489
No log	15.0769	392	0.9584	0.2839	0.9584	0.9790
No log	15.1538	394	1.1356	0.1636	1.1356	1.0656
No log	15.2308	396	1.2127	0.1687	1.2127	1.1012
No log	15.3077	398	1.1528	0.1824	1.1528	1.0737
No log	15.3846	400	1.0122	0.3280	1.0122	1.0061
No log	15.4615	402	0.9582	0.2523	0.9582	0.9789
No log	15.5385	404	0.9714	0.2262	0.9714	0.9856
No log	15.6154	406	1.0135	0.2054	1.0135	1.0067
No log	15.6923	408	1.1015	0.2055	1.1015	1.0495
No log	15.7692	410	1.0614	0.1330	1.0614	1.0303
No log	15.8462	412	1.0175	0.1441	1.0175	1.0087
No log	15.9231	414	0.9897	0.1783	0.9897	0.9948
No log	16.0	416	1.0096	0.1691	1.0096	1.0048
No log	16.0769	418	0.9507	0.2495	0.9507	0.9750
No log	16.1538	420	0.9267	0.1715	0.9267	0.9627
No log	16.2308	422	0.9329	0.1760	0.9329	0.9659
No log	16.3077	424	0.9243	0.1760	0.9243	0.9614
No log	16.3846	426	0.9595	0.1870	0.9595	0.9796
No log	16.4615	428	1.0631	0.1819	1.0631	1.0311
No log	16.5385	430	1.1692	0.1779	1.1692	1.0813
No log	16.6154	432	1.1831	0.2065	1.1831	1.0877
No log	16.6923	434	1.0933	0.2488	1.0933	1.0456
No log	16.7692	436	1.0014	0.1940	1.0014	1.0007
No log	16.8462	438	1.0096	0.2183	1.0096	1.0048
No log	16.9231	440	1.0929	0.2603	1.0929	1.0454
No log	17.0	442	1.1386	0.2143	1.1386	1.0670
No log	17.0769	444	1.1449	0.2359	1.1449	1.0700
No log	17.1538	446	1.0952	0.3394	1.0952	1.0465
No log	17.2308	448	1.0126	0.3159	1.0126	1.0063
No log	17.3077	450	0.9722	0.3159	0.9722	0.9860
No log	17.3846	452	0.9505	0.3219	0.9505	0.9749
No log	17.4615	454	1.0061	0.3159	1.0061	1.0030
No log	17.5385	456	0.9923	0.3159	0.9923	0.9961
No log	17.6154	458	0.9556	0.2670	0.9556	0.9775
No log	17.6923	460	0.9883	0.2616	0.9883	0.9941
No log	17.7692	462	0.9892	0.2670	0.9892	0.9946
No log	17.8462	464	0.9903	0.2670	0.9903	0.9951
No log	17.9231	466	1.0084	0.2616	1.0084	1.0042
No log	18.0	468	1.0485	0.3159	1.0485	1.0239
No log	18.0769	470	0.9913	0.2616	0.9913	0.9957
No log	18.1538	472	0.9333	0.2839	0.9333	0.9660
No log	18.2308	474	0.9187	0.2839	0.9187	0.9585
No log	18.3077	476	0.9258	0.2975	0.9258	0.9622
No log	18.3846	478	0.9281	0.2975	0.9281	0.9634
No log	18.4615	480	0.9763	0.3159	0.9763	0.9881
No log	18.5385	482	0.9998	0.3159	0.9998	0.9999
No log	18.6154	484	1.0420	0.3159	1.0420	1.0208
No log	18.6923	486	1.0898	0.3100	1.0898	1.0439
No log	18.7692	488	1.0684	0.3159	1.0684	1.0336
No log	18.8462	490	1.0393	0.2670	1.0393	1.0194
No log	18.9231	492	0.9973	0.2751	0.9973	0.9987
No log	19.0	494	0.9664	0.2495	0.9664	0.9830
No log	19.0769	496	0.9822	0.2617	0.9822	0.9910
No log	19.1538	498	0.9966	0.2943	0.9966	0.9983
0.3114	19.2308	500	1.0656	0.2097	1.0656	1.0323
0.3114	19.3077	502	1.0683	0.2905	1.0683	1.0336
0.3114	19.3846	504	1.0200	0.2905	1.0200	1.0100
0.3114	19.4615	506	0.9818	0.3095	0.9818	0.9908
0.3114	19.5385	508	0.9591	0.3095	0.9591	0.9793
0.3114	19.6154	510	0.9573	0.3095	0.9573	0.9784
0.3114	19.6923	512	0.9966	0.2943	0.9966	0.9983
0.3114	19.7692	514	1.0009	0.2943	1.0009	1.0004
0.3114	19.8462	516	1.0760	0.2097	1.0760	1.0373
0.3114	19.9231	518	1.1806	0.2317	1.1806	1.0865
0.3114	20.0	520	1.1615	0.1628	1.1615	1.0777
0.3114	20.0769	522	1.0525	0.2643	1.0525	1.0259
0.3114	20.1538	524	0.9980	0.1856	0.9980	0.9990
0.3114	20.2308	526	1.0265	0.2696	1.0265	1.0131
0.3114	20.3077	528	1.1166	0.2401	1.1166	1.0567
0.3114	20.3846	530	1.1002	0.2401	1.1002	1.0489
0.3114	20.4615	532	1.0084	0.3012	1.0084	1.0042
0.3114	20.5385	534	0.9238	0.2839	0.9238	0.9611
0.3114	20.6154	536	0.8798	0.2077	0.8798	0.9380
0.3114	20.6923	538	0.8929	0.2077	0.8929	0.9449
0.3114	20.7692	540	0.9635	0.2183	0.9635	0.9816
0.3114	20.8462	542	1.1025	0.1923	1.1025	1.0500
0.3114	20.9231	544	1.1957	0.1594	1.1957	1.0935
0.3114	21.0	546	1.1812	0.2317	1.1812	1.0868
0.3114	21.0769	548	1.1079	0.2285	1.1079	1.0525
0.3114	21.1538	550	0.9961	0.2315	0.9961	0.9981
0.3114	21.2308	552	0.9203	0.2383	0.9203	0.9593
0.3114	21.3077	554	0.8681	0.1850	0.8681	0.9317
0.3114	21.3846	556	0.8525	0.1850	0.8525	0.9233
0.3114	21.4615	558	0.8767	0.2096	0.8767	0.9363
0.3114	21.5385	560	0.9360	0.2781	0.9360	0.9675
0.3114	21.6154	562	0.9958	0.2113	0.9958	0.9979
0.3114	21.6923	564	1.0443	0.1594	1.0443	1.0219
0.3114	21.7692	566	1.0221	0.1697	1.0221	1.0110
0.3114	21.8462	568	0.9428	0.2139	0.9428	0.9710
0.3114	21.9231	570	0.9138	0.2370	0.9138	0.9559
0.3114	22.0	572	0.8716	0.3146	0.8716	0.9336
0.3114	22.0769	574	0.8403	0.2633	0.8403	0.9167
0.3114	22.1538	576	0.8307	0.2359	0.8307	0.9114
0.3114	22.2308	578	0.8812	0.2576	0.8812	0.9387
0.3114	22.3077	580	1.0000	0.1926	1.0000	1.0000
0.3114	22.3846	582	1.1450	0.1920	1.1450	1.0701
0.3114	22.4615	584	1.1682	0.2308	1.1682	1.0809
0.3114	22.5385	586	1.0816	0.2159	1.0816	1.0400
0.3114	22.6154	588	0.9121	0.2359	0.9121	0.9550
0.3114	22.6923	590	0.8491	0.2009	0.8491	0.9215
0.3114	22.7692	592	0.8662	0.2359	0.8662	0.9307
0.3114	22.8462	594	0.9967	0.2220	0.9967	0.9983
0.3114	22.9231	596	1.1470	0.1922	1.1470	1.0710
0.3114	23.0	598	1.2457	0.1819	1.2457	1.1161
0.3114	23.0769	600	1.4038	0.1511	1.4038	1.1848
0.3114	23.1538	602	1.4013	0.1511	1.4013	1.1838
0.3114	23.2308	604	1.2725	0.1497	1.2725	1.1280

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1