ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0572
• Qwk: 0.1734
• Mse: 1.0572
• Rmse: 1.0282

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	2.5689	-0.0758	2.5689	1.6028
No log	0.1290	4	1.3470	0.0985	1.3470	1.1606
No log	0.1935	6	1.2992	-0.1871	1.2992	1.1398
No log	0.2581	8	0.9648	-0.1569	0.9648	0.9823
No log	0.3226	10	0.8289	0.0313	0.8289	0.9105
No log	0.3871	12	0.7585	0.0846	0.7585	0.8709
No log	0.4516	14	0.7376	0.0444	0.7376	0.8589
No log	0.5161	16	0.7601	0.0393	0.7601	0.8718
No log	0.5806	18	0.7828	0.1456	0.7828	0.8847
No log	0.6452	20	0.7168	0.2181	0.7168	0.8467
No log	0.7097	22	0.6717	0.1660	0.6717	0.8196
No log	0.7742	24	0.7674	0.2846	0.7674	0.8760
No log	0.8387	26	0.7903	0.2087	0.7903	0.8890
No log	0.9032	28	0.7985	0.1739	0.7985	0.8936
No log	0.9677	30	0.7911	0.0522	0.7911	0.8894
No log	1.0323	32	0.7372	0.0937	0.7372	0.8586
No log	1.0968	34	0.6835	0.0889	0.6835	0.8267
No log	1.1613	36	0.7124	0.1508	0.7124	0.8440
No log	1.2258	38	0.7244	0.0	0.7244	0.8511
No log	1.2903	40	0.8085	0.0053	0.8085	0.8992
No log	1.3548	42	0.8816	0.0944	0.8816	0.9389
No log	1.4194	44	0.8094	0.0053	0.8094	0.8997
No log	1.4839	46	0.7740	0.1863	0.7740	0.8798
No log	1.5484	48	0.8476	0.1065	0.8476	0.9206
No log	1.6129	50	0.8885	0.2297	0.8885	0.9426
No log	1.6774	52	0.8079	0.1972	0.8079	0.8988
No log	1.7419	54	0.7521	0.2443	0.7521	0.8673
No log	1.8065	56	0.7469	0.2786	0.7469	0.8643
No log	1.8710	58	0.8253	0.2498	0.8253	0.9085
No log	1.9355	60	1.1261	0.0838	1.1261	1.0612
No log	2.0	62	1.1771	0.1328	1.1771	1.0849
No log	2.0645	64	0.9466	0.1853	0.9466	0.9729
No log	2.1290	66	0.6952	0.2786	0.6952	0.8338
No log	2.1935	68	0.7153	0.2443	0.7153	0.8458
No log	2.2581	70	0.7031	0.2443	0.7031	0.8385
No log	2.3226	72	0.6826	0.2786	0.6826	0.8262
No log	2.3871	74	0.6901	0.3117	0.6901	0.8307
No log	2.4516	76	0.7695	0.2227	0.7695	0.8772
No log	2.5161	78	0.8922	0.2075	0.8922	0.9446
No log	2.5806	80	0.9769	0.1870	0.9769	0.9884
No log	2.6452	82	1.1617	0.2130	1.1617	1.0778
No log	2.7097	84	1.2462	0.1473	1.2462	1.1163
No log	2.7742	86	1.0601	0.1443	1.0601	1.0296
No log	2.8387	88	0.8642	0.3794	0.8642	0.9296
No log	2.9032	90	0.8358	0.2231	0.8358	0.9142
No log	2.9677	92	0.8770	0.2546	0.8770	0.9365
No log	3.0323	94	0.8240	0.2923	0.8240	0.9077
No log	3.0968	96	0.9467	0.3219	0.9467	0.9730
No log	3.1613	98	1.1960	0.1233	1.1960	1.0936
No log	3.2258	100	1.1506	0.1296	1.1506	1.0727
No log	3.2903	102	0.9506	0.1312	0.9506	0.9750
No log	3.3548	104	0.8534	0.3712	0.8534	0.9238
No log	3.4194	106	0.8103	0.2883	0.8103	0.9002
No log	3.4839	108	0.8280	0.3637	0.8280	0.9100
No log	3.5484	110	0.8964	0.2982	0.8964	0.9468
No log	3.6129	112	0.9465	0.2343	0.9465	0.9729
No log	3.6774	114	0.9305	0.2949	0.9305	0.9646
No log	3.7419	116	0.9496	0.2754	0.9496	0.9745
No log	3.8065	118	1.1193	0.1774	1.1193	1.0580
No log	3.8710	120	1.1225	0.1671	1.1225	1.0595
No log	3.9355	122	1.0314	0.1787	1.0314	1.0156
No log	4.0	124	0.8884	0.2784	0.8884	0.9425
No log	4.0645	126	0.8684	0.3843	0.8684	0.9319
No log	4.1290	128	0.9217	0.2358	0.9217	0.9601
No log	4.1935	130	1.0044	0.1827	1.0044	1.0022
No log	4.2581	132	1.0907	0.2271	1.0907	1.0444
No log	4.3226	134	1.0870	0.2271	1.0870	1.0426
No log	4.3871	136	0.9741	0.1734	0.9741	0.9870
No log	4.4516	138	0.9774	0.2784	0.9774	0.9887
No log	4.5161	140	1.0995	0.1208	1.0995	1.0486
No log	4.5806	142	1.1691	0.1146	1.1691	1.0812
No log	4.6452	144	1.0912	0.2000	1.0912	1.0446
No log	4.7097	146	1.0714	0.1422	1.0714	1.0351
No log	4.7742	148	1.1069	0.0713	1.1069	1.0521
No log	4.8387	150	1.2690	0.0838	1.2690	1.1265
No log	4.9032	152	1.5198	0.0283	1.5198	1.2328
No log	4.9677	154	1.4776	0.0578	1.4776	1.2156
No log	5.0323	156	1.2430	0.0561	1.2430	1.1149
No log	5.0968	158	1.0727	0.1461	1.0727	1.0357
No log	5.1613	160	1.0741	0.1461	1.0741	1.0364
No log	5.2258	162	1.1958	0.0346	1.1958	1.0935
No log	5.2903	164	1.4179	0.0620	1.4179	1.1907
No log	5.3548	166	1.4176	0.0620	1.4176	1.1906
No log	5.4194	168	1.3353	0.0665	1.3353	1.1555
No log	5.4839	170	1.2096	0.1116	1.2096	1.0998
No log	5.5484	172	1.1538	0.1911	1.1538	1.0742
No log	5.6129	174	1.0416	0.1955	1.0416	1.0206
No log	5.6774	176	1.0128	0.2510	1.0128	1.0064
No log	5.7419	178	1.1005	0.2141	1.1005	1.0491
No log	5.8065	180	1.1981	0.1067	1.1981	1.0946
No log	5.8710	182	1.1438	0.2199	1.1438	1.0695
No log	5.9355	184	0.9710	0.3777	0.9710	0.9854
No log	6.0	186	0.8753	0.2932	0.8753	0.9356
No log	6.0645	188	0.8111	0.2685	0.8111	0.9006
No log	6.1290	190	0.8142	0.2981	0.8142	0.9023
No log	6.1935	192	0.9033	0.1628	0.9033	0.9504
No log	6.2581	194	1.0484	0.1642	1.0484	1.0239
No log	6.3226	196	1.2257	0.1254	1.2257	1.1071
No log	6.3871	198	1.1689	0.0327	1.1689	1.0811
No log	6.4516	200	0.9860	0.1777	0.9860	0.9930
No log	6.5161	202	0.8384	0.2652	0.8384	0.9156
No log	6.5806	204	0.8302	0.2145	0.8302	0.9111
No log	6.6452	206	0.8400	0.0971	0.8400	0.9165
No log	6.7097	208	0.8427	0.2718	0.8427	0.9180
No log	6.7742	210	0.9424	0.2297	0.9424	0.9708
No log	6.8387	212	1.1875	0.0368	1.1875	1.0897
No log	6.9032	214	1.3119	0.0188	1.3119	1.1454
No log	6.9677	216	1.2839	0.0471	1.2839	1.1331
No log	7.0323	218	1.2907	0.0225	1.2907	1.1361
No log	7.0968	220	1.1529	0.0074	1.1529	1.0738
No log	7.1613	222	1.1283	0.1014	1.1283	1.0622
No log	7.2258	224	1.1927	0.0038	1.1927	1.0921
No log	7.2903	226	1.3342	0.0879	1.3342	1.1551
No log	7.3548	228	1.3282	0.1203	1.3282	1.1525
No log	7.4194	230	1.1820	0.0609	1.1820	1.0872
No log	7.4839	232	0.9519	0.2244	0.9519	0.9757
No log	7.5484	234	0.8410	0.2527	0.8410	0.9170
No log	7.6129	236	0.8411	0.2467	0.8411	0.9171
No log	7.6774	238	0.9106	0.1914	0.9106	0.9543
No log	7.7419	240	0.9559	0.1914	0.9559	0.9777
No log	7.8065	242	0.9960	0.2142	0.9960	0.9980
No log	7.8710	244	1.0378	0.3294	1.0378	1.0187
No log	7.9355	246	0.9655	0.1723	0.9655	0.9826
No log	8.0	248	0.9292	0.1454	0.9292	0.9640
No log	8.0645	250	0.9085	0.1454	0.9085	0.9531
No log	8.1290	252	0.9416	0.2142	0.9416	0.9704
No log	8.1935	254	0.9564	0.2029	0.9564	0.9779
No log	8.2581	256	1.0521	0.1642	1.0521	1.0257
No log	8.3226	258	1.0916	0.2259	1.0916	1.0448
No log	8.3871	260	1.0479	0.0829	1.0479	1.0237
No log	8.4516	262	1.0181	0.0891	1.0181	1.0090
No log	8.5161	264	0.9735	0.1254	0.9735	0.9866
No log	8.5806	266	1.0359	0.0891	1.0359	1.0178
No log	8.6452	268	1.0463	0.1461	1.0463	1.0229
No log	8.7097	270	0.9023	0.2244	0.9023	0.9499
No log	8.7742	272	0.8982	0.1914	0.8982	0.9478
No log	8.8387	274	0.9291	0.1822	0.9291	0.9639
No log	8.9032	276	1.0781	0.1651	1.0781	1.0383
No log	8.9677	278	1.2174	0.1290	1.2174	1.1034
No log	9.0323	280	1.1864	0.2017	1.1864	1.0892
No log	9.0968	282	0.9907	0.1777	0.9907	0.9953
No log	9.1613	284	0.8060	0.3755	0.8060	0.8978
No log	9.2258	286	0.7734	0.3243	0.7734	0.8794
No log	9.2903	288	0.7917	0.3465	0.7917	0.8898
No log	9.3548	290	0.8601	0.3950	0.8601	0.9274
No log	9.4194	292	1.0923	0.1077	1.0923	1.0451
No log	9.4839	294	1.3004	0.1328	1.3004	1.1404
No log	9.5484	296	1.3136	0.0973	1.3136	1.1461
No log	9.6129	298	1.1649	0.2032	1.1649	1.0793
No log	9.6774	300	0.9529	0.2463	0.9529	0.9762
No log	9.7419	302	0.7916	0.3341	0.7916	0.8897
No log	9.8065	304	0.7577	0.3081	0.7577	0.8704
No log	9.8710	306	0.7589	0.2819	0.7589	0.8712
No log	9.9355	308	0.7992	0.3092	0.7992	0.8940
No log	10.0	310	0.9027	0.2754	0.9027	0.9501
No log	10.0645	312	0.9878	0.2670	0.9878	0.9939
No log	10.1290	314	0.9456	0.2059	0.9456	0.9724
No log	10.1935	316	0.8294	0.3312	0.8294	0.9107
No log	10.2581	318	0.7400	0.3123	0.7400	0.8602
No log	10.3226	320	0.7310	0.2852	0.7310	0.8550
No log	10.3871	322	0.7561	0.3387	0.7561	0.8695
No log	10.4516	324	0.9126	0.2029	0.9126	0.9553
No log	10.5161	326	1.1082	0.2577	1.1082	1.0527
No log	10.5806	328	1.1276	0.2833	1.1276	1.0619
No log	10.6452	330	1.0606	0.2939	1.0606	1.0299
No log	10.7097	332	0.9957	0.2866	0.9957	0.9978
No log	10.7742	334	0.9290	0.1777	0.9290	0.9638
No log	10.8387	336	0.9049	0.1822	0.9049	0.9513
No log	10.9032	338	0.9776	0.2923	0.9776	0.9888
No log	10.9677	340	1.0154	0.2562	1.0154	1.0077
No log	11.0323	342	1.0488	0.2810	1.0488	1.0241
No log	11.0968	344	0.9764	0.2000	0.9764	0.9881
No log	11.1613	346	0.8469	0.3372	0.8469	0.9203
No log	11.2258	348	0.8009	0.3238	0.8009	0.8949
No log	11.2903	350	0.8305	0.3372	0.8305	0.9113
No log	11.3548	352	0.9334	0.2193	0.9334	0.9661
No log	11.4194	354	1.0665	0.2437	1.0665	1.0327
No log	11.4839	356	1.0948	0.2389	1.0948	1.0463
No log	11.5484	358	0.9985	0.1777	0.9985	0.9992
No log	11.6129	360	0.8931	0.2967	0.8931	0.9451
No log	11.6774	362	0.8628	0.3032	0.8628	0.9289
No log	11.7419	364	0.9020	0.2967	0.9020	0.9497
No log	11.8065	366	0.9429	0.2193	0.9429	0.9710
No log	11.8710	368	1.0193	0.2000	1.0193	1.0096
No log	11.9355	370	0.9575	0.2784	0.9575	0.9785
No log	12.0	372	0.8989	0.2574	0.8989	0.9481
No log	12.0645	374	0.8608	0.3444	0.8608	0.9278
No log	12.1290	376	0.8758	0.3637	0.8758	0.9359
No log	12.1935	378	0.8554	0.3032	0.8554	0.9249
No log	12.2581	380	0.8975	0.3637	0.8975	0.9474
No log	12.3226	382	0.9336	0.2643	0.9336	0.9662
No log	12.3871	384	0.9800	0.2784	0.9800	0.9899
No log	12.4516	386	0.9819	0.2726	0.9819	0.9909
No log	12.5161	388	0.9208	0.2574	0.9208	0.9596
No log	12.5806	390	0.8752	0.2692	0.8752	0.9355
No log	12.6452	392	0.9303	0.2439	0.9303	0.9645
No log	12.7097	394	0.9640	0.2439	0.9640	0.9818
No log	12.7742	396	0.9439	0.2173	0.9439	0.9715
No log	12.8387	398	0.9497	0.2173	0.9497	0.9745
No log	12.9032	400	0.9399	0.1808	0.9399	0.9695
No log	12.9677	402	0.9772	0.1454	0.9772	0.9885
No log	13.0323	404	0.9346	0.1914	0.9346	0.9668
No log	13.0968	406	0.8442	0.2754	0.8442	0.9188
No log	13.1613	408	0.7905	0.2883	0.7905	0.8891
No log	13.2258	410	0.8043	0.2847	0.8043	0.8968
No log	13.2903	412	0.8730	0.2754	0.8730	0.9344
No log	13.3548	414	0.9991	0.2410	0.9991	0.9996
No log	13.4194	416	1.0646	0.2510	1.0646	1.0318
No log	13.4839	418	1.0438	0.2562	1.0438	1.0217
No log	13.5484	420	1.0101	0.2410	1.0101	1.0050
No log	13.6129	422	0.9789	0.2193	0.9789	0.9894
No log	13.6774	424	0.9201	0.1672	0.9201	0.9592
No log	13.7419	426	0.8636	0.2883	0.8636	0.9293
No log	13.8065	428	0.8578	0.3020	0.8578	0.9261
No log	13.8710	430	0.8720	0.2589	0.8720	0.9338
No log	13.9355	432	0.9071	0.2275	0.9071	0.9524
No log	14.0	434	0.9890	0.1859	0.9890	0.9945
No log	14.0645	436	1.0729	0.1402	1.0729	1.0358
No log	14.1290	438	1.0354	0.1434	1.0354	1.0175
No log	14.1935	440	0.9787	0.1954	0.9787	0.9893
No log	14.2581	442	0.8592	0.3329	0.8592	0.9269
No log	14.3226	444	0.8066	0.3312	0.8066	0.8981
No log	14.3871	446	0.8381	0.3594	0.8381	0.9155
No log	14.4516	448	0.9304	0.1753	0.9304	0.9646
No log	14.5161	450	1.0255	0.1871	1.0255	1.0126
No log	14.5806	452	1.1010	0.1764	1.1010	1.0493
No log	14.6452	454	1.1107	0.1385	1.1107	1.0539
No log	14.7097	456	1.1094	0.1044	1.1094	1.0533
No log	14.7742	458	1.0651	0.1651	1.0651	1.0320
No log	14.8387	460	0.9466	0.2574	0.9466	0.9729
No log	14.9032	462	0.8500	0.2063	0.8500	0.9219
No log	14.9677	464	0.7897	0.3387	0.7897	0.8887
No log	15.0323	466	0.7742	0.3387	0.7742	0.8799
No log	15.0968	468	0.7917	0.3387	0.7917	0.8898
No log	15.1613	470	0.8223	0.2883	0.8223	0.9068
No log	15.2258	472	0.8585	0.2352	0.8585	0.9266
No log	15.2903	474	0.9646	0.2697	0.9646	0.9821
No log	15.3548	476	1.0235	0.2239	1.0235	1.0117
No log	15.4194	478	1.0116	0.2239	1.0116	1.0058
No log	15.4839	480	1.0144	0.2239	1.0144	1.0072
No log	15.5484	482	0.9946	0.2643	0.9946	0.9973
No log	15.6129	484	0.9629	0.2784	0.9629	0.9813
No log	15.6774	486	0.9325	0.2193	0.9325	0.9657
No log	15.7419	488	0.9445	0.2784	0.9445	0.9719
No log	15.8065	490	0.9451	0.2193	0.9451	0.9722
No log	15.8710	492	1.0223	0.2726	1.0223	1.0111
No log	15.9355	494	1.0866	0.3169	1.0866	1.0424
No log	16.0	496	1.0762	0.2810	1.0762	1.0374
No log	16.0645	498	0.9887	0.2142	0.9887	0.9944
0.2959	16.1290	500	0.8776	0.1914	0.8776	0.9368
0.2959	16.1935	502	0.7978	0.2558	0.7978	0.8932
0.2959	16.2581	504	0.7925	0.2558	0.7925	0.8902
0.2959	16.3226	506	0.8280	0.1766	0.8280	0.9099
0.2959	16.3871	508	0.9213	0.1914	0.9213	0.9598
0.2959	16.4516	510	1.0520	0.2810	1.0520	1.0257
0.2959	16.5161	512	1.1764	0.1870	1.1764	1.0846
0.2959	16.5806	514	1.2576	0.2043	1.2576	1.1214
0.2959	16.6452	516	1.1618	0.1858	1.1618	1.0779
0.2959	16.7097	518	0.9939	0.2726	0.9939	0.9969
0.2959	16.7742	520	0.9034	0.1962	0.9034	0.9505
0.2959	16.8387	522	0.8684	0.2352	0.8684	0.9319
0.2959	16.9032	524	0.8840	0.2352	0.8840	0.9402
0.2959	16.9677	526	0.9293	0.1962	0.9293	0.9640
0.2959	17.0323	528	0.9472	0.1962	0.9472	0.9733
0.2959	17.0968	530	0.9893	0.1867	0.9893	0.9946
0.2959	17.1613	532	1.0182	0.2726	1.0182	1.0091
0.2959	17.2258	534	1.0771	0.1955	1.0771	1.0379
0.2959	17.2903	536	1.0741	0.2192	1.0741	1.0364
0.2959	17.3548	538	1.0460	0.2537	1.0460	1.0227
0.2959	17.4194	540	1.0033	0.2892	1.0033	1.0016
0.2959	17.4839	542	0.9839	0.2892	0.9839	0.9919
0.2959	17.5484	544	1.0197	0.2892	1.0197	1.0098
0.2959	17.6129	546	1.0391	0.2892	1.0391	1.0193
0.2959	17.6774	548	1.0106	0.2892	1.0106	1.0053
0.2959	17.7419	550	0.9595	0.2124	0.9595	0.9796
0.2959	17.8065	552	0.9404	0.2223	0.9404	0.9697
0.2959	17.8710	554	0.9867	0.2076	0.9867	0.9933
0.2959	17.9355	556	1.0301	0.2239	1.0301	1.0149
0.2959	18.0	558	1.0091	0.2358	1.0091	1.0045
0.2959	18.0645	560	0.9972	0.2000	0.9972	0.9986
0.2959	18.1290	562	0.9707	0.2784	0.9707	0.9852
0.2959	18.1935	564	0.9261	0.1416	0.9261	0.9623
0.2959	18.2581	566	0.8775	0.2227	0.8775	0.9368
0.2959	18.3226	568	0.8976	0.2352	0.8976	0.9474
0.2959	18.3871	570	0.9783	0.2726	0.9783	0.9891
0.2959	18.4516	572	1.0721	0.1535	1.0721	1.0354
0.2959	18.5161	574	1.0947	0.2075	1.0947	1.0463
0.2959	18.5806	576	1.0552	0.1535	1.0552	1.0272
0.2959	18.6452	578	0.9897	0.2358	0.9897	0.9949
0.2959	18.7097	580	0.9604	0.1822	0.9604	0.9800
0.2959	18.7742	582	0.9197	0.2244	0.9197	0.9590
0.2959	18.8387	584	0.9017	0.2632	0.9017	0.9496
0.2959	18.9032	586	0.8983	0.2632	0.8983	0.9478
0.2959	18.9677	588	0.8824	0.2632	0.8824	0.9394
0.2959	19.0323	590	0.8872	0.2632	0.8872	0.9419
0.2959	19.0968	592	0.9112	0.2244	0.9112	0.9546
0.2959	19.1613	594	0.9680	0.1777	0.9680	0.9839
0.2959	19.2258	596	1.0045	0.1734	1.0045	1.0022
0.2959	19.2903	598	1.0215	0.1692	1.0215	1.0107
0.2959	19.3548	600	0.9669	0.1777	0.9669	0.9833
0.2959	19.4194	602	0.9205	0.2244	0.9205	0.9594
0.2959	19.4839	604	0.8891	0.2632	0.8891	0.9429
0.2959	19.5484	606	0.9012	0.2632	0.9012	0.9493
0.2959	19.6129	608	0.9595	0.2193	0.9595	0.9796
0.2959	19.6774	610	0.9952	0.1777	0.9952	0.9976
0.2959	19.7419	612	1.0044	0.2094	1.0044	1.0022
0.2959	19.8065	614	1.0545	0.1692	1.0545	1.0269
0.2959	19.8710	616	1.0850	0.1348	1.0850	1.0416
0.2959	19.9355	618	1.0490	0.1692	1.0490	1.0242
0.2959	20.0	620	1.0582	0.1734	1.0582	1.0287
0.2959	20.0645	622	1.0572	0.1734	1.0572	1.0282

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1