ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k20_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4181
• Qwk: 0.0465
• Mse: 1.4181
• Rmse: 1.1909

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	2.6637	-0.0924	2.6637	1.6321
No log	0.0851	4	1.4013	0.0141	1.4013	1.1837
No log	0.1277	6	1.3553	-0.2440	1.3553	1.1642
No log	0.1702	8	1.2365	-0.0464	1.2365	1.1120
No log	0.2128	10	1.2210	-0.0344	1.2210	1.1050
No log	0.2553	12	1.2286	-0.0690	1.2286	1.1084
No log	0.2979	14	1.1498	-0.0358	1.1498	1.0723
No log	0.3404	16	1.0321	0.0584	1.0321	1.0159
No log	0.3830	18	0.8367	0.0393	0.8367	0.9147
No log	0.4255	20	0.7600	0.0481	0.7600	0.8718
No log	0.4681	22	0.8112	0.1754	0.8112	0.9006
No log	0.5106	24	0.7766	0.1365	0.7766	0.8813
No log	0.5532	26	0.7312	0.0481	0.7312	0.8551
No log	0.5957	28	0.7361	0.0	0.7361	0.8580
No log	0.6383	30	0.7731	0.0393	0.7731	0.8792
No log	0.6809	32	0.7855	0.0757	0.7855	0.8863
No log	0.7234	34	0.8020	0.1972	0.8020	0.8955
No log	0.7660	36	0.8369	0.2883	0.8369	0.9148
No log	0.8085	38	0.8729	0.3777	0.8729	0.9343
No log	0.8511	40	0.8536	0.3538	0.8536	0.9239
No log	0.8936	42	0.7890	0.3712	0.7890	0.8882
No log	0.9362	44	0.7599	0.2345	0.7599	0.8717
No log	0.9787	46	0.7531	0.1094	0.7531	0.8678
No log	1.0213	48	0.7545	0.0798	0.7545	0.8686
No log	1.0638	50	0.7628	0.0798	0.7628	0.8734
No log	1.1064	52	0.7359	0.0840	0.7359	0.8578
No log	1.1489	54	0.6856	0.0717	0.6856	0.8280
No log	1.1915	56	0.6886	0.2950	0.6886	0.8298
No log	1.2340	58	0.7264	0.3894	0.7264	0.8523
No log	1.2766	60	0.7790	0.3606	0.7790	0.8826
No log	1.3191	62	0.7259	0.3675	0.7259	0.8520
No log	1.3617	64	0.6399	0.3839	0.6399	0.7999
No log	1.4043	66	0.6327	0.1508	0.6327	0.7954
No log	1.4468	68	0.6409	0.1508	0.6409	0.8006
No log	1.4894	70	0.6632	0.1400	0.6632	0.8144
No log	1.5319	72	0.7024	0.3471	0.7024	0.8381
No log	1.5745	74	0.7651	0.4144	0.7651	0.8747
No log	1.6170	76	0.7902	0.4067	0.7902	0.8889
No log	1.6596	78	0.7896	0.3637	0.7896	0.8886
No log	1.7021	80	0.8315	0.2576	0.8315	0.9119
No log	1.7447	82	0.8869	0.2812	0.8869	0.9418
No log	1.7872	84	0.9990	0.3019	0.9990	0.9995
No log	1.8298	86	1.0665	0.2166	1.0665	1.0327
No log	1.8723	88	1.1087	0.2348	1.1087	1.0529
No log	1.9149	90	1.0266	0.2529	1.0266	1.0132
No log	1.9574	92	0.9319	0.3675	0.9319	0.9653
No log	2.0	94	0.8717	0.3675	0.8717	0.9337
No log	2.0426	96	0.8632	0.3746	0.8632	0.9291
No log	2.0851	98	0.8763	0.3494	0.8763	0.9361
No log	2.1277	100	0.9157	0.2843	0.9157	0.9569
No log	2.1702	102	0.8750	0.2574	0.8750	0.9354
No log	2.2128	104	0.8447	0.2692	0.8447	0.9191
No log	2.2553	106	0.8336	0.2574	0.8336	0.9130
No log	2.2979	108	0.8581	0.3234	0.8581	0.9263
No log	2.3404	110	0.8801	0.4175	0.8801	0.9382
No log	2.3830	112	0.9891	0.3022	0.9891	0.9945
No log	2.4255	114	1.0033	0.3160	1.0033	1.0016
No log	2.4681	116	1.0751	0.2730	1.0751	1.0369
No log	2.5106	118	1.0456	0.2779	1.0456	1.0225
No log	2.5532	120	1.1145	0.2824	1.1145	1.0557
No log	2.5957	122	1.0825	0.2659	1.0825	1.0404
No log	2.6383	124	0.9248	0.3461	0.9248	0.9616
No log	2.6809	126	0.8835	0.2871	0.8835	0.9399
No log	2.7234	128	0.9150	0.2754	0.9150	0.9565
No log	2.7660	130	0.8767	0.2812	0.8767	0.9363
No log	2.8085	132	0.8217	0.2871	0.8217	0.9065
No log	2.8511	134	0.8263	0.2604	0.8263	0.9090
No log	2.8936	136	0.8949	0.3008	0.8949	0.9460
No log	2.9362	138	0.9890	0.2988	0.9890	0.9945
No log	2.9787	140	1.1405	0.2094	1.1405	1.0680
No log	3.0213	142	1.2391	0.2271	1.2391	1.1132
No log	3.0638	144	1.1744	0.1689	1.1744	1.0837
No log	3.1064	146	0.9975	0.2012	0.9975	0.9987
No log	3.1489	148	0.9324	0.1706	0.9324	0.9656
No log	3.1915	150	0.9432	0.1661	0.9432	0.9712
No log	3.2340	152	1.0607	0.2124	1.0607	1.0299
No log	3.2766	154	1.0919	0.1712	1.0919	1.0449
No log	3.3191	156	1.0642	0.1912	1.0642	1.0316
No log	3.3617	158	0.9816	0.1405	0.9816	0.9907
No log	3.4043	160	0.9449	0.1368	0.9449	0.9721
No log	3.4468	162	0.9285	0.1550	0.9285	0.9636
No log	3.4894	164	0.9671	0.1103	0.9671	0.9834
No log	3.5319	166	0.9898	0.1718	0.9898	0.9949
No log	3.5745	168	0.9891	0.1332	0.9891	0.9946
No log	3.6170	170	0.9543	0.1332	0.9543	0.9769
No log	3.6596	172	0.9507	0.1332	0.9507	0.9751
No log	3.7021	174	1.0339	0.1765	1.0339	1.0168
No log	3.7447	176	1.1445	0.2017	1.1445	1.0698
No log	3.7872	178	1.1887	0.2590	1.1887	1.0903
No log	3.8298	180	1.1285	0.3052	1.1285	1.0623
No log	3.8723	182	1.0855	0.2702	1.0855	1.0419
No log	3.9149	184	1.0691	0.2702	1.0691	1.0340
No log	3.9574	186	1.1336	0.2234	1.1336	1.0647
No log	4.0	188	1.2641	0.1849	1.2641	1.1243
No log	4.0426	190	1.2897	0.1067	1.2897	1.1356
No log	4.0851	192	1.2222	0.0948	1.2222	1.1055
No log	4.1277	194	1.1853	0.1821	1.1853	1.0887
No log	4.1702	196	1.2344	0.1839	1.2344	1.1110
No log	4.2128	198	1.2098	0.2153	1.2098	1.0999
No log	4.2553	200	1.1901	0.2153	1.1901	1.0909
No log	4.2979	202	1.1610	0.1908	1.1610	1.0775
No log	4.3404	204	1.2079	0.2043	1.2079	1.0991
No log	4.3830	206	1.3086	0.1648	1.3086	1.1439
No log	4.4255	208	1.3439	0.1364	1.3439	1.1593
No log	4.4681	210	1.1700	0.1428	1.1700	1.0817
No log	4.5106	212	0.9381	0.2967	0.9381	0.9686
No log	4.5532	214	0.8745	0.1183	0.8745	0.9351
No log	4.5957	216	0.9031	0.1459	0.9031	0.9503
No log	4.6383	218	1.0161	0.3274	1.0161	1.0080
No log	4.6809	220	1.2003	0.2280	1.2003	1.0956
No log	4.7234	222	1.2345	0.1641	1.2345	1.1111
No log	4.7660	224	1.0792	0.3131	1.0792	1.0388
No log	4.8085	226	0.8733	0.3494	0.8733	0.9345
No log	4.8511	228	0.8262	0.3234	0.8262	0.9089
No log	4.8936	230	0.8650	0.3425	0.8650	0.9301
No log	4.9362	232	1.0486	0.3082	1.0486	1.0240
No log	4.9787	234	1.2878	0.1098	1.2878	1.1348
No log	5.0213	236	1.4160	0.1031	1.4160	1.1900
No log	5.0638	238	1.3507	0.0903	1.3507	1.1622
No log	5.1064	240	1.2556	0.2069	1.2556	1.1205
No log	5.1489	242	1.2089	0.2206	1.2089	1.0995
No log	5.1915	244	1.1334	0.2380	1.1334	1.0646
No log	5.2340	246	1.0664	0.2872	1.0664	1.0327
No log	5.2766	248	1.0182	0.2803	1.0182	1.0090
No log	5.3191	250	1.0290	0.2578	1.0290	1.0144
No log	5.3617	252	1.1254	0.2312	1.1254	1.0608
No log	5.4043	254	1.1977	0.1202	1.1977	1.0944
No log	5.4468	256	1.1340	0.1484	1.1340	1.0649
No log	5.4894	258	1.0732	0.2234	1.0732	1.0359
No log	5.5319	260	1.0803	0.2252	1.0803	1.0394
No log	5.5745	262	1.0004	0.3169	1.0004	1.0002
No log	5.6170	264	0.9853	0.3169	0.9853	0.9926
No log	5.6596	266	0.9985	0.3409	0.9985	0.9993
No log	5.7021	268	1.0085	0.3347	1.0085	1.0042
No log	5.7447	270	1.1040	0.2926	1.1040	1.0507
No log	5.7872	272	1.0869	0.3425	1.0869	1.0426
No log	5.8298	274	0.9636	0.3160	0.9636	0.9817
No log	5.8723	276	0.9093	0.3560	0.9093	0.9536
No log	5.9149	278	0.9715	0.3597	0.9715	0.9857
No log	5.9574	280	1.0613	0.3630	1.0613	1.0302
No log	6.0	282	1.0722	0.3425	1.0722	1.0355
No log	6.0426	284	1.0160	0.3538	1.0160	1.0080
No log	6.0851	286	0.9509	0.3933	0.9509	0.9752
No log	6.1277	288	0.9364	0.4113	0.9364	0.9677
No log	6.1702	290	1.0327	0.3425	1.0327	1.0162
No log	6.2128	292	1.1927	0.2459	1.1927	1.0921
No log	6.2553	294	1.3034	0.1939	1.3034	1.1417
No log	6.2979	296	1.3167	0.1450	1.3167	1.1475
No log	6.3404	298	1.2116	0.1704	1.2116	1.1007
No log	6.3830	300	1.0489	0.3310	1.0489	1.0242
No log	6.4255	302	0.9681	0.4144	0.9681	0.9839
No log	6.4681	304	1.0129	0.3074	1.0129	1.0064
No log	6.5106	306	1.1592	0.2055	1.1592	1.0766
No log	6.5532	308	1.2599	0.1641	1.2599	1.1225
No log	6.5957	310	1.2279	0.1654	1.2279	1.1081
No log	6.6383	312	1.1121	0.1795	1.1121	1.0546
No log	6.6809	314	0.9758	0.3538	0.9758	0.9878
No log	6.7234	316	0.9221	0.3918	0.9221	0.9603
No log	6.7660	318	0.9536	0.3473	0.9536	0.9765
No log	6.8085	320	1.0558	0.2833	1.0558	1.0275
No log	6.8511	322	1.1307	0.2635	1.1307	1.0633
No log	6.8936	324	1.1335	0.2141	1.1335	1.0647
No log	6.9362	326	1.0941	0.1990	1.0941	1.0460
No log	6.9787	328	1.0076	0.2463	1.0076	1.0038
No log	7.0213	330	0.9463	0.2843	0.9463	0.9728
No log	7.0638	332	0.9575	0.2843	0.9575	0.9785
No log	7.1064	334	0.9911	0.2726	0.9911	0.9956
No log	7.1489	336	0.9937	0.3105	0.9937	0.9969
No log	7.1915	338	1.0384	0.2726	1.0384	1.0190
No log	7.2340	340	1.1031	0.2164	1.1031	1.0503
No log	7.2766	342	1.0783	0.1144	1.0783	1.0384
No log	7.3191	344	1.0375	0.1178	1.0375	1.0186
No log	7.3617	346	1.0397	0.1214	1.0397	1.0197
No log	7.4043	348	1.0529	0.0631	1.0529	1.0261
No log	7.4468	350	1.0779	0.0927	1.0779	1.0382
No log	7.4894	352	1.0918	0.1214	1.0918	1.0449
No log	7.5319	354	1.1294	0.2876	1.1294	1.0627
No log	7.5745	356	1.1072	0.2982	1.1072	1.0522
No log	7.6170	358	1.0378	0.3445	1.0378	1.0187
No log	7.6596	360	1.0169	0.3889	1.0169	1.0084
No log	7.7021	362	1.0377	0.3411	1.0377	1.0187
No log	7.7447	364	1.0882	0.3203	1.0882	1.0432
No log	7.7872	366	1.1040	0.3203	1.1040	1.0507
No log	7.8298	368	1.0731	0.3253	1.0731	1.0359
No log	7.8723	370	1.0073	0.3160	1.0073	1.0036
No log	7.9149	372	0.9860	0.3217	0.9860	0.9930
No log	7.9574	374	0.9630	0.3623	0.9630	0.9813
No log	8.0	376	1.0430	0.3613	1.0430	1.0213
No log	8.0426	378	1.1862	0.2459	1.1862	1.0891
No log	8.0851	380	1.2610	0.1670	1.2610	1.1230
No log	8.1277	382	1.3847	0.1146	1.3847	1.1767
No log	8.1702	384	1.3606	0.0969	1.3606	1.1664
No log	8.2128	386	1.2634	0.1484	1.2634	1.1240
No log	8.2553	388	1.1270	0.1388	1.1270	1.0616
No log	8.2979	390	0.9740	0.3160	0.9740	0.9869
No log	8.3404	392	0.9341	0.3560	0.9341	0.9665
No log	8.3830	394	0.9622	0.3522	0.9622	0.9809
No log	8.4255	396	1.0551	0.3305	1.0551	1.0272
No log	8.4681	398	1.2236	0.2156	1.2236	1.1062
No log	8.5106	400	1.2761	0.2009	1.2761	1.1296
No log	8.5532	402	1.2238	0.2259	1.2238	1.1062
No log	8.5957	404	1.0921	0.2559	1.0921	1.0450
No log	8.6383	406	0.9710	0.3031	0.9710	0.9854
No log	8.6809	408	0.9136	0.3618	0.9136	0.9558
No log	8.7234	410	0.9100	0.3618	0.9100	0.9539
No log	8.7660	412	0.9937	0.2910	0.9937	0.9969
No log	8.8085	414	1.1505	0.2733	1.1505	1.0726
No log	8.8511	416	1.2065	0.2691	1.2065	1.0984
No log	8.8936	418	1.1238	0.2889	1.1238	1.0601
No log	8.9362	420	0.9936	0.3455	0.9936	0.9968
No log	8.9787	422	0.8863	0.3538	0.8863	0.9414
No log	9.0213	424	0.8552	0.3606	0.8552	0.9248
No log	9.0638	426	0.8754	0.4230	0.8754	0.9356
No log	9.1064	428	0.9368	0.3643	0.9368	0.9679
No log	9.1489	430	1.0233	0.3395	1.0233	1.0116
No log	9.1915	432	1.1856	0.2121	1.1856	1.0889
No log	9.2340	434	1.4260	0.1189	1.4260	1.1942
No log	9.2766	436	1.5751	0.0948	1.5751	1.2550
No log	9.3191	438	1.5739	0.1316	1.5739	1.2545
No log	9.3617	440	1.4376	0.0825	1.4376	1.1990
No log	9.4043	442	1.2469	0.2294	1.2469	1.1166
No log	9.4468	444	1.1271	0.2755	1.1271	1.0617
No log	9.4894	446	1.1076	0.3059	1.1076	1.0524
No log	9.5319	448	1.1763	0.2056	1.1763	1.0846
No log	9.5745	450	1.2022	0.1782	1.2022	1.0964
No log	9.6170	452	1.1566	0.2336	1.1566	1.0755
No log	9.6596	454	1.0864	0.3193	1.0864	1.0423
No log	9.7021	456	1.0880	0.2501	1.0880	1.0431
No log	9.7447	458	1.1477	0.2191	1.1477	1.0713
No log	9.7872	460	1.1657	0.2459	1.1657	1.0797
No log	9.8298	462	1.1040	0.2459	1.1040	1.0507
No log	9.8723	464	1.0003	0.2820	1.0003	1.0001
No log	9.9149	466	1.0028	0.2802	1.0028	1.0014
No log	9.9574	468	1.0479	0.3010	1.0479	1.0237
No log	10.0	470	1.0838	0.2417	1.0838	1.0410
No log	10.0426	472	1.1913	0.2156	1.1913	1.0915
No log	10.0851	474	1.3189	0.1793	1.3189	1.1484
No log	10.1277	476	1.3700	0.1310	1.3700	1.1705
No log	10.1702	478	1.3164	0.1391	1.3164	1.1473
No log	10.2128	480	1.1934	0.2008	1.1934	1.0924
No log	10.2553	482	1.0624	0.3225	1.0624	1.0308
No log	10.2979	484	0.9983	0.3516	0.9983	0.9991
No log	10.3404	486	0.9943	0.3455	0.9943	0.9972
No log	10.3830	488	1.0346	0.3059	1.0346	1.0171
No log	10.4255	490	1.0837	0.2635	1.0837	1.0410
No log	10.4681	492	1.2024	0.1815	1.2024	1.0965
No log	10.5106	494	1.2791	0.1450	1.2791	1.1310
No log	10.5532	496	1.3274	0.1450	1.3274	1.1521
No log	10.5957	498	1.3228	0.1450	1.3228	1.1501
0.3059	10.6383	500	1.2542	0.1248	1.2542	1.1199
0.3059	10.6809	502	1.2090	0.1537	1.2090	1.0996
0.3059	10.7234	504	1.2697	0.1450	1.2697	1.1268
0.3059	10.7660	506	1.3644	0.0948	1.3644	1.1681
0.3059	10.8085	508	1.4310	0.0884	1.4310	1.1962
0.3059	10.8511	510	1.4609	0.0650	1.4609	1.2087
0.3059	10.8936	512	1.4563	0.0650	1.4563	1.2068
0.3059	10.9362	514	1.4181	0.0465	1.4181	1.1909

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1