ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2639
• Qwk: 0.1814
• Mse: 1.2639
• Rmse: 1.1242

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	3.9152	-0.0319	3.9152	1.9787
No log	0.0976	4	2.3161	0.0372	2.3161	1.5219
No log	0.1463	6	2.0454	0.0260	2.0454	1.4302
No log	0.1951	8	1.6301	0.0100	1.6301	1.2768
No log	0.2439	10	1.2168	0.1091	1.2168	1.1031
No log	0.2927	12	1.1692	0.1901	1.1692	1.0813
No log	0.3415	14	1.2690	0.1205	1.2690	1.1265
No log	0.3902	16	1.3094	0.0613	1.3094	1.1443
No log	0.4390	18	1.2486	0.0374	1.2486	1.1174
No log	0.4878	20	1.1393	0.1304	1.1393	1.0674
No log	0.5366	22	1.0717	0.1167	1.0717	1.0352
No log	0.5854	24	1.0785	0.0888	1.0785	1.0385
No log	0.6341	26	1.1062	0.0445	1.1062	1.0518
No log	0.6829	28	1.0674	0.1203	1.0674	1.0331
No log	0.7317	30	0.9890	0.1107	0.9890	0.9945
No log	0.7805	32	0.9718	0.3221	0.9718	0.9858
No log	0.8293	34	1.1094	0.1576	1.1094	1.0533
No log	0.8780	36	1.0090	0.2392	1.0090	1.0045
No log	0.9268	38	0.9661	0.3935	0.9661	0.9829
No log	0.9756	40	0.9632	0.2834	0.9632	0.9814
No log	1.0244	42	1.0046	0.2217	1.0046	1.0023
No log	1.0732	44	1.0990	0.1189	1.0990	1.0483
No log	1.1220	46	1.1539	0.0761	1.1539	1.0742
No log	1.1707	48	1.1020	0.0823	1.1020	1.0498
No log	1.2195	50	1.0902	0.1350	1.0902	1.0441
No log	1.2683	52	1.1294	0.1003	1.1294	1.0627
No log	1.3171	54	1.1120	0.2145	1.1120	1.0545
No log	1.3659	56	1.0491	0.2912	1.0491	1.0243
No log	1.4146	58	0.9670	0.3048	0.9670	0.9834
No log	1.4634	60	0.9772	0.1330	0.9772	0.9885
No log	1.5122	62	1.0123	0.0888	1.0123	1.0061
No log	1.5610	64	1.0275	0.0888	1.0275	1.0136
No log	1.6098	66	1.0126	0.0888	1.0126	1.0063
No log	1.6585	68	0.9315	0.2672	0.9315	0.9651
No log	1.7073	70	0.9216	0.2895	0.9216	0.9600
No log	1.7561	72	1.0374	0.2392	1.0374	1.0186
No log	1.8049	74	1.0876	0.3283	1.0876	1.0429
No log	1.8537	76	1.1482	0.3283	1.1482	1.0716
No log	1.9024	78	1.2706	0.2926	1.2706	1.1272
No log	1.9512	80	1.4393	0.2588	1.4393	1.1997
No log	2.0	82	1.6033	0.2016	1.6033	1.2662
No log	2.0488	84	1.7020	0.2026	1.7020	1.3046
No log	2.0976	86	1.6749	0.1914	1.6749	1.2942
No log	2.1463	88	1.5513	0.0973	1.5513	1.2455
No log	2.1951	90	1.4070	0.2149	1.4070	1.1862
No log	2.2439	92	1.4139	0.1362	1.4139	1.1891
No log	2.2927	94	1.4569	0.1297	1.4569	1.2070
No log	2.3415	96	1.3699	0.0976	1.3699	1.1704
No log	2.3902	98	1.1940	0.1434	1.1940	1.0927
No log	2.4390	100	1.0175	0.2263	1.0175	1.0087
No log	2.4878	102	0.9743	0.1857	0.9743	0.9871
No log	2.5366	104	0.9971	0.1707	0.9971	0.9986
No log	2.5854	106	1.0930	0.1970	1.0930	1.0454
No log	2.6341	108	1.1941	0.0571	1.1941	1.0928
No log	2.6829	110	1.3024	-0.0297	1.3024	1.1412
No log	2.7317	112	1.3887	-0.0460	1.3887	1.1784
No log	2.7805	114	1.4502	0.1194	1.4502	1.2043
No log	2.8293	116	1.4877	0.2313	1.4877	1.2197
No log	2.8780	118	1.5875	0.2638	1.5875	1.2599
No log	2.9268	120	1.6965	0.2252	1.6965	1.3025
No log	2.9756	122	1.7232	0.1078	1.7232	1.3127
No log	3.0244	124	1.6639	0.1207	1.6639	1.2899
No log	3.0732	126	1.5461	0.2004	1.5461	1.2434
No log	3.1220	128	1.4334	0.1438	1.4334	1.1973
No log	3.1707	130	1.4259	0.0712	1.4259	1.1941
No log	3.2195	132	1.4356	-0.0541	1.4356	1.1982
No log	3.2683	134	1.4579	-0.0939	1.4579	1.2074
No log	3.3171	136	1.4491	0.0147	1.4491	1.2038
No log	3.3659	138	1.5209	0.2752	1.5209	1.2332
No log	3.4146	140	1.5553	0.2110	1.5553	1.2471
No log	3.4634	142	1.5332	0.2317	1.5332	1.2382
No log	3.5122	144	1.4563	0.2437	1.4563	1.2068
No log	3.5610	146	1.4090	0.2694	1.4090	1.1870
No log	3.6098	148	1.4642	0.2694	1.4642	1.2101
No log	3.6585	150	1.6547	0.2644	1.6547	1.2864
No log	3.7073	152	1.9515	0.2247	1.9515	1.3970
No log	3.7561	154	2.0626	0.1896	2.0626	1.4362
No log	3.8049	156	1.9816	0.2127	1.9816	1.4077
No log	3.8537	158	1.7125	0.2252	1.7125	1.3086
No log	3.9024	160	1.4900	0.2221	1.4900	1.2206
No log	3.9512	162	1.3005	0.2424	1.3005	1.1404
No log	4.0	164	1.3190	0.2709	1.3190	1.1485
No log	4.0488	166	1.3899	0.2752	1.3899	1.1789
No log	4.0976	168	1.5366	0.2363	1.5366	1.2396
No log	4.1463	170	1.6811	0.2448	1.6811	1.2966
No log	4.1951	172	1.6823	0.2406	1.6823	1.2971
No log	4.2439	174	1.6922	0.2406	1.6922	1.3009
No log	4.2927	176	1.6000	0.2869	1.6000	1.2649
No log	4.3415	178	1.5276	0.2869	1.5276	1.2360
No log	4.3902	180	1.5637	0.2869	1.5637	1.2505
No log	4.4390	182	1.5011	0.2869	1.5011	1.2252
No log	4.4878	184	1.3543	0.2982	1.3543	1.1637
No log	4.5366	186	1.1786	0.2709	1.1786	1.0856
No log	4.5854	188	1.1007	0.2795	1.1007	1.0492
No log	4.6341	190	1.1784	0.2709	1.1784	1.0855
No log	4.6829	192	1.3811	0.2982	1.3811	1.1752
No log	4.7317	194	1.5727	0.2832	1.5727	1.2541
No log	4.7805	196	1.6856	0.2270	1.6856	1.2983
No log	4.8293	198	1.6794	0.2437	1.6794	1.2959
No log	4.8780	200	1.5514	0.2522	1.5514	1.2456
No log	4.9268	202	1.4239	0.2709	1.4239	1.1933
No log	4.9756	204	1.2668	0.1142	1.2668	1.1255
No log	5.0244	206	1.2415	0.1142	1.2415	1.1142
No log	5.0732	208	1.3106	0.2065	1.3106	1.1448
No log	5.1220	210	1.4415	0.2424	1.4415	1.2006
No log	5.1707	212	1.6183	0.1832	1.6183	1.2721
No log	5.2195	214	1.7023	0.1533	1.7023	1.3047
No log	5.2683	216	1.6420	0.1142	1.6420	1.2814
No log	5.3171	218	1.5048	0.1562	1.5048	1.2267
No log	5.3659	220	1.4030	0.1744	1.4030	1.1845
No log	5.4146	222	1.3956	0.1744	1.3956	1.1814
No log	5.4634	224	1.4510	0.2065	1.4510	1.2046
No log	5.5122	226	1.5505	0.2522	1.5505	1.2452
No log	5.5610	228	1.5876	0.2568	1.5876	1.2600
No log	5.6098	230	1.4723	0.1880	1.4723	1.2134
No log	5.6585	232	1.4053	0.1562	1.4053	1.1854
No log	5.7073	234	1.4550	0.1943	1.4550	1.2063
No log	5.7561	236	1.5212	0.1943	1.5212	1.2334
No log	5.8049	238	1.5631	0.1634	1.5631	1.2502
No log	5.8537	240	1.6752	0.1141	1.6752	1.2943
No log	5.9024	242	1.6585	0.1634	1.6585	1.2878
No log	5.9512	244	1.5822	0.2004	1.5822	1.2578
No log	6.0	246	1.4101	0.2522	1.4101	1.1875
No log	6.0488	248	1.2845	0.2184	1.2845	1.1333
No log	6.0976	250	1.3726	0.3052	1.3726	1.1716
No log	6.1463	252	1.5895	0.2527	1.5895	1.2608
No log	6.1951	254	1.7285	0.2419	1.7285	1.3147
No log	6.2439	256	1.7297	0.2419	1.7297	1.3152
No log	6.2927	258	1.5794	0.2296	1.5794	1.2567
No log	6.3415	260	1.5724	0.2296	1.5724	1.2539
No log	6.3902	262	1.5028	0.3052	1.5028	1.2259
No log	6.4390	264	1.4208	0.2474	1.4208	1.1920
No log	6.4878	266	1.3507	0.2126	1.3507	1.1622
No log	6.5366	268	1.3940	0.2424	1.3940	1.1807
No log	6.5854	270	1.5438	0.2611	1.5438	1.2425
No log	6.6341	272	1.6434	0.2110	1.6434	1.2819
No log	6.6829	274	1.6874	0.1752	1.6874	1.2990
No log	6.7317	276	1.5767	0.2117	1.5767	1.2557
No log	6.7805	278	1.4146	0.1486	1.4146	1.1893
No log	6.8293	280	1.2838	0.1142	1.2838	1.1330
No log	6.8780	282	1.2129	0.0781	1.2129	1.1013
No log	6.9268	284	1.2424	0.1142	1.2424	1.1146
No log	6.9756	286	1.3719	0.2424	1.3719	1.1713
No log	7.0244	288	1.5464	0.2437	1.5464	1.2435
No log	7.0732	290	1.7671	0.2007	1.7671	1.3293
No log	7.1220	292	1.8037	0.1688	1.8037	1.3430
No log	7.1707	294	1.7056	0.2058	1.7056	1.3060
No log	7.2195	296	1.5468	0.2239	1.5468	1.2437
No log	7.2683	298	1.3254	0.2126	1.3254	1.1513
No log	7.3171	300	1.2248	0.1142	1.2248	1.1067
No log	7.3659	302	1.2181	0.1024	1.2181	1.1037
No log	7.4146	304	1.3199	0.2752	1.3199	1.1489
No log	7.4634	306	1.4566	0.2869	1.4566	1.2069
No log	7.5122	308	1.5103	0.2906	1.5103	1.2289
No log	7.5610	310	1.5202	0.2733	1.5202	1.2330
No log	7.6098	312	1.4770	0.3177	1.4770	1.2153
No log	7.6585	314	1.4998	0.3205	1.4998	1.2247
No log	7.7073	316	1.5688	0.2874	1.5688	1.2525
No log	7.7561	318	1.6757	0.2681	1.6757	1.2945
No log	7.8049	320	1.6044	0.2482	1.6044	1.2667
No log	7.8537	322	1.4328	0.2522	1.4328	1.1970
No log	7.9024	324	1.2480	0.1744	1.2480	1.1171
No log	7.9512	326	1.1255	0.0401	1.1255	1.0609
No log	8.0	328	1.0764	0.0781	1.0764	1.0375
No log	8.0488	330	1.1043	0.1744	1.1043	1.0508
No log	8.0976	332	1.2622	0.3018	1.2622	1.1235
No log	8.1463	334	1.5303	0.2606	1.5303	1.2370
No log	8.1951	336	1.7740	0.3024	1.7740	1.3319
No log	8.2439	338	1.8534	0.2988	1.8534	1.3614
No log	8.2927	340	1.7466	0.2967	1.7466	1.3216
No log	8.3415	342	1.5761	0.2940	1.5761	1.2554
No log	8.3902	344	1.4872	0.2793	1.4872	1.2195
No log	8.4390	346	1.4299	0.2665	1.4299	1.1958
No log	8.4878	348	1.4240	0.2665	1.4240	1.1933
No log	8.5366	350	1.4802	0.2474	1.4802	1.2166
No log	8.5854	352	1.4316	0.2709	1.4316	1.1965
No log	8.6341	354	1.3518	0.2665	1.3518	1.1627
No log	8.6829	356	1.4224	0.2568	1.4224	1.1926
No log	8.7317	358	1.4891	0.3117	1.4891	1.2203
No log	8.7805	360	1.4446	0.2709	1.4446	1.2019
No log	8.8293	362	1.3826	0.2665	1.3826	1.1759
No log	8.8780	364	1.3559	0.2665	1.3559	1.1644
No log	8.9268	366	1.3007	0.1814	1.3007	1.1405
No log	8.9756	368	1.3466	0.2372	1.3466	1.1604
No log	9.0244	370	1.4908	0.2793	1.4908	1.2210
No log	9.0732	372	1.5425	0.3052	1.5425	1.2420
No log	9.1220	374	1.4719	0.2752	1.4719	1.2132
No log	9.1707	376	1.3776	0.2126	1.3776	1.1737
No log	9.2195	378	1.3444	0.1814	1.3444	1.1595
No log	9.2683	380	1.3261	0.1814	1.3261	1.1516
No log	9.3171	382	1.3477	0.2126	1.3477	1.1609
No log	9.3659	384	1.3544	0.2126	1.3544	1.1638
No log	9.4146	386	1.3364	0.2126	1.3364	1.1560
No log	9.4634	388	1.3280	0.2126	1.3280	1.1524
No log	9.5122	390	1.3023	0.2424	1.3023	1.1412
No log	9.5610	392	1.3131	0.2944	1.3131	1.1459
No log	9.6098	394	1.3688	0.2982	1.3688	1.1700
No log	9.6585	396	1.4065	0.3018	1.4065	1.1860
No log	9.7073	398	1.4039	0.3018	1.4039	1.1849
No log	9.7561	400	1.3519	0.2982	1.3519	1.1627
No log	9.8049	402	1.3142	0.2665	1.3142	1.1464
No log	9.8537	404	1.3158	0.2665	1.3158	1.1471
No log	9.9024	406	1.3620	0.2665	1.3620	1.1671
No log	9.9512	408	1.4741	0.2832	1.4741	1.2141
No log	10.0	410	1.4998	0.2832	1.4998	1.2247
No log	10.0488	412	1.5107	0.2832	1.5107	1.2291
No log	10.0976	414	1.5279	0.2832	1.5279	1.2361
No log	10.1463	416	1.5454	0.2793	1.5454	1.2431
No log	10.1951	418	1.5071	0.2793	1.5071	1.2276
No log	10.2439	420	1.4512	0.2982	1.4512	1.2047
No log	10.2927	422	1.3641	0.2982	1.3641	1.1680
No log	10.3415	424	1.2933	0.2709	1.2933	1.1372
No log	10.3902	426	1.2873	0.2424	1.2873	1.1346
No log	10.4390	428	1.3117	0.2424	1.3117	1.1453
No log	10.4878	430	1.3510	0.2424	1.3510	1.1623
No log	10.5366	432	1.4179	0.2239	1.4179	1.1907
No log	10.5854	434	1.4578	0.2832	1.4578	1.2074
No log	10.6341	436	1.4536	0.2568	1.4536	1.2057
No log	10.6829	438	1.4186	0.2424	1.4186	1.1911
No log	10.7317	440	1.4318	0.2126	1.4318	1.1966
No log	10.7805	442	1.4254	0.2126	1.4254	1.1939
No log	10.8293	444	1.4542	0.2126	1.4542	1.2059
No log	10.8780	446	1.4625	0.2239	1.4625	1.2094
No log	10.9268	448	1.5026	0.1880	1.5026	1.2258
No log	10.9756	450	1.4913	0.1562	1.4913	1.2212
No log	11.0244	452	1.5060	0.1024	1.5060	1.2272
No log	11.0732	454	1.5108	0.1744	1.5108	1.2291
No log	11.1220	456	1.5158	0.2004	1.5158	1.2312
No log	11.1707	458	1.5287	0.2522	1.5287	1.2364
No log	11.2195	460	1.4799	0.2832	1.4799	1.2165
No log	11.2683	462	1.3876	0.2982	1.3876	1.1780
No log	11.3171	464	1.2905	0.3072	1.2905	1.1360
No log	11.3659	466	1.2601	0.3072	1.2601	1.1226
No log	11.4146	468	1.3082	0.2709	1.3082	1.1438
No log	11.4634	470	1.3823	0.2982	1.3823	1.1757
No log	11.5122	472	1.4097	0.2832	1.4097	1.1873
No log	11.5610	474	1.3280	0.2982	1.3280	1.1524
No log	11.6098	476	1.2140	0.3460	1.2140	1.1018
No log	11.6585	478	1.1924	0.2730	1.1924	1.0920
No log	11.7073	480	1.2291	0.2837	1.2291	1.1086
No log	11.7561	482	1.3147	0.2869	1.3147	1.1466
No log	11.8049	484	1.3998	0.2694	1.3998	1.1831
No log	11.8537	486	1.4945	0.3429	1.4945	1.2225
No log	11.9024	488	1.4541	0.3429	1.4540	1.2058
No log	11.9512	490	1.3182	0.3086	1.3182	1.1481
No log	12.0	492	1.1752	0.2877	1.1752	1.0841
No log	12.0488	494	1.1071	0.3355	1.1071	1.0522
No log	12.0976	496	1.1069	0.3231	1.1069	1.0521
No log	12.1463	498	1.1869	0.3052	1.1869	1.0895
0.3045	12.1951	500	1.3081	0.3329	1.3081	1.1437
0.3045	12.2439	502	1.4234	0.3429	1.4234	1.1931
0.3045	12.2927	504	1.4174	0.3329	1.4174	1.1906
0.3045	12.3415	506	1.3559	0.3086	1.3559	1.1644
0.3045	12.3902	508	1.2393	0.2126	1.2393	1.1132
0.3045	12.4390	510	1.2199	0.1814	1.2199	1.1045
0.3045	12.4878	512	1.2639	0.1814	1.2639	1.1242

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1