ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3838
• Qwk: 0.2260
• Mse: 1.3838
• Rmse: 1.1764

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	4.0800	0.0086	4.0800	2.0199
No log	0.3333	4	2.4496	-0.0040	2.4496	1.5651
No log	0.5	6	1.4813	0.0157	1.4813	1.2171
No log	0.6667	8	1.2831	0.1573	1.2831	1.1328
No log	0.8333	10	1.1310	0.1507	1.1310	1.0635
No log	1.0	12	1.2611	0.0770	1.2611	1.1230
No log	1.1667	14	1.0974	0.0712	1.0974	1.0476
No log	1.3333	16	1.0640	0.2591	1.0640	1.0315
No log	1.5	18	1.1145	0.1521	1.1145	1.0557
No log	1.6667	20	1.1460	0.1821	1.1460	1.0705
No log	1.8333	22	1.0730	0.1504	1.0730	1.0358
No log	2.0	24	1.0759	0.2618	1.0759	1.0372
No log	2.1667	26	1.1609	0.0462	1.1609	1.0774
No log	2.3333	28	1.2804	-0.0296	1.2804	1.1316
No log	2.5	30	1.1608	0.0225	1.1608	1.0774
No log	2.6667	32	1.0524	0.2667	1.0524	1.0258
No log	2.8333	34	1.0375	0.3198	1.0375	1.0186
No log	3.0	36	1.0267	0.3175	1.0267	1.0132
No log	3.1667	38	1.0604	0.2217	1.0604	1.0297
No log	3.3333	40	1.2086	0.0318	1.2086	1.0994
No log	3.5	42	1.1836	0.0436	1.1836	1.0880
No log	3.6667	44	1.0327	0.3117	1.0327	1.0162
No log	3.8333	46	1.0491	0.1389	1.0491	1.0243
No log	4.0	48	1.1004	0.1504	1.1004	1.0490
No log	4.1667	50	1.2414	0.0553	1.2414	1.1142
No log	4.3333	52	1.3055	-0.0180	1.3055	1.1426
No log	4.5	54	1.3020	0.0232	1.3020	1.1410
No log	4.6667	56	1.1647	0.0380	1.1647	1.0792
No log	4.8333	58	1.2082	0.0380	1.2082	1.0992
No log	5.0	60	1.2436	0.0380	1.2436	1.1152
No log	5.1667	62	1.1398	0.0996	1.1398	1.0676
No log	5.3333	64	1.0519	0.3001	1.0519	1.0256
No log	5.5	66	1.0677	0.1926	1.0677	1.0333
No log	5.6667	68	1.0813	0.1771	1.0813	1.0399
No log	5.8333	70	1.0660	0.2518	1.0660	1.0325
No log	6.0	72	1.0578	0.2467	1.0578	1.0285
No log	6.1667	74	1.0441	0.2187	1.0441	1.0218
No log	6.3333	76	1.0159	0.2544	1.0159	1.0079
No log	6.5	78	1.0359	0.1727	1.0359	1.0178
No log	6.6667	80	0.9822	0.2416	0.9822	0.9911
No log	6.8333	82	0.9653	0.2569	0.9653	0.9825
No log	7.0	84	1.0038	0.2108	1.0038	1.0019
No log	7.1667	86	1.0789	0.2512	1.0789	1.0387
No log	7.3333	88	1.1173	0.0924	1.1173	1.0570
No log	7.5	90	1.1223	0.1407	1.1223	1.0594
No log	7.6667	92	1.1591	0.2864	1.1591	1.0766
No log	7.8333	94	1.1773	0.2471	1.1773	1.0850
No log	8.0	96	1.2340	0.2062	1.2340	1.1108
No log	8.1667	98	1.2664	0.2438	1.2664	1.1254
No log	8.3333	100	1.4428	0.2809	1.4428	1.2012
No log	8.5	102	1.6288	0.2414	1.6288	1.2762
No log	8.6667	104	1.5564	0.2395	1.5564	1.2476
No log	8.8333	106	1.4377	0.1756	1.4377	1.1991
No log	9.0	108	1.5048	0.2732	1.5048	1.2267
No log	9.1667	110	1.6045	0.2435	1.6045	1.2667
No log	9.3333	112	1.3368	0.2931	1.3368	1.1562
No log	9.5	114	1.0536	0.2820	1.0536	1.0265
No log	9.6667	116	1.0078	0.3024	1.0078	1.0039
No log	9.8333	118	1.0872	0.3059	1.0872	1.0427
No log	10.0	120	1.4499	0.2924	1.4499	1.2041
No log	10.1667	122	1.6888	0.1950	1.6888	1.2995
No log	10.3333	124	1.6897	0.1892	1.6897	1.2999
No log	10.5	126	1.5258	0.2117	1.5258	1.2352
No log	10.6667	128	1.1232	0.1676	1.1232	1.0598
No log	10.8333	130	1.0285	0.1826	1.0285	1.0141
No log	11.0	132	1.1544	0.0894	1.1544	1.0744
No log	11.1667	134	1.4376	0.2315	1.4376	1.1990
No log	11.3333	136	1.5415	0.0370	1.5415	1.2416
No log	11.5	138	1.5543	0.0973	1.5543	1.2467
No log	11.6667	140	1.5922	0.2164	1.5922	1.2618
No log	11.8333	142	1.6505	0.1982	1.6505	1.2847
No log	12.0	144	1.7054	0.1689	1.7054	1.3059
No log	12.1667	146	1.6291	0.1776	1.6291	1.2763
No log	12.3333	148	1.7011	0.2025	1.7011	1.3043
No log	12.5	150	1.7805	0.1462	1.7805	1.3344
No log	12.6667	152	1.6799	0.2170	1.6799	1.2961
No log	12.8333	154	1.3455	0.3215	1.3455	1.1600
No log	13.0	156	1.1062	0.2680	1.1062	1.0518
No log	13.1667	158	1.1695	0.2791	1.1695	1.0814
No log	13.3333	160	1.5325	0.2857	1.5325	1.2379
No log	13.5	162	1.5795	0.1717	1.5795	1.2568
No log	13.6667	164	1.4537	0.1850	1.4537	1.2057
No log	13.8333	166	1.3782	0.2417	1.3782	1.1740
No log	14.0	168	1.2167	0.2816	1.2167	1.1030
No log	14.1667	170	1.1163	0.2355	1.1163	1.0566
No log	14.3333	172	1.2010	0.3326	1.2010	1.0959
No log	14.5	174	1.3187	0.2417	1.3187	1.1483
No log	14.6667	176	1.3377	0.3409	1.3377	1.1566
No log	14.8333	178	1.4494	0.3038	1.4494	1.2039
No log	15.0	180	1.6392	0.1717	1.6392	1.2803
No log	15.1667	182	1.6488	0.1717	1.6488	1.2841
No log	15.3333	184	1.4960	0.2086	1.4960	1.2231
No log	15.5	186	1.2617	0.2917	1.2617	1.1233
No log	15.6667	188	1.3083	0.2570	1.3083	1.1438
No log	15.8333	190	1.4540	0.2555	1.4540	1.2058
No log	16.0	192	1.5346	0.2240	1.5346	1.2388
No log	16.1667	194	1.4467	0.2240	1.4467	1.2028
No log	16.3333	196	1.4417	0.2555	1.4417	1.2007
No log	16.5	198	1.3930	0.2187	1.3930	1.1803
No log	16.6667	200	1.3459	0.2187	1.3459	1.1601
No log	16.8333	202	1.3765	0.2465	1.3765	1.1733
No log	17.0	204	1.4525	0.2417	1.4525	1.2052
No log	17.1667	206	1.5210	0.2098	1.5210	1.2333
No log	17.3333	208	1.4780	0.2417	1.4780	1.2157
No log	17.5	210	1.3781	0.2623	1.3781	1.1739
No log	17.6667	212	1.3622	0.2964	1.3622	1.1671
No log	17.8333	214	1.5435	0.2417	1.5435	1.2424
No log	18.0	216	1.6072	0.1850	1.6072	1.2678
No log	18.1667	218	1.5677	0.2555	1.5677	1.2521
No log	18.3333	220	1.3048	0.1952	1.3048	1.1423
No log	18.5	222	1.1603	0.1500	1.1603	1.0772
No log	18.6667	224	1.2552	0.2284	1.2552	1.1203
No log	18.8333	226	1.3802	0.2315	1.3802	1.1748
No log	19.0	228	1.3966	0.2132	1.3966	1.1818
No log	19.1667	230	1.3969	0.1958	1.3969	1.1819
No log	19.3333	232	1.3708	0.2070	1.3708	1.1708
No log	19.5	234	1.3566	0.2363	1.3566	1.1647
No log	19.6667	236	1.4026	0.3135	1.4026	1.1843
No log	19.8333	238	1.2960	0.2851	1.2960	1.1384
No log	20.0	240	1.2404	0.2686	1.2404	1.1137
No log	20.1667	242	1.3052	0.2686	1.3052	1.1425
No log	20.3333	244	1.3995	0.2631	1.3995	1.1830
No log	20.5	246	1.5492	0.2809	1.5492	1.2447
No log	20.6667	248	1.5016	0.2597	1.5016	1.2254
No log	20.8333	250	1.3855	0.2851	1.3855	1.1771
No log	21.0	252	1.3068	0.2812	1.3068	1.1432
No log	21.1667	254	1.2435	0.1820	1.2435	1.1151
No log	21.3333	256	1.2698	0.1911	1.2698	1.1269
No log	21.5	258	1.3604	0.2315	1.3604	1.1664
No log	21.6667	260	1.3439	0.2315	1.3439	1.1593
No log	21.8333	262	1.3278	0.2120	1.3278	1.1523
No log	22.0	264	1.3453	0.2410	1.3453	1.1599
No log	22.1667	266	1.4377	0.1935	1.4377	1.1990
No log	22.3333	268	1.5789	0.2555	1.5789	1.2565
No log	22.5	270	1.6877	0.2677	1.6877	1.2991
No log	22.6667	272	1.6999	0.2211	1.6999	1.3038
No log	22.8333	274	1.5683	0.1772	1.5683	1.2523
No log	23.0	276	1.4249	0.2261	1.4249	1.1937
No log	23.1667	278	1.3672	0.2389	1.3672	1.1693
No log	23.3333	280	1.4797	0.2191	1.4797	1.2164
No log	23.5	282	1.5549	0.2386	1.5549	1.2469
No log	23.6667	284	1.5352	0.2026	1.5352	1.2390
No log	23.8333	286	1.5601	0.2355	1.5601	1.2490
No log	24.0	288	1.5870	0.1994	1.5870	1.2597
No log	24.1667	290	1.5516	0.2159	1.5516	1.2456
No log	24.3333	292	1.5574	0.2138	1.5574	1.2480
No log	24.5	294	1.4825	0.1792	1.4825	1.2176
No log	24.6667	296	1.4499	0.1792	1.4499	1.2041
No log	24.8333	298	1.5381	0.2465	1.5381	1.2402
No log	25.0	300	1.5535	0.2070	1.5535	1.2464
No log	25.1667	302	1.4679	0.2417	1.4679	1.2116
No log	25.3333	304	1.3016	0.2315	1.3016	1.1409
No log	25.5	306	1.1955	0.2283	1.1955	1.0934
No log	25.6667	308	1.2301	0.2315	1.2301	1.1091
No log	25.8333	310	1.4109	0.2771	1.4109	1.1878
No log	26.0	312	1.6849	0.3223	1.6849	1.2981
No log	26.1667	314	1.7664	0.2847	1.7664	1.3291
No log	26.3333	316	1.6123	0.3038	1.6123	1.2698
No log	26.5	318	1.2960	0.2597	1.2960	1.1384
No log	26.6667	320	0.9869	0.3527	0.9869	0.9934
No log	26.8333	322	0.8941	0.3295	0.8941	0.9456
No log	27.0	324	0.9160	0.3492	0.9160	0.9571
No log	27.1667	326	1.1090	0.2686	1.1090	1.0531
No log	27.3333	328	1.3790	0.2832	1.3790	1.1743
No log	27.5	330	1.4999	0.2110	1.4999	1.2247
No log	27.6667	332	1.5236	0.2597	1.5236	1.2343
No log	27.8333	334	1.4132	0.2465	1.4132	1.1888
No log	28.0	336	1.2750	0.2132	1.2750	1.1291
No log	28.1667	338	1.2075	0.2315	1.2075	1.0988
No log	28.3333	340	1.2380	0.2315	1.2380	1.1127
No log	28.5	342	1.3379	0.2417	1.3379	1.1567
No log	28.6667	344	1.3296	0.2474	1.3296	1.1531
No log	28.8333	346	1.3259	0.1814	1.3259	1.1515
No log	29.0	348	1.3244	0.1228	1.3244	1.1508
No log	29.1667	350	1.2868	0.1814	1.2868	1.1344
No log	29.3333	352	1.2426	0.1952	1.2426	1.1147
No log	29.5	354	1.2427	0.2315	1.2427	1.1148
No log	29.6667	356	1.2927	0.2602	1.2927	1.1370
No log	29.8333	358	1.2962	0.2602	1.2962	1.1385
No log	30.0	360	1.3222	0.2964	1.3222	1.1499
No log	30.1667	362	1.3936	0.2772	1.3936	1.1805
No log	30.3333	364	1.5006	0.2291	1.5006	1.2250
No log	30.5	366	1.5497	0.2291	1.5497	1.2449
No log	30.6667	368	1.4607	0.2260	1.4607	1.2086
No log	30.8333	370	1.4001	0.1024	1.4001	1.1833
No log	31.0	372	1.3158	0.0556	1.3158	1.1471
No log	31.1667	374	1.2084	0.0556	1.2084	1.0993
No log	31.3333	376	1.1928	0.0556	1.1928	1.0922
No log	31.5	378	1.2309	0.0556	1.2309	1.1095
No log	31.6667	380	1.2495	0.0781	1.2495	1.1178
No log	31.8333	382	1.2744	0.1886	1.2744	1.1289
No log	32.0	384	1.2083	0.2203	1.2083	1.0992
No log	32.1667	386	1.1923	0.2506	1.1923	1.0919
No log	32.3333	388	1.2246	0.2506	1.2246	1.1066
No log	32.5	390	1.3716	0.2555	1.3716	1.1711
No log	32.6667	392	1.5545	0.2518	1.5545	1.2468
No log	32.8333	394	1.4965	0.2666	1.4965	1.2233
No log	33.0	396	1.2525	0.2647	1.2525	1.1191
No log	33.1667	398	1.1815	0.2260	1.1815	1.0869
No log	33.3333	400	1.3736	0.2809	1.3736	1.1720
No log	33.5	402	1.5276	0.2593	1.5276	1.2360
No log	33.6667	404	1.5833	0.2630	1.5833	1.2583
No log	33.8333	406	1.5086	0.2880	1.5086	1.2283
No log	34.0	408	1.3098	0.2417	1.3098	1.1445
No log	34.1667	410	1.1161	0.2203	1.1161	1.0564
No log	34.3333	412	1.1064	0.2203	1.1064	1.0519
No log	34.5	414	1.2208	0.2260	1.2208	1.1049
No log	34.6667	416	1.4230	0.2417	1.4230	1.1929
No log	34.8333	418	1.5466	0.2342	1.5466	1.2436
No log	35.0	420	1.5892	0.2004	1.5892	1.2607
No log	35.1667	422	1.5609	0.1142	1.5609	1.2494
No log	35.3333	424	1.4626	0.1562	1.4626	1.2094
No log	35.5	426	1.3201	0.1024	1.3201	1.1490
No log	35.6667	428	1.2570	0.1024	1.2570	1.1212
No log	35.8333	430	1.2937	0.1024	1.2937	1.1374
No log	36.0	432	1.3747	0.1024	1.3747	1.1725
No log	36.1667	434	1.4605	0.2555	1.4605	1.2085
No log	36.3333	436	1.4990	0.2555	1.4990	1.2243
No log	36.5	438	1.4597	0.2015	1.4597	1.2082
No log	36.6667	440	1.3701	0.2260	1.3701	1.1705
No log	36.8333	442	1.3087	0.2260	1.3087	1.1440
No log	37.0	444	1.3230	0.2260	1.3230	1.1502
No log	37.1667	446	1.4113	0.2132	1.4113	1.1880
No log	37.3333	448	1.5298	0.2417	1.5298	1.2369
No log	37.5	450	1.5495	0.2187	1.5495	1.2448
No log	37.6667	452	1.5123	0.2367	1.5123	1.2298
No log	37.8333	454	1.4953	0.2075	1.4953	1.2228
No log	38.0	456	1.4635	0.2075	1.4635	1.2098
No log	38.1667	458	1.4839	0.2075	1.4839	1.2181
No log	38.3333	460	1.4340	0.2337	1.4340	1.1975
No log	38.5	462	1.3736	0.0661	1.3736	1.1720
No log	38.6667	464	1.3815	0.0661	1.3815	1.1754
No log	38.8333	466	1.4174	0.0661	1.4174	1.1905
No log	39.0	468	1.4741	0.0661	1.4741	1.2141
No log	39.1667	470	1.5113	0.2260	1.5113	1.2293
No log	39.3333	472	1.4823	0.2132	1.4823	1.2175
No log	39.5	474	1.4275	0.2132	1.4275	1.1948
No log	39.6667	476	1.3476	0.2260	1.3476	1.1609
No log	39.8333	478	1.3293	0.2203	1.3293	1.1530
No log	40.0	480	1.3645	0.2260	1.3645	1.1681
No log	40.1667	482	1.4134	0.2260	1.4134	1.1889
No log	40.3333	484	1.4060	0.2260	1.4060	1.1858
No log	40.5	486	1.4041	0.2260	1.4041	1.1849
No log	40.6667	488	1.4284	0.2260	1.4284	1.1952
No log	40.8333	490	1.4028	0.2260	1.4028	1.1844
No log	41.0	492	1.3724	0.2260	1.3724	1.1715
No log	41.1667	494	1.4130	0.2260	1.4130	1.1887
No log	41.3333	496	1.4564	0.2260	1.4564	1.2068
No log	41.5	498	1.5206	0.2132	1.5206	1.2331
0.2893	41.6667	500	1.5684	0.2417	1.5684	1.2524
0.2893	41.8333	502	1.5640	0.2417	1.5640	1.2506
0.2893	42.0	504	1.5308	0.2132	1.5308	1.2373
0.2893	42.1667	506	1.4649	0.2260	1.4649	1.2103
0.2893	42.3333	508	1.3977	0.2260	1.3977	1.1822
0.2893	42.5	510	1.3838	0.2260	1.3838	1.1764

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1