ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3487
• Qwk: 0.2372
• Mse: 1.3487
• Rmse: 1.1613

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	4.2347	0.0178	4.2347	2.0578
No log	0.1111	4	2.3514	0.0462	2.3514	1.5334
No log	0.1667	6	1.8930	-0.0082	1.8930	1.3759
No log	0.2222	8	1.1959	0.1979	1.1959	1.0935
No log	0.2778	10	1.2496	0.0701	1.2496	1.1178
No log	0.3333	12	1.3892	-0.0296	1.3892	1.1787
No log	0.3889	14	1.3074	-0.0858	1.3074	1.1434
No log	0.4444	16	1.1922	0.0850	1.1922	1.0919
No log	0.5	18	1.1243	0.1881	1.1243	1.0603
No log	0.5556	20	1.1225	0.0604	1.1225	1.0595
No log	0.6111	22	1.1062	0.0445	1.1062	1.0517
No log	0.6667	24	1.0935	0.1076	1.0935	1.0457
No log	0.7222	26	1.0925	0.2365	1.0925	1.0452
No log	0.7778	28	1.1041	0.1997	1.1041	1.0508
No log	0.8333	30	1.1243	0.2100	1.1243	1.0603
No log	0.8889	32	1.1332	0.1805	1.1332	1.0645
No log	0.9444	34	1.0906	0.2366	1.0906	1.0443
No log	1.0	36	1.0628	0.1935	1.0628	1.0309
No log	1.0556	38	1.0671	0.1447	1.0671	1.0330
No log	1.1111	40	1.0835	0.0385	1.0835	1.0409
No log	1.1667	42	1.0947	0.0574	1.0947	1.0463
No log	1.2222	44	1.1340	0.0111	1.1340	1.0649
No log	1.2778	46	1.1528	0.0884	1.1528	1.0737
No log	1.3333	48	1.0994	0.1101	1.0994	1.0485
No log	1.3889	50	1.0905	0.0293	1.0905	1.0443
No log	1.4444	52	1.1743	0.0160	1.1743	1.0837
No log	1.5	54	1.1934	0.1770	1.1934	1.0924
No log	1.5556	56	1.2113	0.1770	1.2113	1.1006
No log	1.6111	58	1.3160	0.2395	1.3160	1.1472
No log	1.6667	60	1.4909	0.1892	1.4909	1.2210
No log	1.7222	62	1.4066	0.2863	1.4066	1.1860
No log	1.7778	64	1.2915	0.2915	1.2915	1.1365
No log	1.8333	66	1.5801	0.1871	1.5801	1.2570
No log	1.8889	68	1.9347	0.1487	1.9347	1.3909
No log	1.9444	70	1.8137	0.1559	1.8137	1.3467
No log	2.0	72	1.5147	0.2488	1.5147	1.2307
No log	2.0556	74	1.3057	0.3277	1.3057	1.1427
No log	2.1111	76	1.4478	0.2406	1.4478	1.2032
No log	2.1667	78	1.6012	0.2606	1.6012	1.2654
No log	2.2222	80	1.5243	0.2117	1.5243	1.2346
No log	2.2778	82	1.4949	0.0981	1.4949	1.2227
No log	2.3333	84	1.4649	0.0694	1.4649	1.2103
No log	2.3889	86	1.3064	0.1407	1.3064	1.1430
No log	2.4444	88	1.1106	0.1265	1.1106	1.0539
No log	2.5	90	1.0747	0.0987	1.0747	1.0367
No log	2.5556	92	1.2048	0.2065	1.2048	1.0976
No log	2.6111	94	1.5209	0.2391	1.5209	1.2332
No log	2.6667	96	1.6984	0.2317	1.6984	1.3032
No log	2.7222	98	1.7303	0.1871	1.7303	1.3154
No log	2.7778	100	1.7487	0.2007	1.7487	1.3224
No log	2.8333	102	1.6527	0.2338	1.6527	1.2856
No log	2.8889	104	1.7132	0.2007	1.7132	1.3089
No log	2.9444	106	1.6951	0.2007	1.6951	1.3020
No log	3.0	108	1.8916	0.1925	1.8916	1.3754
No log	3.0556	110	1.8488	0.1964	1.8488	1.3597
No log	3.1111	112	1.4253	0.2117	1.4253	1.1939
No log	3.1667	114	1.2688	0.2132	1.2688	1.1264
No log	3.2222	116	1.4534	0.2117	1.4534	1.2056
No log	3.2778	118	1.6752	0.2566	1.6752	1.2943
No log	3.3333	120	1.6257	0.2525	1.6257	1.2750
No log	3.3889	122	1.3507	0.1744	1.3507	1.1622
No log	3.4444	124	1.1826	0.0	1.1826	1.0875
No log	3.5	126	1.1363	0.0	1.1363	1.0660
No log	3.5556	128	1.2474	0.1407	1.2474	1.1169
No log	3.6111	130	1.5016	0.2221	1.5016	1.2254
No log	3.6667	132	1.6331	0.2644	1.6331	1.2779
No log	3.7222	134	1.8261	0.2236	1.8261	1.3513
No log	3.7778	136	1.7423	0.2296	1.7423	1.3200
No log	3.8333	138	1.4251	0.1892	1.4251	1.1938
No log	3.8889	140	1.2621	0.2184	1.2621	1.1234
No log	3.9444	142	1.3422	0.2239	1.3422	1.1585
No log	4.0	144	1.4341	0.2292	1.4341	1.1975
No log	4.0556	146	1.4563	0.1892	1.4563	1.2068
No log	4.1111	148	1.5529	0.1950	1.5529	1.2462
No log	4.1667	150	1.5806	0.2005	1.5806	1.2572
No log	4.2222	152	1.4631	0.1898	1.4631	1.2096
No log	4.2778	154	1.4616	0.2184	1.4616	1.2090
No log	4.3333	156	1.5825	0.2239	1.5825	1.2580
No log	4.3889	158	1.5634	0.2342	1.5634	1.2504
No log	4.4444	160	1.4506	0.1958	1.4506	1.2044
No log	4.5	162	1.4467	0.2239	1.4467	1.2028
No log	4.5556	164	1.4435	0.2239	1.4435	1.2014
No log	4.6111	166	1.6301	0.2110	1.6301	1.2767
No log	4.6667	168	1.8050	0.2007	1.8050	1.3435
No log	4.7222	170	1.7390	0.2053	1.7390	1.3187
No log	4.7778	172	1.7516	0.2419	1.7516	1.3235
No log	4.8333	174	1.7990	0.2494	1.7990	1.3413
No log	4.8889	176	2.0083	0.1659	2.0083	1.4171
No log	4.9444	178	2.0590	0.1442	2.0590	1.4349
No log	5.0	180	1.8508	0.2299	1.8508	1.3604
No log	5.0556	182	1.5828	0.2906	1.5828	1.2581
No log	5.1111	184	1.5032	0.2806	1.5032	1.2261
No log	5.1667	186	1.6476	0.2806	1.6476	1.2836
No log	5.2222	188	1.5634	0.2221	1.5634	1.2504
No log	5.2778	190	1.4202	0.1533	1.4202	1.1917
No log	5.3333	192	1.3054	0.1486	1.3054	1.1425
No log	5.3889	194	1.2772	0.1407	1.2772	1.1301
No log	5.4444	196	1.3302	0.1486	1.3302	1.1534
No log	5.5	198	1.5600	0.2170	1.5600	1.2490
No log	5.5556	200	1.8307	0.2565	1.8307	1.3530
No log	5.6111	202	1.9067	0.2182	1.9067	1.3808
No log	5.6667	204	1.7788	0.2784	1.7788	1.3337
No log	5.7222	206	1.5079	0.3177	1.5079	1.2279
No log	5.7778	208	1.4496	0.2974	1.4496	1.2040
No log	5.8333	210	1.6512	0.3123	1.6512	1.2850
No log	5.8889	212	1.6167	0.3066	1.6167	1.2715
No log	5.9444	214	1.3960	0.2568	1.3960	1.1815
No log	6.0	216	1.2670	0.2424	1.2670	1.1256
No log	6.0556	218	1.3238	0.2372	1.3238	1.1506
No log	6.1111	220	1.3819	0.2184	1.3819	1.1755
No log	6.1667	222	1.4127	0.2522	1.4127	1.1886
No log	6.2222	224	1.4762	0.2611	1.4762	1.2150
No log	6.2778	226	1.5727	0.3117	1.5727	1.2541
No log	6.3333	228	1.7969	0.2816	1.7969	1.3405
No log	6.3889	230	1.8976	0.1683	1.8976	1.3775
No log	6.4444	232	1.7619	0.2840	1.7619	1.3274
No log	6.5	234	1.4520	0.1407	1.4520	1.2050
No log	6.5556	236	1.2364	0.0	1.2364	1.1120
No log	6.6111	238	1.2030	0.0	1.2030	1.0968
No log	6.6667	240	1.2561	0.0	1.2561	1.1208
No log	6.7222	242	1.2407	0.0401	1.2407	1.1139
No log	6.7778	244	1.3411	0.2065	1.3411	1.1581
No log	6.8333	246	1.5314	0.2437	1.5314	1.2375
No log	6.8889	248	1.5747	0.2270	1.5747	1.2549
No log	6.9444	250	1.3968	0.2709	1.3968	1.1819
No log	7.0	252	1.2787	0.2446	1.2787	1.1308
No log	7.0556	254	1.2747	0.2389	1.2747	1.1290
No log	7.1111	256	1.4505	0.2869	1.4505	1.2044
No log	7.1667	258	1.7110	0.2906	1.7110	1.3080
No log	7.2222	260	1.7580	0.2681	1.7580	1.3259
No log	7.2778	262	1.6042	0.2566	1.6042	1.2666
No log	7.3333	264	1.4083	0.2239	1.4083	1.1867
No log	7.3889	266	1.3517	0.2126	1.3517	1.1626
No log	7.4444	268	1.3971	0.2292	1.3971	1.1820
No log	7.5	270	1.5144	0.2694	1.5144	1.2306
No log	7.5556	272	1.6875	0.2681	1.6875	1.2990
No log	7.6111	274	1.6672	0.2681	1.6672	1.2912
No log	7.6667	276	1.5153	0.2482	1.5153	1.2310
No log	7.7222	278	1.3947	0.2832	1.3947	1.1810
No log	7.7778	280	1.3999	0.2653	1.3999	1.1832
No log	7.8333	282	1.4498	0.2482	1.4498	1.2041
No log	7.8889	284	1.6547	0.3006	1.6547	1.2863
No log	7.9444	286	1.8794	0.1835	1.8794	1.3709
No log	8.0	288	1.9954	0.0981	1.9954	1.4126
No log	8.0556	290	1.9422	0.1305	1.9422	1.3936
No log	8.1111	292	1.7180	0.2527	1.7180	1.3107
No log	8.1667	294	1.5341	0.3018	1.5341	1.2386
No log	8.2222	296	1.3778	0.2474	1.3778	1.1738
No log	8.2778	298	1.3028	0.2424	1.3028	1.1414
No log	8.3333	300	1.3535	0.2752	1.3535	1.1634
No log	8.3889	302	1.4873	0.3018	1.4873	1.2195
No log	8.4444	304	1.6197	0.2681	1.6197	1.2727
No log	8.5	306	1.7190	0.2681	1.7190	1.3111
No log	8.5556	308	1.6524	0.2406	1.6524	1.2855
No log	8.6111	310	1.4767	0.2474	1.4767	1.2152
No log	8.6667	312	1.2868	0.2126	1.2868	1.1344
No log	8.7222	314	1.2230	0.0	1.2230	1.1059
No log	8.7778	316	1.2489	0.0	1.2489	1.1175
No log	8.8333	318	1.3301	0.1052	1.3301	1.1533
No log	8.8889	320	1.4181	0.2474	1.4181	1.1908
No log	8.9444	322	1.6022	0.2974	1.6022	1.2658
No log	9.0	324	1.8390	0.2967	1.8390	1.3561
No log	9.0556	326	1.9375	0.2598	1.9375	1.3920
No log	9.1111	328	1.8273	0.2636	1.8273	1.3518
No log	9.1667	330	1.6042	0.2869	1.6042	1.2666
No log	9.2222	332	1.3819	0.2065	1.3819	1.1755
No log	9.2778	334	1.2516	0.0401	1.2516	1.1188
No log	9.3333	336	1.1897	0.0	1.1897	1.0907
No log	9.3889	338	1.2135	0.0	1.2135	1.1016
No log	9.4444	340	1.2798	0.0	1.2798	1.1313
No log	9.5	342	1.3557	0.0781	1.3557	1.1643
No log	9.5556	344	1.4291	0.2474	1.4291	1.1955
No log	9.6111	346	1.5413	0.2906	1.5413	1.2415
No log	9.6667	348	1.7082	0.3095	1.7082	1.3070
No log	9.7222	350	1.8396	0.2996	1.8396	1.3563
No log	9.7778	352	1.7698	0.2996	1.7698	1.3303
No log	9.8333	354	1.6039	0.2681	1.6039	1.2665
No log	9.8889	356	1.5322	0.2363	1.5322	1.2378
No log	9.9444	358	1.5083	0.2653	1.5083	1.2281
No log	10.0	360	1.5742	0.3052	1.5742	1.2547
No log	10.0556	362	1.5679	0.2793	1.5679	1.2522
No log	10.1111	364	1.5263	0.2474	1.5263	1.2354
No log	10.1667	366	1.4548	0.2065	1.4548	1.2062
No log	10.2222	368	1.3862	0.0	1.3862	1.1774
No log	10.2778	370	1.4287	0.1744	1.4287	1.1953
No log	10.3333	372	1.5239	0.2474	1.5239	1.2345
No log	10.3889	374	1.5667	0.2869	1.5667	1.2517
No log	10.4444	376	1.5699	0.2733	1.5699	1.2530
No log	10.5	378	1.5059	0.2880	1.5059	1.2272
No log	10.5556	380	1.4103	0.2290	1.4103	1.1876
No log	10.6111	382	1.3641	0.2290	1.3641	1.1680
No log	10.6667	384	1.4641	0.2694	1.4641	1.2100
No log	10.7222	386	1.5213	0.2694	1.5213	1.2334
No log	10.7778	388	1.4905	0.2437	1.4905	1.2209
No log	10.8333	390	1.4015	0.2184	1.4015	1.1838
No log	10.8889	392	1.4003	0.2126	1.4003	1.1833
No log	10.9444	394	1.4633	0.2184	1.4633	1.2097
No log	11.0	396	1.4995	0.2184	1.4995	1.2245
No log	11.0556	398	1.6019	0.2568	1.6019	1.2657
No log	11.1111	400	1.6313	0.2611	1.6313	1.2772
No log	11.1667	402	1.5601	0.2292	1.5601	1.2490
No log	11.2222	404	1.4695	0.2184	1.4695	1.2122
No log	11.2778	406	1.4267	0.1744	1.4267	1.1945
No log	11.3333	408	1.4267	0.1744	1.4267	1.1944
No log	11.3889	410	1.4561	0.2065	1.4561	1.2067
No log	11.4444	412	1.4622	0.2065	1.4622	1.2092
No log	11.5	414	1.4977	0.2126	1.4977	1.2238
No log	11.5556	416	1.4822	0.2065	1.4822	1.2175
No log	11.6111	418	1.4133	0.1407	1.4133	1.1888
No log	11.6667	420	1.4018	0.0781	1.4018	1.1840
No log	11.7222	422	1.4189	0.0781	1.4189	1.1912
No log	11.7778	424	1.4320	0.1407	1.4320	1.1966
No log	11.8333	426	1.4152	0.1407	1.4152	1.1896
No log	11.8889	428	1.4729	0.2065	1.4729	1.2136
No log	11.9444	430	1.6033	0.2184	1.6033	1.2662
No log	12.0	432	1.6575	0.2474	1.6575	1.2874
No log	12.0556	434	1.6433	0.2522	1.6433	1.2819
No log	12.1111	436	1.5800	0.2065	1.5800	1.2570
No log	12.1667	438	1.4984	0.2065	1.4984	1.2241
No log	12.2222	440	1.4207	0.1744	1.4207	1.1920
No log	12.2778	442	1.4032	0.1407	1.4032	1.1846
No log	12.3333	444	1.3806	0.1407	1.3806	1.1750
No log	12.3889	446	1.4346	0.2065	1.4346	1.1978
No log	12.4444	448	1.4932	0.2424	1.4932	1.2220
No log	12.5	450	1.5766	0.2752	1.5766	1.2556
No log	12.5556	452	1.6869	0.3233	1.6869	1.2988
No log	12.6111	454	1.8263	0.2906	1.8263	1.3514
No log	12.6667	456	1.8431	0.2906	1.8431	1.3576
No log	12.7222	458	1.8703	0.2457	1.8703	1.3676
No log	12.7778	460	1.9067	0.1756	1.9067	1.3808
No log	12.8333	462	1.8448	0.2457	1.8448	1.3582
No log	12.8889	464	1.6890	0.3036	1.6890	1.2996
No log	12.9444	466	1.5310	0.2752	1.5310	1.2373
No log	13.0	468	1.4845	0.2474	1.4845	1.2184
No log	13.0556	470	1.4381	0.2474	1.4381	1.1992
No log	13.1111	472	1.4026	0.2474	1.4026	1.1843
No log	13.1667	474	1.3989	0.2474	1.3989	1.1828
No log	13.2222	476	1.2673	0.2184	1.2673	1.1257
No log	13.2778	478	1.2444	0.2184	1.2444	1.1155
No log	13.3333	480	1.2825	0.2184	1.2825	1.1325
No log	13.3889	482	1.3713	0.2184	1.3713	1.1710
No log	13.4444	484	1.4895	0.2126	1.4895	1.2204
No log	13.5	486	1.5630	0.2065	1.5630	1.2502
No log	13.5556	488	1.5557	0.1744	1.5557	1.2473
No log	13.6111	490	1.5091	0.1142	1.5091	1.2285
No log	13.6667	492	1.4152	0.0401	1.4152	1.1896
No log	13.7222	494	1.3889	0.0401	1.3889	1.1785
No log	13.7778	496	1.3835	0.0781	1.3835	1.1762
No log	13.8333	498	1.4242	0.2126	1.4242	1.1934
0.2543	13.8889	500	1.4848	0.2474	1.4848	1.2185
0.2543	13.9444	502	1.4536	0.2752	1.4536	1.2057
0.2543	14.0	504	1.3737	0.2474	1.3737	1.1720
0.2543	14.0556	506	1.3477	0.2474	1.3477	1.1609
0.2543	14.1111	508	1.3168	0.2474	1.3168	1.1475
0.2543	14.1667	510	1.3128	0.2372	1.3128	1.1458
0.2543	14.2222	512	1.3487	0.2372	1.3487	1.1613

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1