ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k5_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4700
• Qwk: 0.1700
• Mse: 1.4700
• Rmse: 1.2124

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	4.0800	0.0086	4.0800	2.0199
No log	0.3333	4	2.4496	-0.0040	2.4496	1.5651
No log	0.5	6	1.4813	0.0157	1.4813	1.2171
No log	0.6667	8	1.2831	0.1573	1.2831	1.1328
No log	0.8333	10	1.1310	0.1507	1.1310	1.0635
No log	1.0	12	1.2611	0.0770	1.2611	1.1230
No log	1.1667	14	1.0974	0.0712	1.0974	1.0476
No log	1.3333	16	1.0640	0.2591	1.0640	1.0315
No log	1.5	18	1.1145	0.1521	1.1145	1.0557
No log	1.6667	20	1.1460	0.1821	1.1460	1.0705
No log	1.8333	22	1.0730	0.1504	1.0730	1.0358
No log	2.0	24	1.0759	0.2618	1.0759	1.0372
No log	2.1667	26	1.1609	0.0462	1.1609	1.0774
No log	2.3333	28	1.2804	-0.0296	1.2804	1.1315
No log	2.5	30	1.1608	0.0225	1.1608	1.0774
No log	2.6667	32	1.0524	0.2667	1.0524	1.0258
No log	2.8333	34	1.0375	0.3198	1.0375	1.0186
No log	3.0	36	1.0267	0.3175	1.0267	1.0132
No log	3.1667	38	1.0604	0.2217	1.0604	1.0297
No log	3.3333	40	1.2086	0.0318	1.2086	1.0994
No log	3.5	42	1.1836	0.0436	1.1836	1.0880
No log	3.6667	44	1.0327	0.3117	1.0327	1.0162
No log	3.8333	46	1.0491	0.1389	1.0491	1.0243
No log	4.0	48	1.1004	0.1504	1.1004	1.0490
No log	4.1667	50	1.2414	0.0553	1.2414	1.1142
No log	4.3333	52	1.3055	-0.0180	1.3055	1.1426
No log	4.5	54	1.3020	0.0232	1.3020	1.1411
No log	4.6667	56	1.1647	0.0380	1.1647	1.0792
No log	4.8333	58	1.2082	0.0380	1.2082	1.0992
No log	5.0	60	1.2436	0.0380	1.2436	1.1152
No log	5.1667	62	1.1398	0.0996	1.1398	1.0676
No log	5.3333	64	1.0519	0.3001	1.0519	1.0256
No log	5.5	66	1.0677	0.1926	1.0677	1.0333
No log	5.6667	68	1.0813	0.1771	1.0813	1.0399
No log	5.8333	70	1.0660	0.2518	1.0660	1.0325
No log	6.0	72	1.0578	0.2467	1.0578	1.0285
No log	6.1667	74	1.0442	0.2187	1.0442	1.0218
No log	6.3333	76	1.0159	0.2544	1.0159	1.0079
No log	6.5	78	1.0358	0.1727	1.0358	1.0178
No log	6.6667	80	0.9822	0.2416	0.9822	0.9911
No log	6.8333	82	0.9653	0.2569	0.9653	0.9825
No log	7.0	84	1.0038	0.2108	1.0038	1.0019
No log	7.1667	86	1.0789	0.2512	1.0789	1.0387
No log	7.3333	88	1.1173	0.0924	1.1173	1.0570
No log	7.5	90	1.1223	0.1407	1.1223	1.0594
No log	7.6667	92	1.1592	0.2864	1.1592	1.0766
No log	7.8333	94	1.1774	0.2471	1.1774	1.0851
No log	8.0	96	1.2340	0.2062	1.2340	1.1108
No log	8.1667	98	1.2664	0.2438	1.2664	1.1254
No log	8.3333	100	1.4429	0.2809	1.4429	1.2012
No log	8.5	102	1.6288	0.2414	1.6288	1.2763
No log	8.6667	104	1.5564	0.2395	1.5564	1.2475
No log	8.8333	106	1.4380	0.1756	1.4380	1.1992
No log	9.0	108	1.5052	0.2732	1.5052	1.2269
No log	9.1667	110	1.6046	0.2435	1.6046	1.2667
No log	9.3333	112	1.3366	0.2931	1.3366	1.1561
No log	9.5	114	1.0535	0.2820	1.0535	1.0264
No log	9.6667	116	1.0081	0.3024	1.0081	1.0040
No log	9.8333	118	1.0874	0.3059	1.0874	1.0428
No log	10.0	120	1.4501	0.3165	1.4501	1.2042
No log	10.1667	122	1.6890	0.1950	1.6890	1.2996
No log	10.3333	124	1.6899	0.1892	1.6899	1.3000
No log	10.5	126	1.5256	0.2117	1.5256	1.2352
No log	10.6667	128	1.1233	0.1676	1.1233	1.0598
No log	10.8333	130	1.0290	0.1826	1.0290	1.0144
No log	11.0	132	1.1558	0.0894	1.1558	1.0751
No log	11.1667	134	1.4380	0.2315	1.4380	1.1992
No log	11.3333	136	1.5412	0.0370	1.5412	1.2415
No log	11.5	138	1.5549	0.0973	1.5549	1.2469
No log	11.6667	140	1.5939	0.2164	1.5939	1.2625
No log	11.8333	142	1.6515	0.1982	1.6515	1.2851
No log	12.0	144	1.7059	0.1689	1.7059	1.3061
No log	12.1667	146	1.6268	0.1776	1.6268	1.2755
No log	12.3333	148	1.6979	0.2025	1.6979	1.3030
No log	12.5	150	1.7829	0.1462	1.7829	1.3353
No log	12.6667	152	1.6843	0.2170	1.6843	1.2978
No log	12.8333	154	1.3452	0.3215	1.3452	1.1598
No log	13.0	156	1.0983	0.2680	1.0983	1.0480
No log	13.1667	158	1.1521	0.3149	1.1521	1.0733
No log	13.3333	160	1.5269	0.2857	1.5269	1.2357
No log	13.5	162	1.6022	0.1717	1.6022	1.2658
No log	13.6667	164	1.4836	0.1850	1.4836	1.2180
No log	13.8333	166	1.4090	0.2240	1.4090	1.1870
No log	14.0	168	1.2373	0.2816	1.2373	1.1124
No log	14.1667	170	1.1201	0.2355	1.1201	1.0583
No log	14.3333	172	1.1946	0.3326	1.1946	1.0930
No log	14.5	174	1.3085	0.2772	1.3085	1.1439
No log	14.6667	176	1.3337	0.3409	1.3337	1.1549
No log	14.8333	178	1.4518	0.3038	1.4518	1.2049
No log	15.0	180	1.6387	0.1717	1.6387	1.2801
No log	15.1667	182	1.6450	0.1717	1.6450	1.2826
No log	15.3333	184	1.4922	0.1792	1.4922	1.2215
No log	15.5	186	1.2596	0.2917	1.2596	1.1223
No log	15.6667	188	1.3077	0.2570	1.3077	1.1435
No log	15.8333	190	1.4603	0.2555	1.4603	1.2084
No log	16.0	192	1.5406	0.2240	1.5406	1.2412
No log	16.1667	194	1.4469	0.2240	1.4469	1.2029
No log	16.3333	196	1.4326	0.2555	1.4326	1.1969
No log	16.5	198	1.3702	0.2187	1.3702	1.1706
No log	16.6667	200	1.3187	0.2187	1.3187	1.1484
No log	16.8333	202	1.3599	0.2465	1.3599	1.1661
No log	17.0	204	1.4677	0.2417	1.4677	1.2115
No log	17.1667	206	1.5435	0.1379	1.5435	1.2424
No log	17.3333	208	1.5090	0.2417	1.5090	1.2284
No log	17.5	210	1.3947	0.2623	1.3947	1.1810
No log	17.6667	212	1.3644	0.2964	1.3644	1.1681
No log	17.8333	214	1.5272	0.2417	1.5272	1.2358
No log	18.0	216	1.5934	0.1850	1.5934	1.2623
No log	18.1667	218	1.6061	0.2511	1.6061	1.2673
No log	18.3333	220	1.4160	0.2690	1.4160	1.1899
No log	18.5	222	1.2260	0.2284	1.2260	1.1073
No log	18.6667	224	1.2619	0.1886	1.2619	1.1233
No log	18.8333	226	1.3604	0.2315	1.3604	1.1664
No log	19.0	228	1.3710	0.2075	1.3710	1.1709
No log	19.1667	230	1.3704	0.2132	1.3704	1.1707
No log	19.3333	232	1.3229	0.2132	1.3229	1.1502
No log	19.5	234	1.2604	0.2686	1.2604	1.1227
No log	19.6667	236	1.3371	0.2672	1.3371	1.1563
No log	19.8333	238	1.3722	0.2924	1.3722	1.1714
No log	20.0	240	1.3807	0.2924	1.3807	1.1750
No log	20.1667	242	1.4849	0.2888	1.4849	1.2186
No log	20.3333	244	1.5684	0.3084	1.5684	1.2523
No log	20.5	246	1.6963	0.2209	1.6963	1.3024
No log	20.6667	248	1.6267	0.2315	1.6267	1.2754
No log	20.8333	250	1.5035	0.2924	1.5035	1.2262
No log	21.0	252	1.3892	0.2531	1.3892	1.1786
No log	21.1667	254	1.3221	0.2337	1.3221	1.1498
No log	21.3333	256	1.3703	0.2315	1.3703	1.1706
No log	21.5	258	1.4509	0.2315	1.4509	1.2045
No log	21.6667	260	1.4251	0.2015	1.4251	1.1938
No log	21.8333	262	1.3513	0.1966	1.3513	1.1624
No log	22.0	264	1.2864	0.1774	1.2864	1.1342
No log	22.1667	266	1.3252	0.1619	1.3252	1.1512
No log	22.3333	268	1.4466	0.1792	1.4466	1.2028
No log	22.5	270	1.5636	0.2543	1.5636	1.2504
No log	22.6667	272	1.7243	0.2666	1.7243	1.3131
No log	22.8333	274	1.7043	0.2978	1.7043	1.3055
No log	23.0	276	1.5890	0.3084	1.5890	1.2606
No log	23.1667	278	1.3678	0.2026	1.3678	1.1695
No log	23.3333	280	1.2989	0.1658	1.2989	1.1397
No log	23.5	282	1.3739	0.1658	1.3739	1.1721
No log	23.6667	284	1.4433	0.2132	1.4433	1.2014
No log	23.8333	286	1.5058	0.2417	1.5058	1.2271
No log	24.0	288	1.5176	0.2417	1.5176	1.2319
No log	24.1667	290	1.4753	0.1792	1.4753	1.2146
No log	24.3333	292	1.4929	0.1487	1.4929	1.2218
No log	24.5	294	1.5291	0.1792	1.5291	1.2366
No log	24.6667	296	1.5801	0.2015	1.5801	1.2570
No log	24.8333	298	1.6767	0.1850	1.6767	1.2949
No log	25.0	300	1.6721	0.1850	1.6721	1.2931
No log	25.1667	302	1.5522	0.2417	1.5522	1.2459
No log	25.3333	304	1.4431	0.2315	1.4431	1.2013
No log	25.5	306	1.4510	0.2132	1.4510	1.2046
No log	25.6667	308	1.4598	0.2417	1.4598	1.2082
No log	25.8333	310	1.5471	0.2240	1.5471	1.2438
No log	26.0	312	1.6964	0.2223	1.6964	1.3024
No log	26.1667	314	1.7142	0.3143	1.7142	1.3093
No log	26.3333	316	1.5487	0.3053	1.5487	1.2445
No log	26.5	318	1.3615	0.2465	1.3615	1.1668
No log	26.6667	320	1.2882	0.2602	1.2882	1.1350
No log	26.8333	322	1.3065	0.2315	1.3065	1.1430
No log	27.0	324	1.3700	0.2555	1.3700	1.1705
No log	27.1667	326	1.4160	0.1562	1.4160	1.1900
No log	27.3333	328	1.4229	0.0454	1.4229	1.1929
No log	27.5	330	1.4198	0.2837	1.4198	1.1915
No log	27.6667	332	1.3628	0.2417	1.3628	1.1674
No log	27.8333	334	1.2799	0.2132	1.2799	1.1313
No log	28.0	336	1.2396	0.2132	1.2396	1.1134
No log	28.1667	338	1.3222	0.2465	1.3222	1.1499
No log	28.3333	340	1.5534	0.3084	1.5534	1.2464
No log	28.5	342	1.7149	0.3386	1.7149	1.3096
No log	28.6667	344	1.6593	0.3513	1.6593	1.2881
No log	28.8333	346	1.5393	0.2809	1.5393	1.2407
No log	29.0	348	1.4215	0.2132	1.4215	1.1923
No log	29.1667	350	1.2956	0.2132	1.2956	1.1383
No log	29.3333	352	1.2304	0.2315	1.2304	1.1093
No log	29.5	354	1.2164	0.2260	1.2164	1.1029
No log	29.6667	356	1.2485	0.2555	1.2485	1.1174
No log	29.8333	358	1.2766	0.2555	1.2766	1.1299
No log	30.0	360	1.2912	0.2623	1.2912	1.1363
No log	30.1667	362	1.2818	0.2707	1.2818	1.1322
No log	30.3333	364	1.3067	0.2707	1.3067	1.1431
No log	30.5	366	1.3509	0.2337	1.3509	1.1623
No log	30.6667	368	1.3965	0.2337	1.3965	1.1817
No log	30.8333	370	1.4239	0.2260	1.4239	1.1933
No log	31.0	372	1.3797	0.2260	1.3797	1.1746
No log	31.1667	374	1.2752	0.0931	1.2752	1.1292
No log	31.3333	376	1.1859	0.0160	1.1859	1.0890
No log	31.5	378	1.1837	0.0160	1.1837	1.0880
No log	31.6667	380	1.2176	0.0160	1.2176	1.1035
No log	31.8333	382	1.3203	0.1976	1.3203	1.1490
No log	32.0	384	1.4071	0.2337	1.4071	1.1862
No log	32.1667	386	1.4593	0.2209	1.4593	1.2080
No log	32.3333	388	1.5448	0.2531	1.5448	1.2429
No log	32.5	390	1.6238	0.2555	1.6238	1.2743
No log	32.6667	392	1.6353	0.2809	1.6353	1.2788
No log	32.8333	394	1.5320	0.2555	1.5320	1.2377
No log	33.0	396	1.3372	0.1288	1.3372	1.1564
No log	33.1667	398	1.2537	0.0160	1.2537	1.1197
No log	33.3333	400	1.2892	0.0160	1.2892	1.1354
No log	33.5	402	1.4090	0.0931	1.4090	1.1870
No log	33.6667	404	1.5977	0.2555	1.5977	1.2640
No log	33.8333	406	1.6920	0.2731	1.6920	1.3008
No log	34.0	408	1.6662	0.2731	1.6662	1.2908
No log	34.1667	410	1.5829	0.2915	1.5829	1.2581
No log	34.3333	412	1.4806	0.1700	1.4806	1.2168
No log	34.5	414	1.3722	0.1952	1.3722	1.1714
No log	34.6667	416	1.3305	0.2260	1.3305	1.1535
No log	34.8333	418	1.3922	0.1952	1.3922	1.1799
No log	35.0	420	1.4572	0.1952	1.4572	1.2072
No log	35.1667	422	1.4428	0.1952	1.4428	1.2012
No log	35.3333	424	1.3503	0.2555	1.3503	1.1620
No log	35.5	426	1.1973	0.2592	1.1973	1.0942
No log	35.6667	428	1.0817	0.2960	1.0817	1.0401
No log	35.8333	430	1.1169	0.2728	1.1169	1.0568
No log	36.0	432	1.1977	0.2203	1.1977	1.0944
No log	36.1667	434	1.3116	0.0661	1.3116	1.1452
No log	36.3333	436	1.3844	0.0661	1.3844	1.1766
No log	36.5	438	1.3707	0.0661	1.3707	1.1708
No log	36.6667	440	1.3303	0.0661	1.3303	1.1534
No log	36.8333	442	1.3123	0.1370	1.3123	1.1456
No log	37.0	444	1.3311	0.2203	1.3311	1.1537
No log	37.1667	446	1.3761	0.2015	1.3761	1.1731
No log	37.3333	448	1.4488	0.2132	1.4488	1.2037
No log	37.5	450	1.4537	0.2417	1.4537	1.2057
No log	37.6667	452	1.3653	0.2417	1.3653	1.1685
No log	37.8333	454	1.3277	0.2315	1.3277	1.1523
No log	38.0	456	1.4023	0.2417	1.4023	1.1842
No log	38.1667	458	1.4690	0.2187	1.4690	1.2120
No log	38.3333	460	1.4602	0.2132	1.4602	1.2084
No log	38.5	462	1.4246	0.2260	1.4246	1.1935
No log	38.6667	464	1.3857	0.1024	1.3857	1.1771
No log	38.8333	466	1.3785	0.0661	1.3785	1.1741
No log	39.0	468	1.4160	0.1024	1.4160	1.1900
No log	39.1667	470	1.4557	0.2260	1.4557	1.2065
No log	39.3333	472	1.4311	0.2260	1.4311	1.1963
No log	39.5	474	1.4169	0.2315	1.4169	1.1903
No log	39.6667	476	1.3650	0.2260	1.3650	1.1683
No log	39.8333	478	1.3953	0.2315	1.3953	1.1812
No log	40.0	480	1.4715	0.2602	1.4715	1.2130
No log	40.1667	482	1.5243	0.2465	1.5243	1.2346
No log	40.3333	484	1.4744	0.2647	1.4744	1.2143
No log	40.5	486	1.3893	0.2602	1.3893	1.1787
No log	40.6667	488	1.3216	0.2260	1.3216	1.1496
No log	40.8333	490	1.2621	0.2203	1.2621	1.1234
No log	41.0	492	1.2834	0.2283	1.2834	1.1329
No log	41.1667	494	1.3958	0.2667	1.3958	1.1814
No log	41.3333	496	1.5100	0.2465	1.5100	1.2288
No log	41.5	498	1.5442	0.2465	1.5442	1.2426
0.2891	41.6667	500	1.4912	0.2075	1.4912	1.2212
0.2891	41.8333	502	1.4030	0.2260	1.4030	1.1845
0.2891	42.0	504	1.3611	0.2260	1.3611	1.1667
0.2891	42.1667	506	1.3327	0.2260	1.3327	1.1544
0.2891	42.3333	508	1.3105	0.1700	1.3105	1.1448
0.2891	42.5	510	1.3269	0.1024	1.3269	1.1519
0.2891	42.6667	512	1.3966	0.1024	1.3966	1.1818
0.2891	42.8333	514	1.4580	0.1024	1.4580	1.2075
0.2891	43.0	516	1.4700	0.1700	1.4700	1.2124

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1