ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2923
• Qwk: 0.0401
• Mse: 1.2923
• Rmse: 1.1368

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	4.0158	0.0034	4.0158	2.0039
No log	0.0930	4	2.2748	0.0271	2.2748	1.5083
No log	0.1395	6	1.6688	0.0329	1.6688	1.2918
No log	0.1860	8	1.2346	0.0967	1.2346	1.1111
No log	0.2326	10	1.1925	0.0731	1.1925	1.0920
No log	0.2791	12	1.1109	0.2150	1.1109	1.0540
No log	0.3256	14	1.0932	0.1884	1.0932	1.0456
No log	0.3721	16	1.2148	0.0380	1.2148	1.1022
No log	0.4186	18	1.2750	0.0	1.2750	1.1292
No log	0.4651	20	1.1496	0.0760	1.1496	1.0722
No log	0.5116	22	1.1357	0.1379	1.1357	1.0657
No log	0.5581	24	1.1803	0.1333	1.1803	1.0864
No log	0.6047	26	1.1167	0.1981	1.1167	1.0568
No log	0.6512	28	1.1559	0.0445	1.1559	1.0751
No log	0.6977	30	1.2187	0.0445	1.2187	1.1039
No log	0.7442	32	1.2232	0.0445	1.2232	1.1060
No log	0.7907	34	1.1709	0.1643	1.1709	1.0821
No log	0.8372	36	1.1800	0.0792	1.1800	1.0863
No log	0.8837	38	1.3732	-0.0296	1.3732	1.1718
No log	0.9302	40	1.6117	0.0143	1.6117	1.2695
No log	0.9767	42	1.7119	0.0143	1.7119	1.3084
No log	1.0233	44	1.5533	0.0	1.5533	1.2463
No log	1.0698	46	1.4371	-0.0148	1.4371	1.1988
No log	1.1163	48	1.1990	0.0701	1.1990	1.0950
No log	1.1628	50	1.0921	0.2239	1.0921	1.0450
No log	1.2093	52	1.2033	0.0102	1.2033	1.0969
No log	1.2558	54	1.2896	-0.1560	1.2896	1.1356
No log	1.3023	56	1.4626	-0.0326	1.4626	1.2094
No log	1.3488	58	1.3772	-0.0022	1.3772	1.1735
No log	1.3953	60	1.2187	0.1361	1.2187	1.1040
No log	1.4419	62	1.2426	0.0374	1.2426	1.1147
No log	1.4884	64	1.2838	0.0999	1.2838	1.1330
No log	1.5349	66	1.2161	0.0700	1.2161	1.1028
No log	1.5814	68	1.1278	0.2692	1.1278	1.0620
No log	1.6279	70	1.1283	0.1725	1.1283	1.0622
No log	1.6744	72	1.0934	0.2366	1.0934	1.0456
No log	1.7209	74	1.0742	0.1783	1.0742	1.0364
No log	1.7674	76	1.1561	0.1389	1.1561	1.0752
No log	1.8140	78	1.4370	-0.0641	1.4370	1.1988
No log	1.8605	80	1.4812	-0.0641	1.4812	1.2170
No log	1.9070	82	1.4368	-0.0641	1.4368	1.1987
No log	1.9535	84	1.2691	-0.0091	1.2691	1.1266
No log	2.0	86	1.2183	0.0542	1.2183	1.1038
No log	2.0465	88	1.2777	0.0188	1.2777	1.1304
No log	2.0930	90	1.4962	-0.1067	1.4962	1.2232
No log	2.1395	92	1.5525	-0.0747	1.5525	1.2460
No log	2.1860	94	1.3421	0.0587	1.3421	1.1585
No log	2.2326	96	1.1766	0.0164	1.1766	1.0847
No log	2.2791	98	1.1748	0.0164	1.1748	1.0839
No log	2.3256	100	1.3959	0.0464	1.3959	1.1815
No log	2.3721	102	1.7946	-0.1843	1.7946	1.3396
No log	2.4186	104	1.9849	-0.3093	1.9849	1.4089
No log	2.4651	106	1.9655	-0.1443	1.9655	1.4020
No log	2.5116	108	1.7718	-0.0788	1.7718	1.3311
No log	2.5581	110	1.5685	-0.0167	1.5685	1.2524
No log	2.6047	112	1.6681	-0.0688	1.6681	1.2915
No log	2.6512	114	1.8767	-0.1179	1.8767	1.3699
No log	2.6977	116	2.0265	-0.1122	2.0265	1.4235
No log	2.7442	118	2.0327	-0.1111	2.0327	1.4257
No log	2.7907	120	2.0567	-0.1154	2.0567	1.4341
No log	2.8372	122	1.8256	-0.0655	1.8256	1.3511
No log	2.8837	124	1.5249	-0.0735	1.5249	1.2349
No log	2.9302	126	1.7056	-0.1078	1.7056	1.3060
No log	2.9767	128	2.0800	-0.2156	2.0800	1.4422
No log	3.0233	130	2.3606	-0.2661	2.3606	1.5364
No log	3.0698	132	2.2817	-0.1571	2.2817	1.5105
No log	3.1163	134	2.0214	-0.1658	2.0214	1.4218
No log	3.1628	136	1.9381	-0.1254	1.9381	1.3922
No log	3.2093	138	1.8794	-0.0892	1.8794	1.3709
No log	3.2558	140	1.8790	-0.0849	1.8790	1.3708
No log	3.3023	142	1.7652	-0.0762	1.7652	1.3286
No log	3.3488	144	1.5875	0.0294	1.5875	1.2600
No log	3.3953	146	1.5859	0.0294	1.5859	1.2593
No log	3.4419	148	1.6412	0.0279	1.6412	1.2811
No log	3.4884	150	1.7297	-0.0267	1.7297	1.3152
No log	3.5349	152	1.7574	-0.0757	1.7574	1.3257
No log	3.5814	154	1.7627	-0.0397	1.7627	1.3277
No log	3.6279	156	1.7590	-0.0508	1.7590	1.3263
No log	3.6744	158	1.7226	-0.0709	1.7226	1.3125
No log	3.7209	160	1.7571	-0.0514	1.7571	1.3255
No log	3.7674	162	1.8651	0.0726	1.8651	1.3657
No log	3.8140	164	1.9178	0.0402	1.9178	1.3848
No log	3.8605	166	1.8295	0.0400	1.8295	1.3526
No log	3.9070	168	1.8388	0.0562	1.8388	1.3560
No log	3.9535	170	1.8312	0.1342	1.8312	1.3532
No log	4.0	172	1.6488	0.2105	1.6488	1.2841
No log	4.0465	174	1.5039	0.1282	1.5039	1.2263
No log	4.0930	176	1.4472	0.1198	1.4472	1.2030
No log	4.1395	178	1.4438	0.0270	1.4438	1.2016
No log	4.1860	180	1.5245	0.0809	1.5245	1.2347
No log	4.2326	182	1.7945	0.1525	1.7945	1.3396
No log	4.2791	184	1.8868	0.2098	1.8868	1.3736
No log	4.3256	186	1.7519	0.1663	1.7519	1.3236
No log	4.3721	188	1.5123	0.2342	1.5123	1.2298
No log	4.4186	190	1.4055	0.0946	1.4055	1.1855
No log	4.4651	192	1.4700	0.1911	1.4700	1.2124
No log	4.5116	194	1.4920	0.1423	1.4920	1.2215
No log	4.5581	196	1.4560	0.1423	1.4560	1.2067
No log	4.6047	198	1.3958	0.0602	1.3958	1.1815
No log	4.6512	200	1.3918	0.1110	1.3918	1.1797
No log	4.6977	202	1.4725	0.1110	1.4725	1.2135
No log	4.7442	204	1.5527	0.1423	1.5527	1.2461
No log	4.7907	206	1.5577	0.1027	1.5577	1.2481
No log	4.8372	208	1.5542	0.1027	1.5542	1.2467
No log	4.8837	210	1.5371	0.1423	1.5371	1.2398
No log	4.9302	212	1.4930	0.1904	1.4930	1.2219
No log	4.9767	214	1.3998	0.1943	1.3998	1.1831
No log	5.0233	216	1.3669	0.2126	1.3669	1.1692
No log	5.0698	218	1.4563	0.2239	1.4563	1.2068
No log	5.1163	220	1.4184	0.2203	1.4184	1.1910
No log	5.1628	222	1.4032	0.2203	1.4032	1.1846
No log	5.2093	224	1.4234	0.1886	1.4234	1.1931
No log	5.2558	226	1.5342	0.2062	1.5342	1.2386
No log	5.3023	228	1.7152	0.2058	1.7152	1.3096
No log	5.3488	230	1.7465	0.2159	1.7465	1.3216
No log	5.3953	232	1.7388	0.1847	1.7388	1.3186
No log	5.4419	234	1.7177	0.2037	1.7177	1.3106
No log	5.4884	236	1.5929	0.1461	1.5929	1.2621
No log	5.5349	238	1.5233	0.1911	1.5233	1.2342
No log	5.5814	240	1.3727	0.1052	1.3727	1.1716
No log	5.6279	242	1.2763	0.1052	1.2763	1.1297
No log	5.6744	244	1.2254	0.0401	1.2254	1.1070
No log	5.7209	246	1.2271	0.0401	1.2271	1.1077
No log	5.7674	248	1.2152	0.0401	1.2152	1.1024
No log	5.8140	250	1.1823	0.0556	1.1823	1.0873
No log	5.8605	252	1.2305	0.0	1.2305	1.1093
No log	5.9070	254	1.3563	0.0401	1.3563	1.1646
No log	5.9535	256	1.5399	0.1880	1.5399	1.2409
No log	6.0	258	1.5874	0.2315	1.5874	1.2599
No log	6.0465	260	1.5458	0.1966	1.5458	1.2433
No log	6.0930	262	1.4816	0.1966	1.4816	1.2172
No log	6.1395	264	1.4256	0.1886	1.4256	1.1940
No log	6.1860	266	1.4040	0.1886	1.4040	1.1849
No log	6.2326	268	1.3947	0.1434	1.3947	1.1810
No log	6.2791	270	1.4113	0.1886	1.4113	1.1880
No log	6.3256	272	1.4185	0.2203	1.4185	1.1910
No log	6.3721	274	1.4255	0.2015	1.4255	1.1940
No log	6.4186	276	1.4421	0.2315	1.4421	1.2009
No log	6.4651	278	1.5226	0.2731	1.5226	1.2339
No log	6.5116	280	1.5173	0.2952	1.5173	1.2318
No log	6.5581	282	1.3784	0.1816	1.3784	1.1741
No log	6.6047	284	1.3181	0.0833	1.3181	1.1481
No log	6.6512	286	1.3230	0.0833	1.3230	1.1502
No log	6.6977	288	1.3580	0.1816	1.3580	1.1653
No log	6.7442	290	1.3819	0.2143	1.3819	1.1755
No log	6.7907	292	1.3575	0.2506	1.3575	1.1651
No log	6.8372	294	1.3322	0.2506	1.3322	1.1542
No log	6.8837	296	1.2927	0.2506	1.2927	1.1369
No log	6.9302	298	1.2496	0.2203	1.2496	1.1179
No log	6.9767	300	1.2524	0.1886	1.2524	1.1191
No log	7.0233	302	1.2781	0.1886	1.2781	1.1305
No log	7.0698	304	1.4067	0.2417	1.4067	1.1860
No log	7.1163	306	1.5485	0.2771	1.5485	1.2444
No log	7.1628	308	1.5858	0.3020	1.5858	1.2593
No log	7.2093	310	1.6114	0.2987	1.6114	1.2694
No log	7.2558	312	1.4916	0.2602	1.4916	1.2213
No log	7.3023	314	1.4367	0.2315	1.4367	1.1986
No log	7.3488	316	1.4423	0.1595	1.4423	1.2009
No log	7.3953	318	1.4696	0.1958	1.4696	1.2123
No log	7.4419	320	1.5664	0.2690	1.5664	1.2515
No log	7.4884	322	1.5865	0.2731	1.5865	1.2596
No log	7.5349	324	1.5387	0.3107	1.5387	1.2404
No log	7.5814	326	1.3827	0.2203	1.3827	1.1759
No log	7.6279	328	1.3455	0.2203	1.3455	1.1600
No log	7.6744	330	1.3509	0.2203	1.3509	1.1623
No log	7.7209	332	1.3117	0.2143	1.3117	1.1453
No log	7.7674	334	1.3095	0.2143	1.3095	1.1443
No log	7.8140	336	1.2653	0.1816	1.2653	1.1249
No log	7.8605	338	1.2822	0.1816	1.2822	1.1323
No log	7.9070	340	1.3041	0.1961	1.3041	1.1420
No log	7.9535	342	1.4134	0.2027	1.4134	1.1889
No log	8.0	344	1.6333	0.2987	1.6333	1.2780
No log	8.0465	346	1.8143	0.2252	1.8143	1.3470
No log	8.0930	348	1.7698	0.2474	1.7698	1.3304
No log	8.1395	350	1.5678	0.2239	1.5678	1.2521
No log	8.1860	352	1.3718	0.0401	1.3718	1.1712
No log	8.2326	354	1.2656	0.0833	1.2656	1.1250
No log	8.2791	356	1.2403	0.0401	1.2403	1.1137
No log	8.3256	358	1.3532	0.0781	1.3532	1.1633
No log	8.3721	360	1.5357	0.2126	1.5357	1.2392
No log	8.4186	362	1.6544	0.2568	1.6544	1.2862
No log	8.4651	364	1.6464	0.2391	1.6464	1.2831
No log	8.5116	366	1.5570	0.2522	1.5570	1.2478
No log	8.5581	368	1.5089	0.2555	1.5089	1.2284
No log	8.6047	370	1.5168	0.2690	1.5168	1.2316
No log	8.6512	372	1.5308	0.1880	1.5308	1.2373
No log	8.6977	374	1.5079	0.0781	1.5079	1.2280
No log	8.7442	376	1.4155	0.0	1.4155	1.1897
No log	8.7907	378	1.3810	0.0	1.3810	1.1752
No log	8.8372	380	1.2840	-0.0375	1.2840	1.1331
No log	8.8837	382	1.3222	0.0033	1.3222	1.1499
No log	8.9302	384	1.5521	0.2291	1.5521	1.2458
No log	8.9767	386	1.7264	0.3084	1.7264	1.3139
No log	9.0233	388	1.6544	0.2987	1.6544	1.2862
No log	9.0698	390	1.4743	0.2495	1.4743	1.2142
No log	9.1163	392	1.3437	0.1230	1.3437	1.1592
No log	9.1628	394	1.3353	0.2284	1.3353	1.1555
No log	9.2093	396	1.3253	0.1622	1.3253	1.1512
No log	9.2558	398	1.2764	0.0987	1.2764	1.1298
No log	9.3023	400	1.2300	0.0833	1.2300	1.1090
No log	9.3488	402	1.2650	0.0	1.2650	1.1247
No log	9.3953	404	1.3456	0.0401	1.3456	1.1600
No log	9.4419	406	1.4712	0.1407	1.4712	1.2130
No log	9.4884	408	1.5939	0.1943	1.5939	1.2625
No log	9.5349	410	1.6439	0.2522	1.6439	1.2822
No log	9.5814	412	1.5823	0.2239	1.5823	1.2579
No log	9.6279	414	1.4812	0.1595	1.4812	1.2170
No log	9.6744	416	1.4949	0.1595	1.4949	1.2227
No log	9.7209	418	1.5644	0.2126	1.5644	1.2508
No log	9.7674	420	1.6255	0.1769	1.6255	1.2749
No log	9.8140	422	1.5442	0.0889	1.5442	1.2427
No log	9.8605	424	1.4701	-0.0054	1.4701	1.2125
No log	9.9070	426	1.3881	0.0342	1.3881	1.1782
No log	9.9535	428	1.2467	0.0833	1.2467	1.1166
No log	10.0	430	1.2026	0.0433	1.2026	1.0966
No log	10.0465	432	1.2536	0.0433	1.2536	1.1196
No log	10.0930	434	1.3629	0.2126	1.3629	1.1674
No log	10.1395	436	1.4862	0.1943	1.4862	1.2191
No log	10.1860	438	1.4690	0.1943	1.4690	1.2120
No log	10.2326	440	1.3796	0.2126	1.3796	1.1746
No log	10.2791	442	1.2641	0.0401	1.2641	1.1243
No log	10.3256	444	1.2315	0.0833	1.2315	1.1097
No log	10.3721	446	1.2732	0.0833	1.2732	1.1284
No log	10.4186	448	1.3231	0.0833	1.3231	1.1502
No log	10.4651	450	1.3849	0.1473	1.3849	1.1768
No log	10.5116	452	1.4104	0.1473	1.4104	1.1876
No log	10.5581	454	1.4238	0.1473	1.4238	1.1932
No log	10.6047	456	1.4082	0.1473	1.4082	1.1867
No log	10.6512	458	1.3841	0.0833	1.3841	1.1765
No log	10.6977	460	1.3275	0.0833	1.3275	1.1522
No log	10.7442	462	1.3188	0.0833	1.3188	1.1484
No log	10.7907	464	1.3399	0.0833	1.3399	1.1576
No log	10.8372	466	1.3945	0.1473	1.3945	1.1809
No log	10.8837	468	1.4864	0.1552	1.4864	1.2192
No log	10.9302	470	1.4975	0.1886	1.4975	1.2237
No log	10.9767	472	1.4815	0.1886	1.4815	1.2172
No log	11.0233	474	1.4117	0.1310	1.4117	1.1881
No log	11.0698	476	1.2998	0.0760	1.2998	1.1401
No log	11.1163	478	1.2905	0.1142	1.2905	1.1360
No log	11.1628	480	1.3166	0.1744	1.3166	1.1474
No log	11.2093	482	1.3275	0.1814	1.3275	1.1522
No log	11.2558	484	1.3906	0.2126	1.3906	1.1792
No log	11.3023	486	1.3680	0.2126	1.3680	1.1696
No log	11.3488	488	1.3236	0.2203	1.3236	1.1505
No log	11.3953	490	1.3095	0.1816	1.3095	1.1443
No log	11.4419	492	1.3273	0.1473	1.3273	1.1521
No log	11.4884	494	1.2982	0.1816	1.2982	1.1394
No log	11.5349	496	1.2053	0.1142	1.2053	1.0979
No log	11.5814	498	1.1060	0.1697	1.1060	1.0517
0.3524	11.6279	500	1.0573	0.1842	1.0573	1.0283
0.3524	11.6744	502	1.1592	0.2686	1.1592	1.0767
0.3524	11.7209	504	1.2972	0.2239	1.2972	1.1389
0.3524	11.7674	506	1.4665	0.2653	1.4665	1.2110
0.3524	11.8140	508	1.5383	0.2611	1.5383	1.2403
0.3524	11.8605	510	1.4547	0.1943	1.4547	1.2061
0.3524	11.9070	512	1.3097	0.0401	1.3097	1.1444
0.3524	11.9535	514	1.2572	0.0	1.2572	1.1213
0.3524	12.0	516	1.2290	0.0	1.2290	1.1086
0.3524	12.0465	518	1.2347	0.0	1.2347	1.1112
0.3524	12.0930	520	1.2923	0.0401	1.2923	1.1368

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1