ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2288
• Qwk: 0.0
• Mse: 1.2288
• Rmse: 1.1085

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	4.0158	0.0034	4.0158	2.0039
No log	0.0930	4	2.2748	0.0271	2.2748	1.5083
No log	0.1395	6	1.6688	0.0329	1.6688	1.2918
No log	0.1860	8	1.2346	0.0967	1.2346	1.1111
No log	0.2326	10	1.1925	0.0731	1.1925	1.0920
No log	0.2791	12	1.1109	0.2150	1.1109	1.0540
No log	0.3256	14	1.0932	0.1884	1.0932	1.0456
No log	0.3721	16	1.2148	0.0380	1.2148	1.1022
No log	0.4186	18	1.2750	0.0	1.2750	1.1292
No log	0.4651	20	1.1496	0.0760	1.1496	1.0722
No log	0.5116	22	1.1357	0.1379	1.1357	1.0657
No log	0.5581	24	1.1803	0.1333	1.1803	1.0864
No log	0.6047	26	1.1167	0.1981	1.1167	1.0568
No log	0.6512	28	1.1559	0.0445	1.1559	1.0751
No log	0.6977	30	1.2187	0.0445	1.2187	1.1039
No log	0.7442	32	1.2232	0.0445	1.2232	1.1060
No log	0.7907	34	1.1709	0.1643	1.1709	1.0821
No log	0.8372	36	1.1800	0.0792	1.1800	1.0863
No log	0.8837	38	1.3732	-0.0296	1.3732	1.1719
No log	0.9302	40	1.6117	0.0143	1.6117	1.2695
No log	0.9767	42	1.7119	0.0143	1.7119	1.3084
No log	1.0233	44	1.5533	0.0	1.5533	1.2463
No log	1.0698	46	1.4371	-0.0148	1.4371	1.1988
No log	1.1163	48	1.1990	0.0701	1.1990	1.0950
No log	1.1628	50	1.0921	0.2239	1.0921	1.0450
No log	1.2093	52	1.2033	0.0102	1.2033	1.0969
No log	1.2558	54	1.2896	-0.1560	1.2896	1.1356
No log	1.3023	56	1.4626	-0.0326	1.4626	1.2094
No log	1.3488	58	1.3772	-0.0022	1.3772	1.1735
No log	1.3953	60	1.2187	0.1361	1.2187	1.1040
No log	1.4419	62	1.2426	0.0374	1.2426	1.1147
No log	1.4884	64	1.2838	0.0999	1.2838	1.1330
No log	1.5349	66	1.2161	0.0700	1.2161	1.1028
No log	1.5814	68	1.1278	0.2692	1.1278	1.0620
No log	1.6279	70	1.1283	0.1725	1.1283	1.0622
No log	1.6744	72	1.0934	0.2366	1.0934	1.0456
No log	1.7209	74	1.0742	0.1783	1.0742	1.0364
No log	1.7674	76	1.1562	0.1389	1.1562	1.0752
No log	1.8140	78	1.4371	-0.0641	1.4371	1.1988
No log	1.8605	80	1.4812	-0.0641	1.4812	1.2171
No log	1.9070	82	1.4368	-0.0641	1.4368	1.1987
No log	1.9535	84	1.2691	-0.0091	1.2691	1.1266
No log	2.0	86	1.2183	0.0542	1.2183	1.1038
No log	2.0465	88	1.2777	0.0188	1.2777	1.1304
No log	2.0930	90	1.4962	-0.1067	1.4962	1.2232
No log	2.1395	92	1.5524	-0.0747	1.5524	1.2460
No log	2.1860	94	1.3420	0.0587	1.3420	1.1585
No log	2.2326	96	1.1766	0.0164	1.1766	1.0847
No log	2.2791	98	1.1748	0.0164	1.1748	1.0839
No log	2.3256	100	1.3960	0.0464	1.3960	1.1815
No log	2.3721	102	1.7947	-0.1843	1.7947	1.3397
No log	2.4186	104	1.9849	-0.3093	1.9849	1.4089
No log	2.4651	106	1.9655	-0.1443	1.9655	1.4020
No log	2.5116	108	1.7718	-0.0788	1.7718	1.3311
No log	2.5581	110	1.5684	-0.0167	1.5684	1.2524
No log	2.6047	112	1.6681	-0.0688	1.6681	1.2916
No log	2.6512	114	1.8768	-0.1179	1.8768	1.3700
No log	2.6977	116	2.0265	-0.1122	2.0265	1.4236
No log	2.7442	118	2.0327	-0.1111	2.0327	1.4257
No log	2.7907	120	2.0567	-0.1154	2.0567	1.4341
No log	2.8372	122	1.8254	-0.0655	1.8254	1.3511
No log	2.8837	124	1.5249	-0.0735	1.5249	1.2349
No log	2.9302	126	1.7057	-0.1078	1.7057	1.3060
No log	2.9767	128	2.0800	-0.2156	2.0800	1.4422
No log	3.0233	130	2.3606	-0.2661	2.3606	1.5364
No log	3.0698	132	2.2816	-0.1571	2.2816	1.5105
No log	3.1163	134	2.0213	-0.1658	2.0213	1.4217
No log	3.1628	136	1.9379	-0.1254	1.9379	1.3921
No log	3.2093	138	1.8792	-0.0892	1.8792	1.3708
No log	3.2558	140	1.8788	-0.0849	1.8788	1.3707
No log	3.3023	142	1.7651	-0.0762	1.7651	1.3286
No log	3.3488	144	1.5874	0.0294	1.5874	1.2599
No log	3.3953	146	1.5857	0.0294	1.5857	1.2593
No log	3.4419	148	1.6411	0.0279	1.6411	1.2810
No log	3.4884	150	1.7297	-0.0267	1.7297	1.3152
No log	3.5349	152	1.7574	-0.0757	1.7574	1.3257
No log	3.5814	154	1.7628	-0.0397	1.7628	1.3277
No log	3.6279	156	1.7589	-0.0508	1.7589	1.3262
No log	3.6744	158	1.7224	-0.0378	1.7224	1.3124
No log	3.7209	160	1.7568	-0.0514	1.7568	1.3254
No log	3.7674	162	1.8652	0.0726	1.8652	1.3657
No log	3.8140	164	1.9175	0.0402	1.9175	1.3847
No log	3.8605	166	1.8288	0.0400	1.8288	1.3523
No log	3.9070	168	1.8386	0.0562	1.8386	1.3559
No log	3.9535	170	1.8316	0.1342	1.8316	1.3534
No log	4.0	172	1.6490	0.2105	1.6490	1.2842
No log	4.0465	174	1.5040	0.1282	1.5040	1.2264
No log	4.0930	176	1.4472	0.1198	1.4472	1.2030
No log	4.1395	178	1.4452	0.0270	1.4452	1.2022
No log	4.1860	180	1.5266	0.0809	1.5266	1.2356
No log	4.2326	182	1.7969	0.1525	1.7969	1.3405
No log	4.2791	184	1.8888	0.2098	1.8888	1.3744
No log	4.3256	186	1.7524	0.1663	1.7524	1.3238
No log	4.3721	188	1.5118	0.2342	1.5118	1.2296
No log	4.4186	190	1.4063	0.0946	1.4063	1.1859
No log	4.4651	192	1.4720	0.1911	1.4720	1.2133
No log	4.5116	194	1.4943	0.1423	1.4943	1.2224
No log	4.5581	196	1.4577	0.1423	1.4577	1.2073
No log	4.6047	198	1.3969	0.0602	1.3969	1.1819
No log	4.6512	200	1.3910	0.1110	1.3910	1.1794
No log	4.6977	202	1.4709	0.1110	1.4709	1.2128
No log	4.7442	204	1.5518	0.1423	1.5518	1.2457
No log	4.7907	206	1.5587	0.1027	1.5587	1.2485
No log	4.8372	208	1.5567	0.1027	1.5567	1.2477
No log	4.8837	210	1.5407	0.1423	1.5407	1.2413
No log	4.9302	212	1.4965	0.1904	1.4965	1.2233
No log	4.9767	214	1.3997	0.1943	1.3997	1.1831
No log	5.0233	216	1.3739	0.2126	1.3739	1.1721
No log	5.0698	218	1.4697	0.2292	1.4697	1.2123
No log	5.1163	220	1.4313	0.2015	1.4313	1.1964
No log	5.1628	222	1.4067	0.2203	1.4067	1.1860
No log	5.2093	224	1.4171	0.1886	1.4171	1.1904
No log	5.2558	226	1.5312	0.2117	1.5312	1.2374
No log	5.3023	228	1.7132	0.2058	1.7132	1.3089
No log	5.3488	230	1.7432	0.2206	1.7432	1.3203
No log	5.3953	232	1.7312	0.1963	1.7312	1.3158
No log	5.4419	234	1.7061	0.2389	1.7061	1.3062
No log	5.4884	236	1.5999	0.1461	1.5999	1.2649
No log	5.5349	238	1.5428	0.1911	1.5428	1.2421
No log	5.5814	240	1.3937	0.1142	1.3937	1.1806
No log	5.6279	242	1.3014	0.1052	1.3014	1.1408
No log	5.6744	244	1.2485	0.1052	1.2485	1.1174
No log	5.7209	246	1.2400	0.0401	1.2400	1.1136
No log	5.7674	248	1.2161	0.0401	1.2161	1.1028
No log	5.8140	250	1.1670	0.0556	1.1670	1.0803
No log	5.8605	252	1.1944	0.0155	1.1944	1.0929
No log	5.9070	254	1.3146	0.0781	1.3146	1.1466
No log	5.9535	256	1.5336	0.1880	1.5336	1.2384
No log	6.0	258	1.6128	0.2465	1.6128	1.2700
No log	6.0465	260	1.5854	0.2465	1.5854	1.2591
No log	6.0930	262	1.5079	0.1966	1.5079	1.2280
No log	6.1395	264	1.4465	0.1886	1.4465	1.2027
No log	6.1860	266	1.4232	0.2027	1.4232	1.1930
No log	6.2326	268	1.3952	0.2027	1.3952	1.1812
No log	6.2791	270	1.3799	0.2027	1.3799	1.1747
No log	6.3256	272	1.3777	0.2089	1.3777	1.1738
No log	6.3721	274	1.4345	0.2203	1.4345	1.1977
No log	6.4186	276	1.4906	0.2555	1.4906	1.2209
No log	6.4651	278	1.6231	0.2771	1.6231	1.2740
No log	6.5116	280	1.6548	0.2270	1.6548	1.2864
No log	6.5581	282	1.4900	0.1058	1.4900	1.2207
No log	6.6047	284	1.4021	0.0781	1.4021	1.1841
No log	6.6512	286	1.4033	0.0781	1.4033	1.1846
No log	6.6977	288	1.4786	0.2315	1.4786	1.2160
No log	6.7442	290	1.4991	0.2915	1.4991	1.2244
No log	6.7907	292	1.4009	0.2455	1.4009	1.1836
No log	6.8372	294	1.3681	0.2455	1.3681	1.1697
No log	6.8837	296	1.3522	0.2455	1.3522	1.1628
No log	6.9302	298	1.3574	0.2506	1.3574	1.1651
No log	6.9767	300	1.4005	0.2506	1.4005	1.1834
No log	7.0233	302	1.4022	0.2203	1.4022	1.1841
No log	7.0698	304	1.3696	0.1886	1.3696	1.1703
No log	7.1163	306	1.3437	0.1886	1.3437	1.1592
No log	7.1628	308	1.3611	0.1886	1.3611	1.1667
No log	7.2093	310	1.4336	0.2260	1.4336	1.1973
No log	7.2558	312	1.4199	0.1886	1.4199	1.1916
No log	7.3023	314	1.3951	0.1886	1.3951	1.1811
No log	7.3488	316	1.3180	0.1316	1.3180	1.1481
No log	7.3953	318	1.3180	0.1548	1.3180	1.1480
No log	7.4419	320	1.4264	0.1980	1.4264	1.1943
No log	7.4884	322	1.7047	0.2315	1.7047	1.3057
No log	7.5349	324	1.7725	0.2116	1.7725	1.3313
No log	7.5814	326	1.6272	0.2363	1.6272	1.2756
No log	7.6279	328	1.5210	0.2395	1.5210	1.2333
No log	7.6744	330	1.4116	0.2027	1.4116	1.1881
No log	7.7209	332	1.3019	0.1622	1.3019	1.1410
No log	7.7674	334	1.2722	0.1622	1.2722	1.1279
No log	7.8140	336	1.3118	0.1473	1.3118	1.1453
No log	7.8605	338	1.3846	0.1886	1.3846	1.1767
No log	7.9070	340	1.3764	0.1886	1.3764	1.1732
No log	7.9535	342	1.3974	0.1886	1.3974	1.1821
No log	8.0	344	1.4388	0.2506	1.4388	1.1995
No log	8.0465	346	1.4310	0.2126	1.4310	1.1962
No log	8.0930	348	1.4688	0.2424	1.4688	1.2119
No log	8.1395	350	1.4365	0.2424	1.4365	1.1986
No log	8.1860	352	1.3914	0.1814	1.3914	1.1796
No log	8.2326	354	1.3864	0.1814	1.3864	1.1775
No log	8.2791	356	1.3512	0.1552	1.3512	1.1624
No log	8.3256	358	1.3229	0.1473	1.3229	1.1502
No log	8.3721	360	1.3194	0.1552	1.3194	1.1486
No log	8.4186	362	1.3151	0.1552	1.3151	1.1468
No log	8.4651	364	1.4077	0.2640	1.4077	1.1865
No log	8.5116	366	1.5515	0.2223	1.5515	1.2456
No log	8.5581	368	1.6437	0.1978	1.6437	1.2821
No log	8.6047	370	1.7347	0.2414	1.7347	1.3171
No log	8.6512	372	1.8221	0.2224	1.8221	1.3499
No log	8.6977	374	1.6633	0.2481	1.6633	1.2897
No log	8.7442	376	1.4077	0.1898	1.4077	1.1865
No log	8.7907	378	1.3061	0.0931	1.3061	1.1428
No log	8.8372	380	1.2222	0.0160	1.2222	1.1055
No log	8.8837	382	1.2155	0.0160	1.2155	1.1025
No log	8.9302	384	1.2623	0.0445	1.2623	1.1235
No log	8.9767	386	1.3885	0.1552	1.3885	1.1783
No log	9.0233	388	1.4957	0.2795	1.4957	1.2230
No log	9.0698	390	1.3858	0.2640	1.3858	1.1772
No log	9.1163	392	1.2752	0.1961	1.2752	1.1293
No log	9.1628	394	1.2226	0.1961	1.2226	1.1057
No log	9.2093	396	1.1909	0.1697	1.1909	1.0913
No log	9.2558	398	1.1800	0.1552	1.1800	1.0863
No log	9.3023	400	1.1418	0.1202	1.1418	1.0686
No log	9.3488	402	1.1663	0.1552	1.1663	1.0800
No log	9.3953	404	1.1681	0.1552	1.1681	1.0808
No log	9.4419	406	1.2341	0.1552	1.2341	1.1109
No log	9.4884	408	1.3670	0.2647	1.3670	1.1692
No log	9.5349	410	1.4327	0.2465	1.4327	1.1970
No log	9.5814	412	1.4405	0.2465	1.4405	1.2002
No log	9.6279	414	1.4134	0.2602	1.4134	1.1889
No log	9.6744	416	1.3585	0.2506	1.3585	1.1656
No log	9.7209	418	1.3508	0.1886	1.3508	1.1623
No log	9.7674	420	1.3591	0.1952	1.3591	1.1658
No log	9.8140	422	1.3131	0.1952	1.3131	1.1459
No log	9.8605	424	1.3215	0.1886	1.3215	1.1496
No log	9.9070	426	1.4130	0.2506	1.4130	1.1887
No log	9.9535	428	1.3922	0.1310	1.3922	1.1799
No log	10.0	430	1.4431	0.1428	1.4431	1.2013
No log	10.0465	432	1.5592	0.2117	1.5592	1.2487
No log	10.0930	434	1.5122	0.2292	1.5122	1.2297
No log	10.1395	436	1.4766	0.2647	1.4766	1.2151
No log	10.1860	438	1.3397	0.2315	1.3397	1.1574
No log	10.2326	440	1.2819	0.1886	1.2819	1.1322
No log	10.2791	442	1.2954	0.1700	1.2954	1.1381
No log	10.3256	444	1.3657	0.2315	1.3657	1.1686
No log	10.3721	446	1.4421	0.2315	1.4421	1.2009
No log	10.4186	448	1.4492	0.2015	1.4492	1.2038
No log	10.4651	450	1.3858	0.1202	1.3858	1.1772
No log	10.5116	452	1.3957	0.0833	1.3957	1.1814
No log	10.5581	454	1.4324	0.0833	1.4324	1.1968
No log	10.6047	456	1.5332	0.1552	1.5332	1.2382
No log	10.6512	458	1.5961	0.1952	1.5961	1.2634
No log	10.6977	460	1.6255	0.1595	1.6255	1.2750
No log	10.7442	462	1.5482	0.1634	1.5482	1.2443
No log	10.7907	464	1.4990	0.1407	1.4990	1.2243
No log	10.8372	466	1.4643	0.1473	1.4643	1.2101
No log	10.8837	468	1.4725	0.1407	1.4725	1.2135
No log	10.9302	470	1.4109	0.0781	1.4109	1.1878
No log	10.9767	472	1.3841	0.1142	1.3841	1.1765
No log	11.0233	474	1.4789	0.2239	1.4789	1.2161
No log	11.0698	476	1.5078	0.2126	1.5078	1.2279
No log	11.1163	478	1.5220	0.1486	1.5220	1.2337
No log	11.1628	480	1.4774	0.1552	1.4774	1.2155
No log	11.2093	482	1.4310	0.1486	1.4310	1.1962
No log	11.2558	484	1.4349	0.2424	1.4349	1.1979
No log	11.3023	486	1.3930	0.2424	1.3930	1.1803
No log	11.3488	488	1.3830	0.2126	1.3830	1.1760
No log	11.3953	490	1.3882	0.1407	1.3882	1.1782
No log	11.4419	492	1.3933	0.1473	1.3933	1.1804
No log	11.4884	494	1.3616	0.1473	1.3616	1.1669
No log	11.5349	496	1.3209	0.1473	1.3209	1.1493
No log	11.5814	498	1.2735	0.0401	1.2735	1.1285
0.3529	11.6279	500	1.2606	0.0401	1.2606	1.1228
0.3529	11.6744	502	1.2457	0.0401	1.2457	1.1161
0.3529	11.7209	504	1.2800	0.0401	1.2800	1.1314
0.3529	11.7674	506	1.3705	0.1052	1.3705	1.1707
0.3529	11.8140	508	1.4245	0.1351	1.4245	1.1935
0.3529	11.8605	510	1.4236	0.1351	1.4236	1.1932
0.3529	11.9070	512	1.4686	0.1142	1.4686	1.2118
0.3529	11.9535	514	1.5206	0.2126	1.5206	1.2331
0.3529	12.0	516	1.4949	0.2126	1.4949	1.2226
0.3529	12.0465	518	1.4517	0.1562	1.4517	1.2048
0.3529	12.0930	520	1.4807	0.2126	1.4807	1.2169
0.3529	12.1395	522	1.5059	0.2239	1.5059	1.2272
0.3529	12.1860	524	1.6043	0.2391	1.6043	1.2666
0.3529	12.2326	526	1.5695	0.2391	1.5695	1.2528
0.3529	12.2791	528	1.4159	0.2424	1.4159	1.1899
0.3529	12.3256	530	1.3219	0.1486	1.3219	1.1497
0.3529	12.3721	532	1.3401	0.2065	1.3401	1.1576
0.3529	12.4186	534	1.3882	0.2424	1.3882	1.1782
0.3529	12.4651	536	1.3911	0.2126	1.3911	1.1795
0.3529	12.5116	538	1.3736	0.2506	1.3736	1.1720
0.3529	12.5581	540	1.3963	0.2424	1.3963	1.1816
0.3529	12.6047	542	1.4377	0.2709	1.4377	1.1990
0.3529	12.6512	544	1.3851	0.2126	1.3851	1.1769
0.3529	12.6977	546	1.3814	0.2126	1.3814	1.1753
0.3529	12.7442	548	1.4161	0.2424	1.4161	1.1900
0.3529	12.7907	550	1.4834	0.2690	1.4834	1.2180
0.3529	12.8372	552	1.5133	0.2731	1.5133	1.2302
0.3529	12.8837	554	1.4658	0.2690	1.4658	1.2107
0.3529	12.9302	556	1.3921	0.2315	1.3921	1.1799
0.3529	12.9767	558	1.3701	0.2506	1.3701	1.1705
0.3529	13.0233	560	1.4052	0.2795	1.4052	1.1854
0.3529	13.0698	562	1.4930	0.2602	1.4930	1.2219
0.3529	13.1163	564	1.5950	0.2731	1.5950	1.2629
0.3529	13.1628	566	1.6690	0.3232	1.6690	1.2919
0.3529	13.2093	568	1.6193	0.3172	1.6193	1.2725
0.3529	13.2558	570	1.5363	0.2752	1.5363	1.2395
0.3529	13.3023	572	1.4229	0.0833	1.4229	1.1928
0.3529	13.3488	574	1.3506	0.0833	1.3506	1.1622
0.3529	13.3953	576	1.3492	0.0833	1.3492	1.1616
0.3529	13.4419	578	1.3896	0.0833	1.3896	1.1788
0.3529	13.4884	580	1.4283	0.0781	1.4283	1.1951
0.3529	13.5349	582	1.4724	0.1142	1.4724	1.2134
0.3529	13.5814	584	1.4633	0.1142	1.4633	1.2097
0.3529	13.6279	586	1.4614	0.1142	1.4614	1.2089
0.3529	13.6744	588	1.4658	0.1486	1.4658	1.2107
0.3529	13.7209	590	1.4604	0.1228	1.4604	1.2085
0.3529	13.7674	592	1.3979	0.1228	1.3979	1.1823
0.3529	13.8140	594	1.3791	0.1228	1.3791	1.1744
0.3529	13.8605	596	1.4188	0.2126	1.4188	1.1911
0.3529	13.9070	598	1.4513	0.2709	1.4513	1.2047
0.3529	13.9535	600	1.4620	0.2709	1.4620	1.2092
0.3529	14.0	602	1.3948	0.2424	1.3948	1.1810
0.3529	14.0465	604	1.3774	0.2126	1.3774	1.1736
0.3529	14.0930	606	1.3843	0.2424	1.3843	1.1765
0.3529	14.1395	608	1.3777	0.1814	1.3777	1.1738
0.3529	14.1860	610	1.3095	0.0781	1.3095	1.1443
0.3529	14.2326	612	1.2472	0.0401	1.2472	1.1168
0.3529	14.2791	614	1.2122	0.0401	1.2122	1.1010
0.3529	14.3256	616	1.1979	0.0	1.1979	1.0945
0.3529	14.3721	618	1.2415	0.0401	1.2415	1.1142
0.3529	14.4186	620	1.2917	0.0781	1.2917	1.1365
0.3529	14.4651	622	1.3478	0.1310	1.3478	1.1609
0.3529	14.5116	624	1.4031	0.1634	1.4031	1.1845
0.3529	14.5581	626	1.4545	0.2522	1.4545	1.2060
0.3529	14.6047	628	1.4968	0.2522	1.4968	1.2234
0.3529	14.6512	630	1.5350	0.2522	1.5350	1.2389
0.3529	14.6977	632	1.5023	0.2239	1.5023	1.2257
0.3529	14.7442	634	1.3888	0.0401	1.3888	1.1785
0.3529	14.7907	636	1.2818	0.0	1.2818	1.1322
0.3529	14.8372	638	1.2042	0.0	1.2042	1.0974
0.3529	14.8837	640	1.1860	0.0	1.1860	1.0890
0.3529	14.9302	642	1.2288	0.0	1.2288	1.1085

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1