ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4932
• Qwk: 0.1462
• Mse: 1.4932
• Rmse: 1.2220

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0230	2	4.6499	0.0010	4.6499	2.1564
No log	0.0460	4	2.5955	-0.0285	2.5955	1.6111
No log	0.0690	6	2.0620	-0.0370	2.0620	1.4360
No log	0.0920	8	1.7169	0.0681	1.7169	1.3103
No log	0.1149	10	1.6569	-0.0838	1.6569	1.2872
No log	0.1379	12	1.5420	-0.0581	1.5420	1.2418
No log	0.1609	14	1.5222	-0.0417	1.5222	1.2338
No log	0.1839	16	1.6110	-0.0859	1.6110	1.2692
No log	0.2069	18	1.4815	-0.0071	1.4815	1.2172
No log	0.2299	20	1.4633	-0.0759	1.4633	1.2097
No log	0.2529	22	1.3935	0.0571	1.3935	1.1805
No log	0.2759	24	1.4253	0.0454	1.4253	1.1938
No log	0.2989	26	1.4467	0.0454	1.4467	1.2028
No log	0.3218	28	1.4194	0.0454	1.4194	1.1914
No log	0.3448	30	1.4018	0.0253	1.4018	1.1840
No log	0.3678	32	1.3967	0.0945	1.3967	1.1818
No log	0.3908	34	1.4061	0.0300	1.4061	1.1858
No log	0.4138	36	1.3606	0.0750	1.3606	1.1665
No log	0.4368	38	1.3145	0.1242	1.3145	1.1465
No log	0.4598	40	1.3407	0.1109	1.3407	1.1579
No log	0.4828	42	1.3725	0.1612	1.3725	1.1715
No log	0.5057	44	1.5311	0.0687	1.5311	1.2374
No log	0.5287	46	1.4234	0.1267	1.4234	1.1930
No log	0.5517	48	1.4899	0.0380	1.4899	1.2206
No log	0.5747	50	1.4833	-0.0020	1.4833	1.2179
No log	0.5977	52	1.4344	0.0	1.4344	1.1977
No log	0.6207	54	1.4012	0.1150	1.4012	1.1837
No log	0.6437	56	1.4177	0.1396	1.4177	1.1907
No log	0.6667	58	1.3790	0.0723	1.3790	1.1743
No log	0.6897	60	1.3868	0.1050	1.3868	1.1776
No log	0.7126	62	1.3783	0.0993	1.3783	1.1740
No log	0.7356	64	1.4896	0.2010	1.4896	1.2205
No log	0.7586	66	1.6282	0.2179	1.6282	1.2760
No log	0.7816	68	1.4743	0.2122	1.4743	1.2142
No log	0.8046	70	1.4760	0.1765	1.4760	1.2149
No log	0.8276	72	1.5948	0.2126	1.5948	1.2629
No log	0.8506	74	1.7450	0.1322	1.7450	1.3210
No log	0.8736	76	1.8149	0.1525	1.8149	1.3472
No log	0.8966	78	1.6427	0.1900	1.6427	1.2817
No log	0.9195	80	1.6505	0.1688	1.6505	1.2847
No log	0.9425	82	1.8099	0.0801	1.8099	1.3453
No log	0.9655	84	1.5436	0.1908	1.5436	1.2424
No log	0.9885	86	1.8385	0.1693	1.8385	1.3559
No log	1.0115	88	1.8931	0.0978	1.8931	1.3759
No log	1.0345	90	1.6605	0.1345	1.6605	1.2886
No log	1.0575	92	1.4870	0.0454	1.4870	1.2194
No log	1.0805	94	1.3548	0.0454	1.3548	1.1640
No log	1.1034	96	1.2838	0.0671	1.2838	1.1331
No log	1.1264	98	1.3000	0.1786	1.3000	1.1402
No log	1.1494	100	1.3160	0.1530	1.3160	1.1472
No log	1.1724	102	1.3269	0.0427	1.3269	1.1519
No log	1.1954	104	1.4134	0.0253	1.4134	1.1889
No log	1.2184	106	1.5271	0.0628	1.5271	1.2358
No log	1.2414	108	1.5788	0.0168	1.5788	1.2565
No log	1.2644	110	1.4830	0.0940	1.4830	1.2178
No log	1.2874	112	1.5276	0.0555	1.5276	1.2360
No log	1.3103	114	1.5340	0.0444	1.5340	1.2385
No log	1.3333	116	1.6904	-0.0417	1.6904	1.3002
No log	1.3563	118	1.7466	0.0136	1.7466	1.3216
No log	1.3793	120	1.6698	0.1050	1.6698	1.2922
No log	1.4023	122	1.6354	0.0263	1.6354	1.2788
No log	1.4253	124	1.6341	-0.0095	1.6341	1.2783
No log	1.4483	126	1.7114	0.0639	1.7114	1.3082
No log	1.4713	128	1.8345	0.0395	1.8345	1.3544
No log	1.4943	130	1.7805	-0.0008	1.7805	1.3344
No log	1.5172	132	1.6995	-0.0129	1.6995	1.3037
No log	1.5402	134	1.7335	-0.0107	1.7335	1.3166
No log	1.5632	136	1.7713	-0.0822	1.7713	1.3309
No log	1.5862	138	1.6979	0.0189	1.6979	1.3030
No log	1.6092	140	1.7052	-0.0426	1.7052	1.3058
No log	1.6322	142	1.6265	0.0177	1.6265	1.2754
No log	1.6552	144	1.5344	-0.0054	1.5344	1.2387
No log	1.6782	146	1.5397	0.1624	1.5397	1.2409
No log	1.7011	148	1.6442	0.1037	1.6442	1.2823
No log	1.7241	150	1.7438	0.0920	1.7438	1.3205
No log	1.7471	152	1.7317	0.1021	1.7317	1.3159
No log	1.7701	154	1.7088	0.1787	1.7088	1.3072
No log	1.7931	156	1.6957	0.1327	1.6957	1.3022
No log	1.8161	158	1.8030	0.1627	1.8030	1.3428
No log	1.8391	160	1.8315	0.0754	1.8315	1.3533
No log	1.8621	162	1.6998	-0.0112	1.6998	1.3038
No log	1.8851	164	1.6444	-0.0533	1.6444	1.2823
No log	1.9080	166	1.6813	0.0132	1.6813	1.2966
No log	1.9310	168	1.7328	0.0681	1.7328	1.3164
No log	1.9540	170	1.7696	0.0208	1.7696	1.3302
No log	1.9770	172	1.8772	0.0337	1.8772	1.3701
No log	2.0	174	1.9129	0.0168	1.9129	1.3831
No log	2.0230	176	2.0849	0.0125	2.0849	1.4439
No log	2.0460	178	2.1220	0.0338	2.1220	1.4567
No log	2.0690	180	1.8087	0.1071	1.8087	1.3449
No log	2.0920	182	1.7086	0.1017	1.7086	1.3071
No log	2.1149	184	1.7478	0.1327	1.7478	1.3220
No log	2.1379	186	1.8704	0.0639	1.8704	1.3676
No log	2.1609	188	1.8467	0.0023	1.8467	1.3589
No log	2.1839	190	1.8504	-0.0441	1.8504	1.3603
No log	2.2069	192	1.9258	0.0682	1.9258	1.3877
No log	2.2299	194	2.1301	0.0127	2.1301	1.4595
No log	2.2529	196	2.1444	-0.0031	2.1444	1.4644
No log	2.2759	198	2.2342	0.0229	2.2342	1.4947
No log	2.2989	200	2.4161	0.0150	2.4161	1.5544
No log	2.3218	202	2.1985	0.0489	2.1985	1.4827
No log	2.3448	204	1.8871	-0.0094	1.8871	1.3737
No log	2.3678	206	1.6889	0.0331	1.6889	1.2996
No log	2.3908	208	1.5833	-0.0207	1.5833	1.2583
No log	2.4138	210	1.5813	-0.0207	1.5813	1.2575
No log	2.4368	212	1.5898	0.0326	1.5898	1.2609
No log	2.4598	214	1.6734	0.0181	1.6734	1.2936
No log	2.4828	216	1.6978	0.0181	1.6978	1.3030
No log	2.5057	218	1.6124	0.0871	1.6124	1.2698
No log	2.5287	220	1.6350	0.1166	1.6350	1.2787
No log	2.5517	222	1.7433	0.1003	1.7433	1.3203
No log	2.5747	224	1.8517	0.0144	1.8517	1.3608
No log	2.5977	226	1.8321	-0.0164	1.8321	1.3535
No log	2.6207	228	1.6933	0.0700	1.6933	1.3013
No log	2.6437	230	1.5550	0.0857	1.5550	1.2470
No log	2.6667	232	1.5016	0.0780	1.5016	1.2254
No log	2.6897	234	1.5797	0.0778	1.5797	1.2569
No log	2.7126	236	1.7123	-0.0728	1.7123	1.3085
No log	2.7356	238	1.6687	-0.0396	1.6687	1.2918
No log	2.7586	240	1.5103	0.0270	1.5103	1.2290
No log	2.7816	242	1.4288	0.0427	1.4288	1.1953
No log	2.8046	244	1.3735	0.1110	1.3735	1.1719
No log	2.8276	246	1.4115	0.1442	1.4115	1.1881
No log	2.8506	248	1.6156	0.1570	1.6156	1.2710
No log	2.8736	250	1.9250	-0.0338	1.9250	1.3875
No log	2.8966	252	2.0015	0.0459	2.0015	1.4148
No log	2.9195	254	1.8430	0.0767	1.8430	1.3576
No log	2.9425	256	1.5780	0.1143	1.5780	1.2562
No log	2.9655	258	1.4578	0.1037	1.4578	1.2074
No log	2.9885	260	1.4644	0.1541	1.4644	1.2101
No log	3.0115	262	1.4744	0.0427	1.4744	1.2143
No log	3.0345	264	1.5635	0.1053	1.5635	1.2504
No log	3.0575	266	1.7211	-0.0174	1.7211	1.3119
No log	3.0805	268	1.8887	-0.0081	1.8887	1.3743
No log	3.1034	270	1.9556	0.0995	1.9556	1.3984
No log	3.1264	272	1.9449	0.0446	1.9449	1.3946
No log	3.1494	274	2.0719	0.0653	2.0719	1.4394
No log	3.1724	276	2.0695	0.0605	2.0695	1.4386
No log	3.1954	278	1.8568	0.0828	1.8568	1.3627
No log	3.2184	280	1.6814	0.1079	1.6814	1.2967
No log	3.2414	282	1.6059	0.1280	1.6059	1.2673
No log	3.2644	284	1.5342	0.1722	1.5342	1.2386
No log	3.2874	286	1.5205	0.1449	1.5205	1.2331
No log	3.3103	288	1.4967	0.1995	1.4967	1.2234
No log	3.3333	290	1.4517	0.1465	1.4517	1.2049
No log	3.3563	292	1.4536	0.1465	1.4536	1.2057
No log	3.3793	294	1.5215	0.2173	1.5215	1.2335
No log	3.4023	296	1.6372	0.2275	1.6372	1.2795
No log	3.4253	298	1.6403	0.1929	1.6403	1.2807
No log	3.4483	300	1.5484	0.2371	1.5484	1.2444
No log	3.4713	302	1.5835	0.2405	1.5835	1.2584
No log	3.4943	304	1.7207	0.1353	1.7207	1.3118
No log	3.5172	306	1.9162	0.1012	1.9162	1.3843
No log	3.5402	308	1.9378	0.1135	1.9378	1.3920
No log	3.5632	310	1.8269	0.1260	1.8269	1.3516
No log	3.5862	312	1.6579	0.1416	1.6579	1.2876
No log	3.6092	314	1.6347	0.1580	1.6347	1.2786
No log	3.6322	316	1.7049	0.1674	1.7049	1.3057
No log	3.6552	318	1.6473	0.1580	1.6473	1.2835
No log	3.6782	320	1.6247	0.1929	1.6247	1.2746
No log	3.7011	322	1.7510	0.1498	1.7510	1.3233
No log	3.7241	324	1.8447	0.1641	1.8447	1.3582
No log	3.7471	326	1.8136	0.1565	1.8136	1.3467
No log	3.7701	328	1.6034	0.1929	1.6034	1.2663
No log	3.7931	330	1.5111	0.1896	1.5111	1.2293
No log	3.8161	332	1.5959	0.1687	1.5959	1.2633
No log	3.8391	334	1.7229	0.1064	1.7229	1.3126
No log	3.8621	336	1.7608	0.0844	1.7608	1.3270
No log	3.8851	338	1.7420	0.0768	1.7420	1.3199
No log	3.9080	340	1.7136	0.1139	1.7136	1.3090
No log	3.9310	342	1.6725	0.1280	1.6725	1.2933
No log	3.9540	344	1.7540	0.0345	1.7540	1.3244
No log	3.9770	346	1.6762	0.1281	1.6762	1.2947
No log	4.0	348	1.6851	0.1643	1.6851	1.2981
No log	4.0230	350	1.7355	0.0544	1.7355	1.3174
No log	4.0460	352	1.7420	0.0217	1.7420	1.3198
No log	4.0690	354	1.6975	0.0733	1.6975	1.3029
No log	4.0920	356	1.7115	0.0748	1.7115	1.3083
No log	4.1149	358	1.7311	0.0416	1.7311	1.3157
No log	4.1379	360	1.7521	0.1028	1.7521	1.3237
No log	4.1609	362	1.6257	0.1801	1.6257	1.2750
No log	4.1839	364	1.5458	0.0347	1.5458	1.2433
No log	4.2069	366	1.5659	0.1371	1.5659	1.2513
No log	4.2299	368	1.5547	0.1313	1.5547	1.2469
No log	4.2529	370	1.4508	0.1654	1.4508	1.2045
No log	4.2759	372	1.4369	0.1654	1.4369	1.1987
No log	4.2989	374	1.4876	0.1071	1.4876	1.2197
No log	4.3218	376	1.6356	0.2012	1.6356	1.2789
No log	4.3448	378	1.7970	0.1498	1.7970	1.3405
No log	4.3678	380	1.7299	0.0977	1.7299	1.3153
No log	4.3908	382	1.5673	0.1888	1.5673	1.2519
No log	4.4138	384	1.4364	0.2509	1.4364	1.1985
No log	4.4368	386	1.4780	0.2084	1.4780	1.2157
No log	4.4598	388	1.6242	0.1547	1.6242	1.2744
No log	4.4828	390	1.6924	0.1922	1.6924	1.3009
No log	4.5057	392	1.6794	0.1922	1.6794	1.2959
No log	4.5287	394	1.6170	0.2012	1.6170	1.2716
No log	4.5517	396	1.4863	0.2743	1.4863	1.2192
No log	4.5747	398	1.4716	0.2542	1.4716	1.2131
No log	4.5977	400	1.5387	0.2693	1.5387	1.2404
No log	4.6207	402	1.5796	0.2354	1.5796	1.2568
No log	4.6437	404	1.5667	0.2481	1.5667	1.2517
No log	4.6667	406	1.5336	0.2481	1.5336	1.2384
No log	4.6897	408	1.5097	0.2237	1.5097	1.2287
No log	4.7126	410	1.4094	0.2381	1.4094	1.1872
No log	4.7356	412	1.3660	0.1602	1.3660	1.1688
No log	4.7586	414	1.3963	0.1701	1.3963	1.1817
No log	4.7816	416	1.4482	0.1312	1.4482	1.2034
No log	4.8046	418	1.5740	0.1935	1.5740	1.2546
No log	4.8276	420	1.6119	0.1552	1.6119	1.2696
No log	4.8506	422	1.5383	0.1098	1.5383	1.2403
No log	4.8736	424	1.4446	0.1599	1.4446	1.2019
No log	4.8966	426	1.3874	0.1442	1.3874	1.1779
No log	4.9195	428	1.4172	0.1755	1.4172	1.1905
No log	4.9425	430	1.5372	0.2494	1.5372	1.2399
No log	4.9655	432	1.8290	0.0767	1.8290	1.3524
No log	4.9885	434	1.9801	0.0615	1.9801	1.4071
No log	5.0115	436	1.9416	0.0400	1.9416	1.3934
No log	5.0345	438	1.7270	0.1604	1.7270	1.3141
No log	5.0575	440	1.4589	0.1745	1.4589	1.2079
No log	5.0805	442	1.3752	0.2056	1.3752	1.1727
No log	5.1034	444	1.4127	0.1944	1.4127	1.1886
No log	5.1264	446	1.5418	0.1929	1.5418	1.2417
No log	5.1494	448	1.6613	0.1922	1.6613	1.2889
No log	5.1724	450	1.6160	0.1674	1.6160	1.2712
No log	5.1954	452	1.5370	0.1929	1.5370	1.2398
No log	5.2184	454	1.5791	0.1840	1.5791	1.2566
No log	5.2414	456	1.7260	0.1841	1.7260	1.3138
No log	5.2644	458	1.8074	0.1768	1.8074	1.3444
No log	5.2874	460	1.7312	0.1880	1.7312	1.3158
No log	5.3103	462	1.5748	0.2084	1.5748	1.2549
No log	5.3333	464	1.5618	0.2251	1.5618	1.2497
No log	5.3563	466	1.5256	0.2181	1.5256	1.2351
No log	5.3793	468	1.4384	0.2224	1.4384	1.1993
No log	5.4023	470	1.4825	0.2252	1.4825	1.2176
No log	5.4253	472	1.5385	0.1840	1.5385	1.2404
No log	5.4483	474	1.5917	0.1840	1.5917	1.2616
No log	5.4713	476	1.5732	0.1840	1.5732	1.2543
No log	5.4943	478	1.5208	0.1840	1.5208	1.2332
No log	5.5172	480	1.4481	0.2163	1.4481	1.2034
No log	5.5402	482	1.4798	0.2619	1.4798	1.2165
No log	5.5632	484	1.6363	0.2514	1.6363	1.2792
No log	5.5862	486	1.7132	0.2378	1.7132	1.3089
No log	5.6092	488	1.6582	0.2514	1.6582	1.2877
No log	5.6322	490	1.6575	0.2162	1.6575	1.2875
No log	5.6552	492	1.7132	0.1922	1.7132	1.3089
No log	5.6782	494	1.6996	0.1922	1.6996	1.3037
No log	5.7011	496	1.5702	0.1796	1.5702	1.2531
No log	5.7241	498	1.4049	0.2633	1.4049	1.1853
0.3959	5.7471	500	1.3739	0.2184	1.3739	1.1721
0.3959	5.7701	502	1.5092	0.2325	1.5092	1.2285
0.3959	5.7931	504	1.7187	0.2424	1.7187	1.3110
0.3959	5.8161	506	1.8244	0.1843	1.8244	1.3507
0.3959	5.8391	508	1.7445	0.2138	1.7445	1.3208
0.3959	5.8621	510	1.5830	0.2264	1.5830	1.2582
0.3959	5.8851	512	1.4811	0.2914	1.4811	1.2170
0.3959	5.9080	514	1.5239	0.2663	1.5239	1.2344
0.3959	5.9310	516	1.6814	0.1802	1.6814	1.2967
0.3959	5.9540	518	1.7197	0.1802	1.7197	1.3114
0.3959	5.9770	520	1.5975	0.1427	1.5975	1.2639
0.3959	6.0	522	1.4854	0.1405	1.4854	1.2188
0.3959	6.0230	524	1.4932	0.1462	1.4932	1.2220

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1