ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0786
• Qwk: 0.1176
• Mse: 1.0786
• Rmse: 1.0385

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0244	2	4.8658	0.0010	4.8658	2.2059
No log	0.0488	4	2.8477	-0.0091	2.8477	1.6875
No log	0.0732	6	2.9375	-0.0980	2.9375	1.7139
No log	0.0976	8	2.3015	-0.0984	2.3015	1.5171
No log	0.1220	10	1.5445	-0.0441	1.5445	1.2428
No log	0.1463	12	1.3892	-0.0674	1.3892	1.1786
No log	0.1707	14	1.3866	0.0169	1.3866	1.1776
No log	0.1951	16	1.3153	0.0339	1.3153	1.1469
No log	0.2195	18	1.3042	0.0488	1.3042	1.1420
No log	0.2439	20	1.3285	0.0169	1.3285	1.1526
No log	0.2683	22	1.2512	0.0600	1.2512	1.1186
No log	0.2927	24	1.1924	0.1927	1.1924	1.0920
No log	0.3171	26	1.1997	0.1852	1.1997	1.0953
No log	0.3415	28	1.2353	0.2532	1.2353	1.1114
No log	0.3659	30	1.3387	0.0426	1.3387	1.1570
No log	0.3902	32	1.3341	0.0926	1.3341	1.1550
No log	0.4146	34	1.1891	0.2053	1.1891	1.0905
No log	0.4390	36	1.2614	0.0872	1.2614	1.1231
No log	0.4634	38	1.1968	0.1176	1.1968	1.0940
No log	0.4878	40	1.2173	0.1542	1.2173	1.1033
No log	0.5122	42	1.2284	0.1658	1.2284	1.1083
No log	0.5366	44	1.2008	0.1519	1.2008	1.0958
No log	0.5610	46	1.2136	0.1927	1.2136	1.1016
No log	0.5854	48	1.1621	0.2574	1.1621	1.0780
No log	0.6098	50	1.1912	0.0771	1.1912	1.0914
No log	0.6341	52	1.1380	0.1752	1.1380	1.0668
No log	0.6585	54	1.1092	0.3271	1.1092	1.0532
No log	0.6829	56	1.1499	0.2605	1.1499	1.0723
No log	0.7073	58	1.0808	0.2539	1.0808	1.0396
No log	0.7317	60	1.0836	0.2587	1.0836	1.0409
No log	0.7561	62	1.2832	0.2789	1.2832	1.1328
No log	0.7805	64	1.7941	0.1656	1.7941	1.3394
No log	0.8049	66	1.7729	0.1781	1.7729	1.3315
No log	0.8293	68	1.3845	0.3642	1.3845	1.1767
No log	0.8537	70	1.1174	0.2417	1.1174	1.0571
No log	0.8780	72	1.1217	0.2658	1.1217	1.0591
No log	0.9024	74	1.1736	0.2206	1.1736	1.0834
No log	0.9268	76	1.4081	0.2328	1.4081	1.1867
No log	0.9512	78	1.4770	0.2363	1.4770	1.2153
No log	0.9756	80	1.3363	0.1851	1.3363	1.1560
No log	1.0	82	1.1930	0.3113	1.1930	1.0923
No log	1.0244	84	1.2115	0.1792	1.2115	1.1007
No log	1.0488	86	1.1705	0.3134	1.1705	1.0819
No log	1.0732	88	1.2567	0.2288	1.2567	1.1210
No log	1.0976	90	1.6148	0.1609	1.6148	1.2708
No log	1.1220	92	1.5654	0.2348	1.5654	1.2512
No log	1.1463	94	1.2612	0.2983	1.2612	1.1230
No log	1.1707	96	1.2336	0.3158	1.2336	1.1107
No log	1.1951	98	1.0856	0.2175	1.0856	1.0419
No log	1.2195	100	1.0271	0.3142	1.0271	1.0135
No log	1.2439	102	1.0399	0.2871	1.0399	1.0197
No log	1.2683	104	1.3023	0.3152	1.3023	1.1412
No log	1.2927	106	1.4784	0.1674	1.4784	1.2159
No log	1.3171	108	1.4298	0.2498	1.4298	1.1957
No log	1.3415	110	1.2775	0.3148	1.2775	1.1303
No log	1.3659	112	1.3680	0.2578	1.3680	1.1696
No log	1.3902	114	1.4386	0.1634	1.4386	1.1994
No log	1.4146	116	1.3347	0.2418	1.3347	1.1553
No log	1.4390	118	1.4062	0.3004	1.4062	1.1858
No log	1.4634	120	1.4293	0.3025	1.4293	1.1955
No log	1.4878	122	1.3106	0.2772	1.3106	1.1448
No log	1.5122	124	1.3675	0.2069	1.3675	1.1694
No log	1.5366	126	1.5674	0.2251	1.5674	1.2519
No log	1.5610	128	1.6704	0.1639	1.6704	1.2924
No log	1.5854	130	1.4393	0.1098	1.4393	1.1997
No log	1.6098	132	1.2170	0.1543	1.2170	1.1032
No log	1.6341	134	1.2112	0.1767	1.2112	1.1005
No log	1.6585	136	1.2766	0.1379	1.2766	1.1299
No log	1.6829	138	1.4965	0.2024	1.4965	1.2233
No log	1.7073	140	1.5356	0.1628	1.5356	1.2392
No log	1.7317	142	1.4173	0.0969	1.4173	1.1905
No log	1.7561	144	1.2299	0.1761	1.2299	1.1090
No log	1.7805	146	1.1898	0.1820	1.1898	1.0908
No log	1.8049	148	1.2889	0.2173	1.2889	1.1353
No log	1.8293	150	1.4708	0.2127	1.4708	1.2127
No log	1.8537	152	1.4217	0.1929	1.4217	1.1924
No log	1.8780	154	1.2180	0.1801	1.2180	1.1036
No log	1.9024	156	1.1696	0.1961	1.1696	1.0815
No log	1.9268	158	1.2072	0.1641	1.2072	1.0987
No log	1.9512	160	1.3676	0.1162	1.3676	1.1694
No log	1.9756	162	1.4993	0.1882	1.4993	1.2245
No log	2.0	164	1.4544	0.2217	1.4544	1.2060
No log	2.0244	166	1.4077	0.2550	1.4077	1.1865
No log	2.0488	168	1.2420	0.1599	1.2420	1.1145
No log	2.0732	170	1.1928	0.1541	1.1928	1.0921
No log	2.0976	172	1.2800	0.1991	1.2800	1.1314
No log	2.1220	174	1.4840	0.2564	1.4840	1.2182
No log	2.1463	176	1.5709	0.2618	1.5709	1.2534
No log	2.1707	178	1.4739	0.2592	1.4739	1.2140
No log	2.1951	180	1.3564	0.2173	1.3564	1.1646
No log	2.2195	182	1.2449	0.1479	1.2449	1.1158
No log	2.2439	184	1.2422	0.1801	1.2422	1.1145
No log	2.2683	186	1.2513	0.1801	1.2513	1.1186
No log	2.2927	188	1.3254	0.1554	1.3254	1.1513
No log	2.3171	190	1.5061	0.2090	1.5061	1.2273
No log	2.3415	192	1.5031	0.1655	1.5031	1.2260
No log	2.3659	194	1.3743	0.1592	1.3743	1.1723
No log	2.3902	196	1.3820	0.1162	1.3820	1.1756
No log	2.4146	198	1.3379	0.125	1.3379	1.1567
No log	2.4390	200	1.3615	0.125	1.3615	1.1668
No log	2.4634	202	1.4261	0.1051	1.4261	1.1942
No log	2.4878	204	1.5994	0.1960	1.5993	1.2647
No log	2.5122	206	1.5484	0.1594	1.5484	1.2444
No log	2.5366	208	1.3401	0.1441	1.3401	1.1576
No log	2.5610	210	1.2988	0.1599	1.2988	1.1396
No log	2.5854	212	1.4488	0.1283	1.4488	1.2037
No log	2.6098	214	1.6125	0.1704	1.6125	1.2699
No log	2.6341	216	1.5795	0.0768	1.5795	1.2568
No log	2.6585	218	1.4669	0.0098	1.4669	1.2112
No log	2.6829	220	1.2970	0.0454	1.2970	1.1389
No log	2.7073	222	1.1916	0.1417	1.1916	1.0916
No log	2.7317	224	1.1724	0.1417	1.1724	1.0828
No log	2.7561	226	1.1959	0.0904	1.1959	1.0936
No log	2.7805	228	1.3140	0.1477	1.3140	1.1463
No log	2.8049	230	1.4643	0.1198	1.4643	1.2101
No log	2.8293	232	1.5064	0.1580	1.5064	1.2274
No log	2.8537	234	1.4360	0.1283	1.4360	1.1983
No log	2.8780	236	1.4436	0.1568	1.4436	1.2015
No log	2.9024	238	1.4334	0.1461	1.4334	1.1972
No log	2.9268	240	1.3896	0.1404	1.3896	1.1788
No log	2.9512	242	1.2631	0.1477	1.2631	1.1239
No log	2.9756	244	1.1676	0.1641	1.1676	1.0805
No log	3.0	246	1.1886	0.1316	1.1886	1.0902
No log	3.0244	248	1.2544	0.0887	1.2544	1.1200
No log	3.0488	250	1.3242	0.1477	1.3242	1.1507
No log	3.0732	252	1.3352	0.1477	1.3352	1.1555
No log	3.0976	254	1.3962	0.1840	1.3962	1.1816
No log	3.1220	256	1.4159	0.2131	1.4159	1.1899
No log	3.1463	258	1.4103	0.2131	1.4103	1.1876
No log	3.1707	260	1.3254	0.1536	1.3254	1.1512
No log	3.1951	262	1.2652	0.0887	1.2652	1.1248
No log	3.2195	264	1.1737	0.1801	1.1737	1.0834
No log	3.2439	266	1.1798	0.1641	1.1798	1.0862
No log	3.2683	268	1.2760	0.2790	1.2760	1.1296
No log	3.2927	270	1.4608	0.2506	1.4608	1.2086
No log	3.3171	272	1.6513	0.2899	1.6513	1.2850
No log	3.3415	274	1.5420	0.2506	1.5420	1.2418
No log	3.3659	276	1.2957	0.2617	1.2957	1.1383
No log	3.3902	278	1.1880	0.1479	1.1880	1.0899
No log	3.4146	280	1.2220	0.1479	1.2220	1.1054
No log	3.4390	282	1.2576	0.1795	1.2576	1.1214
No log	3.4634	284	1.2991	0.1692	1.2991	1.1398
No log	3.4878	286	1.2465	0.1795	1.2465	1.1164
No log	3.5122	288	1.2857	0.2184	1.2857	1.1339
No log	3.5366	290	1.3846	0.2617	1.3846	1.1767
No log	3.5610	292	1.3945	0.2201	1.3945	1.1809
No log	3.5854	294	1.3780	0.2201	1.3780	1.1739
No log	3.6098	296	1.3560	0.2553	1.3560	1.1645
No log	3.6341	298	1.3891	0.2390	1.3891	1.1786
No log	3.6585	300	1.4038	0.2024	1.4038	1.1848
No log	3.6829	302	1.5310	0.2090	1.5310	1.2373
No log	3.7073	304	1.5957	0.2564	1.5957	1.2632
No log	3.7317	306	1.5014	0.1704	1.5014	1.2253
No log	3.7561	308	1.4350	0.1748	1.4350	1.1979
No log	3.7805	310	1.3573	0.2173	1.3573	1.1650
No log	3.8049	312	1.2984	0.2037	1.2984	1.1395
No log	3.8293	314	1.3842	0.1796	1.3842	1.1765
No log	3.8537	316	1.5728	0.3026	1.5728	1.2541
No log	3.8780	318	1.8544	0.2419	1.8544	1.3618
No log	3.9024	320	1.8616	0.2100	1.8616	1.3644
No log	3.9268	322	1.5713	0.3026	1.5713	1.2535
No log	3.9512	324	1.3273	0.1889	1.3273	1.1521
No log	3.9756	326	1.2228	0.0887	1.2228	1.1058
No log	4.0	328	1.1993	0.1053	1.1993	1.0951
No log	4.0244	330	1.2815	0.1536	1.2815	1.1320
No log	4.0488	332	1.3983	0.2173	1.3983	1.1825
No log	4.0732	334	1.4436	0.2982	1.4436	1.2015
No log	4.0976	336	1.3591	0.2173	1.3591	1.1658
No log	4.1220	338	1.2537	0.0887	1.2537	1.1197
No log	4.1463	340	1.1884	0.1148	1.1884	1.0902
No log	4.1707	342	1.1842	0.0711	1.1842	1.0882
No log	4.1951	344	1.1854	0.0711	1.1854	1.0888
No log	4.2195	346	1.2338	0.0887	1.2338	1.1108
No log	4.2439	348	1.3836	0.1592	1.3836	1.1763
No log	4.2683	350	1.4844	0.2982	1.4844	1.2184
No log	4.2927	352	1.4346	0.2935	1.4346	1.1977
No log	4.3171	354	1.4013	0.2935	1.4013	1.1838
No log	4.3415	356	1.3644	0.1840	1.3644	1.1681
No log	4.3659	358	1.4250	0.1889	1.4250	1.1937
No log	4.3902	360	1.4715	0.2736	1.4715	1.2130
No log	4.4146	362	1.4568	0.2325	1.4568	1.2070
No log	4.4390	364	1.3936	0.2512	1.3936	1.1805
No log	4.4634	366	1.4236	0.2544	1.4236	1.1931
No log	4.4878	368	1.5284	0.2514	1.5284	1.2363
No log	4.5122	370	1.5384	0.2804	1.5384	1.2403
No log	4.5366	372	1.4452	0.2863	1.4452	1.2022
No log	4.5610	374	1.3658	0.2544	1.3658	1.1687
No log	4.5854	376	1.3382	0.2789	1.3382	1.1568
No log	4.6098	378	1.2718	0.3049	1.2718	1.1278
No log	4.6341	380	1.3048	0.2512	1.3048	1.1423
No log	4.6585	382	1.3337	0.2632	1.3337	1.1549
No log	4.6829	384	1.2811	0.2870	1.2811	1.1318
No log	4.7073	386	1.2524	0.3113	1.2524	1.1191
No log	4.7317	388	1.2615	0.2676	1.2615	1.1232
No log	4.7561	390	1.3617	0.3317	1.3617	1.1669
No log	4.7805	392	1.4007	0.3287	1.4007	1.1835
No log	4.8049	394	1.3333	0.2173	1.3333	1.1547
No log	4.8293	396	1.2731	0.2730	1.2731	1.1283
No log	4.8537	398	1.2460	0.2730	1.2460	1.1163
No log	4.8780	400	1.1991	0.2780	1.1991	1.0950
No log	4.9024	402	1.2057	0.2780	1.2057	1.0981
No log	4.9268	404	1.2220	0.2809	1.2220	1.1055
No log	4.9512	406	1.3798	0.3171	1.3798	1.1747
No log	4.9756	408	1.5100	0.2987	1.5100	1.2288
No log	5.0	410	1.4247	0.1971	1.4247	1.1936
No log	5.0244	412	1.3591	0.2373	1.3591	1.1658
No log	5.0488	414	1.2656	0.1894	1.2656	1.1250
No log	5.0732	416	1.2421	0.1894	1.2421	1.1145
No log	5.0976	418	1.2912	0.2935	1.2912	1.1363
No log	5.1220	420	1.3472	0.3202	1.3472	1.1607
No log	5.1463	422	1.4413	0.2564	1.4413	1.2005
No log	5.1707	424	1.4144	0.2213	1.4144	1.1893
No log	5.1951	426	1.3271	0.1840	1.3271	1.1520
No log	5.2195	428	1.2910	0.1840	1.2910	1.1362
No log	5.2439	430	1.2862	0.2553	1.2862	1.1341
No log	5.2683	432	1.2956	0.2553	1.2956	1.1382
No log	5.2927	434	1.3117	0.2586	1.3117	1.1453
No log	5.3171	436	1.3852	0.2144	1.3852	1.1769
No log	5.3415	438	1.5297	0.3067	1.5297	1.2368
No log	5.3659	440	1.6282	0.3521	1.6282	1.2760
No log	5.3902	442	1.5895	0.3287	1.5895	1.2607
No log	5.4146	444	1.4443	0.2105	1.4443	1.2018
No log	5.4390	446	1.2429	0.2051	1.2429	1.1149
No log	5.4634	448	1.1927	0.1801	1.1927	1.0921
No log	5.4878	450	1.1957	0.2363	1.1957	1.0935
No log	5.5122	452	1.2622	0.1989	1.2622	1.1235
No log	5.5366	454	1.3686	0.3287	1.3686	1.1699
No log	5.5610	456	1.4207	0.3287	1.4207	1.1919
No log	5.5854	458	1.3992	0.3047	1.3992	1.1829
No log	5.6098	460	1.3016	0.1477	1.3016	1.1409
No log	5.6341	462	1.2506	0.1795	1.2506	1.1183
No log	5.6585	464	1.2936	0.1536	1.2936	1.1374
No log	5.6829	466	1.4124	0.2789	1.4124	1.1884
No log	5.7073	468	1.5267	0.2908	1.5267	1.2356
No log	5.7317	470	1.5925	0.2782	1.5925	1.2620
No log	5.7561	472	1.5192	0.3105	1.5192	1.2326
No log	5.7805	474	1.3843	0.2763	1.3843	1.1765
No log	5.8049	476	1.2000	0.2363	1.2000	1.0955
No log	5.8293	478	1.0970	0.1602	1.0970	1.0474
No log	5.8537	480	1.0780	0.1820	1.0780	1.0383
No log	5.8780	482	1.0984	0.1602	1.0984	1.0481
No log	5.9024	484	1.1517	0.2402	1.1517	1.0732
No log	5.9268	486	1.2306	0.2809	1.2306	1.1093
No log	5.9512	488	1.4086	0.2789	1.4086	1.1868
No log	5.9756	490	1.4779	0.2065	1.4779	1.2157
No log	6.0	492	1.4467	0.2455	1.4467	1.2028
No log	6.0244	494	1.2477	0.2772	1.2477	1.1170
No log	6.0488	496	1.0777	0.1504	1.0777	1.0381
No log	6.0732	498	1.0826	0.1504	1.0826	1.0405
0.3552	6.0976	500	1.1623	0.2326	1.1623	1.0781
0.3552	6.1220	502	1.2950	0.3047	1.2950	1.1380
0.3552	6.1463	504	1.4656	0.2711	1.4656	1.2106
0.3552	6.1707	506	1.5417	0.2542	1.5417	1.2417
0.3552	6.1951	508	1.5015	0.2359	1.5015	1.2253
0.3552	6.2195	510	1.3720	0.1219	1.3720	1.1713
0.3552	6.2439	512	1.2226	0.1314	1.2226	1.1057
0.3552	6.2683	514	1.1084	0.1278	1.1084	1.0528
0.3552	6.2927	516	1.0734	0.1343	1.0734	1.0361
0.3552	6.3171	518	1.0786	0.1176	1.0786	1.0385

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1