ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2258
• Qwk: 0.1185
• Mse: 1.2258
• Rmse: 1.1071

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0244	2	4.5652	0.0010	4.5652	2.1366
No log	0.0488	4	2.7459	0.0104	2.7459	1.6571
No log	0.0732	6	2.5274	-0.0777	2.5274	1.5898
No log	0.0976	8	1.7551	-0.0063	1.7551	1.3248
No log	0.1220	10	1.5769	0.0451	1.5769	1.2557
No log	0.1463	12	1.4548	-0.0271	1.4548	1.2062
No log	0.1707	14	1.4874	-0.0128	1.4874	1.2196
No log	0.1951	16	1.4750	-0.0128	1.4750	1.2145
No log	0.2195	18	1.4909	-0.0217	1.4909	1.2210
No log	0.2439	20	1.6340	-0.0046	1.6340	1.2783
No log	0.2683	22	2.1231	-0.0708	2.1231	1.4571
No log	0.2927	24	2.0422	-0.0439	2.0422	1.4290
No log	0.3171	26	1.5819	0.0210	1.5819	1.2577
No log	0.3415	28	1.3647	0.0091	1.3647	1.1682
No log	0.3659	30	1.3332	0.0694	1.3332	1.1546
No log	0.3902	32	1.3421	0.0600	1.3421	1.1585
No log	0.4146	34	1.3134	0.0750	1.3134	1.1460
No log	0.4390	36	1.3126	0.0613	1.3126	1.1457
No log	0.4634	38	1.3152	0.1271	1.3152	1.1468
No log	0.4878	40	1.3221	0.0506	1.3221	1.1498
No log	0.5122	42	1.3251	0.0389	1.3251	1.1511
No log	0.5366	44	1.3678	0.0342	1.3678	1.1695
No log	0.5610	46	1.4386	0.0362	1.4386	1.1994
No log	0.5854	48	1.4969	0.0600	1.4969	1.2235
No log	0.6098	50	1.4414	0.0625	1.4414	1.2006
No log	0.6341	52	1.4574	0.0232	1.4574	1.2072
No log	0.6585	54	1.4327	0.0165	1.4327	1.1969
No log	0.6829	56	1.4109	0.0522	1.4109	1.1878
No log	0.7073	58	1.3892	-0.0217	1.3892	1.1787
No log	0.7317	60	1.3999	-0.0234	1.3999	1.1832
No log	0.7561	62	1.3249	0.1294	1.3249	1.1511
No log	0.7805	64	1.2512	0.1556	1.2512	1.1186
No log	0.8049	66	1.2116	0.1173	1.2116	1.1007
No log	0.8293	68	1.1877	0.1076	1.1877	1.0898
No log	0.8537	70	1.1849	0.1278	1.1849	1.0885
No log	0.8780	72	1.1827	0.1279	1.1827	1.0875
No log	0.9024	74	1.2141	0.0849	1.2141	1.1019
No log	0.9268	76	1.1818	0.0472	1.1818	1.0871
No log	0.9512	78	1.2332	0.1045	1.2332	1.1105
No log	0.9756	80	1.3428	0.1196	1.3428	1.1588
No log	1.0	82	1.3227	0.1045	1.3227	1.1501
No log	1.0244	84	1.2377	0.1791	1.2377	1.1125
No log	1.0488	86	1.1557	0.1616	1.1557	1.0750
No log	1.0732	88	1.1321	0.2053	1.1321	1.0640
No log	1.0976	90	1.1728	0.1144	1.1728	1.0829
No log	1.1220	92	1.3277	0.1313	1.3277	1.1522
No log	1.1463	94	1.3221	0.1943	1.3221	1.1498
No log	1.1707	96	1.2304	0.2330	1.2304	1.1092
No log	1.1951	98	1.0793	0.2371	1.0793	1.0389
No log	1.2195	100	1.1123	0.2593	1.1123	1.0546
No log	1.2439	102	1.1121	0.2593	1.1121	1.0546
No log	1.2683	104	1.0268	0.2871	1.0268	1.0133
No log	1.2927	106	1.1400	0.1621	1.1400	1.0677
No log	1.3171	108	1.3865	0.1220	1.3865	1.1775
No log	1.3415	110	1.4920	0.0691	1.4920	1.2215
No log	1.3659	112	1.3567	0.0814	1.3567	1.1648
No log	1.3902	114	1.2405	0.3427	1.2405	1.1138
No log	1.4146	116	1.1610	0.3438	1.1610	1.0775
No log	1.4390	118	1.1545	0.3308	1.1545	1.0745
No log	1.4634	120	1.3065	0.2375	1.3065	1.1430
No log	1.4878	122	1.4682	0.2826	1.4682	1.2117
No log	1.5122	124	1.5316	0.2797	1.5316	1.2376
No log	1.5366	126	1.4006	0.2708	1.4006	1.1835
No log	1.5610	128	1.1958	0.3427	1.1958	1.0935
No log	1.5854	130	1.2296	0.3243	1.2296	1.1089
No log	1.6098	132	1.3008	0.3833	1.3008	1.1405
No log	1.6341	134	1.3689	0.3667	1.3689	1.1700
No log	1.6585	136	1.5518	0.2668	1.5518	1.2457
No log	1.6829	138	1.5978	0.2251	1.5978	1.2641
No log	1.7073	140	1.5343	0.1811	1.5343	1.2387
No log	1.7317	142	1.3298	0.0885	1.3298	1.1532
No log	1.7561	144	1.2333	0.1559	1.2333	1.1105
No log	1.7805	146	1.3224	0.2663	1.3224	1.1500
No log	1.8049	148	1.4372	0.3416	1.4372	1.1988
No log	1.8293	150	1.4719	0.2201	1.4719	1.2132
No log	1.8537	152	1.6245	0.1995	1.6245	1.2746
No log	1.8780	154	1.5758	0.2691	1.5758	1.2553
No log	1.9024	156	1.3530	0.3778	1.3530	1.1632
No log	1.9268	158	1.3808	0.3785	1.3808	1.1751
No log	1.9512	160	1.5399	0.3148	1.5399	1.2409
No log	1.9756	162	1.8981	0.1940	1.8981	1.3777
No log	2.0	164	1.9394	0.1940	1.9394	1.3926
No log	2.0244	166	1.6876	0.2735	1.6876	1.2991
No log	2.0488	168	1.2735	0.3742	1.2735	1.1285
No log	2.0732	170	1.1526	0.2223	1.1526	1.0736
No log	2.0976	172	1.2696	0.2851	1.2696	1.1268
No log	2.1220	174	1.5219	0.2595	1.5219	1.2336
No log	2.1463	176	1.6825	0.2867	1.6825	1.2971
No log	2.1707	178	1.5266	0.2735	1.5266	1.2356
No log	2.1951	180	1.2698	0.2212	1.2698	1.1268
No log	2.2195	182	1.0946	0.1860	1.0946	1.0463
No log	2.2439	184	1.0845	0.1617	1.0845	1.0414
No log	2.2683	186	1.1975	0.2223	1.1975	1.0943
No log	2.2927	188	1.4189	0.2392	1.4189	1.1912
No log	2.3171	190	1.4973	0.2685	1.4973	1.2236
No log	2.3415	192	1.3687	0.1979	1.3687	1.1699
No log	2.3659	194	1.3271	0.1795	1.3271	1.1520
No log	2.3902	196	1.5027	0.1713	1.5027	1.2259
No log	2.4146	198	1.6023	0.2970	1.6023	1.2658
No log	2.4390	200	1.4105	0.3067	1.4105	1.1877
No log	2.4634	202	1.3088	0.2173	1.3088	1.1440
No log	2.4878	204	1.4117	0.2020	1.4117	1.1881
No log	2.5122	206	1.5752	0.2595	1.5752	1.2551
No log	2.5366	208	1.5266	0.2967	1.5266	1.2356
No log	2.5610	210	1.3560	0.3621	1.3560	1.1645
No log	2.5854	212	1.4189	0.3631	1.4189	1.1912
No log	2.6098	214	1.5651	0.2915	1.5651	1.2510
No log	2.6341	216	1.6762	0.2339	1.6762	1.2947
No log	2.6585	218	1.5739	0.2759	1.5739	1.2546
No log	2.6829	220	1.3537	0.2754	1.3537	1.1635
No log	2.7073	222	1.1425	0.1114	1.1425	1.0689
No log	2.7317	224	1.1516	0.1314	1.1516	1.0731
No log	2.7561	226	1.2934	0.0880	1.2934	1.1373
No log	2.7805	228	1.3727	0.0623	1.3727	1.1716
No log	2.8049	230	1.3690	0.1379	1.3690	1.1700
No log	2.8293	232	1.2696	0.2141	1.2696	1.1268
No log	2.8537	234	1.1659	0.2665	1.1659	1.0798
No log	2.8780	236	1.2384	0.3433	1.2384	1.1128
No log	2.9024	238	1.4333	0.3723	1.4333	1.1972
No log	2.9268	240	1.5524	0.2735	1.5524	1.2459
No log	2.9512	242	1.4196	0.2839	1.4196	1.1915
No log	2.9756	244	1.1665	0.2207	1.1665	1.0800
No log	3.0	246	1.0668	0.1808	1.0668	1.0329
No log	3.0244	248	1.0651	0.1969	1.0651	1.0320
No log	3.0488	250	1.1377	0.2363	1.1377	1.0666
No log	3.0732	252	1.2142	0.2141	1.2142	1.1019
No log	3.0976	254	1.2952	0.2424	1.2952	1.1381
No log	3.1220	256	1.3688	0.1935	1.3688	1.1700
No log	3.1463	258	1.3357	0.1844	1.3357	1.1557
No log	3.1707	260	1.2902	0.2132	1.2902	1.1359
No log	3.1951	262	1.3281	0.2132	1.3281	1.1524
No log	3.2195	264	1.3020	0.2132	1.3020	1.1410
No log	3.2439	266	1.3327	0.2471	1.3327	1.1544
No log	3.2683	268	1.3318	0.2721	1.3318	1.1541
No log	3.2927	270	1.3808	0.2983	1.3808	1.1751
No log	3.3171	272	1.4303	0.2731	1.4303	1.1960
No log	3.3415	274	1.3464	0.3187	1.3464	1.1604
No log	3.3659	276	1.1759	0.2291	1.1759	1.0844
No log	3.3902	278	1.1023	0.2651	1.1023	1.0499
No log	3.4146	280	1.0847	0.1701	1.0847	1.0415
No log	3.4390	282	1.0911	0.2552	1.0911	1.0446
No log	3.4634	284	1.1159	0.2343	1.1159	1.0563
No log	3.4878	286	1.1110	0.2343	1.1110	1.0540
No log	3.5122	288	1.2391	0.2570	1.2391	1.1132
No log	3.5366	290	1.3917	0.1801	1.3917	1.1797
No log	3.5610	292	1.3576	0.2201	1.3576	1.1652
No log	3.5854	294	1.1769	0.2141	1.1769	1.0849
No log	3.6098	296	1.0998	0.2291	1.0998	1.0487
No log	3.6341	298	1.1583	0.2141	1.1583	1.0763
No log	3.6585	300	1.2962	0.2790	1.2962	1.1385
No log	3.6829	302	1.4333	0.1631	1.4333	1.1972
No log	3.7073	304	1.4111	0.2390	1.4111	1.1879
No log	3.7317	306	1.2480	0.1637	1.2480	1.1171
No log	3.7561	308	1.1176	0.2009	1.1176	1.0572
No log	3.7805	310	1.1158	0.2056	1.1158	1.0563
No log	3.8049	312	1.2012	0.2714	1.2012	1.0960
No log	3.8293	314	1.3575	0.2275	1.3575	1.1651
No log	3.8537	316	1.4902	0.2606	1.4902	1.2207
No log	3.8780	318	1.4595	0.3045	1.4595	1.2081
No log	3.9024	320	1.3842	0.3045	1.3842	1.1765
No log	3.9268	322	1.3358	0.3605	1.3358	1.1558
No log	3.9512	324	1.4309	0.3467	1.4309	1.1962
No log	3.9756	326	1.6555	0.3164	1.6555	1.2867
No log	4.0	328	1.7493	0.2894	1.7493	1.3226
No log	4.0244	330	1.4546	0.3659	1.4546	1.2061
No log	4.0488	332	1.0513	0.3560	1.0513	1.0253
No log	4.0732	334	0.9821	0.3560	0.9821	0.9910
No log	4.0976	336	1.0384	0.3656	1.0384	1.0190
No log	4.1220	338	1.3311	0.2371	1.3311	1.1538
No log	4.1463	340	1.5047	0.2852	1.5047	1.2267
No log	4.1707	342	1.4788	0.2757	1.4788	1.2161
No log	4.1951	344	1.4234	0.2275	1.4234	1.1931
No log	4.2195	346	1.3388	0.2405	1.3388	1.1571
No log	4.2439	348	1.4538	0.2520	1.4538	1.2057
No log	4.2683	350	1.6018	0.2683	1.6018	1.2656
No log	4.2927	352	1.5105	0.2987	1.5105	1.2290
No log	4.3171	354	1.4564	0.2092	1.4564	1.2068
No log	4.3415	356	1.3266	0.1848	1.3266	1.1518
No log	4.3659	358	1.2499	0.1026	1.2499	1.1180
No log	4.3902	360	1.2228	0.1214	1.2228	1.1058
No log	4.4146	362	1.2367	0.0954	1.2367	1.1120
No log	4.4390	364	1.3142	0.1462	1.3142	1.1464
No log	4.4634	366	1.3863	0.1282	1.3863	1.1774
No log	4.4878	368	1.3331	0.1650	1.3331	1.1546
No log	4.5122	370	1.2325	0.1442	1.2325	1.1102
No log	4.5366	372	1.2093	0.1279	1.2093	1.0997
No log	4.5610	374	1.2347	0.2009	1.2347	1.1112
No log	4.5854	376	1.3231	0.1312	1.3231	1.1503
No log	4.6098	378	1.4529	0.1718	1.4529	1.2054
No log	4.6341	380	1.5311	0.2206	1.5311	1.2374
No log	4.6585	382	1.6345	0.2465	1.6345	1.2785
No log	4.6829	384	1.5413	0.2406	1.5413	1.2415
No log	4.7073	386	1.5155	0.1447	1.5155	1.2311
No log	4.7317	388	1.4255	0.0436	1.4255	1.1939
No log	4.7561	390	1.3363	0.0865	1.3363	1.1560
No log	4.7805	392	1.3000	0.1498	1.3000	1.1402
No log	4.8049	394	1.3105	0.1795	1.3105	1.1448
No log	4.8293	396	1.3665	0.1979	1.3665	1.1690
No log	4.8537	398	1.3834	0.1801	1.3834	1.1762
No log	4.8780	400	1.3446	0.1608	1.3446	1.1596
No log	4.9024	402	1.2068	0.1894	1.2068	1.0986
No log	4.9268	404	1.0992	0.0872	1.0992	1.0484
No log	4.9512	406	1.0754	0.1042	1.0754	1.0370
No log	4.9756	408	1.1044	0.1247	1.1044	1.0509
No log	5.0	410	1.2136	0.1249	1.2136	1.1017
No log	5.0244	412	1.4120	0.0920	1.4120	1.1883
No log	5.0488	414	1.5397	0.1447	1.5397	1.2408
No log	5.0732	416	1.5663	0.1009	1.5663	1.2515
No log	5.0976	418	1.4682	0.0038	1.4682	1.2117
No log	5.1220	420	1.3111	0.1053	1.3111	1.1450
No log	5.1463	422	1.1989	0.1076	1.1989	1.0950
No log	5.1707	424	1.1960	0.1416	1.1960	1.0936
No log	5.1951	426	1.2321	0.1479	1.2321	1.1100
No log	5.2195	428	1.3146	0.0513	1.3146	1.1466
No log	5.2439	430	1.3519	0.0513	1.3519	1.1627
No log	5.2683	432	1.2900	0.1122	1.2900	1.1358
No log	5.2927	434	1.2091	0.1416	1.2091	1.0996
No log	5.3171	436	1.1978	0.1315	1.1978	1.0944
No log	5.3415	438	1.2822	0.1053	1.2822	1.1323
No log	5.3659	440	1.3567	0.1135	1.3567	1.1648
No log	5.3902	442	1.4337	0.1708	1.4337	1.1974
No log	5.4146	444	1.4256	0.1756	1.4256	1.1940
No log	5.4390	446	1.3404	0.1570	1.3404	1.1578
No log	5.4634	448	1.3531	0.1935	1.3531	1.1632
No log	5.4878	450	1.3566	0.2424	1.3566	1.1647
No log	5.5122	452	1.3924	0.2731	1.3924	1.1800
No log	5.5366	454	1.3610	0.2489	1.3610	1.1666
No log	5.5610	456	1.3126	0.2424	1.3126	1.1457
No log	5.5854	458	1.4005	0.2065	1.4005	1.1834
No log	5.6098	460	1.4129	0.1796	1.4129	1.1887
No log	5.6341	462	1.3145	0.1345	1.3145	1.1465
No log	5.6585	464	1.2375	0.1249	1.2375	1.1124
No log	5.6829	466	1.1621	0.1416	1.1621	1.0780
No log	5.7073	468	1.1401	0.1747	1.1401	1.0678
No log	5.7317	470	1.2076	0.2090	1.2076	1.0989
No log	5.7561	472	1.3455	0.1756	1.3455	1.1600
No log	5.7805	474	1.3732	0.2424	1.3732	1.1718
No log	5.8049	476	1.3247	0.2693	1.3247	1.1510
No log	5.8293	478	1.2436	0.2212	1.2436	1.1152
No log	5.8537	480	1.2684	0.2212	1.2684	1.1262
No log	5.8780	482	1.3047	0.2212	1.3047	1.1422
No log	5.9024	484	1.2373	0.2132	1.2373	1.1123
No log	5.9268	486	1.1980	0.1750	1.1980	1.0945
No log	5.9512	488	1.2493	0.2132	1.2493	1.1177
No log	5.9756	490	1.2123	0.1801	1.2123	1.1010
No log	6.0	492	1.2524	0.1989	1.2524	1.1191
No log	6.0244	494	1.3118	0.1989	1.3118	1.1453
No log	6.0488	496	1.3387	0.2263	1.3387	1.1570
No log	6.0732	498	1.4702	0.2941	1.4702	1.2125
0.4092	6.0976	500	1.5290	0.2659	1.5290	1.2365
0.4092	6.1220	502	1.3898	0.1844	1.3898	1.1789
0.4092	6.1463	504	1.2440	0.1185	1.2440	1.1154
0.4092	6.1707	506	1.2142	0.1185	1.2142	1.1019
0.4092	6.1951	508	1.2152	0.1185	1.2152	1.1024
0.4092	6.2195	510	1.2258	0.1185	1.2258	1.1071

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1