ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4007
• Qwk: 0.0778
• Mse: 1.4007
• Rmse: 1.1835

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.7286	-0.0020	4.7286	2.1745
No log	0.0976	4	2.6619	0.0159	2.6619	1.6315
No log	0.1463	6	1.8540	-0.0017	1.8540	1.3616
No log	0.1951	8	2.3466	-0.0899	2.3466	1.5319
No log	0.2439	10	1.8112	-0.1104	1.8112	1.3458
No log	0.2927	12	1.5655	-0.0441	1.5655	1.2512
No log	0.3415	14	1.4131	0.0438	1.4131	1.1887
No log	0.3902	16	1.3104	0.0889	1.3104	1.1447
No log	0.4390	18	1.3648	-0.0407	1.3648	1.1683
No log	0.4878	20	1.5208	-0.0441	1.5208	1.2332
No log	0.5366	22	1.7310	-0.0441	1.7310	1.3157
No log	0.5854	24	1.8733	0.0227	1.8733	1.3687
No log	0.6341	26	1.7635	0.0082	1.7635	1.3280
No log	0.6829	28	1.4427	0.0297	1.4427	1.2011
No log	0.7317	30	1.2255	0.1570	1.2255	1.1070
No log	0.7805	32	1.2079	0.1009	1.2079	1.0991
No log	0.8293	34	1.2001	0.0941	1.2001	1.0955
No log	0.8780	36	1.2112	0.0527	1.2112	1.1005
No log	0.9268	38	1.2431	0.0527	1.2431	1.1150
No log	0.9756	40	1.2270	0.0499	1.2270	1.1077
No log	1.0244	42	1.2162	0.0180	1.2162	1.1028
No log	1.0732	44	1.2030	0.0810	1.2030	1.0968
No log	1.1220	46	1.1763	0.0642	1.1763	1.0846
No log	1.1707	48	1.1521	0.1278	1.1521	1.0734
No log	1.2195	50	1.1181	0.1773	1.1181	1.0574
No log	1.2683	52	1.1375	0.1507	1.1375	1.0666
No log	1.3171	54	1.1121	0.1711	1.1121	1.0546
No log	1.3659	56	1.0773	0.1649	1.0773	1.0379
No log	1.4146	58	1.1092	0.1148	1.1092	1.0532
No log	1.4634	60	1.2166	0.1188	1.2166	1.1030
No log	1.5122	62	1.2361	0.0692	1.2361	1.1118
No log	1.5610	64	1.1673	0.1507	1.1673	1.0804
No log	1.6098	66	1.1814	0.2485	1.1814	1.0869
No log	1.6585	68	1.2532	0.0432	1.2532	1.1195
No log	1.7073	70	1.2262	0.1168	1.2262	1.1073
No log	1.7561	72	1.1245	0.1696	1.1245	1.0604
No log	1.8049	74	1.0579	0.4116	1.0579	1.0285
No log	1.8537	76	1.0500	0.3408	1.0500	1.0247
No log	1.9024	78	1.1346	0.1958	1.1346	1.0652
No log	1.9512	80	1.3481	0.2099	1.3481	1.1611
No log	2.0	82	1.4895	0.3331	1.4895	1.2205
No log	2.0488	84	1.4847	0.3345	1.4847	1.2185
No log	2.0976	86	1.3033	0.2251	1.3033	1.1416
No log	2.1463	88	1.2492	0.2251	1.2492	1.1177
No log	2.1951	90	1.5188	0.3371	1.5188	1.2324
No log	2.2439	92	1.5893	0.3189	1.5893	1.2607
No log	2.2927	94	1.4744	0.3345	1.4744	1.2142
No log	2.3415	96	1.3962	0.3542	1.3962	1.1816
No log	2.3902	98	1.3869	0.3140	1.3869	1.1777
No log	2.4390	100	1.4793	0.3407	1.4793	1.2163
No log	2.4878	102	1.7856	0.2943	1.7856	1.3363
No log	2.5366	104	1.8342	0.2222	1.8342	1.3543
No log	2.5854	106	1.7025	0.2691	1.7025	1.3048
No log	2.6341	108	1.3838	0.3222	1.3838	1.1764
No log	2.6829	110	1.2841	0.3442	1.2841	1.1332
No log	2.7317	112	1.5093	0.2847	1.5093	1.2285
No log	2.7805	114	1.7802	0.2008	1.7802	1.3342
No log	2.8293	116	1.9692	0.2038	1.9692	1.4033
No log	2.8780	118	1.9012	0.2008	1.9012	1.3788
No log	2.9268	120	1.6028	0.2540	1.6028	1.2660
No log	2.9756	122	1.3052	0.3874	1.3052	1.1424
No log	3.0244	124	1.1773	0.2563	1.1773	1.0850
No log	3.0732	126	1.3335	0.3693	1.3335	1.1548
No log	3.1220	128	1.7716	0.1978	1.7716	1.3310
No log	3.1707	130	1.9236	0.0878	1.9236	1.3869
No log	3.2195	132	1.7837	0.1242	1.7837	1.3355
No log	3.2683	134	1.4599	0.3442	1.4599	1.2083
No log	3.3171	136	1.2831	0.3231	1.2831	1.1327
No log	3.3659	138	1.1053	0.1968	1.1053	1.0513
No log	3.4146	140	1.0721	0.2132	1.0721	1.0354
No log	3.4634	142	1.1513	0.2357	1.1513	1.0730
No log	3.5122	144	1.3320	0.2895	1.3320	1.1541
No log	3.5610	146	1.3352	0.2060	1.3352	1.1555
No log	3.6098	148	1.2790	0.1310	1.2790	1.1309
No log	3.6585	150	1.2802	0.1807	1.2802	1.1315
No log	3.7073	152	1.2650	0.2223	1.2650	1.1247
No log	3.7561	154	1.4642	0.2711	1.4642	1.2100
No log	3.8049	156	1.7423	0.2419	1.7423	1.3199
No log	3.8537	158	1.7049	0.2564	1.7049	1.3057
No log	3.9024	160	1.3904	0.3523	1.3904	1.1791
No log	3.9512	162	1.1261	0.2623	1.1261	1.0612
No log	4.0	164	1.0874	0.2850	1.0874	1.0428
No log	4.0488	166	1.0923	0.3111	1.0923	1.0451
No log	4.0976	168	1.1981	0.2037	1.1981	1.0946
No log	4.1463	170	1.5924	0.3642	1.5924	1.2619
No log	4.1951	172	1.7958	0.2469	1.7958	1.3401
No log	4.2439	174	1.6519	0.2887	1.6519	1.2853
No log	4.2927	176	1.3763	0.2275	1.3763	1.1732
No log	4.3415	178	1.1844	0.1911	1.1844	1.0883
No log	4.3902	180	1.1710	0.1602	1.1710	1.0821
No log	4.4390	182	1.2228	0.2291	1.2228	1.1058
No log	4.4878	184	1.3412	0.2520	1.3412	1.1581
No log	4.5366	186	1.5402	0.3345	1.5402	1.2410
No log	4.5854	188	1.5641	0.3189	1.5641	1.2507
No log	4.6341	190	1.3901	0.2929	1.3901	1.1790
No log	4.6829	192	1.2511	0.3512	1.2511	1.1185
No log	4.7317	194	1.2050	0.2747	1.2050	1.0977
No log	4.7805	196	1.1612	0.2084	1.1612	1.0776
No log	4.8293	198	1.2333	0.2544	1.2333	1.1105
No log	4.8780	200	1.4394	0.2929	1.4394	1.1998
No log	4.9268	202	1.6033	0.2847	1.6033	1.2662
No log	4.9756	204	1.6613	0.2644	1.6613	1.2889
No log	5.0244	206	1.5769	0.2378	1.5769	1.2558
No log	5.0732	208	1.3334	0.2617	1.3334	1.1547
No log	5.1220	210	1.0991	0.1602	1.0991	1.0484
No log	5.1707	212	1.0714	0.1977	1.0714	1.0351
No log	5.2195	214	1.1829	0.2141	1.1829	1.0876
No log	5.2683	216	1.4952	0.2105	1.4952	1.2228
No log	5.3171	218	1.7397	0.2220	1.7397	1.3190
No log	5.3659	220	1.7971	0.1555	1.7971	1.3406
No log	5.4146	222	1.6592	0.1667	1.6592	1.2881
No log	5.4634	224	1.4758	0.1031	1.4758	1.2148
No log	5.5122	226	1.3297	0.1795	1.3297	1.1531
No log	5.5610	228	1.2458	0.1479	1.2458	1.1162
No log	5.6098	230	1.2572	0.2000	1.2572	1.1213
No log	5.6585	232	1.3210	0.2367	1.3210	1.1493
No log	5.7073	234	1.4516	0.2436	1.4516	1.2048
No log	5.7561	236	1.5004	0.2658	1.5004	1.2249
No log	5.8049	238	1.3966	0.2405	1.3966	1.1818
No log	5.8537	240	1.2947	0.1670	1.2947	1.1379
No log	5.9024	242	1.2257	0.2100	1.2257	1.1071
No log	5.9512	244	1.2463	0.2650	1.2463	1.1164
No log	6.0	246	1.3321	0.2634	1.3321	1.1541
No log	6.0488	248	1.3774	0.2489	1.3774	1.1736
No log	6.0976	250	1.3991	0.2704	1.3991	1.1828
No log	6.1463	252	1.3056	0.2725	1.3056	1.1426
No log	6.1951	254	1.1779	0.2762	1.1779	1.0853
No log	6.2439	256	1.1878	0.2762	1.1878	1.0899
No log	6.2927	258	1.2746	0.2807	1.2746	1.1290
No log	6.3415	260	1.2940	0.2807	1.2940	1.1375
No log	6.3902	262	1.1880	0.2570	1.1880	1.0899
No log	6.4390	264	1.1594	0.2904	1.1594	1.0767
No log	6.4878	266	1.1650	0.3001	1.1650	1.0794
No log	6.5366	268	1.2506	0.2938	1.2506	1.1183
No log	6.5854	270	1.3712	0.3105	1.3712	1.1710
No log	6.6341	272	1.4260	0.3123	1.4260	1.1942
No log	6.6829	274	1.3832	0.2782	1.3832	1.1761
No log	6.7317	276	1.3105	0.2239	1.3105	1.1448
No log	6.7805	278	1.1332	0.2304	1.1332	1.0645
No log	6.8293	280	1.0763	0.2317	1.0763	1.0374
No log	6.8780	282	1.1405	0.2195	1.1405	1.0679
No log	6.9268	284	1.2826	0.2460	1.2826	1.1325
No log	6.9756	286	1.4318	0.2289	1.4318	1.1966
No log	7.0244	288	1.4181	0.1031	1.4181	1.1908
No log	7.0732	290	1.3058	0.1637	1.3058	1.1427
No log	7.1220	292	1.3141	0.1795	1.3141	1.1463
No log	7.1707	294	1.4695	0.1162	1.4695	1.2122
No log	7.2195	296	1.4963	0.1162	1.4963	1.2233
No log	7.2683	298	1.3794	0.0887	1.3794	1.1745
No log	7.3171	300	1.3641	0.0887	1.3641	1.1679
No log	7.3659	302	1.3410	0.1081	1.3410	1.1580
No log	7.4146	304	1.3679	0.1219	1.3679	1.1696
No log	7.4634	306	1.3965	0.1031	1.3965	1.1818
No log	7.5122	308	1.3986	0.1219	1.3986	1.1826
No log	7.5610	310	1.3785	0.1536	1.3785	1.1741
No log	7.6098	312	1.3835	0.1646	1.3835	1.1762
No log	7.6585	314	1.4497	0.2024	1.4497	1.2040
No log	7.7073	316	1.5694	0.2392	1.5694	1.2528
No log	7.7561	318	1.5457	0.1395	1.5457	1.2433
No log	7.8049	320	1.3880	0.1219	1.3880	1.1781
No log	7.8537	322	1.3162	0.1219	1.3162	1.1473
No log	7.9024	324	1.3744	0.1219	1.3744	1.1723
No log	7.9512	326	1.3791	0.2213	1.3791	1.1743
No log	8.0	328	1.3619	0.1970	1.3619	1.1670
No log	8.0488	330	1.3947	0.2251	1.3947	1.1810
No log	8.0976	332	1.4718	0.2317	1.4718	1.2132
No log	8.1463	334	1.4262	0.2485	1.4262	1.1942
No log	8.1951	336	1.2484	0.2122	1.2484	1.1173
No log	8.2439	338	1.2216	0.2122	1.2216	1.1053
No log	8.2927	340	1.3311	0.1568	1.3311	1.1537
No log	8.3415	342	1.4475	0.1980	1.4475	1.2031
No log	8.3902	344	1.4341	0.1698	1.4341	1.1976
No log	8.4390	346	1.4205	0.1646	1.4205	1.1918
No log	8.4878	348	1.3871	0.1646	1.3871	1.1777
No log	8.5366	350	1.4189	0.1516	1.4189	1.1912
No log	8.5854	352	1.3975	0.1516	1.3975	1.1822
No log	8.6341	354	1.3787	0.1516	1.3787	1.1742
No log	8.6829	356	1.2899	0.2032	1.2899	1.1357
No log	8.7317	358	1.2574	0.2032	1.2574	1.1213
No log	8.7805	360	1.3408	0.2289	1.3408	1.1579
No log	8.8293	362	1.3895	0.2839	1.3895	1.1788
No log	8.8780	364	1.3755	0.2632	1.3755	1.1728
No log	8.9268	366	1.2449	0.2173	1.2449	1.1158
No log	8.9756	368	1.1891	0.2313	1.1891	1.0905
No log	9.0244	370	1.3290	0.2985	1.3290	1.1528
No log	9.0732	372	1.5043	0.2970	1.5043	1.2265
No log	9.1220	374	1.5124	0.2908	1.5124	1.2298
No log	9.1707	376	1.3783	0.1608	1.3783	1.1740
No log	9.2195	378	1.3673	0.1252	1.3673	1.1693
No log	9.2683	380	1.4214	0.1844	1.4214	1.1922
No log	9.3171	382	1.5118	0.3026	1.5118	1.2295
No log	9.3659	384	1.5783	0.3026	1.5783	1.2563
No log	9.4146	386	1.4380	0.3467	1.4380	1.1991
No log	9.4634	388	1.2917	0.3454	1.2917	1.1365
No log	9.5122	390	1.3146	0.3339	1.3146	1.1465
No log	9.5610	392	1.5378	0.3008	1.5378	1.2401
No log	9.6098	394	1.6977	0.3060	1.6977	1.3029
No log	9.6585	396	1.6017	0.3026	1.6017	1.2656
No log	9.7073	398	1.3414	0.2925	1.3414	1.1582
No log	9.7561	400	1.0926	0.3138	1.0926	1.0453
No log	9.8049	402	0.9999	0.2878	0.9999	0.9999
No log	9.8537	404	1.0501	0.2904	1.0501	1.0247
No log	9.9024	406	1.2062	0.2173	1.2062	1.0983
No log	9.9512	408	1.4449	0.2485	1.4449	1.2021
No log	10.0	410	1.5529	0.2759	1.5529	1.2462
No log	10.0488	412	1.4659	0.2925	1.4659	1.2107
No log	10.0976	414	1.2625	0.1611	1.2625	1.1236
No log	10.1463	416	1.1275	0.2100	1.1275	1.0619
No log	10.1951	418	1.1451	0.1667	1.1451	1.0701
No log	10.2439	420	1.2896	0.2173	1.2896	1.1356
No log	10.2927	422	1.3887	0.2191	1.3887	1.1784
No log	10.3415	424	1.3695	0.2153	1.3695	1.1702
No log	10.3902	426	1.3848	0.1935	1.3848	1.1768
No log	10.4390	428	1.3135	0.2212	1.3135	1.1461
No log	10.4878	430	1.2590	0.2173	1.2590	1.1221
No log	10.5366	432	1.1986	0.2291	1.1986	1.0948
No log	10.5854	434	1.1037	0.2439	1.1037	1.0506
No log	10.6341	436	1.0239	0.2276	1.0239	1.0119
No log	10.6829	438	1.0391	0.3097	1.0391	1.0194
No log	10.7317	440	1.1598	0.2439	1.1598	1.0770
No log	10.7805	442	1.3612	0.2163	1.3612	1.1667
No log	10.8293	444	1.5320	0.3105	1.5320	1.2377
No log	10.8780	446	1.4929	0.1845	1.4929	1.2218
No log	10.9268	448	1.4492	0.1196	1.4492	1.2038
No log	10.9756	450	1.3386	0.2003	1.3386	1.1570
No log	11.0244	452	1.2809	0.1416	1.2809	1.1318
No log	11.0732	454	1.2183	0.1247	1.2183	1.1038
No log	11.1220	456	1.1963	0.1247	1.1963	1.0938
No log	11.1707	458	1.2246	0.1247	1.2246	1.1066
No log	11.2195	460	1.2646	0.0802	1.2646	1.1246
No log	11.2683	462	1.2838	0.0802	1.2838	1.1330
No log	11.3171	464	1.2872	0.1741	1.2872	1.1345
No log	11.3659	466	1.3297	0.1440	1.3297	1.1531
No log	11.4146	468	1.3522	0.1753	1.3522	1.1628
No log	11.4634	470	1.3248	0.2173	1.3248	1.1510
No log	11.5122	472	1.2678	0.2570	1.2678	1.1260
No log	11.5610	474	1.2483	0.2570	1.2483	1.1173
No log	11.6098	476	1.2389	0.1896	1.2389	1.1130
No log	11.6585	478	1.2270	0.1896	1.2270	1.1077
No log	11.7073	480	1.1799	0.2207	1.1799	1.0862
No log	11.7561	482	1.2075	0.1596	1.2075	1.0989
No log	11.8049	484	1.2221	0.1596	1.2221	1.1055
No log	11.8537	486	1.2196	0.2000	1.2196	1.1044
No log	11.9024	488	1.1627	0.2000	1.1627	1.0783
No log	11.9512	490	1.2061	0.2000	1.2061	1.0982
No log	12.0	492	1.3459	0.1659	1.3459	1.1601
No log	12.0488	494	1.5816	0.2485	1.5816	1.2576
No log	12.0976	496	1.6896	0.2711	1.6896	1.2998
No log	12.1463	498	1.6462	0.2251	1.6462	1.2830
0.3357	12.1951	500	1.4979	0.1395	1.4979	1.2239
0.3357	12.2439	502	1.4135	0.0920	1.4135	1.1889
0.3357	12.2927	504	1.3591	0.0811	1.3591	1.1658
0.3357	12.3415	506	1.4087	0.0186	1.4087	1.1869
0.3357	12.3902	508	1.4282	0.0778	1.4282	1.1951
0.3357	12.4390	510	1.4007	0.0778	1.4007	1.1835

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1