ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2912
• Qwk: 0.0887
• Mse: 1.2912
• Rmse: 1.1363

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	4.6682	-0.0132	4.6682	2.1606
No log	0.0816	4	2.9059	-0.0276	2.9059	1.7047
No log	0.1224	6	2.0115	0.0062	2.0115	1.4183
No log	0.1633	8	1.8315	0.0062	1.8315	1.3533
No log	0.2041	10	1.6191	0.0227	1.6191	1.2724
No log	0.2449	12	1.5895	-0.0132	1.5895	1.2608
No log	0.2857	14	1.4890	-0.0182	1.4890	1.2202
No log	0.3265	16	1.4388	-0.0590	1.4388	1.1995
No log	0.3673	18	1.4318	-0.0506	1.4318	1.1966
No log	0.4082	20	1.4675	-0.0368	1.4675	1.2114
No log	0.4490	22	1.5834	0.0169	1.5834	1.2583
No log	0.4898	24	1.4562	0.0169	1.4562	1.2067
No log	0.5306	26	1.3032	0.1076	1.3032	1.1416
No log	0.5714	28	1.3638	-0.0267	1.3638	1.1678
No log	0.6122	30	1.4682	-0.0132	1.4682	1.2117
No log	0.6531	32	1.4877	0.0189	1.4877	1.2197
No log	0.6939	34	1.3738	0.0385	1.3738	1.1721
No log	0.7347	36	1.3044	0.0694	1.3044	1.1421
No log	0.7755	38	1.2486	0.1546	1.2486	1.1174
No log	0.8163	40	1.2628	0.0253	1.2628	1.1237
No log	0.8571	42	1.2124	0.1752	1.2124	1.1011
No log	0.8980	44	1.2057	0.1812	1.2057	1.0981
No log	0.9388	46	1.2250	0.0741	1.2250	1.1068
No log	0.9796	48	1.1984	0.1696	1.1984	1.0947
No log	1.0204	50	1.1786	0.1609	1.1786	1.0856
No log	1.0612	52	1.1892	0.1969	1.1892	1.0905
No log	1.1020	54	1.1501	0.1986	1.1501	1.0724
No log	1.1429	56	1.1167	0.2417	1.1167	1.0567
No log	1.1837	58	1.0972	0.1979	1.0972	1.0475
No log	1.2245	60	1.2907	0.1248	1.2907	1.1361
No log	1.2653	62	1.3105	0.1951	1.3105	1.1448
No log	1.3061	64	1.0674	0.1875	1.0674	1.0332
No log	1.3469	66	1.1079	0.2891	1.1079	1.0526
No log	1.3878	68	1.0796	0.3814	1.0796	1.0391
No log	1.4286	70	1.1335	0.1621	1.1335	1.0647
No log	1.4694	72	1.8029	0.0639	1.8029	1.3427
No log	1.5102	74	1.7708	0.0566	1.7708	1.3307
No log	1.5510	76	1.2103	0.2864	1.2103	1.1001
No log	1.5918	78	1.0137	0.3299	1.0137	1.0068
No log	1.6327	80	1.0436	0.3338	1.0436	1.0216
No log	1.6735	82	1.0245	0.3347	1.0245	1.0122
No log	1.7143	84	1.1075	0.2721	1.1075	1.0524
No log	1.7551	86	1.1580	0.2928	1.1580	1.0761
No log	1.7959	88	1.5316	0.0896	1.5316	1.2376
No log	1.8367	90	1.8854	-0.0880	1.8854	1.3731
No log	1.8776	92	1.9533	-0.1159	1.9533	1.3976
No log	1.9184	94	1.9787	-0.0900	1.9787	1.4067
No log	1.9592	96	1.4563	0.1047	1.4563	1.2068
No log	2.0	98	1.2553	0.2326	1.2553	1.1204
No log	2.0408	100	1.2534	0.2574	1.2534	1.1196
No log	2.0816	102	1.4584	0.2659	1.4584	1.2077
No log	2.1224	104	1.2485	0.3357	1.2485	1.1173
No log	2.1633	106	1.0013	0.3796	1.0013	1.0006
No log	2.2041	108	1.0321	0.3443	1.0321	1.0159
No log	2.2449	110	1.0268	0.3908	1.0268	1.0133
No log	2.2857	112	1.1959	0.3184	1.1959	1.0936
No log	2.3265	114	1.2615	0.3676	1.2615	1.1232
No log	2.3673	116	1.1937	0.3676	1.1937	1.0925
No log	2.4082	118	1.0373	0.2509	1.0373	1.0185
No log	2.4490	120	1.0158	0.2086	1.0158	1.0079
No log	2.4898	122	1.0237	0.2870	1.0237	1.0118
No log	2.5306	124	1.0642	0.2765	1.0642	1.0316
No log	2.5714	126	1.1062	0.3088	1.1062	1.0518
No log	2.6122	128	0.9640	0.3046	0.9640	0.9818
No log	2.6531	130	0.9584	0.3936	0.9584	0.9790
No log	2.6939	132	1.1326	0.3347	1.1326	1.0642
No log	2.7347	134	1.5289	0.3283	1.5289	1.2365
No log	2.7755	136	1.4211	0.3545	1.4211	1.1921
No log	2.8163	138	0.9839	0.4166	0.9839	0.9919
No log	2.8571	140	0.8887	0.4418	0.8887	0.9427
No log	2.8980	142	0.9070	0.3522	0.9070	0.9524
No log	2.9388	144	1.2152	0.3889	1.2152	1.1024
No log	2.9796	146	1.7559	0.2713	1.7559	1.3251
No log	3.0204	148	1.7922	0.2353	1.7922	1.3387
No log	3.0612	150	1.4774	0.3339	1.4774	1.2155
No log	3.1020	152	1.0914	0.3617	1.0914	1.0447
No log	3.1429	154	1.0390	0.3945	1.0390	1.0193
No log	3.1837	156	1.1917	0.3703	1.1917	1.0916
No log	3.2245	158	1.2385	0.3778	1.2385	1.1129
No log	3.2653	160	1.3550	0.3133	1.3550	1.1640
No log	3.3061	162	1.2887	0.3299	1.2887	1.1352
No log	3.3469	164	1.0676	0.3023	1.0676	1.0332
No log	3.3878	166	0.9638	0.2503	0.9638	0.9817
No log	3.4286	168	0.9969	0.2741	0.9969	0.9985
No log	3.4694	170	1.2116	0.2090	1.2116	1.1007
No log	3.5102	172	1.5203	0.1929	1.5203	1.2330
No log	3.5510	174	1.5278	0.1970	1.5278	1.2360
No log	3.5918	176	1.2613	0.2781	1.2613	1.1231
No log	3.6327	178	1.0983	0.2637	1.0983	1.0480
No log	3.6735	180	1.1419	0.3380	1.1419	1.0686
No log	3.7143	182	1.2367	0.3249	1.2367	1.1121
No log	3.7551	184	1.2813	0.3087	1.2813	1.1319
No log	3.7959	186	1.2207	0.2807	1.2207	1.1048
No log	3.8367	188	1.2022	0.2807	1.2022	1.0964
No log	3.8776	190	1.2513	0.3025	1.2513	1.1186
No log	3.9184	192	1.2206	0.2527	1.2206	1.1048
No log	3.9592	194	1.1966	0.2313	1.1966	1.0939
No log	4.0	196	1.2396	0.2574	1.2396	1.1134
No log	4.0408	198	1.2490	0.3046	1.2490	1.1176
No log	4.0816	200	1.2421	0.3301	1.2421	1.1145
No log	4.1224	202	1.3072	0.3559	1.3072	1.1433
No log	4.1633	204	1.4472	0.3082	1.4472	1.2030
No log	4.2041	206	1.3414	0.2757	1.3414	1.1582
No log	4.2449	208	1.3406	0.2704	1.3406	1.1579
No log	4.2857	210	1.2769	0.2032	1.2769	1.1300
No log	4.3265	212	1.1503	0.2056	1.1503	1.0725
No log	4.3673	214	1.1375	0.1755	1.1375	1.0665
No log	4.4082	216	1.2132	0.3267	1.2132	1.1014
No log	4.4490	218	1.2686	0.3548	1.2686	1.1263
No log	4.4898	220	1.4381	0.3471	1.4381	1.1992
No log	4.5306	222	1.2452	0.3879	1.2452	1.1159
No log	4.5714	224	1.0747	0.3836	1.0747	1.0367
No log	4.6122	226	0.9860	0.3908	0.9860	0.9930
No log	4.6531	228	1.1044	0.3131	1.1044	1.0509
No log	4.6939	230	1.2389	0.3402	1.2389	1.1130
No log	4.7347	232	1.1488	0.2909	1.1488	1.0718
No log	4.7755	234	1.0309	0.1767	1.0309	1.0153
No log	4.8163	236	1.1351	0.2304	1.1351	1.0654
No log	4.8571	238	1.3361	0.2354	1.3361	1.1559
No log	4.8980	240	1.2807	0.1554	1.2807	1.1317
No log	4.9388	242	1.1441	0.1214	1.1441	1.0696
No log	4.9796	244	1.0502	0.2569	1.0502	1.0248
No log	5.0204	246	1.0608	0.2028	1.0608	1.0300
No log	5.0612	248	1.1178	0.1712	1.1178	1.0572
No log	5.1020	250	1.2042	0.2403	1.2042	1.0973
No log	5.1429	252	1.2077	0.2721	1.2077	1.0989
No log	5.1837	254	1.0732	0.2810	1.0732	1.0359
No log	5.2245	256	1.0536	0.2431	1.0536	1.0264
No log	5.2653	258	1.0960	0.2525	1.0960	1.0469
No log	5.3061	260	1.2108	0.3087	1.2108	1.1004
No log	5.3469	262	1.3263	0.3615	1.3263	1.1517
No log	5.3878	264	1.3684	0.3392	1.3684	1.1698
No log	5.4286	266	1.2788	0.2790	1.2788	1.1308
No log	5.4694	268	1.2192	0.0980	1.2192	1.1042
No log	5.5102	270	1.1619	0.1148	1.1619	1.0779
No log	5.5510	272	1.0489	0.1711	1.0489	1.0241
No log	5.5918	274	1.0320	0.1546	1.0320	1.0159
No log	5.6327	276	1.0642	0.1706	1.0642	1.0316
No log	5.6735	278	1.1679	0.3187	1.1679	1.0807
No log	5.7143	280	1.2023	0.3475	1.2023	1.0965
No log	5.7551	282	1.1375	0.3387	1.1375	1.0665
No log	5.7959	284	1.0914	0.3413	1.0914	1.0447
No log	5.8367	286	1.1140	0.3648	1.1140	1.0555
No log	5.8776	288	1.0189	0.3677	1.0189	1.0094
No log	5.9184	290	0.9839	0.3211	0.9839	0.9919
No log	5.9592	292	0.9560	0.2155	0.9560	0.9777
No log	6.0	294	1.0754	0.2330	1.0754	1.0370
No log	6.0408	296	1.2278	0.3461	1.2278	1.1080
No log	6.0816	298	1.2578	0.3299	1.2578	1.1215
No log	6.1224	300	1.1922	0.2330	1.1922	1.0919
No log	6.1633	302	1.1184	0.1696	1.1184	1.0575
No log	6.2041	304	1.0787	0.1645	1.0787	1.0386
No log	6.2449	306	1.1151	0.1480	1.1151	1.0560
No log	6.2857	308	1.2816	0.1031	1.2816	1.1321
No log	6.3265	310	1.3715	0.1592	1.3715	1.1711
No log	6.3673	312	1.2872	0.0702	1.2872	1.1345
No log	6.4082	314	1.1607	0.1379	1.1607	1.0774
No log	6.4490	316	1.1134	0.1442	1.1134	1.0552
No log	6.4898	318	1.1169	0.1442	1.1169	1.0568
No log	6.5306	320	1.2089	0.2330	1.2089	1.0995
No log	6.5714	322	1.3638	0.2544	1.3638	1.1678
No log	6.6122	324	1.3152	0.2424	1.3152	1.1468
No log	6.6531	326	1.1800	0.2330	1.1800	1.0863
No log	6.6939	328	1.0405	0.2486	1.0405	1.0201
No log	6.7347	330	1.0577	0.2175	1.0577	1.0284
No log	6.7755	332	1.1892	0.2330	1.1892	1.0905
No log	6.8163	334	1.2682	0.2817	1.2682	1.1262
No log	6.8571	336	1.2866	0.2390	1.2866	1.1343
No log	6.8980	338	1.1833	0.2236	1.1833	1.0878
No log	6.9388	340	1.0796	0.2019	1.0796	1.0390
No log	6.9796	342	1.0829	0.2019	1.0829	1.0406
No log	7.0204	344	1.1344	0.2051	1.1344	1.0651
No log	7.0612	346	1.2673	0.2410	1.2673	1.1258
No log	7.1020	348	1.3507	0.2252	1.3507	1.1622
No log	7.1429	350	1.2765	0.2410	1.2765	1.1298
No log	7.1837	352	1.1827	0.2424	1.1827	1.0875
No log	7.2245	354	1.2503	0.2512	1.2503	1.1182
No log	7.2653	356	1.3759	0.3067	1.3759	1.1730
No log	7.3061	358	1.3881	0.3067	1.3881	1.1782
No log	7.3469	360	1.3502	0.2815	1.3502	1.1620
No log	7.3878	362	1.2546	0.2935	1.2546	1.1201
No log	7.4286	364	1.2077	0.2790	1.2077	1.0990
No log	7.4694	366	1.1697	0.2447	1.1697	1.0815
No log	7.5102	368	1.2034	0.2041	1.2034	1.0970
No log	7.5510	370	1.2685	0.2410	1.2685	1.1263
No log	7.5918	372	1.3430	0.2935	1.3430	1.1589
No log	7.6327	374	1.4458	0.2825	1.4458	1.2024
No log	7.6735	376	1.4236	0.3183	1.4236	1.1931
No log	7.7143	378	1.3034	0.2678	1.3034	1.1417
No log	7.7551	380	1.1980	0.2410	1.1980	1.0945
No log	7.7959	382	1.1732	0.2131	1.1732	1.0832
No log	7.8367	384	1.1647	0.1692	1.1647	1.0792
No log	7.8776	386	1.1792	0.2131	1.1792	1.0859
No log	7.9184	388	1.1896	0.2131	1.1896	1.0907
No log	7.9592	390	1.2397	0.2678	1.2397	1.1134
No log	8.0	392	1.1354	0.2931	1.1354	1.0656
No log	8.0408	394	0.9994	0.3361	0.9994	0.9997
No log	8.0816	396	0.9984	0.3361	0.9984	0.9992
No log	8.1224	398	1.1175	0.3341	1.1175	1.0571
No log	8.1633	400	1.2470	0.3442	1.2470	1.1167
No log	8.2041	402	1.1757	0.3357	1.1757	1.0843
No log	8.2449	404	1.0064	0.1379	1.0064	1.0032
No log	8.2857	406	0.9426	0.3145	0.9426	0.9709
No log	8.3265	408	0.9477	0.3250	0.9477	0.9735
No log	8.3673	410	1.0102	0.1379	1.0102	1.0051
No log	8.4082	412	1.1089	0.2570	1.1089	1.0531
No log	8.4490	414	1.1771	0.3341	1.1771	1.0849
No log	8.4898	416	1.1399	0.2837	1.1399	1.0677
No log	8.5306	418	1.1105	0.2046	1.1105	1.0538
No log	8.5714	420	1.0456	0.1605	1.0456	1.0226
No log	8.6122	422	0.9978	0.3616	0.9978	0.9989
No log	8.6531	424	1.0220	0.3616	1.0220	1.0109
No log	8.6939	426	1.0962	0.1546	1.0962	1.0470
No log	8.7347	428	1.1961	0.0974	1.1961	1.0936
No log	8.7755	430	1.2813	0.1122	1.2813	1.1320
No log	8.8163	432	1.2426	0.1122	1.2426	1.1147
No log	8.8571	434	1.1568	0.1076	1.1568	1.0756
No log	8.8980	436	1.1109	0.1417	1.1109	1.0540
No log	8.9388	438	1.1664	0.1795	1.1664	1.0800
No log	8.9796	440	1.3364	0.2707	1.3364	1.1560
No log	9.0204	442	1.3672	0.2574	1.3672	1.1693
No log	9.0612	444	1.2926	0.2707	1.2926	1.1369
No log	9.1020	446	1.2485	0.2678	1.2485	1.1174
No log	9.1429	448	1.1933	0.2173	1.1933	1.0924
No log	9.1837	450	1.1747	0.2173	1.1747	1.0838
No log	9.2245	452	1.1990	0.2173	1.1990	1.0950
No log	9.2653	454	1.2913	0.2935	1.2913	1.1364
No log	9.3061	456	1.2748	0.2678	1.2748	1.1291
No log	9.3469	458	1.2196	0.1789	1.2196	1.1044
No log	9.3878	460	1.1779	0.0541	1.1779	1.0853
No log	9.4286	462	1.1773	0.0541	1.1773	1.0850
No log	9.4694	464	1.1833	0.0887	1.1833	1.0878
No log	9.5102	466	1.2424	0.2087	1.2424	1.1146
No log	9.5510	468	1.3442	0.2304	1.3442	1.1594
No log	9.5918	470	1.4499	0.2660	1.4499	1.2041
No log	9.6327	472	1.3941	0.2660	1.3941	1.1807
No log	9.6735	474	1.1909	0.2678	1.1909	1.0913
No log	9.7143	476	1.0435	0.1952	1.0435	1.0215
No log	9.7551	478	0.9680	0.2331	0.9680	0.9839
No log	9.7959	480	0.9528	0.2231	0.9528	0.9761
No log	9.8367	482	1.0211	0.2304	1.0211	1.0105
No log	9.8776	484	1.1691	0.3562	1.1691	1.0813
No log	9.9184	486	1.2988	0.2863	1.2988	1.1396
No log	9.9592	488	1.2324	0.3562	1.2324	1.1101
No log	10.0	490	1.1196	0.3136	1.1196	1.0581
No log	10.0408	492	1.0657	0.2619	1.0657	1.0323
No log	10.0816	494	1.1249	0.2424	1.1249	1.0606
No log	10.1224	496	1.1716	0.2519	1.1716	1.0824
No log	10.1633	498	1.1667	0.1637	1.1667	1.0801
0.3698	10.2041	500	1.1500	0.1316	1.1500	1.0724
0.3698	10.2449	502	1.1668	0.1637	1.1668	1.0802
0.3698	10.2857	504	1.2597	0.2736	1.2597	1.1224
0.3698	10.3265	506	1.4146	0.3067	1.4146	1.1894
0.3698	10.3673	508	1.4633	0.3521	1.4633	1.2097
0.3698	10.4082	510	1.4718	0.3233	1.4718	1.2132
0.3698	10.4490	512	1.3304	0.3302	1.3304	1.1534
0.3698	10.4898	514	1.1019	0.3502	1.1019	1.0497
0.3698	10.5306	516	1.0090	0.2686	1.0090	1.0045
0.3698	10.5714	518	1.0481	0.2951	1.0481	1.0238
0.3698	10.6122	520	1.1453	0.2586	1.1453	1.0702
0.3698	10.6531	522	1.1713	0.2445	1.1713	1.0823
0.3698	10.6939	524	1.1892	0.2445	1.1892	1.0905
0.3698	10.7347	526	1.1418	0.1219	1.1418	1.0685
0.3698	10.7755	528	1.1169	0.1315	1.1169	1.0568
0.3698	10.8163	530	1.1483	0.1479	1.1483	1.0716
0.3698	10.8571	532	1.2336	0.2173	1.2336	1.1107
0.3698	10.8980	534	1.3142	0.2736	1.3142	1.1464
0.3698	10.9388	536	1.2667	0.1980	1.2667	1.1255
0.3698	10.9796	538	1.1916	0.1894	1.1916	1.0916
0.3698	11.0204	540	1.1170	0.1279	1.1170	1.0569
0.3698	11.0612	542	1.1050	0.1211	1.1050	1.0512
0.3698	11.1020	544	1.1322	0.1211	1.1322	1.0641
0.3698	11.1429	546	1.2135	0.0980	1.2135	1.1016
0.3698	11.1837	548	1.2912	0.0887	1.2912	1.1363

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1