ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2646
• Qwk: 0.1142
• Mse: 1.2646
• Rmse: 1.1246

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	3.8463	-0.0047	3.8463	1.9612
No log	0.1481	4	2.0640	0.0348	2.0640	1.4367
No log	0.2222	6	1.7013	0.0219	1.7013	1.3044
No log	0.2963	8	1.3863	0.0922	1.3863	1.1774
No log	0.3704	10	1.1891	0.2221	1.1891	1.0905
No log	0.4444	12	1.2914	0.0380	1.2914	1.1364
No log	0.5185	14	1.2715	0.0380	1.2715	1.1276
No log	0.5926	16	1.1246	0.1142	1.1246	1.0605
No log	0.6667	18	1.1476	0.0760	1.1476	1.0712
No log	0.7407	20	1.2824	0.0380	1.2824	1.1324
No log	0.8148	22	1.2976	0.0380	1.2976	1.1391
No log	0.8889	24	1.1548	0.1790	1.1548	1.0746
No log	0.9630	26	0.9931	0.2758	0.9931	0.9966
No log	1.0370	28	0.9400	0.4129	0.9400	0.9695
No log	1.1111	30	0.9479	0.4002	0.9479	0.9736
No log	1.1852	32	0.9378	0.3519	0.9378	0.9684
No log	1.2593	34	0.9514	0.3562	0.9514	0.9754
No log	1.3333	36	0.9913	0.4080	0.9913	0.9956
No log	1.4074	38	1.0350	0.3171	1.0350	1.0173
No log	1.4815	40	1.0425	0.3026	1.0425	1.0210
No log	1.5556	42	1.0145	0.3753	1.0145	1.0072
No log	1.6296	44	1.0251	0.2441	1.0251	1.0125
No log	1.7037	46	1.0255	0.2492	1.0255	1.0127
No log	1.7778	48	1.0022	0.4420	1.0022	1.0011
No log	1.8519	50	0.9692	0.3519	0.9692	0.9845
No log	1.9259	52	0.9609	0.2161	0.9609	0.9803
No log	2.0	54	0.9787	0.1545	0.9787	0.9893
No log	2.0741	56	0.8788	0.2314	0.8788	0.9375
No log	2.1481	58	0.8456	0.2865	0.8456	0.9196
No log	2.2222	60	0.8515	0.2572	0.8515	0.9228
No log	2.2963	62	1.1005	0.1076	1.1005	1.0491
No log	2.3704	64	1.3831	0.0445	1.3831	1.1761
No log	2.4444	66	1.3813	0.0319	1.3813	1.1753
No log	2.5185	68	1.2259	0.0888	1.2259	1.1072
No log	2.5926	70	0.9592	0.2771	0.9592	0.9794
No log	2.6667	72	0.8938	0.3528	0.8938	0.9454
No log	2.7407	74	0.9199	0.2441	0.9199	0.9591
No log	2.8148	76	1.0335	0.1203	1.0335	1.0166
No log	2.8889	78	1.1079	0.0762	1.1079	1.0526
No log	2.9630	80	1.1789	-0.0251	1.1789	1.0858
No log	3.0370	82	1.2041	-0.0251	1.2041	1.0973
No log	3.1111	84	1.1286	0.0319	1.1286	1.0623
No log	3.1852	86	0.9486	0.1516	0.9486	0.9739
No log	3.2593	88	0.8336	0.3326	0.8336	0.9130
No log	3.3333	90	0.8336	0.2746	0.8336	0.9130
No log	3.4074	92	0.9671	0.1516	0.9671	0.9834
No log	3.4815	94	1.2083	0.0193	1.2083	1.0992
No log	3.5556	96	1.3479	0.0691	1.3479	1.1610
No log	3.6296	98	1.3716	0.2926	1.3716	1.1711
No log	3.7037	100	1.1264	0.2984	1.1264	1.0613
No log	3.7778	102	1.1119	0.3504	1.1119	1.0545
No log	3.8519	104	1.3268	0.3308	1.3268	1.1519
No log	3.9259	106	1.4472	0.3038	1.4472	1.2030
No log	4.0	108	1.2882	0.3336	1.2882	1.1350
No log	4.0741	110	1.0979	0.3663	1.0979	1.0478
No log	4.1481	112	1.1984	0.3897	1.1984	1.0947
No log	4.2222	114	1.5431	0.3134	1.5431	1.2422
No log	4.2963	116	1.7864	0.1709	1.7864	1.3366
No log	4.3704	118	1.6330	0.2103	1.6330	1.2779
No log	4.4444	120	1.3616	0.3194	1.3616	1.1669
No log	4.5185	122	1.0542	0.3913	1.0542	1.0267
No log	4.5926	124	0.9547	0.4226	0.9547	0.9771
No log	4.6667	126	1.1346	0.3595	1.1346	1.0652
No log	4.7407	128	1.5151	0.2677	1.5151	1.2309
No log	4.8148	130	1.6484	0.1960	1.6484	1.2839
No log	4.8889	132	1.5573	0.2786	1.5573	1.2479
No log	4.9630	134	1.2984	0.3624	1.2984	1.1395
No log	5.0370	136	1.2095	0.3040	1.2095	1.0998
No log	5.1111	138	1.2243	0.2816	1.2243	1.1065
No log	5.1852	140	1.2904	0.2015	1.2904	1.1360
No log	5.2593	142	1.3687	0.2424	1.3687	1.1699
No log	5.3333	144	1.3250	0.2837	1.3250	1.1511
No log	5.4074	146	1.1208	0.3091	1.1208	1.0587
No log	5.4815	148	0.9726	0.2772	0.9726	0.9862
No log	5.5556	150	1.0188	0.2794	1.0188	1.0093
No log	5.6296	152	1.2527	0.2647	1.2527	1.1192
No log	5.7037	154	1.5677	0.2611	1.5677	1.2521
No log	5.7778	156	1.6638	0.1807	1.6638	1.2899
No log	5.8519	158	1.6221	0.2317	1.6221	1.2736
No log	5.9259	160	1.5038	0.2653	1.5038	1.2263
No log	6.0	162	1.2809	0.2915	1.2809	1.1318
No log	6.0741	164	1.1960	0.3261	1.1960	1.0936
No log	6.1481	166	1.2760	0.3392	1.2760	1.1296
No log	6.2222	168	1.3454	0.2793	1.3454	1.1599
No log	6.2963	170	1.2233	0.2793	1.2233	1.1060
No log	6.3704	172	1.0271	0.2592	1.0271	1.0135
No log	6.4444	174	0.9363	0.2979	0.9363	0.9676
No log	6.5185	176	0.9739	0.3263	0.9739	0.9869
No log	6.5926	178	1.1432	0.2987	1.1432	1.0692
No log	6.6667	180	1.2002	0.2733	1.2002	1.0956
No log	6.7407	182	1.1830	0.3511	1.1830	1.0876
No log	6.8148	184	1.1926	0.2837	1.1926	1.0921
No log	6.8889	186	1.1802	0.1113	1.1802	1.0864
No log	6.9630	188	1.1813	0.2730	1.1813	1.0869
No log	7.0370	190	1.2551	0.3084	1.2551	1.1203
No log	7.1111	192	1.1757	0.3745	1.1757	1.0843
No log	7.1852	194	1.0098	0.3500	1.0098	1.0049
No log	7.2593	196	1.0653	0.4021	1.0653	1.0321
No log	7.3333	198	1.2749	0.3659	1.2749	1.1291
No log	7.4074	200	1.3649	0.3066	1.3649	1.1683
No log	7.4815	202	1.2593	0.2806	1.2593	1.1222
No log	7.5556	204	1.0829	0.2239	1.0829	1.0406
No log	7.6296	206	0.9218	0.2750	0.9218	0.9601
No log	7.7037	208	0.8997	0.2424	0.8997	0.9485
No log	7.7778	210	0.9944	0.1842	0.9944	0.9972
No log	7.8519	212	1.2150	0.2239	1.2150	1.1023
No log	7.9259	214	1.3574	0.2653	1.3574	1.1651
No log	8.0	216	1.3909	0.2694	1.3909	1.1794
No log	8.0741	218	1.2930	0.2694	1.2930	1.1371
No log	8.1481	220	1.2336	0.2568	1.2336	1.1107
No log	8.2222	222	1.1562	0.3424	1.1562	1.0753
No log	8.2963	224	1.0950	0.3151	1.0950	1.0464
No log	8.3704	226	1.1476	0.2126	1.1476	1.0713
No log	8.4444	228	1.2411	0.2292	1.2411	1.1140
No log	8.5185	230	1.3192	0.2391	1.3192	1.1486
No log	8.5926	232	1.2483	0.2239	1.2483	1.1173
No log	8.6667	234	1.1911	0.1562	1.1911	1.0914
No log	8.7407	236	1.1323	0.1228	1.1323	1.0641
No log	8.8148	238	1.1235	0.1562	1.1235	1.0600
No log	8.8889	240	1.0722	0.1622	1.0722	1.0355
No log	8.9630	242	0.9704	0.1676	0.9704	0.9851
No log	9.0370	244	0.9787	0.1893	0.9787	0.9893
No log	9.1111	246	1.1167	0.3534	1.1167	1.0568
No log	9.1852	248	1.3199	0.3018	1.3199	1.1489
No log	9.2593	250	1.4413	0.2869	1.4413	1.2005
No log	9.3333	252	1.4059	0.2940	1.4059	1.1857
No log	9.4074	254	1.2514	0.2982	1.2514	1.1187
No log	9.4815	256	1.1630	0.2982	1.1630	1.0784
No log	9.5556	258	1.0786	0.2885	1.0786	1.0385
No log	9.6296	260	1.1406	0.2795	1.1406	1.0680
No log	9.7037	262	1.3179	0.2982	1.3179	1.1480
No log	9.7778	264	1.5455	0.2606	1.5455	1.2432
No log	9.8519	266	1.6971	0.3095	1.6971	1.3027
No log	9.9259	268	1.6550	0.2606	1.6550	1.2865
No log	10.0	270	1.4722	0.3086	1.4722	1.2134
No log	10.0741	272	1.2881	0.2424	1.2881	1.1349
No log	10.1481	274	1.1102	0.2592	1.1102	1.0537
No log	10.2222	276	1.0736	0.1622	1.0736	1.0362
No log	10.2963	278	1.1447	0.2143	1.1447	1.0699
No log	10.3704	280	1.2769	0.1814	1.2769	1.1300
No log	10.4444	282	1.3081	0.2126	1.3081	1.1437
No log	10.5185	284	1.3029	0.1814	1.3029	1.1415
No log	10.5926	286	1.3047	0.2126	1.3047	1.1422
No log	10.6667	288	1.3106	0.2126	1.3106	1.1448
No log	10.7407	290	1.2514	0.2126	1.2514	1.1187
No log	10.8148	292	1.2560	0.2126	1.2560	1.1207
No log	10.8889	294	1.2522	0.2126	1.2522	1.1190
No log	10.9630	296	1.2768	0.2474	1.2768	1.1300
No log	11.0370	298	1.2672	0.2474	1.2672	1.1257
No log	11.1111	300	1.1908	0.3433	1.1908	1.0912
No log	11.1852	302	1.1228	0.3560	1.1228	1.0596
No log	11.2593	304	1.1474	0.3584	1.1474	1.0712
No log	11.3333	306	1.2681	0.3140	1.2681	1.1261
No log	11.4074	308	1.3481	0.2611	1.3481	1.1611
No log	11.4815	310	1.3129	0.1814	1.3129	1.1458
No log	11.5556	312	1.1880	0.1892	1.1880	1.0899
No log	11.6296	314	1.0923	0.1722	1.0923	1.0451
No log	11.7037	316	1.0861	0.1722	1.0861	1.0422
No log	11.7778	318	1.1542	0.0833	1.1542	1.0743
No log	11.8519	320	1.2270	0.0401	1.2270	1.1077
No log	11.9259	322	1.3462	0.1052	1.3462	1.1602
No log	12.0	324	1.4716	0.1407	1.4716	1.2131
No log	12.0741	326	1.4999	0.1814	1.4999	1.2247
No log	12.1481	328	1.4190	0.2424	1.4190	1.1912
No log	12.2222	330	1.3249	0.2795	1.3249	1.1511
No log	12.2963	332	1.3362	0.3231	1.3362	1.1560
No log	12.3704	334	1.4086	0.3243	1.4086	1.1868
No log	12.4444	336	1.4529	0.3273	1.4529	1.2053
No log	12.5185	338	1.4530	0.2752	1.4530	1.2054
No log	12.5926	340	1.3811	0.2065	1.3811	1.1752
No log	12.6667	342	1.3094	0.0781	1.3094	1.1443
No log	12.7407	344	1.2619	0.0401	1.2619	1.1234
No log	12.8148	346	1.2824	0.0781	1.2824	1.1324
No log	12.8889	348	1.3667	0.1814	1.3667	1.1691
No log	12.9630	350	1.3465	0.2126	1.3465	1.1604
No log	13.0370	352	1.3067	0.2773	1.3067	1.1431
No log	13.1111	354	1.2788	0.2773	1.2788	1.1308
No log	13.1852	356	1.3209	0.2773	1.3209	1.1493
No log	13.2593	358	1.4195	0.2315	1.4195	1.1914
No log	13.3333	360	1.4091	0.2424	1.4091	1.1870
No log	13.4074	362	1.3618	0.2424	1.3618	1.1670
No log	13.4815	364	1.3748	0.2424	1.3748	1.1725
No log	13.5556	366	1.4144	0.2474	1.4144	1.1893
No log	13.6296	368	1.3280	0.1486	1.3280	1.1524
No log	13.7037	370	1.2866	0.0	1.2866	1.1343
No log	13.7778	372	1.2502	0.0401	1.2502	1.1181
No log	13.8519	374	1.2632	0.2065	1.2632	1.1239
No log	13.9259	376	1.3061	0.2126	1.3061	1.1428
No log	14.0	378	1.3260	0.2126	1.3260	1.1515
No log	14.0741	380	1.3243	0.2424	1.3243	1.1508
No log	14.1481	382	1.3100	0.2752	1.3100	1.1445
No log	14.2222	384	1.3875	0.2906	1.3875	1.1779
No log	14.2963	386	1.3394	0.2906	1.3394	1.1573
No log	14.3704	388	1.3843	0.2906	1.3843	1.1766
No log	14.4444	390	1.4299	0.2906	1.4299	1.1958
No log	14.5185	392	1.4014	0.3052	1.4014	1.1838
No log	14.5926	394	1.3064	0.2982	1.3064	1.1430
No log	14.6667	396	1.1323	0.1228	1.1323	1.0641
No log	14.7407	398	1.0794	0.2308	1.0794	1.0390
No log	14.8148	400	1.1363	0.1228	1.1363	1.0660
No log	14.8889	402	1.2886	0.2424	1.2886	1.1352
No log	14.9630	404	1.3256	0.2424	1.3256	1.1514
No log	15.0370	406	1.3215	0.2126	1.3215	1.1496
No log	15.1111	408	1.2306	0.1814	1.2306	1.1093
No log	15.1852	410	1.1266	0.2592	1.1266	1.0614
No log	15.2593	412	1.0809	0.2592	1.0809	1.0396
No log	15.3333	414	1.1577	0.2424	1.1577	1.0760
No log	15.4074	416	1.2682	0.3052	1.2682	1.1262
No log	15.4815	418	1.3676	0.3117	1.3676	1.1695
No log	15.5556	420	1.4035	0.2940	1.4035	1.1847
No log	15.6296	422	1.3200	0.3202	1.3200	1.1489
No log	15.7037	424	1.3229	0.2869	1.3229	1.1502
No log	15.7778	426	1.3839	0.2869	1.3839	1.1764
No log	15.8519	428	1.3963	0.3117	1.3963	1.1817
No log	15.9259	430	1.3704	0.3117	1.3704	1.1707
No log	16.0	432	1.4083	0.3148	1.4083	1.1867
No log	16.0741	434	1.4627	0.3036	1.4627	1.2094
No log	16.1481	436	1.4275	0.3381	1.4275	1.1948
No log	16.2222	438	1.3200	0.3202	1.3200	1.1489
No log	16.2963	440	1.1901	0.3091	1.1901	1.0909
No log	16.3704	442	1.0804	0.1911	1.0804	1.0394
No log	16.4444	444	1.1128	0.2477	1.1128	1.0549
No log	16.5185	446	1.2228	0.3199	1.2228	1.1058
No log	16.5926	448	1.3459	0.3117	1.3459	1.1601
No log	16.6667	450	1.2872	0.3117	1.2872	1.1346
No log	16.7407	452	1.1651	0.3243	1.1651	1.0794
No log	16.8148	454	1.1281	0.3336	1.1281	1.0621
No log	16.8889	456	1.0461	0.2260	1.0461	1.0228
No log	16.9630	458	0.9650	0.2167	0.9650	0.9824
No log	17.0370	460	0.8977	0.2750	0.8977	0.9475
No log	17.1111	462	0.9643	0.2564	0.9643	0.9820
No log	17.1852	464	1.1049	0.2885	1.1049	1.0511
No log	17.2593	466	1.2719	0.3072	1.2719	1.1278
No log	17.3333	468	1.4301	0.3086	1.4301	1.1959
No log	17.4074	470	1.4834	0.2653	1.4834	1.2180
No log	17.4815	472	1.4363	0.2126	1.4363	1.1985
No log	17.5556	474	1.3238	0.1052	1.3238	1.1506
No log	17.6296	476	1.2777	0.0401	1.2777	1.1304
No log	17.7037	478	1.2549	0.1407	1.2549	1.1202
No log	17.7778	480	1.2155	0.2395	1.2155	1.1025
No log	17.8519	482	1.2124	0.2424	1.2124	1.1011
No log	17.9259	484	1.2670	0.3018	1.2670	1.1256
No log	18.0	486	1.2865	0.3018	1.2865	1.1342
No log	18.0741	488	1.2415	0.2709	1.2415	1.1142
No log	18.1481	490	1.1631	0.1562	1.1631	1.0785
No log	18.2222	492	1.0646	0.1654	1.0646	1.0318
No log	18.2963	494	1.0318	0.1230	1.0318	1.0158
No log	18.3704	496	1.0274	0.1230	1.0274	1.0136
No log	18.4444	498	1.0933	0.1628	1.0933	1.0456
0.3061	18.5185	500	1.1751	0.1228	1.1751	1.0840
0.3061	18.5926	502	1.2244	0.2424	1.2244	1.1065
0.3061	18.6667	504	1.2144	0.2424	1.2144	1.1020
0.3061	18.7407	506	1.1201	0.2506	1.1201	1.0583
0.3061	18.8148	508	1.1074	0.3326	1.1074	1.0523
0.3061	18.8889	510	1.1731	0.3584	1.1731	1.0831
0.3061	18.9630	512	1.3121	0.3172	1.3121	1.1455
0.3061	19.0370	514	1.3841	0.3273	1.3841	1.1765
0.3061	19.1111	516	1.3696	0.3018	1.3696	1.1703
0.3061	19.1852	518	1.2720	0.2424	1.2720	1.1278
0.3061	19.2593	520	1.1848	0.2203	1.1848	1.0885
0.3061	19.3333	522	1.0639	0.1170	1.0639	1.0314
0.3061	19.4074	524	0.9974	0.1500	0.9974	0.9987
0.3061	19.4815	526	0.9294	0.2066	0.9294	0.9640
0.3061	19.5556	528	0.9078	0.3041	0.9078	0.9528
0.3061	19.6296	530	1.0075	0.1986	1.0075	1.0037
0.3061	19.7037	532	1.1478	0.1700	1.1478	1.0714
0.3061	19.7778	534	1.2823	0.2709	1.2823	1.1324
0.3061	19.8519	536	1.4290	0.3117	1.4290	1.1954
0.3061	19.9259	538	1.4398	0.2869	1.4398	1.1999
0.3061	20.0	540	1.3383	0.2126	1.3383	1.1568
0.3061	20.0741	542	1.2515	0.1744	1.2515	1.1187
0.3061	20.1481	544	1.1874	0.0781	1.1874	1.0897
0.3061	20.2222	546	1.1893	0.0401	1.1893	1.0905
0.3061	20.2963	548	1.2270	0.0401	1.2270	1.1077
0.3061	20.3704	550	1.2607	0.0781	1.2607	1.1228
0.3061	20.4444	552	1.2646	0.1142	1.2646	1.1246

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1