ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2296
• Qwk: 0.1142
• Mse: 1.2296
• Rmse: 1.1089

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	3.8463	-0.0047	3.8463	1.9612
No log	0.1481	4	2.0640	0.0348	2.0640	1.4367
No log	0.2222	6	1.7013	0.0219	1.7013	1.3044
No log	0.2963	8	1.3863	0.0922	1.3863	1.1774
No log	0.3704	10	1.1891	0.2221	1.1891	1.0905
No log	0.4444	12	1.2914	0.0380	1.2914	1.1364
No log	0.5185	14	1.2715	0.0380	1.2715	1.1276
No log	0.5926	16	1.1246	0.1142	1.1246	1.0605
No log	0.6667	18	1.1476	0.0760	1.1476	1.0712
No log	0.7407	20	1.2824	0.0380	1.2824	1.1324
No log	0.8148	22	1.2976	0.0380	1.2976	1.1391
No log	0.8889	24	1.1548	0.1790	1.1548	1.0746
No log	0.9630	26	0.9931	0.2758	0.9931	0.9966
No log	1.0370	28	0.9400	0.4129	0.9400	0.9695
No log	1.1111	30	0.9479	0.4002	0.9479	0.9736
No log	1.1852	32	0.9378	0.3519	0.9378	0.9684
No log	1.2593	34	0.9514	0.3562	0.9514	0.9754
No log	1.3333	36	0.9913	0.4080	0.9913	0.9956
No log	1.4074	38	1.0350	0.3171	1.0350	1.0173
No log	1.4815	40	1.0425	0.3026	1.0425	1.0210
No log	1.5556	42	1.0145	0.3753	1.0145	1.0072
No log	1.6296	44	1.0251	0.2441	1.0251	1.0125
No log	1.7037	46	1.0255	0.2492	1.0255	1.0127
No log	1.7778	48	1.0022	0.4420	1.0022	1.0011
No log	1.8519	50	0.9692	0.3519	0.9692	0.9845
No log	1.9259	52	0.9609	0.2161	0.9609	0.9803
No log	2.0	54	0.9787	0.1545	0.9787	0.9893
No log	2.0741	56	0.8788	0.2314	0.8788	0.9375
No log	2.1481	58	0.8456	0.2865	0.8456	0.9195
No log	2.2222	60	0.8515	0.2572	0.8515	0.9228
No log	2.2963	62	1.1005	0.1076	1.1005	1.0490
No log	2.3704	64	1.3831	0.0445	1.3831	1.1761
No log	2.4444	66	1.3813	0.0319	1.3813	1.1753
No log	2.5185	68	1.2258	0.0888	1.2258	1.1072
No log	2.5926	70	0.9592	0.2771	0.9592	0.9794
No log	2.6667	72	0.8938	0.3528	0.8938	0.9454
No log	2.7407	74	0.9200	0.2441	0.9200	0.9591
No log	2.8148	76	1.0335	0.1203	1.0335	1.0166
No log	2.8889	78	1.1080	0.0762	1.1080	1.0526
No log	2.9630	80	1.1789	-0.0251	1.1789	1.0858
No log	3.0370	82	1.2041	-0.0251	1.2041	1.0973
No log	3.1111	84	1.1285	0.0319	1.1285	1.0623
No log	3.1852	86	0.9485	0.1516	0.9485	0.9739
No log	3.2593	88	0.8336	0.3326	0.8336	0.9130
No log	3.3333	90	0.8336	0.2746	0.8336	0.9130
No log	3.4074	92	0.9672	0.1516	0.9672	0.9834
No log	3.4815	94	1.2084	0.0193	1.2084	1.0993
No log	3.5556	96	1.3480	0.0691	1.3480	1.1610
No log	3.6296	98	1.3715	0.2926	1.3715	1.1711
No log	3.7037	100	1.1264	0.2984	1.1264	1.0613
No log	3.7778	102	1.1119	0.3504	1.1119	1.0545
No log	3.8519	104	1.3268	0.3308	1.3268	1.1519
No log	3.9259	106	1.4472	0.3038	1.4472	1.2030
No log	4.0	108	1.2881	0.3336	1.2881	1.1349
No log	4.0741	110	1.0978	0.3663	1.0978	1.0478
No log	4.1481	112	1.1983	0.3897	1.1983	1.0947
No log	4.2222	114	1.5429	0.3134	1.5429	1.2421
No log	4.2963	116	1.7863	0.1709	1.7863	1.3365
No log	4.3704	118	1.6329	0.2103	1.6329	1.2778
No log	4.4444	120	1.3616	0.3194	1.3616	1.1669
No log	4.5185	122	1.0540	0.3913	1.0540	1.0267
No log	4.5926	124	0.9543	0.4226	0.9543	0.9769
No log	4.6667	126	1.1339	0.3595	1.1339	1.0648
No log	4.7407	128	1.5147	0.2677	1.5147	1.2307
No log	4.8148	130	1.6484	0.1960	1.6484	1.2839
No log	4.8889	132	1.5576	0.2786	1.5576	1.2480
No log	4.9630	134	1.2986	0.3624	1.2986	1.1396
No log	5.0370	136	1.2092	0.3040	1.2092	1.0996
No log	5.1111	138	1.2239	0.2816	1.2239	1.1063
No log	5.1852	140	1.2902	0.2015	1.2902	1.1359
No log	5.2593	142	1.3694	0.2424	1.3694	1.1702
No log	5.3333	144	1.3264	0.2837	1.3264	1.1517
No log	5.4074	146	1.1224	0.3091	1.1224	1.0594
No log	5.4815	148	0.9741	0.2772	0.9741	0.9870
No log	5.5556	150	1.0205	0.2794	1.0205	1.0102
No log	5.6296	152	1.2544	0.2647	1.2544	1.1200
No log	5.7037	154	1.5678	0.2611	1.5678	1.2521
No log	5.7778	156	1.6629	0.1807	1.6629	1.2895
No log	5.8519	158	1.6218	0.2317	1.6218	1.2735
No log	5.9259	160	1.5042	0.2653	1.5042	1.2265
No log	6.0	162	1.2821	0.2915	1.2821	1.1323
No log	6.0741	164	1.1970	0.2915	1.1970	1.0941
No log	6.1481	166	1.2767	0.3392	1.2767	1.1299
No log	6.2222	168	1.3445	0.2793	1.3445	1.1595
No log	6.2963	170	1.2206	0.2793	1.2206	1.1048
No log	6.3704	172	1.0245	0.2592	1.0245	1.0122
No log	6.4444	174	0.9358	0.2979	0.9358	0.9674
No log	6.5185	176	0.9744	0.3263	0.9744	0.9871
No log	6.5926	178	1.1453	0.2987	1.1453	1.0702
No log	6.6667	180	1.2037	0.2733	1.2037	1.0971
No log	6.7407	182	1.1858	0.3172	1.1858	1.0889
No log	6.8148	184	1.1926	0.2837	1.1926	1.0921
No log	6.8889	186	1.1780	0.1449	1.1780	1.0854
No log	6.9630	188	1.1783	0.2730	1.1783	1.0855
No log	7.0370	190	1.2523	0.3084	1.2523	1.1191
No log	7.1111	192	1.1736	0.3745	1.1736	1.0833
No log	7.1852	194	1.0128	0.3500	1.0128	1.0064
No log	7.2593	196	1.0720	0.4021	1.0720	1.0354
No log	7.3333	198	1.2789	0.3659	1.2789	1.1309
No log	7.4074	200	1.3670	0.3066	1.3670	1.1692
No log	7.4815	202	1.2600	0.2806	1.2600	1.1225
No log	7.5556	204	1.0820	0.2239	1.0820	1.0402
No log	7.6296	206	0.9200	0.2750	0.9200	0.9592
No log	7.7037	208	0.9002	0.2424	0.9002	0.9488
No log	7.7778	210	0.9968	0.1842	0.9968	0.9984
No log	7.8519	212	1.2195	0.2239	1.2195	1.1043
No log	7.9259	214	1.3612	0.2653	1.3612	1.1667
No log	8.0	216	1.3938	0.2694	1.3938	1.1806
No log	8.0741	218	1.2961	0.2694	1.2961	1.1385
No log	8.1481	220	1.2361	0.2568	1.2361	1.1118
No log	8.2222	222	1.1573	0.2773	1.1573	1.0758
No log	8.2963	224	1.0963	0.3151	1.0963	1.0470
No log	8.3704	226	1.1482	0.2126	1.1482	1.0716
No log	8.4444	228	1.2409	0.2292	1.2409	1.1140
No log	8.5185	230	1.3191	0.2391	1.3191	1.1485
No log	8.5926	232	1.2493	0.2239	1.2493	1.1177
No log	8.6667	234	1.1921	0.1562	1.1921	1.0918
No log	8.7407	236	1.1327	0.1228	1.1327	1.0643
No log	8.8148	238	1.1230	0.1562	1.1230	1.0597
No log	8.8889	240	1.0719	0.1622	1.0719	1.0353
No log	8.9630	242	0.9707	0.1676	0.9707	0.9853
No log	9.0370	244	0.9799	0.1893	0.9799	0.9899
No log	9.1111	246	1.1179	0.3534	1.1179	1.0573
No log	9.1852	248	1.3183	0.3018	1.3183	1.1482
No log	9.2593	250	1.4448	0.2869	1.4448	1.2020
No log	9.3333	252	1.4181	0.2940	1.4181	1.1908
No log	9.4074	254	1.2654	0.3018	1.2654	1.1249
No log	9.4815	256	1.1625	0.2982	1.1625	1.0782
No log	9.5556	258	1.0758	0.2885	1.0758	1.0372
No log	9.6296	260	1.1434	0.2506	1.1434	1.0693
No log	9.7037	262	1.3273	0.2982	1.3273	1.1521
No log	9.7778	264	1.5627	0.2606	1.5627	1.2501
No log	9.8519	266	1.7173	0.2937	1.7173	1.3105
No log	9.9259	268	1.6715	0.2874	1.6715	1.2929
No log	10.0	270	1.4838	0.3117	1.4838	1.2181
No log	10.0741	272	1.3011	0.2424	1.3011	1.1407
No log	10.1481	274	1.1232	0.2203	1.1232	1.0598
No log	10.2222	276	1.0899	0.2284	1.0899	1.0440
No log	10.2963	278	1.1676	0.1814	1.1676	1.0805
No log	10.3704	280	1.3067	0.2126	1.3067	1.1431
No log	10.4444	282	1.3326	0.2126	1.3326	1.1544
No log	10.5185	284	1.3167	0.2126	1.3167	1.1475
No log	10.5926	286	1.3086	0.2126	1.3086	1.1439
No log	10.6667	288	1.3129	0.2424	1.3129	1.1458
No log	10.7407	290	1.2527	0.2126	1.2527	1.1192
No log	10.8148	292	1.2446	0.2126	1.2446	1.1156
No log	10.8889	294	1.2328	0.1814	1.2328	1.1103
No log	10.9630	296	1.2884	0.2474	1.2884	1.1351
No log	11.0370	298	1.3108	0.2793	1.3108	1.1449
No log	11.1111	300	1.2481	0.3486	1.2481	1.1172
No log	11.1852	302	1.1813	0.3486	1.1813	1.0869
No log	11.2593	304	1.1876	0.3486	1.1876	1.0898
No log	11.3333	306	1.2891	0.3140	1.2891	1.1354
No log	11.4074	308	1.3509	0.2752	1.3509	1.1623
No log	11.4815	310	1.2965	0.2126	1.2965	1.1386
No log	11.5556	312	1.1508	0.1918	1.1508	1.0727
No log	11.6296	314	1.0823	0.1722	1.0823	1.0403
No log	11.7037	316	1.1110	0.1722	1.1110	1.0540
No log	11.7778	318	1.2088	0.0833	1.2088	1.0995
No log	11.8519	320	1.2865	0.0401	1.2865	1.1342
No log	11.9259	322	1.3816	0.1052	1.3816	1.1754
No log	12.0	324	1.4275	0.1052	1.4275	1.1948
No log	12.0741	326	1.4001	0.1052	1.4001	1.1833
No log	12.1481	328	1.2986	0.1052	1.2986	1.1396
No log	12.2222	330	1.2140	0.2027	1.2140	1.1018
No log	12.2963	332	1.2458	0.2686	1.2458	1.1161
No log	12.3704	334	1.3531	0.3336	1.3531	1.1632
No log	12.4444	336	1.4757	0.2869	1.4757	1.2148
No log	12.5185	338	1.5172	0.2653	1.5172	1.2317
No log	12.5926	340	1.4580	0.1744	1.4580	1.2075
No log	12.6667	342	1.3340	0.1407	1.3340	1.1550
No log	12.7407	344	1.2217	0.0401	1.2217	1.1053
No log	12.8148	346	1.2308	0.1407	1.2308	1.1094
No log	12.8889	348	1.3390	0.2424	1.3390	1.1571
No log	12.9630	350	1.3571	0.2424	1.3571	1.1649
No log	13.0370	352	1.3371	0.2372	1.3371	1.1563
No log	13.1111	354	1.2641	0.2424	1.2641	1.1243
No log	13.1852	356	1.2231	0.1770	1.2231	1.1059
No log	13.2593	358	1.2783	0.1770	1.2783	1.1306
No log	13.3333	360	1.3380	0.1770	1.3380	1.1567
No log	13.4074	362	1.4643	0.1943	1.4643	1.2101
No log	13.4815	364	1.5773	0.1769	1.5773	1.2559
No log	13.5556	366	1.5452	0.1462	1.5452	1.2431
No log	13.6296	368	1.4292	0.1052	1.4292	1.1955
No log	13.7037	370	1.2839	0.0401	1.2839	1.1331
No log	13.7778	372	1.2001	0.0401	1.2001	1.0955
No log	13.8519	374	1.1666	0.1052	1.1666	1.0801
No log	13.9259	376	1.2460	0.2065	1.2460	1.1163
No log	14.0	378	1.3346	0.2372	1.3346	1.1553
No log	14.0741	380	1.4032	0.3052	1.4032	1.1846
No log	14.1481	382	1.4160	0.3117	1.4160	1.1900
No log	14.2222	384	1.4028	0.3086	1.4028	1.1844
No log	14.2963	386	1.3045	0.3273	1.3045	1.1422
No log	14.3704	388	1.2631	0.2424	1.2631	1.1239
No log	14.4444	390	1.2542	0.2065	1.2542	1.1199
No log	14.5185	392	1.2997	0.2065	1.2997	1.1400
No log	14.5926	394	1.2792	0.2065	1.2792	1.1310
No log	14.6667	396	1.1874	0.1407	1.1874	1.0897
No log	14.7407	398	1.1419	0.0833	1.1419	1.0686
No log	14.8148	400	1.1902	0.0401	1.1902	1.0909
No log	14.8889	402	1.2214	0.0401	1.2214	1.1052
No log	14.9630	404	1.2287	0.0401	1.2287	1.1085
No log	15.0370	406	1.2439	0.1052	1.2439	1.1153
No log	15.1111	408	1.1655	0.0401	1.1655	1.0796
No log	15.1852	410	1.0647	0.0811	1.0647	1.0318
No log	15.2593	412	1.0322	0.1316	1.0322	1.0160
No log	15.3333	414	1.1340	0.1886	1.1340	1.0649
No log	15.4074	416	1.2367	0.2424	1.2367	1.1121
No log	15.4815	418	1.2299	0.2506	1.2299	1.1090
No log	15.5556	420	1.1885	0.2592	1.1885	1.0902
No log	15.6296	422	1.2027	0.2885	1.2027	1.0967
No log	15.7037	424	1.2883	0.3336	1.2883	1.1350
No log	15.7778	426	1.3533	0.2752	1.3533	1.1633
No log	15.8519	428	1.4083	0.2126	1.4083	1.1867
No log	15.9259	430	1.4075	0.2126	1.4075	1.1864
No log	16.0	432	1.3811	0.2709	1.3811	1.1752
No log	16.0741	434	1.2600	0.2795	1.2600	1.1225
No log	16.1481	436	1.1122	0.3165	1.1122	1.0546
No log	16.2222	438	1.0527	0.3424	1.0527	1.0260
No log	16.2963	440	1.0487	0.3165	1.0487	1.0241
No log	16.3704	442	1.0747	0.2795	1.0747	1.0367
No log	16.4444	444	1.1268	0.3202	1.1268	1.0615
No log	16.5185	446	1.0803	0.3711	1.0803	1.0394
No log	16.5926	448	1.1116	0.3607	1.1116	1.0543
No log	16.6667	450	1.1693	0.3650	1.1693	1.0814
No log	16.7407	452	1.1531	0.3967	1.1531	1.0738
No log	16.8148	454	1.2864	0.3768	1.2864	1.1342
No log	16.8889	456	1.3499	0.3148	1.3499	1.1619
No log	16.9630	458	1.2124	0.3365	1.2124	1.1011
No log	17.0370	460	1.0561	0.2885	1.0561	1.0277
No log	17.1111	462	1.0810	0.2885	1.0810	1.0397
No log	17.1852	464	1.0908	0.2885	1.0908	1.0444
No log	17.2593	466	1.1290	0.3326	1.1290	1.0625
No log	17.3333	468	1.2441	0.3433	1.2441	1.1154
No log	17.4074	470	1.4192	0.3590	1.4192	1.1913
No log	17.4815	472	1.5049	0.3273	1.5049	1.2267
No log	17.5556	474	1.4310	0.2709	1.4310	1.1963
No log	17.6296	476	1.2666	0.0833	1.2666	1.1254
No log	17.7037	478	1.1369	0.0833	1.1369	1.0663
No log	17.7778	480	1.0975	0.0833	1.0975	1.0476
No log	17.8519	482	1.1338	0.1202	1.1338	1.0648
No log	17.9259	484	1.2700	0.3072	1.2700	1.1269
No log	18.0	486	1.3787	0.2832	1.3787	1.1742
No log	18.0741	488	1.3869	0.2869	1.3869	1.1776
No log	18.1481	490	1.2937	0.2832	1.2937	1.1374
No log	18.2222	492	1.1532	0.1952	1.1532	1.0739
No log	18.2963	494	1.0743	0.2284	1.0743	1.0365
No log	18.3704	496	1.0270	0.2040	1.0270	1.0134
No log	18.4444	498	1.0864	0.1622	1.0864	1.0423
0.3075	18.5185	500	1.1756	0.1486	1.1756	1.0842
0.3075	18.5926	502	1.2447	0.2424	1.2447	1.1157
0.3075	18.6667	504	1.2871	0.2424	1.2871	1.1345
0.3075	18.7407	506	1.2374	0.2795	1.2374	1.1124
0.3075	18.8148	508	1.2106	0.2686	1.2106	1.1003
0.3075	18.8889	510	1.2121	0.2686	1.2121	1.1009
0.3075	18.9630	512	1.2365	0.2686	1.2365	1.1120
0.3075	19.0370	514	1.2085	0.1770	1.2085	1.0993
0.3075	19.1111	516	1.2228	0.1142	1.2228	1.1058
0.3075	19.1852	518	1.1972	0.1142	1.1972	1.0942
0.3075	19.2593	520	1.2302	0.1142	1.2302	1.1091
0.3075	19.3333	522	1.2294	0.1142	1.2294	1.1088
0.3075	19.4074	524	1.2296	0.1142	1.2296	1.1089

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1