ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2036
• Qwk: 0.1434
• Mse: 1.2036
• Rmse: 1.0971

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	4.2210	-0.0230	4.2210	2.0545
No log	0.1290	4	2.7231	-0.0397	2.7231	1.6502
No log	0.1935	6	2.2480	-0.0189	2.2480	1.4993
No log	0.2581	8	1.6561	-0.0144	1.6561	1.2869
No log	0.3226	10	1.4944	0.0	1.4944	1.2225
No log	0.3871	12	1.3455	0.0	1.3455	1.1600
No log	0.4516	14	1.1805	0.2260	1.1805	1.0865
No log	0.5161	16	1.1394	0.2376	1.1394	1.0674
No log	0.5806	18	1.2602	0.0704	1.2602	1.1226
No log	0.6452	20	1.4081	0.0775	1.4081	1.1867
No log	0.7097	22	1.4930	0.0827	1.4930	1.2219
No log	0.7742	24	1.2513	0.1750	1.2513	1.1186
No log	0.8387	26	1.0086	0.2473	1.0086	1.0043
No log	0.9032	28	1.0869	0.2441	1.0869	1.0426
No log	0.9677	30	1.1338	0.1671	1.1338	1.0648
No log	1.0323	32	1.1088	0.2541	1.1088	1.0530
No log	1.0968	34	1.0692	0.1561	1.0692	1.0340
No log	1.1613	36	1.0331	0.1837	1.0331	1.0164
No log	1.2258	38	1.0105	0.2619	1.0105	1.0052
No log	1.2903	40	1.0009	0.2473	1.0009	1.0004
No log	1.3548	42	1.0070	0.2288	1.0070	1.0035
No log	1.4194	44	1.0316	0.1671	1.0316	1.0157
No log	1.4839	46	1.0027	0.2161	1.0027	1.0014
No log	1.5484	48	0.9805	0.3071	0.9805	0.9902
No log	1.6129	50	0.9788	0.2935	0.9788	0.9893
No log	1.6774	52	0.9670	0.2515	0.9670	0.9834
No log	1.7419	54	1.0036	0.2897	1.0036	1.0018
No log	1.8065	56	1.0507	0.2667	1.0507	1.0250
No log	1.8710	58	1.0882	0.2692	1.0882	1.0432
No log	1.9355	60	1.0888	0.2366	1.0888	1.0435
No log	2.0	62	1.0778	0.2711	1.0778	1.0382
No log	2.0645	64	1.0382	0.3396	1.0382	1.0189
No log	2.1290	66	0.9608	0.2764	0.9608	0.9802
No log	2.1935	68	1.0137	0.1418	1.0137	1.0068
No log	2.2581	70	1.0547	0.1233	1.0547	1.0270
No log	2.3226	72	1.0767	0.1233	1.0767	1.0376
No log	2.3871	74	1.0521	0.1233	1.0521	1.0257
No log	2.4516	76	0.9309	0.1011	0.9309	0.9648
No log	2.5161	78	0.9180	0.2077	0.9180	0.9581
No log	2.5806	80	1.0677	0.1233	1.0677	1.0333
No log	2.6452	82	1.1382	0.1598	1.1382	1.0668
No log	2.7097	84	1.2462	0.0841	1.2462	1.1164
No log	2.7742	86	1.2122	0.2704	1.2122	1.1010
No log	2.8387	88	0.9648	0.2651	0.9648	0.9823
No log	2.9032	90	0.8997	0.2965	0.8997	0.9485
No log	2.9677	92	0.9152	0.3214	0.9152	0.9567
No log	3.0323	94	1.1024	0.275	1.1024	1.0500
No log	3.0968	96	1.3785	0.3199	1.3785	1.1741
No log	3.1613	98	1.3167	0.2640	1.3167	1.1475
No log	3.2258	100	1.0285	0.2981	1.0285	1.0142
No log	3.2903	102	0.9193	0.2698	0.9193	0.9588
No log	3.3548	104	0.9860	0.2037	0.9860	0.9930
No log	3.4194	106	1.2871	0.3346	1.2871	1.1345
No log	3.4839	108	1.5374	0.2431	1.5374	1.2399
No log	3.5484	110	1.6254	0.1752	1.6254	1.2749
No log	3.6129	112	1.4716	0.2290	1.4716	1.2131
No log	3.6774	114	1.1940	0.3280	1.1940	1.0927
No log	3.7419	116	1.0826	0.2417	1.0826	1.0405
No log	3.8065	118	1.1104	0.2227	1.1104	1.0537
No log	3.8710	120	1.1575	0.1316	1.1575	1.0759
No log	3.9355	122	1.2591	0.1654	1.2591	1.1221
No log	4.0	124	1.3400	0.2730	1.3400	1.1576
No log	4.0645	126	1.3153	0.3261	1.3153	1.1469
No log	4.1290	128	1.3547	0.3291	1.3547	1.1639
No log	4.1935	130	1.4814	0.3037	1.4814	1.2171
No log	4.2581	132	1.5330	0.2672	1.5330	1.2381
No log	4.3226	134	1.5051	0.2730	1.5051	1.2268
No log	4.3871	136	1.3594	0.2284	1.3594	1.1660
No log	4.4516	138	1.1383	0.1203	1.1383	1.0669
No log	4.5161	140	0.9933	0.1629	0.9933	0.9967
No log	4.5806	142	0.9737	0.2035	0.9737	0.9867
No log	4.6452	144	1.0500	0.1954	1.0500	1.0247
No log	4.7097	146	1.1101	0.1846	1.1101	1.0536
No log	4.7742	148	1.1770	0.0888	1.1770	1.0849
No log	4.8387	150	1.1274	0.0888	1.1274	1.0618
No log	4.9032	152	1.1782	0.2284	1.1782	1.0854
No log	4.9677	154	1.3330	0.3107	1.3330	1.1545
No log	5.0323	156	1.4588	0.3172	1.4588	1.2078
No log	5.0968	158	1.5743	0.2809	1.5743	1.2547
No log	5.1613	160	1.5193	0.2771	1.5193	1.2326
No log	5.2258	162	1.3052	0.3231	1.3052	1.1424
No log	5.2903	164	1.1763	0.2686	1.1763	1.0846
No log	5.3548	166	1.2173	0.3231	1.2173	1.1033
No log	5.4194	168	1.3756	0.3261	1.3756	1.1729
No log	5.4839	170	1.5694	0.2474	1.5694	1.2528
No log	5.5484	172	1.4800	0.3135	1.4800	1.2165
No log	5.6129	174	1.3556	0.3199	1.3556	1.1643
No log	5.6774	176	1.3564	0.2640	1.3564	1.1647
No log	5.7419	178	1.2625	0.1770	1.2625	1.1236
No log	5.8065	180	1.2050	0.2167	1.2050	1.0977
No log	5.8710	182	1.1940	0.2341	1.1940	1.0927
No log	5.9355	184	1.3242	0.3001	1.3242	1.1507
No log	6.0	186	1.3661	0.3511	1.3661	1.1688
No log	6.0645	188	1.2889	0.3711	1.2889	1.1353
No log	6.1290	190	1.1195	0.3686	1.1195	1.0581
No log	6.1935	192	1.0371	0.3424	1.0371	1.0184
No log	6.2581	194	1.1781	0.3584	1.1781	1.0854
No log	6.3226	196	1.2423	0.3831	1.2423	1.1146
No log	6.3871	198	1.3150	0.3511	1.3150	1.1468
No log	6.4516	200	1.1784	0.3326	1.1784	1.0856
No log	6.5161	202	0.9683	0.2448	0.9683	0.9840
No log	6.5806	204	0.9538	0.2392	0.9538	0.9766
No log	6.6452	206	1.0011	0.2249	1.0011	1.0006
No log	6.7097	208	1.1442	0.2926	1.1442	1.0697
No log	6.7742	210	1.2134	0.3460	1.2134	1.1015
No log	6.8387	212	1.1885	0.3813	1.1885	1.0902
No log	6.9032	214	1.3267	0.3711	1.3267	1.1518
No log	6.9677	216	1.4505	0.2677	1.4505	1.2044
No log	7.0323	218	1.3788	0.3882	1.3788	1.1742
No log	7.0968	220	1.1899	0.4056	1.1899	1.0908
No log	7.1613	222	1.2352	0.3813	1.2352	1.1114
No log	7.2258	224	1.3073	0.2614	1.3073	1.1434
No log	7.2903	226	1.3772	0.1461	1.3772	1.1735
No log	7.3548	228	1.3505	0.0741	1.3505	1.1621
No log	7.4194	230	1.2032	0.1294	1.2032	1.0969
No log	7.4839	232	1.1896	0.2681	1.1896	1.0907
No log	7.5484	234	1.3384	0.3935	1.3384	1.1569
No log	7.6129	236	1.3090	0.3951	1.3090	1.1441
No log	7.6774	238	1.0544	0.3395	1.0544	1.0268
No log	7.7419	240	0.9711	0.3000	0.9711	0.9854
No log	7.8065	242	1.0728	0.3686	1.0728	1.0358
No log	7.8710	244	1.4155	0.3006	1.4155	1.1898
No log	7.9355	246	1.7553	0.2563	1.7553	1.3249
No log	8.0	248	1.8255	0.2563	1.8255	1.3511
No log	8.0645	250	1.5658	0.2296	1.5658	1.2513
No log	8.1290	252	1.2619	0.3866	1.2619	1.1233
No log	8.1935	254	1.0194	0.2906	1.0194	1.0096
No log	8.2581	256	1.0008	0.2564	1.0008	1.0004
No log	8.3226	258	1.1027	0.3813	1.1027	1.0501
No log	8.3871	260	1.2736	0.3107	1.2736	1.1285
No log	8.4516	262	1.3696	0.3365	1.3696	1.1703
No log	8.5161	264	1.3283	0.3107	1.3283	1.1525
No log	8.5806	266	1.1867	0.3560	1.1867	1.0894
No log	8.6452	268	1.1257	0.2424	1.1257	1.0610
No log	8.7097	270	1.1941	0.2773	1.1941	1.0928
No log	8.7742	272	1.3086	0.2474	1.3086	1.1440
No log	8.8387	274	1.3416	0.2568	1.3416	1.1583
No log	8.9032	276	1.2038	0.2837	1.2038	1.0972
No log	8.9677	278	1.1437	0.3326	1.1437	1.0695
No log	9.0323	280	1.2213	0.3365	1.2213	1.1051
No log	9.0968	282	1.3321	0.2832	1.3321	1.1542
No log	9.1613	284	1.2634	0.2555	1.2634	1.1240
No log	9.2258	286	1.2315	0.2506	1.2315	1.1097
No log	9.2903	288	1.1839	0.1952	1.1839	1.0881
No log	9.3548	290	1.1309	0.2089	1.1309	1.0634
No log	9.4194	292	1.1951	0.1952	1.1951	1.0932
No log	9.4839	294	1.4080	0.2437	1.4080	1.1866
No log	9.5484	296	1.6579	0.2565	1.6579	1.2876
No log	9.6129	298	1.7782	0.1925	1.7782	1.3335
No log	9.6774	300	1.6383	0.2601	1.6383	1.2800
No log	9.7419	302	1.4298	0.2110	1.4298	1.1957
No log	9.8065	304	1.3584	0.2568	1.3584	1.1655
No log	9.8710	306	1.3363	0.0878	1.3363	1.1560
No log	9.9355	308	1.2606	0.0	1.2606	1.1228
No log	10.0	310	1.1896	0.0888	1.1896	1.0907
No log	10.0645	312	1.1689	0.0888	1.1689	1.0812
No log	10.1290	314	1.1587	0.0888	1.1587	1.0764
No log	10.1935	316	1.1835	0.1351	1.1835	1.0879
No log	10.2581	318	1.3109	0.2004	1.3109	1.1449
No log	10.3226	320	1.3633	0.2482	1.3633	1.1676
No log	10.3871	322	1.3701	0.3084	1.3701	1.1705
No log	10.4516	324	1.3386	0.3260	1.3386	1.1570
No log	10.5161	326	1.2996	0.3579	1.2996	1.1400
No log	10.5806	328	1.3066	0.3260	1.3066	1.1430
No log	10.6452	330	1.1838	0.3319	1.1838	1.0880
No log	10.7097	332	1.1344	0.3071	1.1344	1.0651
No log	10.7742	334	1.0414	0.2750	1.0414	1.0205
No log	10.8387	336	0.9618	0.2797	0.9618	0.9807
No log	10.9032	338	0.9017	0.3185	0.9017	0.9496
No log	10.9677	340	0.9558	0.2481	0.9558	0.9777
No log	11.0323	342	1.0279	0.2249	1.0279	1.0138
No log	11.0968	344	1.1782	0.3001	1.1782	1.0854
No log	11.1613	346	1.3221	0.3020	1.3221	1.1498
No log	11.2258	348	1.3833	0.2974	1.3833	1.1762
No log	11.2903	350	1.5574	0.2717	1.5574	1.2480
No log	11.3548	352	1.5844	0.2937	1.5844	1.2587
No log	11.4194	354	1.4329	0.3066	1.4329	1.1970
No log	11.4839	356	1.1918	0.2611	1.1918	1.0917
No log	11.5484	358	1.0984	0.2341	1.0984	1.0480
No log	11.6129	360	1.1499	0.2795	1.1499	1.0723
No log	11.6774	362	1.3457	0.2733	1.3457	1.1600
No log	11.7419	364	1.4928	0.2717	1.4928	1.2218
No log	11.8065	366	1.4950	0.2488	1.4950	1.2227
No log	11.8710	368	1.4044	0.2823	1.4044	1.1851
No log	11.9355	370	1.3490	0.3103	1.3490	1.1615
No log	12.0	372	1.2202	0.3165	1.2202	1.1046
No log	12.0645	374	1.1830	0.2640	1.1830	1.0876
No log	12.1290	376	1.1919	0.2640	1.1919	1.0917
No log	12.1935	378	1.1480	0.2341	1.1480	1.0714
No log	12.2581	380	1.0949	0.2027	1.0949	1.0464
No log	12.3226	382	1.0669	0.2027	1.0669	1.0329
No log	12.3871	384	1.0890	0.2027	1.0890	1.0436
No log	12.4516	386	1.2123	0.3460	1.2123	1.1010
No log	12.5161	388	1.3746	0.3135	1.3746	1.1724
No log	12.5806	390	1.4947	0.2644	1.4947	1.2226
No log	12.6452	392	1.4677	0.2606	1.4677	1.2115
No log	12.7097	394	1.3845	0.2924	1.3845	1.1766
No log	12.7742	396	1.3037	0.2924	1.3037	1.1418
No log	12.8387	398	1.1891	0.4056	1.1891	1.0905
No log	12.9032	400	1.1881	0.4056	1.1881	1.0900
No log	12.9677	402	1.2517	0.3511	1.2517	1.1188
No log	13.0323	404	1.3299	0.2832	1.3299	1.1532
No log	13.0968	406	1.3152	0.2793	1.3152	1.1468
No log	13.1613	408	1.2562	0.1814	1.2562	1.1208
No log	13.2258	410	1.1566	0.2424	1.1566	1.0755
No log	13.2903	412	1.1626	0.2424	1.1626	1.0782
No log	13.3548	414	1.1939	0.3263	1.1939	1.0927
No log	13.4194	416	1.3274	0.3107	1.3274	1.1521
No log	13.4839	418	1.4125	0.2342	1.4125	1.1885
No log	13.5484	420	1.3916	0.2342	1.3916	1.1797
No log	13.6129	422	1.3262	0.3107	1.3262	1.1516
No log	13.6774	424	1.1882	0.3534	1.1882	1.0901
No log	13.7419	426	1.1743	0.3794	1.1743	1.0836
No log	13.8065	428	1.2921	0.3460	1.2921	1.1367
No log	13.8710	430	1.4900	0.2437	1.4900	1.2206
No log	13.9355	432	1.5587	0.2694	1.5587	1.2485
No log	14.0	434	1.4795	0.2437	1.4795	1.2163
No log	14.0645	436	1.3527	0.3072	1.3527	1.1631
No log	14.1290	438	1.3079	0.2284	1.3079	1.1436
No log	14.1935	440	1.3366	0.1486	1.3366	1.1561
No log	14.2581	442	1.3076	0.1486	1.3076	1.1435
No log	14.3226	444	1.2479	0.2284	1.2479	1.1171
No log	14.3871	446	1.2028	0.2681	1.2028	1.0967
No log	14.4516	448	1.2486	0.3813	1.2486	1.1174
No log	14.5161	450	1.3550	0.3365	1.3550	1.1640
No log	14.5806	452	1.4052	0.2611	1.4052	1.1854
No log	14.6452	454	1.3540	0.2611	1.3540	1.1636
No log	14.7097	456	1.2575	0.3460	1.2575	1.1214
No log	14.7742	458	1.2297	0.3199	1.2297	1.1089
No log	14.8387	460	1.2212	0.2926	1.2212	1.1051
No log	14.9032	462	1.1993	0.2528	1.1993	1.0951
No log	14.9677	464	1.2042	0.2528	1.2042	1.0974
No log	15.0323	466	1.3143	0.2926	1.3143	1.1464
No log	15.0968	468	1.3739	0.2313	1.3739	1.1721
No log	15.1613	470	1.4661	0.2771	1.4661	1.2108
No log	15.2258	472	1.4577	0.2511	1.4577	1.2074
No log	15.2903	474	1.3690	0.2647	1.3690	1.1700
No log	15.3548	476	1.2198	0.2167	1.2198	1.1044
No log	15.4194	478	1.1636	0.1294	1.1636	1.0787
No log	15.4839	480	1.2587	0.1288	1.2587	1.1219
No log	15.5484	482	1.5153	0.2170	1.5153	1.2310
No log	15.6129	484	1.6620	0.2448	1.6620	1.2892
No log	15.6774	486	1.6249	0.2406	1.6249	1.2747
No log	15.7419	488	1.4394	0.2170	1.4394	1.1997
No log	15.8065	490	1.3143	0.2926	1.3143	1.1464
No log	15.8710	492	1.2173	0.2614	1.2173	1.1033
No log	15.9355	494	1.2326	0.2564	1.2326	1.1102
No log	16.0	496	1.3332	0.1562	1.3332	1.1546
No log	16.0645	498	1.4842	0.2239	1.4842	1.2183
0.2885	16.1290	500	1.5289	0.1533	1.5289	1.2365
0.2885	16.1935	502	1.4666	0.1310	1.4666	1.2110
0.2885	16.2581	504	1.3550	0.0878	1.3550	1.1641
0.2885	16.3226	506	1.2856	0.0878	1.2856	1.1338
0.2885	16.3871	508	1.3204	0.1814	1.3204	1.1491
0.2885	16.4516	510	1.3874	0.2004	1.3874	1.1779
0.2885	16.5161	512	1.4601	0.2170	1.4601	1.2083
0.2885	16.5806	514	1.5196	0.2170	1.5196	1.2327
0.2885	16.6452	516	1.5635	0.2170	1.5635	1.2504
0.2885	16.7097	518	1.5160	0.2170	1.5160	1.2312
0.2885	16.7742	520	1.3683	0.1814	1.3683	1.1697
0.2885	16.8387	522	1.1875	0.0833	1.1875	1.0897
0.2885	16.9032	524	1.1206	0.1487	1.1206	1.0586
0.2885	16.9677	526	1.1391	0.1487	1.1391	1.0673
0.2885	17.0323	528	1.1382	0.1487	1.1382	1.0669
0.2885	17.0968	530	1.2036	0.1434	1.2036	1.0971

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1