ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1502
• Qwk: 0.1076
• Mse: 1.1502
• Rmse: 1.0725

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0870	2	4.8158	0.0010	4.8158	2.1945
No log	0.1739	4	3.0545	-0.0406	3.0545	1.7477
No log	0.2609	6	2.0687	-0.0102	2.0687	1.4383
No log	0.3478	8	1.9692	0.0706	1.9692	1.4033
No log	0.4348	10	1.5053	0.0222	1.5053	1.2269
No log	0.5217	12	1.3874	-0.0064	1.3874	1.1779
No log	0.6087	14	1.3076	0.0208	1.3076	1.1435
No log	0.6957	16	1.2371	0.1211	1.2371	1.1123
No log	0.7826	18	1.2545	0.0904	1.2545	1.1200
No log	0.8696	20	1.2727	0.0904	1.2727	1.1281
No log	0.9565	22	1.2776	0.0157	1.2776	1.1303
No log	1.0435	24	1.3281	-0.0047	1.3281	1.1524
No log	1.1304	26	1.5488	0.0317	1.5488	1.2445
No log	1.2174	28	1.6256	0.0317	1.6256	1.2750
No log	1.3043	30	1.4052	0.0317	1.4052	1.1854
No log	1.3913	32	1.2403	0.1679	1.2403	1.1137
No log	1.4783	34	1.2223	0.1904	1.2223	1.1056
No log	1.5652	36	1.3262	0.0926	1.3262	1.1516
No log	1.6522	38	1.6213	0.0169	1.6213	1.2733
No log	1.7391	40	1.5707	0.0169	1.5707	1.2533
No log	1.8261	42	1.2864	0.1346	1.2864	1.1342
No log	1.9130	44	1.1951	0.1076	1.1951	1.0932
No log	2.0	46	1.1442	0.2520	1.1442	1.0697
No log	2.0870	48	1.1418	0.2678	1.1418	1.0685
No log	2.1739	50	1.1569	0.2835	1.1569	1.0756
No log	2.2609	52	1.1464	0.2471	1.1464	1.0707
No log	2.3478	54	1.1172	0.3045	1.1172	1.0570
No log	2.4348	56	1.1041	0.3095	1.1041	1.0508
No log	2.5217	58	1.0999	0.2624	1.0999	1.0488
No log	2.6087	60	1.1333	0.1753	1.1333	1.0646
No log	2.6957	62	1.1524	0.1556	1.1524	1.0735
No log	2.7826	64	1.1454	0.1612	1.1454	1.0702
No log	2.8696	66	1.1323	0.1432	1.1323	1.0641
No log	2.9565	68	1.1449	0.1482	1.1449	1.0700
No log	3.0435	70	1.2601	0.0343	1.2601	1.1225
No log	3.1304	72	1.3087	0.0172	1.3087	1.1440
No log	3.2174	74	1.1573	0.1214	1.1573	1.0758
No log	3.3043	76	1.0844	0.1919	1.0844	1.0413
No log	3.3913	78	1.0527	0.2242	1.0527	1.0260
No log	3.4783	80	1.0227	0.2089	1.0227	1.0113
No log	3.5652	82	1.0977	0.2006	1.0977	1.0477
No log	3.6522	84	1.2867	0.2301	1.2867	1.1343
No log	3.7391	86	1.4358	0.1848	1.4358	1.1982
No log	3.8261	88	1.2902	0.2589	1.2902	1.1359
No log	3.9130	90	1.2998	0.3243	1.2998	1.1401
No log	4.0	92	1.3881	0.1703	1.3881	1.1782
No log	4.0870	94	1.3519	0.0857	1.3519	1.1627
No log	4.1739	96	1.2137	0.2121	1.2137	1.1017
No log	4.2609	98	1.1497	0.2121	1.1497	1.0723
No log	4.3478	100	1.1298	0.2304	1.1298	1.0629
No log	4.4348	102	1.3005	0.2870	1.3005	1.1404
No log	4.5217	104	1.6225	0.2759	1.6225	1.2738
No log	4.6087	106	1.7019	0.2066	1.7019	1.3046
No log	4.6957	108	1.5432	0.1594	1.5432	1.2423
No log	4.7826	110	1.2122	0.3158	1.2122	1.1010
No log	4.8696	112	1.1050	0.3091	1.1050	1.0512
No log	4.9565	114	1.1796	0.2650	1.1796	1.0861
No log	5.0435	116	1.5078	0.2987	1.5078	1.2279
No log	5.1304	118	1.9157	0.1650	1.9157	1.3841
No log	5.2174	120	1.8613	0.1978	1.8613	1.3643
No log	5.3043	122	1.4955	0.2886	1.4955	1.2229
No log	5.3913	124	1.1661	0.1766	1.1661	1.0798
No log	5.4783	126	1.0764	0.2998	1.0764	1.0375
No log	5.5652	128	1.1781	0.1371	1.1781	1.0854
No log	5.6522	130	1.3942	0.1135	1.3942	1.1808
No log	5.7391	132	1.4538	0.0512	1.4538	1.2058
No log	5.8261	134	1.3310	0.1608	1.3310	1.1537
No log	5.9130	136	1.1715	0.2743	1.1715	1.0824
No log	6.0	138	1.0462	0.3394	1.0462	1.0228
No log	6.0870	140	0.9626	0.3069	0.9626	0.9811
No log	6.1739	142	0.9309	0.3211	0.9309	0.9648
No log	6.2609	144	1.0377	0.2762	1.0377	1.0187
No log	6.3478	146	1.2213	0.3047	1.2213	1.1051
No log	6.4348	148	1.1595	0.2664	1.1595	1.0768
No log	6.5217	150	1.0160	0.2857	1.0160	1.0080
No log	6.6087	152	0.9570	0.3165	0.9570	0.9783
No log	6.6957	154	0.9977	0.3141	0.9977	0.9989
No log	6.7826	156	1.0970	0.2570	1.0970	1.0474
No log	6.8696	158	1.0647	0.3141	1.0647	1.0318
No log	6.9565	160	0.9686	0.3165	0.9686	0.9842
No log	7.0435	162	0.9369	0.3700	0.9369	0.9680
No log	7.1304	164	0.9608	0.3920	0.9608	0.9802
No log	7.2174	166	1.0960	0.3350	1.0960	1.0469
No log	7.3043	168	1.4101	0.2659	1.4101	1.1875
No log	7.3913	170	1.4111	0.2604	1.4111	1.1879
No log	7.4783	172	1.1742	0.2844	1.1742	1.0836
No log	7.5652	174	0.9854	0.3317	0.9854	0.9927
No log	7.6522	176	0.9672	0.3317	0.9672	0.9835
No log	7.7391	178	0.9826	0.3021	0.9826	0.9913
No log	7.8261	180	1.0396	0.2516	1.0396	1.0196
No log	7.9130	182	1.0795	0.2402	1.0795	1.0390
No log	8.0	184	1.0617	0.2402	1.0617	1.0304
No log	8.0870	186	1.1178	0.2953	1.1178	1.0573
No log	8.1739	188	1.2367	0.2817	1.2367	1.1121
No log	8.2609	190	1.3560	0.2789	1.3560	1.1645
No log	8.3478	192	1.2100	0.4151	1.2100	1.1000
No log	8.4348	194	1.0999	0.3231	1.0999	1.0488
No log	8.5217	196	1.0384	0.3117	1.0384	1.0190
No log	8.6087	198	1.0812	0.3212	1.0812	1.0398
No log	8.6957	200	1.2772	0.3087	1.2772	1.1301
No log	8.7826	202	1.3293	0.3067	1.3293	1.1529
No log	8.8696	204	1.2299	0.2224	1.2299	1.1090
No log	8.9565	206	1.0954	0.2953	1.0954	1.0466
No log	9.0435	208	1.0416	0.3095	1.0416	1.0206
No log	9.1304	210	1.0837	0.2953	1.0837	1.0410
No log	9.2174	212	1.2848	0.3487	1.2848	1.1335
No log	9.3043	214	1.4298	0.2757	1.4298	1.1957
No log	9.3913	216	1.3664	0.2833	1.3664	1.1689
No log	9.4783	218	1.2064	0.2224	1.2064	1.0984
No log	9.5652	220	1.0682	0.2260	1.0682	1.0335
No log	9.6522	222	1.0433	0.2132	1.0433	1.0214
No log	9.7391	224	1.0755	0.2782	1.0755	1.0371
No log	9.8261	226	1.2103	0.2224	1.2103	1.1001
No log	9.9130	228	1.3616	0.2881	1.3616	1.1669
No log	10.0	230	1.3149	0.3475	1.3149	1.1467
No log	10.0870	232	1.1979	0.3929	1.1979	1.0945
No log	10.1739	234	1.1662	0.3929	1.1662	1.0799
No log	10.2609	236	1.1375	0.3446	1.1375	1.0665
No log	10.3478	238	1.2700	0.3669	1.2700	1.1269
No log	10.4348	240	1.2972	0.3669	1.2972	1.1389
No log	10.5217	242	1.1935	0.3049	1.1935	1.0925
No log	10.6087	244	1.1005	0.2108	1.1005	1.0491
No log	10.6957	246	1.0928	0.2108	1.0928	1.0453
No log	10.7826	248	1.1970	0.2905	1.1970	1.0941
No log	10.8696	250	1.3173	0.2647	1.3173	1.1477
No log	10.9565	252	1.3329	0.2544	1.3329	1.1545
No log	11.0435	254	1.2408	0.3418	1.2408	1.1139
No log	11.1304	256	1.1644	0.3307	1.1644	1.0791
No log	11.2174	258	1.1774	0.3690	1.1774	1.0851
No log	11.3043	260	1.3058	0.3551	1.3058	1.1427
No log	11.3913	262	1.5209	0.2455	1.5209	1.2332
No log	11.4783	264	1.5151	0.2485	1.5151	1.2309
No log	11.5652	266	1.3325	0.2457	1.3325	1.1544
No log	11.6522	268	1.1547	0.25	1.1547	1.0746
No log	11.7391	270	1.0886	0.2322	1.0886	1.0433
No log	11.8261	272	1.1175	0.2322	1.1175	1.0571
No log	11.9130	274	1.2396	0.2633	1.2396	1.1134
No log	12.0	276	1.4408	0.2105	1.4408	1.2003
No log	12.0870	278	1.6120	0.2317	1.6120	1.2696
No log	12.1739	280	1.6089	0.2435	1.6089	1.2684
No log	12.2609	282	1.4141	0.2789	1.4141	1.1891
No log	12.3478	284	1.1453	0.3446	1.1453	1.0702
No log	12.4348	286	1.0254	0.2900	1.0254	1.0126
No log	12.5217	288	1.0122	0.2617	1.0122	1.0061
No log	12.6087	290	1.0848	0.2683	1.0848	1.0416
No log	12.6957	292	1.2199	0.3049	1.2199	1.1045
No log	12.7826	294	1.2711	0.2678	1.2711	1.1274
No log	12.8696	296	1.1854	0.3049	1.1854	1.0887
No log	12.9565	298	1.1689	0.3554	1.1689	1.0812
No log	13.0435	300	1.1122	0.3446	1.1122	1.0546
No log	13.1304	302	1.0860	0.3192	1.0860	1.0421
No log	13.2174	304	1.1497	0.3418	1.1497	1.0723
No log	13.3043	306	1.2532	0.2980	1.2532	1.1195
No log	13.3913	308	1.3223	0.2105	1.3223	1.1499
No log	13.4783	310	1.2554	0.2617	1.2554	1.1205
No log	13.5652	312	1.2430	0.2617	1.2430	1.1149
No log	13.6522	314	1.2285	0.2931	1.2285	1.1084
No log	13.7391	316	1.1907	0.3307	1.1907	1.0912
No log	13.8261	318	1.2043	0.3049	1.2043	1.0974
No log	13.9130	320	1.2271	0.2665	1.2271	1.1078
No log	14.0	322	1.2367	0.2665	1.2367	1.1121
No log	14.0870	324	1.2232	0.1944	1.2232	1.1060
No log	14.1739	326	1.3179	0.2238	1.3179	1.1480
No log	14.2609	328	1.3588	0.1944	1.3588	1.1657
No log	14.3478	330	1.2892	0.1944	1.2892	1.1354
No log	14.4348	332	1.1800	0.1519	1.1800	1.0863
No log	14.5217	334	1.0753	0.1521	1.0753	1.0370
No log	14.6087	336	1.0181	0.1585	1.0181	1.0090
No log	14.6957	338	1.0016	0.2279	1.0016	1.0008
No log	14.7826	340	1.0296	0.2279	1.0296	1.0147
No log	14.8696	342	1.0583	0.2117	1.0583	1.0287
No log	14.9565	344	1.0896	0.2141	1.0896	1.0438
No log	15.0435	346	1.0597	0.2535	1.0597	1.0294
No log	15.1304	348	1.0078	0.2800	1.0078	1.0039
No log	15.2174	350	1.0371	0.2953	1.0371	1.0184
No log	15.3043	352	1.0511	0.2809	1.0511	1.0252
No log	15.3913	354	1.0208	0.2714	1.0208	1.0104
No log	15.4783	356	1.0009	0.2683	1.0009	1.0004
No log	15.5652	358	0.9359	0.3590	0.9359	0.9674
No log	15.6522	360	0.9335	0.3098	0.9335	0.9662
No log	15.7391	362	0.9805	0.2900	0.9805	0.9902
No log	15.8261	364	1.0817	0.2535	1.0817	1.0401
No log	15.9130	366	1.0984	0.2837	1.0984	1.0480
No log	16.0	368	1.0564	0.2809	1.0564	1.0278
No log	16.0870	370	0.9965	0.2683	0.9965	0.9982
No log	16.1739	372	0.9859	0.2683	0.9859	0.9929
No log	16.2609	374	0.9986	0.2683	0.9986	0.9993
No log	16.3478	376	0.9581	0.3097	0.9581	0.9788
No log	16.4348	378	0.9795	0.2175	0.9795	0.9897
No log	16.5217	380	1.0558	0.275	1.0558	1.0275
No log	16.6087	382	1.1585	0.1991	1.1585	1.0764
No log	16.6957	384	1.1903	0.1991	1.1903	1.0910
No log	16.7826	386	1.2215	0.1889	1.2215	1.1052
No log	16.8696	388	1.2045	0.2278	1.2045	1.0975
No log	16.9565	390	1.1859	0.2278	1.1859	1.0890
No log	17.0435	392	1.1861	0.2278	1.1861	1.0891
No log	17.1304	394	1.1510	0.1991	1.1510	1.0729
No log	17.2174	396	1.0865	0.2387	1.0865	1.0423
No log	17.3043	398	1.1014	0.2665	1.1014	1.0495
No log	17.3913	400	1.2376	0.2617	1.2376	1.1125
No log	17.4783	402	1.3227	0.4002	1.3227	1.1501
No log	17.5652	404	1.3561	0.3222	1.3561	1.1645
No log	17.6522	406	1.3185	0.3332	1.3185	1.1483
No log	17.7391	408	1.1975	0.2278	1.1975	1.0943
No log	17.8261	410	1.1289	0.2535	1.1289	1.0625
No log	17.9130	412	1.1719	0.1991	1.1719	1.0826
No log	18.0	414	1.2273	0.2278	1.2273	1.1078
No log	18.0870	416	1.3793	0.2392	1.3793	1.1744
No log	18.1739	418	1.4853	0.2632	1.4853	1.2187
No log	18.2609	420	1.4204	0.2392	1.4204	1.1918
No log	18.3478	422	1.2476	0.2387	1.2476	1.1170
No log	18.4348	424	1.0990	0.2683	1.0990	1.0483
No log	18.5217	426	1.0859	0.2683	1.0859	1.0421
No log	18.6087	428	1.1422	0.2535	1.1422	1.0687
No log	18.6957	430	1.2368	0.2278	1.2368	1.1121
No log	18.7826	432	1.2868	0.2278	1.2868	1.1344
No log	18.8696	434	1.2380	0.2278	1.2380	1.1126
No log	18.9565	436	1.2168	0.2278	1.2168	1.1031
No log	19.0435	438	1.1815	0.2278	1.1815	1.0870
No log	19.1304	440	1.1460	0.2278	1.1460	1.0705
No log	19.2174	442	1.2010	0.2278	1.2010	1.0959
No log	19.3043	444	1.2308	0.2617	1.2308	1.1094
No log	19.3913	446	1.1340	0.2278	1.1340	1.0649
No log	19.4783	448	1.0874	0.2291	1.0874	1.0428
No log	19.5652	450	1.0792	0.2291	1.0792	1.0388
No log	19.6522	452	1.1369	0.1991	1.1369	1.0663
No log	19.7391	454	1.2286	0.2278	1.2286	1.1084
No log	19.8261	456	1.2372	0.2278	1.2372	1.1123
No log	19.9130	458	1.2246	0.2278	1.2246	1.1066
No log	20.0	460	1.1505	0.1991	1.1505	1.0726
No log	20.0870	462	1.0943	0.1991	1.0943	1.0461
No log	20.1739	464	1.0931	0.1991	1.0931	1.0455
No log	20.2609	466	1.1418	0.1991	1.1418	1.0686
No log	20.3478	468	1.1714	0.1991	1.1714	1.0823
No log	20.4348	470	1.1897	0.1991	1.1897	1.0908
No log	20.5217	472	1.1485	0.1991	1.1485	1.0717
No log	20.6087	474	1.1043	0.1991	1.1043	1.0509
No log	20.6957	476	1.1380	0.1991	1.1380	1.0668
No log	20.7826	478	1.1830	0.2460	1.1830	1.0877
No log	20.8696	480	1.2403	0.3908	1.2403	1.1137
No log	20.9565	482	1.2637	0.3908	1.2637	1.1242
No log	21.0435	484	1.2438	0.4240	1.2438	1.1153
No log	21.1304	486	1.1950	0.3094	1.1950	1.0931
No log	21.2174	488	1.1764	0.2424	1.1764	1.0846
No log	21.3043	490	1.1894	0.1991	1.1894	1.0906
No log	21.3913	492	1.1902	0.1991	1.1902	1.0910
No log	21.4783	494	1.1412	0.1379	1.1412	1.0683
No log	21.5652	496	1.0728	0.1747	1.0728	1.0357
No log	21.6522	498	1.0451	0.1689	1.0451	1.0223
0.3316	21.7391	500	1.0683	0.1747	1.0683	1.0336
0.3316	21.8261	502	1.1315	0.1379	1.1315	1.0637
0.3316	21.9130	504	1.1860	0.1991	1.1860	1.0890
0.3316	22.0	506	1.2162	0.2278	1.2162	1.1028
0.3316	22.0870	508	1.1893	0.2278	1.1893	1.0906
0.3316	22.1739	510	1.1614	0.1991	1.1614	1.0777
0.3316	22.2609	512	1.1727	0.2278	1.1727	1.0829
0.3316	22.3478	514	1.2144	0.2317	1.2144	1.1020
0.3316	22.4348	516	1.2004	0.1991	1.2004	1.0956
0.3316	22.5217	518	1.1732	0.1991	1.1732	1.0832
0.3316	22.6087	520	1.1803	0.1991	1.1803	1.0864
0.3316	22.6957	522	1.2423	0.2278	1.2423	1.1146
0.3316	22.7826	524	1.3163	0.2289	1.3163	1.1473
0.3316	22.8696	526	1.2872	0.1980	1.2872	1.1345
0.3316	22.9565	528	1.1992	0.1991	1.1992	1.0951
0.3316	23.0435	530	1.1064	0.1894	1.1064	1.0519
0.3316	23.1304	532	1.0475	0.2617	1.0475	1.0235
0.3316	23.2174	534	1.0332	0.2617	1.0332	1.0164
0.3316	23.3043	536	1.0604	0.25	1.0604	1.0298
0.3316	23.3913	538	1.1761	0.2278	1.1761	1.0845
0.3316	23.4783	540	1.3405	0.2863	1.3405	1.1578
0.3316	23.5652	542	1.3843	0.2685	1.3843	1.1766
0.3316	23.6522	544	1.3199	0.3047	1.3199	1.1489
0.3316	23.7391	546	1.2301	0.2817	1.2301	1.1091
0.3316	23.8261	548	1.1951	0.2278	1.1951	1.0932
0.3316	23.9130	550	1.2114	0.2278	1.2114	1.1006
0.3316	24.0	552	1.2414	0.2278	1.2414	1.1142
0.3316	24.0870	554	1.3521	0.2574	1.3521	1.1628
0.3316	24.1739	556	1.4737	0.2886	1.4737	1.2140
0.3316	24.2609	558	1.4540	0.2863	1.4540	1.2058
0.3316	24.3478	560	1.3622	0.2574	1.3622	1.1671
0.3316	24.4348	562	1.2915	0.2024	1.2915	1.1364
0.3316	24.5217	564	1.2062	0.1991	1.2062	1.0983
0.3316	24.6087	566	1.1652	0.1991	1.1652	1.0794
0.3316	24.6957	568	1.1705	0.2141	1.1705	1.0819
0.3316	24.7826	570	1.2151	0.2931	1.2151	1.1023
0.3316	24.8696	572	1.3281	0.2815	1.3281	1.1524
0.3316	24.9565	574	1.4118	0.2863	1.4118	1.1882
0.3316	25.0435	576	1.4259	0.2863	1.4259	1.1941
0.3316	25.1304	578	1.3434	0.2359	1.3434	1.1590
0.3316	25.2174	580	1.2345	0.2131	1.2345	1.1111
0.3316	25.3043	582	1.1384	0.0980	1.1384	1.0669
0.3316	25.3913	584	1.0853	0.1689	1.0853	1.0418
0.3316	25.4783	586	1.0694	0.1689	1.0694	1.0341
0.3316	25.5652	588	1.0872	0.1689	1.0872	1.0427
0.3316	25.6522	590	1.1502	0.1076	1.1502	1.0725

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1