ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1936
• Qwk: 0.0811
• Mse: 1.1936
• Rmse: 1.0925

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.7234	0.0010	4.7234	2.1733
No log	0.2667	4	3.0782	-0.0357	3.0782	1.7545
No log	0.4	6	1.7233	0.0062	1.7233	1.3127
No log	0.5333	8	1.5221	0.0538	1.5221	1.2337
No log	0.6667	10	1.2582	0.2913	1.2582	1.1217
No log	0.8	12	1.2402	0.1773	1.2402	1.1136
No log	0.9333	14	1.2631	0.1875	1.2631	1.1239
No log	1.0667	16	1.2179	0.0941	1.2179	1.1036
No log	1.2	18	1.1645	0.1649	1.1645	1.0791
No log	1.3333	20	1.2211	0.1732	1.2211	1.1050
No log	1.4667	22	1.3358	0.0010	1.3358	1.1558
No log	1.6	24	1.4898	-0.0216	1.4898	1.2206
No log	1.7333	26	1.5385	0.0169	1.5385	1.2404
No log	1.8667	28	1.4212	-0.0132	1.4212	1.1921
No log	2.0	30	1.2866	0.0883	1.2866	1.1343
No log	2.1333	32	1.3098	0.0802	1.3098	1.1445
No log	2.2667	34	1.3654	0.0353	1.3654	1.1685
No log	2.4	36	1.4142	0.0789	1.4142	1.1892
No log	2.5333	38	1.4123	-0.0506	1.4123	1.1884
No log	2.6667	40	1.6731	0.0141	1.6731	1.2935
No log	2.8	42	1.7014	0.0141	1.7014	1.3044
No log	2.9333	44	1.4875	0.0203	1.4875	1.2196
No log	3.0667	46	1.4254	0.1111	1.4254	1.1939
No log	3.2	48	1.4736	0.1320	1.4736	1.2139
No log	3.3333	50	1.4422	0.1320	1.4422	1.2009
No log	3.4667	52	1.2903	0.0935	1.2903	1.1359
No log	3.6	54	1.2705	0.1583	1.2705	1.1272
No log	3.7333	56	1.2462	0.1294	1.2462	1.1163
No log	3.8667	58	1.2228	0.1348	1.2228	1.1058
No log	4.0	60	1.2608	0.2156	1.2608	1.1228
No log	4.1333	62	1.4500	0.2063	1.4500	1.2042
No log	4.2667	64	1.5660	0.1181	1.5660	1.2514
No log	4.4	66	1.6211	0.1472	1.6211	1.2732
No log	4.5333	68	1.4464	0.1520	1.4464	1.2027
No log	4.6667	70	1.3649	0.1514	1.3649	1.1683
No log	4.8	72	1.4564	0.1542	1.4564	1.2068
No log	4.9333	74	1.5633	0.0891	1.5633	1.2503
No log	5.0667	76	1.7417	0.2279	1.7417	1.3197
No log	5.2	78	1.6238	0.2219	1.6238	1.2743
No log	5.3333	80	1.3119	0.2837	1.3119	1.1454
No log	5.4667	82	1.3141	0.2837	1.3141	1.1463
No log	5.6	84	1.6633	0.2074	1.6633	1.2897
No log	5.7333	86	1.9826	0.1379	1.9826	1.4080
No log	5.8667	88	1.6879	0.1924	1.6879	1.2992
No log	6.0	90	1.3376	0.2431	1.3376	1.1566
No log	6.1333	92	1.4309	0.1549	1.4309	1.1962
No log	6.2667	94	1.6534	0.1557	1.6534	1.2858
No log	6.4	96	1.6259	0.1328	1.6259	1.2751
No log	6.5333	98	1.2635	0.2056	1.2635	1.1241
No log	6.6667	100	1.2252	0.2083	1.2252	1.1069
No log	6.8	102	1.4334	0.1468	1.4334	1.1972
No log	6.9333	104	1.9920	0.1557	1.9920	1.4114
No log	7.0667	106	1.9117	0.1850	1.9117	1.3827
No log	7.2	108	1.5723	0.1281	1.5723	1.2539
No log	7.3333	110	1.2705	0.2357	1.2705	1.1272
No log	7.4667	112	1.3131	0.2236	1.3131	1.1459
No log	7.6	114	1.6149	0.2043	1.6149	1.2708
No log	7.7333	116	1.7901	0.1716	1.7901	1.3380
No log	7.8667	118	1.6332	0.1692	1.6332	1.2780
No log	8.0	120	1.5594	0.1967	1.5594	1.2487
No log	8.1333	122	1.6928	0.1399	1.6928	1.3011
No log	8.2667	124	1.6038	0.1967	1.6038	1.2664
No log	8.4	126	1.4916	0.1230	1.4916	1.2213
No log	8.5333	128	1.4834	0.1597	1.4834	1.2180
No log	8.6667	130	1.6899	0.1075	1.6899	1.3000
No log	8.8	132	1.8559	0.2107	1.8559	1.3623
No log	8.9333	134	1.9931	0.1940	1.9931	1.4118
No log	9.0667	136	1.8886	0.2038	1.8886	1.3743
No log	9.2	138	1.4964	0.2489	1.4964	1.2233
No log	9.3333	140	1.1848	0.1650	1.1848	1.0885
No log	9.4667	142	1.1471	0.1864	1.1471	1.0710
No log	9.6	144	1.2040	0.2223	1.2040	1.0973
No log	9.7333	146	1.4653	0.2555	1.4653	1.2105
No log	9.8667	148	1.7641	0.2326	1.7641	1.3282
No log	10.0	150	1.7821	0.1985	1.7821	1.3350
No log	10.1333	152	1.6995	0.2446	1.6995	1.3037
No log	10.2667	154	1.5008	0.3045	1.5008	1.2251
No log	10.4	156	1.3108	0.1756	1.3108	1.1449
No log	10.5333	158	1.2794	0.2080	1.2794	1.1311
No log	10.6667	160	1.4090	0.1979	1.4090	1.1870
No log	10.8	162	1.4276	0.2390	1.4276	1.1948
No log	10.9333	164	1.3473	0.1844	1.3473	1.1607
No log	11.0667	166	1.3017	0.1795	1.3017	1.1409
No log	11.2	168	1.3644	0.1891	1.3644	1.1681
No log	11.3333	170	1.3922	0.2163	1.3922	1.1799
No log	11.4667	172	1.6524	0.3099	1.6524	1.2855
No log	11.6	174	1.7000	0.2776	1.7000	1.3038
No log	11.7333	176	1.5123	0.3377	1.5123	1.2298
No log	11.8667	178	1.3557	0.2424	1.3557	1.1644
No log	12.0	180	1.1995	0.1122	1.1995	1.0952
No log	12.1333	182	1.1374	0.1441	1.1374	1.0665
No log	12.2667	184	1.1992	0.2317	1.1992	1.0951
No log	12.4	186	1.4313	0.2852	1.4313	1.1964
No log	12.5333	188	1.6129	0.3164	1.6129	1.2700
No log	12.6667	190	1.5622	0.3311	1.5622	1.2499
No log	12.8	192	1.3668	0.2852	1.3668	1.1691
No log	12.9333	194	1.3561	0.2375	1.3561	1.1645
No log	13.0667	196	1.4888	0.3082	1.4888	1.2202
No log	13.2	198	1.6739	0.3060	1.6739	1.2938
No log	13.3333	200	1.5912	0.3219	1.5912	1.2614
No log	13.4667	202	1.3751	0.2647	1.3751	1.1727
No log	13.6	204	1.2593	0.1891	1.2593	1.1222
No log	13.7333	206	1.2769	0.1891	1.2769	1.1300
No log	13.8667	208	1.4171	0.2105	1.4171	1.1904
No log	14.0	210	1.5485	0.2735	1.5485	1.2444
No log	14.1333	212	1.5104	0.2455	1.5104	1.2290
No log	14.2667	214	1.3432	0.2354	1.3432	1.1590
No log	14.4	216	1.2607	0.1944	1.2607	1.1228
No log	14.5333	218	1.3177	0.1844	1.3177	1.1479
No log	14.6667	220	1.5153	0.2604	1.5153	1.2310
No log	14.8	222	1.6453	0.2989	1.6453	1.2827
No log	14.9333	224	1.5650	0.2514	1.5650	1.2510
No log	15.0667	226	1.3622	0.2213	1.3622	1.1671
No log	15.2	228	1.2857	0.1991	1.2857	1.1339
No log	15.3333	230	1.3472	0.1935	1.3472	1.1607
No log	15.4667	232	1.4886	0.1970	1.4886	1.2201
No log	15.6	234	1.5632	0.2120	1.5632	1.2503
No log	15.7333	236	1.4646	0.1068	1.4646	1.2102
No log	15.8667	238	1.2744	0.1850	1.2744	1.1289
No log	16.0	240	1.2063	0.1853	1.2063	1.0983
No log	16.1333	242	1.1831	0.1801	1.1831	1.0877
No log	16.2667	244	1.2533	0.1944	1.2533	1.1195
No log	16.4	246	1.4053	0.2163	1.4053	1.1855
No log	16.5333	248	1.4191	0.2163	1.4191	1.1913
No log	16.6667	250	1.2703	0.1896	1.2703	1.1271
No log	16.8	252	1.2261	0.1846	1.2261	1.1073
No log	16.9333	254	1.3016	0.2278	1.3016	1.1409
No log	17.0667	256	1.3831	0.2895	1.3831	1.1761
No log	17.2	258	1.2908	0.2317	1.2908	1.1361
No log	17.3333	260	1.2061	0.2238	1.2061	1.0982
No log	17.4667	262	1.1380	0.2250	1.1380	1.0667
No log	17.6	264	1.2080	0.2238	1.2080	1.0991
No log	17.7333	266	1.3470	0.1756	1.3470	1.1606
No log	17.8667	268	1.5106	0.2485	1.5106	1.2291
No log	18.0	270	1.6333	0.2569	1.6333	1.2780
No log	18.1333	272	1.5941	0.2542	1.5941	1.2626
No log	18.2667	274	1.6030	0.2935	1.6030	1.2661
No log	18.4	276	1.5402	0.2708	1.5402	1.2410
No log	18.5333	278	1.5593	0.2731	1.5593	1.2487
No log	18.6667	280	1.6631	0.3179	1.6631	1.2896
No log	18.8	282	1.6779	0.2193	1.6779	1.2953
No log	18.9333	284	1.7059	0.2310	1.7059	1.3061
No log	19.0667	286	1.6220	0.2569	1.6220	1.2736
No log	19.2	288	1.4629	0.1547	1.4629	1.2095
No log	19.3333	290	1.2945	0.2131	1.2945	1.1378
No log	19.4667	292	1.2389	0.2238	1.2389	1.1131
No log	19.6	294	1.2727	0.2238	1.2727	1.1281
No log	19.7333	296	1.3397	0.2122	1.3397	1.1574
No log	19.8667	298	1.4384	0.2275	1.4384	1.1993
No log	20.0	300	1.5257	0.1722	1.5257	1.2352
No log	20.1333	302	1.4869	0.2020	1.4869	1.2194
No log	20.2667	304	1.3988	0.2354	1.3988	1.1827
No log	20.4	306	1.3066	0.1894	1.3066	1.1431
No log	20.5333	308	1.2907	0.1894	1.2907	1.1361
No log	20.6667	310	1.3419	0.1894	1.3419	1.1584
No log	20.8	312	1.5206	0.1631	1.5206	1.2331
No log	20.9333	314	1.6771	0.2310	1.6771	1.2950
No log	21.0667	316	1.6590	0.2645	1.6590	1.2880
No log	21.2	318	1.4679	0.1807	1.4679	1.2116
No log	21.3333	320	1.3752	0.1763	1.3752	1.1727
No log	21.4667	322	1.4026	0.1763	1.4026	1.1843
No log	21.6	324	1.5012	0.1515	1.5012	1.2252
No log	21.7333	326	1.5898	0.2285	1.5898	1.2609
No log	21.8667	328	1.7331	0.2620	1.7331	1.3165
No log	22.0	330	1.7499	0.2281	1.7499	1.3228
No log	22.1333	332	1.6604	0.2542	1.6604	1.2886
No log	22.2667	334	1.6492	0.2711	1.6492	1.2842
No log	22.4	336	1.7194	0.2188	1.7194	1.3112
No log	22.5333	338	1.7897	0.2032	1.7897	1.3378
No log	22.6667	340	1.8003	0.2489	1.8003	1.3418
No log	22.8	342	1.7132	0.2281	1.7132	1.3089
No log	22.9333	344	1.4507	0.1631	1.4507	1.2045
No log	23.0667	346	1.3424	0.2278	1.3424	1.1586
No log	23.2	348	1.3992	0.1748	1.3992	1.1829
No log	23.3333	350	1.5333	0.1639	1.5333	1.2383
No log	23.4667	352	1.6061	0.2120	1.6061	1.2673
No log	23.6	354	1.6698	0.2378	1.6698	1.2922
No log	23.7333	356	1.5168	0.2120	1.5168	1.2316
No log	23.8667	358	1.2752	0.2238	1.2752	1.1293
No log	24.0	360	1.1119	0.1649	1.1119	1.0545
No log	24.1333	362	1.0908	0.0878	1.0908	1.0444
No log	24.2667	364	1.0940	0.1379	1.0940	1.0459
No log	24.4	366	1.1915	0.1637	1.1915	1.0915
No log	24.5333	368	1.3849	0.2325	1.3849	1.1768
No log	24.6667	370	1.6446	0.2084	1.6446	1.2824
No log	24.8	372	1.7395	0.2691	1.7395	1.3189
No log	24.9333	374	1.6347	0.2348	1.6347	1.2785
No log	25.0667	376	1.4148	0.2047	1.4148	1.1895
No log	25.2	378	1.3031	0.2390	1.3031	1.1415
No log	25.3333	380	1.3253	0.2252	1.3253	1.1512
No log	25.4667	382	1.4388	0.1970	1.4388	1.1995
No log	25.6	384	1.5303	0.1929	1.5303	1.2371
No log	25.7333	386	1.4470	0.1929	1.4470	1.2029
No log	25.8667	388	1.3493	0.1889	1.3493	1.1616
No log	26.0	390	1.3670	0.1889	1.3670	1.1692
No log	26.1333	392	1.3118	0.1745	1.3118	1.1453
No log	26.2667	394	1.2851	0.1944	1.2851	1.1336
No log	26.4	396	1.3159	0.1745	1.3159	1.1471
No log	26.5333	398	1.3905	0.1796	1.3905	1.1792
No log	26.6667	400	1.4618	0.1929	1.4618	1.2090
No log	26.8	402	1.5035	0.2181	1.5035	1.2262
No log	26.9333	404	1.4775	0.2544	1.4775	1.2155
No log	27.0667	406	1.4233	0.2024	1.4233	1.1930
No log	27.2	408	1.3656	0.1592	1.3656	1.1686
No log	27.3333	410	1.2961	0.1789	1.2961	1.1385
No log	27.4667	412	1.2893	0.1789	1.2893	1.1355
No log	27.6	414	1.3570	0.1935	1.3570	1.1649
No log	27.7333	416	1.3813	0.2213	1.3813	1.1753
No log	27.8667	418	1.3730	0.2252	1.3730	1.1718
No log	28.0	420	1.4101	0.2736	1.4101	1.1875
No log	28.1333	422	1.4234	0.2325	1.4234	1.1931
No log	28.2667	424	1.4024	0.1796	1.4024	1.1842
No log	28.4	426	1.4418	0.2574	1.4418	1.2007
No log	28.5333	428	1.4103	0.2325	1.4103	1.1875
No log	28.6667	430	1.4004	0.2359	1.4004	1.1834
No log	28.8	432	1.4210	0.2325	1.4210	1.1920
No log	28.9333	434	1.4687	0.1843	1.4687	1.2119
No log	29.0667	436	1.5185	0.2317	1.5185	1.2323
No log	29.2	438	1.5024	0.2084	1.5024	1.2257
No log	29.3333	440	1.4663	0.2217	1.4663	1.2109
No log	29.4667	442	1.4262	0.2325	1.4262	1.1943
No log	29.6	444	1.4254	0.1929	1.4254	1.1939
No log	29.7333	446	1.3322	0.1516	1.3322	1.1542
No log	29.8667	448	1.2733	0.1840	1.2733	1.1284
No log	30.0	450	1.2444	0.1789	1.2444	1.1155
No log	30.1333	452	1.2474	0.1789	1.2474	1.1169
No log	30.2667	454	1.3126	0.1789	1.3126	1.1457
No log	30.4	456	1.4087	0.1796	1.4087	1.1869
No log	30.5333	458	1.4955	0.2217	1.4955	1.2229
No log	30.6667	460	1.4811	0.1713	1.4811	1.2170
No log	30.8	462	1.3653	0.1789	1.3653	1.1684
No log	30.9333	464	1.3157	0.1416	1.3157	1.1470
No log	31.0667	466	1.3107	0.1416	1.3107	1.1449
No log	31.2	468	1.3570	0.1789	1.3570	1.1649
No log	31.3333	470	1.4686	0.1748	1.4686	1.2119
No log	31.4667	472	1.4960	0.1796	1.4960	1.2231
No log	31.6	474	1.4500	0.1796	1.4500	1.2042
No log	31.7333	476	1.4184	0.1796	1.4184	1.1910
No log	31.8667	478	1.3379	0.1345	1.3379	1.1567
No log	32.0	480	1.2492	0.1416	1.2492	1.1177
No log	32.1333	482	1.2148	0.1416	1.2148	1.1022
No log	32.2667	484	1.2260	0.1416	1.2260	1.1073
No log	32.4	486	1.2467	0.1416	1.2467	1.1166
No log	32.5333	488	1.2818	0.1789	1.2818	1.1322
No log	32.6667	490	1.3126	0.1889	1.3126	1.1457
No log	32.8	492	1.3662	0.2289	1.3662	1.1689
No log	32.9333	494	1.3451	0.2289	1.3451	1.1598
No log	33.0667	496	1.2778	0.1789	1.2778	1.1304
No log	33.2	498	1.2289	0.1789	1.2289	1.1086
0.2768	33.3333	500	1.2273	0.1789	1.2273	1.1078
0.2768	33.4667	502	1.2401	0.1789	1.2401	1.1136
0.2768	33.6	504	1.2031	0.1736	1.2031	1.0969
0.2768	33.7333	506	1.1680	0.1249	1.1680	1.0807
0.2768	33.8667	508	1.1636	0.1351	1.1636	1.0787
0.2768	34.0	510	1.1936	0.0811	1.1936	1.0925

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1