ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5758
• Qwk: 0.1212
• Mse: 1.5758
• Rmse: 1.2553

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	2.6637	-0.0924	2.6637	1.6321
No log	0.0851	4	1.4013	0.0141	1.4013	1.1837
No log	0.1277	6	1.3553	-0.2440	1.3553	1.1642
No log	0.1702	8	1.2365	-0.0464	1.2365	1.1120
No log	0.2128	10	1.2210	-0.0344	1.2210	1.1050
No log	0.2553	12	1.2286	-0.0690	1.2286	1.1084
No log	0.2979	14	1.1498	-0.0358	1.1498	1.0723
No log	0.3404	16	1.0321	0.0584	1.0321	1.0159
No log	0.3830	18	0.8367	0.0393	0.8367	0.9147
No log	0.4255	20	0.7600	0.0481	0.7600	0.8718
No log	0.4681	22	0.8111	0.1754	0.8111	0.9006
No log	0.5106	24	0.7766	0.1365	0.7766	0.8812
No log	0.5532	26	0.7313	0.0481	0.7313	0.8551
No log	0.5957	28	0.7361	0.0	0.7361	0.8580
No log	0.6383	30	0.7731	0.0393	0.7731	0.8793
No log	0.6809	32	0.7855	0.0757	0.7855	0.8863
No log	0.7234	34	0.8020	0.1972	0.8020	0.8955
No log	0.7660	36	0.8369	0.2883	0.8369	0.9148
No log	0.8085	38	0.8729	0.3777	0.8729	0.9343
No log	0.8511	40	0.8536	0.3538	0.8536	0.9239
No log	0.8936	42	0.7888	0.3712	0.7888	0.8882
No log	0.9362	44	0.7598	0.2345	0.7598	0.8717
No log	0.9787	46	0.7530	0.1094	0.7530	0.8678
No log	1.0213	48	0.7544	0.0798	0.7544	0.8686
No log	1.0638	50	0.7627	0.0840	0.7627	0.8734
No log	1.1064	52	0.7358	0.0840	0.7358	0.8578
No log	1.1489	54	0.6856	0.0717	0.6856	0.8280
No log	1.1915	56	0.6884	0.2950	0.6884	0.8297
No log	1.2340	58	0.7261	0.3894	0.7261	0.8521
No log	1.2766	60	0.7789	0.3606	0.7789	0.8825
No log	1.3191	62	0.7260	0.3675	0.7260	0.8521
No log	1.3617	64	0.6401	0.3839	0.6401	0.8001
No log	1.4043	66	0.6327	0.1508	0.6327	0.7955
No log	1.4468	68	0.6410	0.1508	0.6410	0.8006
No log	1.4894	70	0.6632	0.1400	0.6632	0.8144
No log	1.5319	72	0.7023	0.3471	0.7023	0.8381
No log	1.5745	74	0.7650	0.4144	0.7650	0.8747
No log	1.6170	76	0.7903	0.4067	0.7903	0.8890
No log	1.6596	78	0.7897	0.3637	0.7897	0.8887
No log	1.7021	80	0.8316	0.2576	0.8316	0.9119
No log	1.7447	82	0.8872	0.2812	0.8872	0.9419
No log	1.7872	84	0.9997	0.3019	0.9997	0.9999
No log	1.8298	86	1.0678	0.2166	1.0678	1.0333
No log	1.8723	88	1.1104	0.2306	1.1104	1.0537
No log	1.9149	90	1.0281	0.2529	1.0281	1.0140
No log	1.9574	92	0.9326	0.3675	0.9326	0.9657
No log	2.0	94	0.8716	0.3675	0.8716	0.9336
No log	2.0426	96	0.8634	0.3746	0.8634	0.9292
No log	2.0851	98	0.8771	0.3494	0.8771	0.9366
No log	2.1277	100	0.9171	0.2843	0.9171	0.9576
No log	2.1702	102	0.8758	0.2574	0.8758	0.9358
No log	2.2128	104	0.8448	0.2692	0.8448	0.9191
No log	2.2553	106	0.8333	0.2574	0.8333	0.9128
No log	2.2979	108	0.8568	0.3234	0.8568	0.9256
No log	2.3404	110	0.8793	0.4175	0.8793	0.9377
No log	2.3830	112	0.9889	0.3022	0.9889	0.9945
No log	2.4255	114	1.0047	0.3160	1.0047	1.0024
No log	2.4681	116	1.0763	0.2730	1.0763	1.0375
No log	2.5106	118	1.0466	0.2779	1.0466	1.0230
No log	2.5532	120	1.1151	0.2824	1.1151	1.0560
No log	2.5957	122	1.0843	0.2659	1.0843	1.0413
No log	2.6383	124	0.9272	0.3461	0.9272	0.9629
No log	2.6809	126	0.8853	0.2871	0.8853	0.9409
No log	2.7234	128	0.9144	0.2754	0.9144	0.9562
No log	2.7660	130	0.8800	0.2812	0.8800	0.9381
No log	2.8085	132	0.8236	0.2871	0.8236	0.9075
No log	2.8511	134	0.8252	0.2871	0.8252	0.9084
No log	2.8936	136	0.8914	0.2439	0.8914	0.9441
No log	2.9362	138	0.9867	0.3043	0.9867	0.9933
No log	2.9787	140	1.1421	0.2094	1.1421	1.0687
No log	3.0213	142	1.2434	0.2271	1.2434	1.1151
No log	3.0638	144	1.1769	0.1689	1.1769	1.0848
No log	3.1064	146	0.9985	0.2012	0.9985	0.9992
No log	3.1489	148	0.9290	0.1815	0.9290	0.9639
No log	3.1915	150	0.9359	0.1661	0.9359	0.9674
No log	3.2340	152	1.0525	0.2124	1.0525	1.0259
No log	3.2766	154	1.0889	0.1712	1.0889	1.0435
No log	3.3191	156	1.0747	0.1912	1.0747	1.0367
No log	3.3617	158	1.0045	0.1575	1.0045	1.0022
No log	3.4043	160	0.9698	0.1409	0.9698	0.9848
No log	3.4468	162	0.9548	0.1181	0.9548	0.9771
No log	3.4894	164	0.9817	0.1504	0.9817	0.9908
No log	3.5319	166	1.0031	0.1718	1.0031	1.0015
No log	3.5745	168	1.0170	0.1293	1.0170	1.0085
No log	3.6170	170	0.9936	0.1914	0.9936	0.9968
No log	3.6596	172	1.0048	0.1867	1.0048	1.0024
No log	3.7021	174	1.0980	0.1565	1.0980	1.0479
No log	3.7447	176	1.2056	0.2125	1.2056	1.0980
No log	3.7872	178	1.2302	0.2439	1.2302	1.1091
No log	3.8298	180	1.1455	0.2779	1.1455	1.0703
No log	3.8723	182	1.0930	0.2754	1.0930	1.0455
No log	3.9149	184	1.0784	0.2220	1.0784	1.0385
No log	3.9574	186	1.1403	0.2554	1.1403	1.0679
No log	4.0	188	1.2969	0.2043	1.2969	1.1388
No log	4.0426	190	1.3622	0.1450	1.3622	1.1671
No log	4.0851	192	1.3052	0.1484	1.3052	1.1424
No log	4.1277	194	1.2622	0.1450	1.2622	1.1235
No log	4.1702	196	1.2648	0.1928	1.2648	1.1246
No log	4.2128	198	1.1831	0.2380	1.1831	1.0877
No log	4.2553	200	1.1262	0.2421	1.1262	1.0612
No log	4.2979	202	1.0855	0.3559	1.0855	1.0419
No log	4.3404	204	1.1628	0.2079	1.1628	1.0783
No log	4.3830	206	1.2835	0.1973	1.2835	1.1329
No log	4.4255	208	1.2825	0.1450	1.2825	1.1325
No log	4.4681	210	1.0654	0.2411	1.0654	1.0322
No log	4.5106	212	0.8324	0.2754	0.8324	0.9123
No log	4.5532	214	0.7856	0.1225	0.7856	0.8863
No log	4.5957	216	0.8323	0.1766	0.8323	0.9123
No log	4.6383	218	0.9972	0.2934	0.9972	0.9986
No log	4.6809	220	1.2488	0.2043	1.2488	1.1175
No log	4.7234	222	1.3068	0.1641	1.3068	1.1432
No log	4.7660	224	1.1524	0.2732	1.1524	1.0735
No log	4.8085	226	0.9214	0.3538	0.9214	0.9599
No log	4.8511	228	0.8427	0.3359	0.8427	0.9180
No log	4.8936	230	0.8577	0.3359	0.8577	0.9261
No log	4.9362	232	0.9906	0.3409	0.9906	0.9953
No log	4.9787	234	1.1941	0.2240	1.1941	1.0927
No log	5.0213	236	1.3406	0.0992	1.3406	1.1578
No log	5.0638	238	1.3299	0.0992	1.3299	1.1532
No log	5.1064	240	1.2705	0.0992	1.2705	1.1271
No log	5.1489	242	1.2032	0.1895	1.2032	1.0969
No log	5.1915	244	1.0963	0.2898	1.0963	1.0470
No log	5.2340	246	1.0007	0.3618	1.0007	1.0003
No log	5.2766	248	1.0085	0.3678	1.0085	1.0042
No log	5.3191	250	1.0542	0.3559	1.0542	1.0268
No log	5.3617	252	1.1527	0.2885	1.1527	1.0737
No log	5.4043	254	1.2276	0.1796	1.2276	1.1080
No log	5.4468	256	1.1468	0.2482	1.1468	1.0709
No log	5.4894	258	1.0743	0.2562	1.0743	1.0365
No log	5.5319	260	1.0421	0.2562	1.0421	1.0208
No log	5.5745	262	0.9842	0.1628	0.9842	0.9921
No log	5.6170	264	1.0036	0.2632	1.0036	1.0018
No log	5.6596	266	1.0427	0.2094	1.0427	1.0211
No log	5.7021	268	1.0650	0.1777	1.0650	1.0320
No log	5.7447	270	1.1338	0.1463	1.1338	1.0648
No log	5.7872	272	1.1282	0.2166	1.1282	1.0622
No log	5.8298	274	1.0319	0.3137	1.0319	1.0158
No log	5.8723	276	1.0287	0.3287	1.0287	1.0142
No log	5.9149	278	1.1328	0.2545	1.1328	1.0643
No log	5.9574	280	1.2403	0.2459	1.2403	1.1137
No log	6.0	282	1.2752	0.2074	1.2752	1.1292
No log	6.0426	284	1.3020	0.1814	1.3020	1.1411
No log	6.0851	286	1.2599	0.1663	1.2599	1.1224
No log	6.1277	288	1.3429	0.1740	1.3429	1.1588
No log	6.1702	290	1.5522	0.1189	1.5522	1.2459
No log	6.2128	292	1.5905	0.0967	1.5905	1.2612
No log	6.2553	294	1.4501	0.1527	1.4501	1.2042
No log	6.2979	296	1.1719	0.2324	1.1719	1.0825
No log	6.3404	298	0.9925	0.2886	0.9925	0.9962
No log	6.3830	300	0.8838	0.3746	0.8838	0.9401
No log	6.4255	302	0.9002	0.2982	0.9002	0.9488
No log	6.4681	304	1.1144	0.2166	1.1144	1.0557
No log	6.5106	306	1.3247	0.2145	1.3247	1.1509
No log	6.5532	308	1.4620	0.2145	1.4620	1.2091
No log	6.5957	310	1.3484	0.1896	1.3484	1.1612
No log	6.6383	312	1.2891	0.2142	1.2891	1.1354
No log	6.6809	314	1.4039	0.2070	1.4039	1.1849
No log	6.7234	316	1.6608	0.2137	1.6608	1.2887
No log	6.7660	318	1.9896	0.1483	1.9896	1.4105
No log	6.8085	320	1.9771	0.1374	1.9771	1.4061
No log	6.8511	322	1.6755	0.1562	1.6755	1.2944
No log	6.8936	324	1.3255	0.1985	1.3255	1.1513
No log	6.9362	326	1.0842	0.2183	1.0842	1.0413
No log	6.9787	328	1.0589	0.2271	1.0589	1.0290
No log	7.0213	330	1.2116	0.2264	1.2116	1.1007
No log	7.0638	332	1.4638	0.1386	1.4638	1.2099
No log	7.1064	334	1.6130	0.1639	1.6130	1.2700
No log	7.1489	336	1.4876	0.1748	1.4876	1.2197
No log	7.1915	338	1.2303	0.1956	1.2303	1.1092
No log	7.2340	340	1.1143	0.2977	1.1143	1.0556
No log	7.2766	342	1.0727	0.2529	1.0727	1.0357
No log	7.3191	344	1.2328	0.2245	1.2328	1.1103
No log	7.3617	346	1.4310	0.2070	1.4310	1.1963
No log	7.4043	348	1.5150	0.1285	1.5150	1.2309
No log	7.4468	350	1.3966	0.0948	1.3966	1.1818
No log	7.4894	352	1.2291	0.2145	1.2291	1.1087
No log	7.5319	354	1.1636	0.1884	1.1636	1.0787
No log	7.5745	356	1.1511	0.1671	1.1511	1.0729
No log	7.6170	358	1.1594	0.1732	1.1594	1.0768
No log	7.6596	360	1.2131	0.1885	1.2131	1.1014
No log	7.7021	362	1.3714	0.2101	1.3714	1.1711
No log	7.7447	364	1.4226	0.1942	1.4226	1.1927
No log	7.7872	366	1.3898	0.1439	1.3898	1.1789
No log	7.8298	368	1.2726	0.1522	1.2726	1.1281
No log	7.8723	370	1.0750	0.2459	1.0750	1.0368
No log	7.9149	372	0.9148	0.3991	0.9148	0.9565
No log	7.9574	374	0.8799	0.3494	0.8799	0.9380
No log	8.0	376	0.9278	0.3256	0.9278	0.9632
No log	8.0426	378	1.0541	0.2982	1.0541	1.0267
No log	8.0851	380	1.2293	0.1905	1.2293	1.1088
No log	8.1277	382	1.3812	0.1670	1.3812	1.1753
No log	8.1702	384	1.3951	0.1670	1.3951	1.1812
No log	8.2128	386	1.2804	0.1670	1.2804	1.1315
No log	8.2553	388	1.1460	0.2168	1.1460	1.0705
No log	8.2979	390	1.0950	0.2898	1.0950	1.0464
No log	8.3404	392	1.1259	0.1810	1.1259	1.0611
No log	8.3830	394	1.1749	0.1873	1.1749	1.0839
No log	8.4255	396	1.3328	0.1726	1.3328	1.1545
No log	8.4681	398	1.5848	0.1721	1.5848	1.2589
No log	8.5106	400	1.6795	0.1504	1.6795	1.2960
No log	8.5532	402	1.6258	0.1584	1.6258	1.2751
No log	8.5957	404	1.4334	0.1905	1.4334	1.1972
No log	8.6383	406	1.2283	0.1884	1.2283	1.1083
No log	8.6809	408	1.1598	0.1484	1.1598	1.0769
No log	8.7234	410	1.1777	0.2336	1.1777	1.0852
No log	8.7660	412	1.3147	0.2086	1.3147	1.1466
No log	8.8085	414	1.5129	0.1439	1.5129	1.2300
No log	8.8511	416	1.5465	0.1189	1.5465	1.2436
No log	8.8936	418	1.4248	0.1171	1.4248	1.1937
No log	8.9362	420	1.2621	0.1678	1.2621	1.1234
No log	8.9787	422	1.0897	0.1968	1.0897	1.0439
No log	9.0213	424	0.9985	0.2857	0.9985	0.9992
No log	9.0638	426	0.9976	0.3214	0.9976	0.9988
No log	9.1064	428	1.0787	0.2710	1.0787	1.0386
No log	9.1489	430	1.2451	0.1422	1.2451	1.1159
No log	9.1915	432	1.3791	0.1122	1.3791	1.1744
No log	9.2340	434	1.5209	0.1031	1.5209	1.2333
No log	9.2766	436	1.6475	0.1123	1.6475	1.2836
No log	9.3191	438	1.5782	0.1339	1.5782	1.2563
No log	9.3617	440	1.4102	0.1285	1.4102	1.1875
No log	9.4043	442	1.2136	0.1422	1.2136	1.1016
No log	9.4468	444	1.1310	0.2130	1.1310	1.0635
No log	9.4894	446	1.1822	0.1450	1.1822	1.0873
No log	9.5319	448	1.3821	0.1285	1.3821	1.1756
No log	9.5745	450	1.5172	0.1053	1.5172	1.2318
No log	9.6170	452	1.4819	0.1285	1.4819	1.2173
No log	9.6596	454	1.3834	0.1122	1.3834	1.1762
No log	9.7021	456	1.3257	0.1171	1.3257	1.1514
No log	9.7447	458	1.2208	0.1422	1.2208	1.1049
No log	9.7872	460	1.2259	0.1422	1.2259	1.1072
No log	9.8298	462	1.1593	0.1740	1.1593	1.0767
No log	9.8723	464	1.0468	0.3110	1.0468	1.0231
No log	9.9149	466	1.0325	0.3233	1.0325	1.0161
No log	9.9574	468	1.0756	0.3134	1.0756	1.0371
No log	10.0	470	1.1063	0.2559	1.1063	1.0518
No log	10.0426	472	1.2347	0.1740	1.2347	1.1112
No log	10.0851	474	1.4333	0.1212	1.4333	1.1972
No log	10.1277	476	1.5129	0.1053	1.5129	1.2300
No log	10.1702	478	1.4558	0.0925	1.4558	1.2066
No log	10.2128	480	1.3235	0.0993	1.3235	1.1504
No log	10.2553	482	1.1590	0.2543	1.1590	1.0766
No log	10.2979	484	1.0594	0.2903	1.0594	1.0293
No log	10.3404	486	1.0267	0.3337	1.0267	1.0133
No log	10.3830	488	1.0256	0.3337	1.0256	1.0127
No log	10.4255	490	1.0592	0.3225	1.0592	1.0292
No log	10.4681	492	1.1422	0.2543	1.1422	1.0687
No log	10.5106	494	1.2296	0.1782	1.2296	1.1089
No log	10.5532	496	1.2458	0.1939	1.2458	1.1162
No log	10.5957	498	1.1652	0.1815	1.1652	1.0794
0.3082	10.6383	500	1.0864	0.2459	1.0864	1.0423
0.3082	10.6809	502	1.0592	0.2755	1.0592	1.0292
0.3082	10.7234	504	1.0735	0.2889	1.0735	1.0361
0.3082	10.7660	506	1.0899	0.2889	1.0899	1.0440
0.3082	10.8085	508	1.0612	0.3052	1.0612	1.0302
0.3082	10.8511	510	1.0651	0.3253	1.0651	1.0321
0.3082	10.8936	512	1.1450	0.3174	1.1450	1.0700
0.3082	10.9362	514	1.2130	0.2074	1.2130	1.1013
0.3082	10.9787	516	1.2692	0.2041	1.2692	1.1266
0.3082	11.0213	518	1.4175	0.1464	1.4175	1.1906
0.3082	11.0638	520	1.5510	0.1212	1.5510	1.2454
0.3082	11.1064	522	1.5758	0.1212	1.5758	1.2553

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1