ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3628
• Qwk: 0.1498
• Mse: 1.3628
• Rmse: 1.1674

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	4.3413	-0.0163	4.3413	2.0836
No log	0.125	4	2.4629	0.0266	2.4629	1.5694
No log	0.1875	6	1.6347	0.0062	1.6347	1.2785
No log	0.25	8	1.3679	-0.0039	1.3679	1.1696
No log	0.3125	10	1.4139	-0.0729	1.4139	1.1891
No log	0.375	12	1.4941	-0.1013	1.4941	1.2223
No log	0.4375	14	1.8327	-0.1939	1.8327	1.3538
No log	0.5	16	1.5792	-0.2275	1.5792	1.2567
No log	0.5625	18	1.5116	-0.0125	1.5116	1.2295
No log	0.625	20	1.5100	-0.0567	1.5100	1.2288
No log	0.6875	22	1.4541	-0.0011	1.4541	1.2059
No log	0.75	24	1.5239	-0.0567	1.5239	1.2345
No log	0.8125	26	1.5507	-0.1171	1.5507	1.2453
No log	0.875	28	1.3766	-0.0256	1.3766	1.1733
No log	0.9375	30	1.3023	0.0499	1.3023	1.1412
No log	1.0	32	1.2986	0.0628	1.2986	1.1396
No log	1.0625	34	1.2664	0.0454	1.2664	1.1254
No log	1.125	36	1.2939	0.0628	1.2939	1.1375
No log	1.1875	38	1.3965	-0.0428	1.3965	1.1818
No log	1.25	40	1.5143	-0.0417	1.5143	1.2306
No log	1.3125	42	1.5259	-0.0581	1.5259	1.2353
No log	1.375	44	1.4864	0.0427	1.4864	1.2192
No log	1.4375	46	1.5092	0.0827	1.5092	1.2285
No log	1.5	48	1.5252	0.0642	1.5252	1.2350
No log	1.5625	50	1.4911	0.1336	1.4911	1.2211
No log	1.625	52	1.5127	0.0861	1.5127	1.2299
No log	1.6875	54	1.4905	0.0797	1.4905	1.2208
No log	1.75	56	1.5023	0.1012	1.5023	1.2257
No log	1.8125	58	1.6259	0.0987	1.6259	1.2751
No log	1.875	60	1.6229	0.1283	1.6229	1.2739
No log	1.9375	62	1.5160	0.0898	1.5160	1.2313
No log	2.0	64	1.7099	-0.0313	1.7099	1.3076
No log	2.0625	66	1.6826	-0.0951	1.6826	1.2971
No log	2.125	68	1.4813	0.0741	1.4813	1.2171
No log	2.1875	70	1.4578	0.0448	1.4578	1.2074
No log	2.25	72	1.5100	0.0942	1.5100	1.2288
No log	2.3125	74	1.5042	0.0792	1.5042	1.2264
No log	2.375	76	1.4911	0.1417	1.4911	1.2211
No log	2.4375	78	1.5771	0.1765	1.5771	1.2558
No log	2.5	80	1.6972	0.1736	1.6972	1.3028
No log	2.5625	82	1.6345	0.2493	1.6345	1.2785
No log	2.625	84	1.5319	0.0198	1.5319	1.2377
No log	2.6875	86	1.5694	0.0989	1.5694	1.2528
No log	2.75	88	1.7695	0.1059	1.7695	1.3302
No log	2.8125	90	1.8374	0.1368	1.8374	1.3555
No log	2.875	92	1.7465	0.0822	1.7465	1.3216
No log	2.9375	94	1.6721	-0.0268	1.6721	1.2931
No log	3.0	96	1.6519	-0.0229	1.6519	1.2853
No log	3.0625	98	1.9416	0.1323	1.9416	1.3934
No log	3.125	100	2.1719	0.1036	2.1719	1.4737
No log	3.1875	102	2.1235	0.1212	2.1235	1.4572
No log	3.25	104	1.7075	0.1259	1.7075	1.3067
No log	3.3125	106	1.6271	0.0314	1.6271	1.2756
No log	3.375	108	1.7152	-0.0040	1.7152	1.3096
No log	3.4375	110	1.5142	0.0088	1.5142	1.2305
No log	3.5	112	1.7317	0.1952	1.7317	1.3159
No log	3.5625	114	1.7845	0.2100	1.7845	1.3359
No log	3.625	116	1.6274	0.1543	1.6274	1.2757
No log	3.6875	118	1.4488	0.1840	1.4488	1.2037
No log	3.75	120	1.4774	0.0786	1.4774	1.2155
No log	3.8125	122	1.5022	0.1358	1.5022	1.2256
No log	3.875	124	1.7602	0.1349	1.7602	1.3267
No log	3.9375	126	1.7623	0.1349	1.7623	1.3275
No log	4.0	128	1.6544	0.0973	1.6544	1.2862
No log	4.0625	130	1.8033	0.1087	1.8033	1.3429
No log	4.125	132	1.7935	0.1303	1.7935	1.3392
No log	4.1875	134	1.6523	0.1170	1.6523	1.2854
No log	4.25	136	1.6254	0.1811	1.6254	1.2749
No log	4.3125	138	1.6717	0.1328	1.6717	1.2930
No log	4.375	140	1.5302	0.2051	1.5302	1.2370
No log	4.4375	142	1.4749	0.1387	1.4749	1.2144
No log	4.5	144	1.5877	0.1305	1.5877	1.2600
No log	4.5625	146	1.8365	0.1325	1.8365	1.3552
No log	4.625	148	1.9524	0.1401	1.9524	1.3973
No log	4.6875	150	1.9991	0.1401	1.9991	1.4139
No log	4.75	152	1.7142	0.1236	1.7142	1.3093
No log	4.8125	154	1.8401	0.1424	1.8401	1.3565
No log	4.875	156	1.7372	0.1022	1.7372	1.3180
No log	4.9375	158	1.5045	0.1203	1.5045	1.2266
No log	5.0	160	1.6251	0.1545	1.6251	1.2748
No log	5.0625	162	1.9592	0.1323	1.9592	1.3997
No log	5.125	164	1.8856	0.1323	1.8856	1.3732
No log	5.1875	166	1.5678	0.1545	1.5678	1.2521
No log	5.25	168	1.4495	0.1171	1.4495	1.2040
No log	5.3125	170	1.6297	0.1557	1.6297	1.2766
No log	5.375	172	1.9217	0.1040	1.9217	1.3863
No log	5.4375	174	1.7840	0.1538	1.7840	1.3357
No log	5.5	176	1.4701	0.1943	1.4701	1.2125
No log	5.5625	178	1.2856	0.1432	1.2856	1.1338
No log	5.625	180	1.2749	0.2255	1.2749	1.1291
No log	5.6875	182	1.3085	0.1860	1.3085	1.1439
No log	5.75	184	1.5827	0.1594	1.5827	1.2581
No log	5.8125	186	1.6703	0.1697	1.6703	1.2924
No log	5.875	188	1.5434	0.1888	1.5434	1.2424
No log	5.9375	190	1.3163	0.1701	1.3163	1.1473
No log	6.0	192	1.2920	0.1860	1.2920	1.1366
No log	6.0625	194	1.4249	0.2236	1.4249	1.1937
No log	6.125	196	1.6992	0.1595	1.6992	1.3036
No log	6.1875	198	1.8193	0.1408	1.8193	1.3488
No log	6.25	200	1.7089	0.0973	1.7089	1.3072
No log	6.3125	202	1.6409	0.0472	1.6409	1.2810
No log	6.375	204	1.5480	0.0733	1.5480	1.2442
No log	6.4375	206	1.5844	0.0651	1.5844	1.2587
No log	6.5	208	1.6821	0.1543	1.6821	1.2970
No log	6.5625	210	1.5357	0.1094	1.5357	1.2392
No log	6.625	212	1.4402	0.0750	1.4402	1.2001
No log	6.6875	214	1.4556	0.0414	1.4556	1.2065
No log	6.75	216	1.3913	0.0648	1.3913	1.1795
No log	6.8125	218	1.5549	0.0271	1.5549	1.2470
No log	6.875	220	1.7484	0.1186	1.7484	1.3223
No log	6.9375	222	1.6616	0.1135	1.6616	1.2890
No log	7.0	224	1.4987	0.1087	1.4987	1.2242
No log	7.0625	226	1.4505	0.1689	1.4505	1.2044
No log	7.125	228	1.5843	0.1358	1.5843	1.2587
No log	7.1875	230	2.0263	0.1363	2.0263	1.4235
No log	7.25	232	2.1771	0.1171	2.1771	1.4755
No log	7.3125	234	2.1175	0.1431	2.1175	1.4552
No log	7.375	236	1.9212	0.1614	1.9212	1.3861
No log	7.4375	238	1.5822	0.1336	1.5822	1.2579
No log	7.5	240	1.3792	0.1658	1.3792	1.1744
No log	7.5625	242	1.3508	0.0923	1.3508	1.1622
No log	7.625	244	1.4774	0.0830	1.4774	1.2155
No log	7.6875	246	1.7373	0.1425	1.7373	1.3181
No log	7.75	248	1.7616	0.1657	1.7616	1.3273
No log	7.8125	250	1.5100	0.1254	1.5100	1.2288
No log	7.875	252	1.2669	0.2528	1.2669	1.1256
No log	7.9375	254	1.3061	0.0714	1.3061	1.1429
No log	8.0	256	1.2339	0.2993	1.2339	1.1108
No log	8.0625	258	1.3544	0.1903	1.3544	1.1638
No log	8.125	260	1.6412	0.1811	1.6412	1.2811
No log	8.1875	262	1.7953	0.1846	1.7953	1.3399
No log	8.25	264	1.7374	0.1774	1.7374	1.3181
No log	8.3125	266	1.5462	0.1845	1.5462	1.2434
No log	8.375	268	1.3114	0.2152	1.3114	1.1452
No log	8.4375	270	1.2803	0.1667	1.2803	1.1315
No log	8.5	272	1.3813	0.2397	1.3813	1.1753
No log	8.5625	274	1.6121	0.1562	1.6121	1.2697
No log	8.625	276	1.8133	0.1634	1.8133	1.3466
No log	8.6875	278	1.9460	0.1282	1.9460	1.3950
No log	8.75	280	1.8064	0.1373	1.8064	1.3440
No log	8.8125	282	1.6144	0.1007	1.6144	1.2706
No log	8.875	284	1.5717	0.1205	1.5717	1.2537
No log	8.9375	286	1.7299	0.0663	1.7299	1.3153
No log	9.0	288	2.0042	0.0995	2.0042	1.4157
No log	9.0625	290	1.9805	0.1538	1.9805	1.4073
No log	9.125	292	1.7057	0.1082	1.7057	1.3060
No log	9.1875	294	1.4740	0.1224	1.4740	1.2141
No log	9.25	296	1.4112	0.0760	1.4112	1.1879
No log	9.3125	298	1.4794	0.0778	1.4794	1.2163
No log	9.375	300	1.5240	0.0356	1.5240	1.2345
No log	9.4375	302	1.5171	0.0920	1.5171	1.2317
No log	9.5	304	1.6022	0.1395	1.6022	1.2658
No log	9.5625	306	1.7394	0.0882	1.7394	1.3189
No log	9.625	308	1.7177	0.0882	1.7177	1.3106
No log	9.6875	310	1.5830	0.0685	1.5830	1.2582
No log	9.75	312	1.5590	0.1143	1.5590	1.2486
No log	9.8125	314	1.6266	0.1713	1.6266	1.2754
No log	9.875	316	1.7179	0.1179	1.7179	1.3107
No log	9.9375	318	1.6446	0.1447	1.6446	1.2824
No log	10.0	320	1.4820	0.0937	1.4820	1.2174
No log	10.0625	322	1.3791	0.0798	1.3791	1.1744
No log	10.125	324	1.3818	0.0964	1.3818	1.1755
No log	10.1875	326	1.4903	0.1071	1.4903	1.2208
No log	10.25	328	1.7159	0.1547	1.7159	1.3099
No log	10.3125	330	1.9331	0.1197	1.9331	1.3903
No log	10.375	332	1.9306	0.1745	1.9306	1.3895
No log	10.4375	334	1.7522	0.1186	1.7522	1.3237
No log	10.5	336	1.4941	0.1795	1.4941	1.2223
No log	10.5625	338	1.4431	0.1850	1.4431	1.2013
No log	10.625	340	1.5660	0.1842	1.5660	1.2514
No log	10.6875	342	1.7248	0.2120	1.7248	1.3133
No log	10.75	344	1.7446	0.1997	1.7446	1.3208
No log	10.8125	346	1.6443	0.1843	1.6443	1.2823
No log	10.875	348	1.4735	0.1345	1.4735	1.2139
No log	10.9375	350	1.3600	0.1026	1.3600	1.1662
No log	11.0	352	1.3672	0.1405	1.3672	1.1693
No log	11.0625	354	1.4537	0.1659	1.4537	1.2057
No log	11.125	356	1.5701	0.1677	1.5701	1.2530
No log	11.1875	358	1.5948	0.1547	1.5948	1.2629
No log	11.25	360	1.5867	0.1929	1.5867	1.2596
No log	11.3125	362	1.4907	0.1345	1.4907	1.2209
No log	11.375	364	1.3791	0.0769	1.3791	1.1744
No log	11.4375	366	1.3758	0.0769	1.3758	1.1729
No log	11.5	368	1.4855	0.1646	1.4855	1.2188
No log	11.5625	370	1.6696	0.1135	1.6696	1.2921
No log	11.625	372	1.7329	0.1425	1.7329	1.3164
No log	11.6875	374	1.6704	0.1767	1.6704	1.2924
No log	11.75	376	1.5113	0.1886	1.5113	1.2294
No log	11.8125	378	1.3722	0.0865	1.3722	1.1714
No log	11.875	380	1.3690	0.0769	1.3690	1.1701
No log	11.9375	382	1.4672	0.1592	1.4672	1.2113
No log	12.0	384	1.7034	0.0992	1.7034	1.3051
No log	12.0625	386	1.7899	0.1918	1.7899	1.3379
No log	12.125	388	1.6901	0.1997	1.6901	1.3000
No log	12.1875	390	1.4905	0.1796	1.4905	1.2209
No log	12.25	392	1.3841	0.0778	1.3841	1.1765
No log	12.3125	394	1.4071	0.1345	1.4071	1.1862
No log	12.375	396	1.5456	0.1618	1.5456	1.2432
No log	12.4375	398	1.6793	0.1529	1.6793	1.2959
No log	12.5	400	1.6980	0.1332	1.6980	1.3031
No log	12.5625	402	1.5619	0.1929	1.5619	1.2498
No log	12.625	404	1.5167	0.2559	1.5167	1.2316
No log	12.6875	406	1.5651	0.1547	1.5651	1.2510
No log	12.75	408	1.7004	0.0992	1.7004	1.3040
No log	12.8125	410	1.6825	0.2285	1.6825	1.2971
No log	12.875	412	1.5942	0.2289	1.5942	1.2626
No log	12.9375	414	1.4854	0.1935	1.4854	1.2188
No log	13.0	416	1.4490	0.1345	1.4490	1.2038
No log	13.0625	418	1.4663	0.1345	1.4663	1.2109
No log	13.125	420	1.5710	0.2512	1.5710	1.2534
No log	13.1875	422	1.6048	0.2144	1.6048	1.2668
No log	13.25	424	1.5172	0.2512	1.5172	1.2317
No log	13.3125	426	1.4986	0.2354	1.4986	1.2242
No log	13.375	428	1.5738	0.2144	1.5738	1.2545
No log	13.4375	430	1.6609	0.1683	1.6609	1.2888
No log	13.5	432	1.7144	0.1044	1.7144	1.3094
No log	13.5625	434	1.6707	0.1283	1.6707	1.2926
No log	13.625	436	1.5376	0.2239	1.5376	1.2400
No log	13.6875	438	1.4346	0.1500	1.4346	1.1978
No log	13.75	440	1.4086	0.1282	1.4086	1.1868
No log	13.8125	442	1.4675	0.1745	1.4675	1.2114
No log	13.875	444	1.5420	0.1842	1.5420	1.2418
No log	13.9375	446	1.5346	0.1842	1.5346	1.2388
No log	14.0	448	1.4367	0.1440	1.4367	1.1986
No log	14.0625	450	1.4156	0.1440	1.4156	1.1898
No log	14.125	452	1.4425	0.1745	1.4425	1.2010
No log	14.1875	454	1.4793	0.1935	1.4793	1.2163
No log	14.25	456	1.4600	0.2080	1.4600	1.2083
No log	14.3125	458	1.4253	0.1498	1.4253	1.1939
No log	14.375	460	1.5318	0.1845	1.5318	1.2377
No log	14.4375	462	1.7550	0.1095	1.7550	1.3247
No log	14.5	464	1.8570	0.1499	1.8570	1.3627
No log	14.5625	466	1.7454	0.1379	1.7454	1.3211
No log	14.625	468	1.6308	0.1068	1.6308	1.2770
No log	14.6875	470	1.5493	0.0038	1.5493	1.2447
No log	14.75	472	1.4770	0.0526	1.4770	1.2153
No log	14.8125	474	1.4299	0.0954	1.4299	1.1958
No log	14.875	476	1.4746	0.0685	1.4746	1.2144
No log	14.9375	478	1.6449	0.1447	1.6449	1.2826
No log	15.0	480	1.9271	0.0846	1.9271	1.3882
No log	15.0625	482	2.0545	0.1069	2.0545	1.4334
No log	15.125	484	1.9545	0.0903	1.9545	1.3980
No log	15.1875	486	1.6183	0.1529	1.6183	1.2721
No log	15.25	488	1.4308	0.2126	1.4308	1.1962
No log	15.3125	490	1.3613	0.2698	1.3613	1.1668
No log	15.375	492	1.4221	0.2438	1.4221	1.1925
No log	15.4375	494	1.6288	0.1483	1.6288	1.2762
No log	15.5	496	1.6831	0.0992	1.6831	1.2974
No log	15.5625	498	1.5937	0.1639	1.5937	1.2624
0.3527	15.625	500	1.4694	0.1659	1.4694	1.2122
0.3527	15.6875	502	1.4794	0.1659	1.4794	1.2163
0.3527	15.75	504	1.4500	0.2080	1.4500	1.2042
0.3527	15.8125	506	1.5002	0.2213	1.5002	1.2248
0.3527	15.875	508	1.5560	0.2479	1.5560	1.2474
0.3527	15.9375	510	1.5025	0.2213	1.5025	1.2257
0.3527	16.0	512	1.4159	0.1345	1.4159	1.1899
0.3527	16.0625	514	1.4393	0.1345	1.4393	1.1997
0.3527	16.125	516	1.4674	0.2213	1.4674	1.2114
0.3527	16.1875	518	1.4956	0.2065	1.4956	1.2230
0.3527	16.25	520	1.4799	0.2479	1.4799	1.2165
0.3527	16.3125	522	1.3854	0.1795	1.3854	1.1770
0.3527	16.375	524	1.3018	0.1801	1.3018	1.1410
0.3527	16.4375	526	1.3098	0.1801	1.3098	1.1445
0.3527	16.5	528	1.3555	0.1498	1.3555	1.1643
0.3527	16.5625	530	1.4151	0.1345	1.4151	1.1896
0.3527	16.625	532	1.3938	0.1345	1.3938	1.1806
0.3527	16.6875	534	1.3837	0.1345	1.3837	1.1763
0.3527	16.75	536	1.3628	0.1498	1.3628	1.1674

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1