ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0531
• Qwk: 0.1451
• Mse: 1.0531
• Rmse: 1.0262

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	2.4558	-0.0449	2.4558	1.5671
No log	0.3333	4	1.2629	0.1882	1.2629	1.1238
No log	0.5	6	1.1918	-0.1866	1.1918	1.0917
No log	0.6667	8	1.1384	-0.1492	1.1384	1.0669
No log	0.8333	10	0.8990	0.1254	0.8990	0.9482
No log	1.0	12	0.7821	0.1737	0.7821	0.8843
No log	1.1667	14	0.8093	0.2103	0.8093	0.8996
No log	1.3333	16	0.7619	0.1138	0.7619	0.8729
No log	1.5	18	0.8983	0.2094	0.8983	0.9478
No log	1.6667	20	1.0006	0.1990	1.0006	1.0003
No log	1.8333	22	0.9355	0.0924	0.9355	0.9672
No log	2.0	24	0.8456	-0.0054	0.8456	0.9195
No log	2.1667	26	0.8250	0.0	0.8250	0.9083
No log	2.3333	28	0.8003	0.0428	0.8003	0.8946
No log	2.5	30	0.7562	0.0428	0.7562	0.8696
No log	2.6667	32	0.7069	0.1617	0.7069	0.8408
No log	2.8333	34	0.6652	0.2786	0.6652	0.8156
No log	3.0	36	0.6421	0.2786	0.6421	0.8013
No log	3.1667	38	0.6285	0.3151	0.6285	0.7928
No log	3.3333	40	0.6167	0.2923	0.6167	0.7853
No log	3.5	42	0.6230	0.2923	0.6230	0.7893
No log	3.6667	44	0.6669	0.2751	0.6669	0.8166
No log	3.8333	46	0.9056	0.2287	0.9056	0.9516
No log	4.0	48	0.9567	0.2964	0.9567	0.9781
No log	4.1667	50	0.6701	0.2960	0.6701	0.8186
No log	4.3333	52	0.6849	0.2576	0.6849	0.8276
No log	4.5	54	1.0355	0.3370	1.0355	1.0176
No log	4.6667	56	1.1746	0.2843	1.1746	1.0838
No log	4.8333	58	0.8429	0.4114	0.8429	0.9181
No log	5.0	60	0.7358	0.4606	0.7358	0.8578
No log	5.1667	62	0.7382	0.4606	0.7382	0.8592
No log	5.3333	64	1.1225	0.3166	1.1225	1.0595
No log	5.5	66	1.2132	0.3255	1.2132	1.1015
No log	5.6667	68	0.8601	0.4180	0.8601	0.9274
No log	5.8333	70	0.7290	0.3946	0.7290	0.8538
No log	6.0	72	0.9108	0.2890	0.9108	0.9544
No log	6.1667	74	0.8193	0.3505	0.8193	0.9052
No log	6.3333	76	0.7107	0.3335	0.7107	0.8430
No log	6.5	78	0.9283	0.3516	0.9283	0.9635
No log	6.6667	80	0.9761	0.3114	0.9761	0.9880
No log	6.8333	82	0.8797	0.4347	0.8797	0.9379
No log	7.0	84	0.7779	0.3393	0.7779	0.8820
No log	7.1667	86	0.7885	0.3051	0.7885	0.8880
No log	7.3333	88	1.0792	0.2963	1.0792	1.0389
No log	7.5	90	1.5711	0.1932	1.5711	1.2534
No log	7.6667	92	1.4735	0.2145	1.4735	1.2139
No log	7.8333	94	0.9924	0.3212	0.9924	0.9962
No log	8.0	96	0.7131	0.3995	0.7131	0.8444
No log	8.1667	98	0.6939	0.3995	0.6939	0.8330
No log	8.3333	100	0.8140	0.4614	0.8140	0.9022
No log	8.5	102	1.1798	0.2459	1.1798	1.0862
No log	8.6667	104	1.4971	0.1522	1.4971	1.2236
No log	8.8333	106	1.3105	0.2243	1.3105	1.1448
No log	9.0	108	0.8939	0.2363	0.8939	0.9455
No log	9.1667	110	0.7475	0.3088	0.7475	0.8646
No log	9.3333	112	0.7727	0.2012	0.7727	0.8790
No log	9.5	114	0.8946	0.2601	0.8946	0.9458
No log	9.6667	116	1.1900	0.2543	1.1900	1.0909
No log	9.8333	118	1.4967	0.1067	1.4967	1.2234
No log	10.0	120	1.5079	0.0846	1.5079	1.2280
No log	10.1667	122	1.2061	0.2020	1.2061	1.0982
No log	10.3333	124	1.0773	0.2006	1.0773	1.0379
No log	10.5	126	1.0147	0.2084	1.0147	1.0073
No log	10.6667	128	1.0713	0.2084	1.0713	1.0350
No log	10.8333	130	1.2005	0.1713	1.2005	1.0957
No log	11.0	132	1.4583	0.1337	1.4583	1.2076
No log	11.1667	134	1.6405	0.0290	1.6405	1.2808
No log	11.3333	136	1.6059	0.0505	1.6059	1.2673
No log	11.5	138	1.3509	0.1550	1.3509	1.1623
No log	11.6667	140	1.0186	0.2227	1.0186	1.0093
No log	11.8333	142	0.8502	0.1962	0.8502	0.9221
No log	12.0	144	0.8498	0.1914	0.8498	0.9218
No log	12.1667	146	0.9614	0.3251	0.9614	0.9805
No log	12.3333	148	1.0172	0.3517	1.0172	1.0086
No log	12.5	150	0.9317	0.2866	0.9317	0.9653
No log	12.6667	152	0.9037	0.2923	0.9037	0.9507
No log	12.8333	154	0.9966	0.3029	0.9966	0.9983
No log	13.0	156	1.1002	0.2348	1.1002	1.0489
No log	13.1667	158	1.1108	0.2125	1.1108	1.0539
No log	13.3333	160	1.2612	0.1884	1.2612	1.1230
No log	13.5	162	1.3677	0.1606	1.3677	1.1695
No log	13.6667	164	1.3307	0.1606	1.3307	1.1536
No log	13.8333	166	1.2251	0.1956	1.2251	1.1069
No log	14.0	168	1.0392	0.2119	1.0392	1.0194
No log	14.1667	170	0.9426	0.1692	0.9426	0.9709
No log	14.3333	172	0.9516	0.2308	0.9516	0.9755
No log	14.5	174	0.9074	0.1867	0.9074	0.9526
No log	14.6667	176	0.8979	0.1584	0.8979	0.9476
No log	14.8333	178	0.8506	0.2063	0.8506	0.9223
No log	15.0	180	0.8814	0.2012	0.8814	0.9388
No log	15.1667	182	1.0734	0.1935	1.0734	1.0361
No log	15.3333	184	1.3389	0.1849	1.3389	1.1571
No log	15.5	186	1.3718	0.1849	1.3718	1.1712
No log	15.6667	188	1.2396	0.1713	1.2396	1.1134
No log	15.8333	190	1.1501	0.2348	1.1501	1.0724
No log	16.0	192	1.0514	0.1499	1.0514	1.0254
No log	16.1667	194	1.0339	0.1277	1.0339	1.0168
No log	16.3333	196	1.1276	0.1949	1.1276	1.0619
No log	16.5	198	1.1555	0.1949	1.1555	1.0749
No log	16.6667	200	1.2600	0.1795	1.2600	1.1225
No log	16.8333	202	1.2647	0.1795	1.2647	1.1246
No log	17.0	204	1.2886	0.1530	1.2886	1.1352
No log	17.1667	206	1.2550	0.2006	1.2550	1.1203
No log	17.3333	208	1.2282	0.1748	1.2282	1.1082
No log	17.5	210	1.2324	0.1564	1.2324	1.1102
No log	17.6667	212	1.1842	0.2045	1.1842	1.0882
No log	17.8333	214	1.1115	0.1492	1.1115	1.0543
No log	18.0	216	1.1450	0.1810	1.1450	1.0700
No log	18.1667	218	1.2441	0.1422	1.2441	1.1154
No log	18.3333	220	1.3611	0.1606	1.3611	1.1667
No log	18.5	222	1.3625	0.1968	1.3625	1.1672
No log	18.6667	224	1.1965	0.1821	1.1965	1.0939
No log	18.8333	226	0.9880	0.2147	0.9880	0.9940
No log	19.0	228	0.9187	0.2275	0.9187	0.9585
No log	19.1667	230	0.9491	0.2387	0.9491	0.9742
No log	19.3333	232	1.0042	0.2487	1.0042	1.0021
No log	19.5	234	1.0199	0.2343	1.0199	1.0099
No log	19.6667	236	1.0849	0.2372	1.0849	1.0416
No log	19.8333	238	1.1605	0.1993	1.1605	1.0773
No log	20.0	240	1.0556	0.1775	1.0556	1.0274
No log	20.1667	242	1.0051	0.1651	1.0051	1.0025
No log	20.3333	244	0.9719	0.1777	0.9719	0.9859
No log	20.5	246	0.9605	0.2410	0.9605	0.9801
No log	20.6667	248	0.9482	0.2358	0.9482	0.9738
No log	20.8333	250	0.9964	0.2211	0.9964	0.9982
No log	21.0	252	1.0277	0.2995	1.0277	1.0137
No log	21.1667	254	1.1098	0.2227	1.1098	1.0535
No log	21.3333	256	1.0845	0.2552	1.0845	1.0414
No log	21.5	258	0.9594	0.2211	0.9594	0.9795
No log	21.6667	260	0.9051	0.2562	0.9051	0.9514
No log	21.8333	262	0.9335	0.2562	0.9335	0.9662
No log	22.0	264	1.0057	0.2833	1.0057	1.0028
No log	22.1667	266	1.0557	0.2782	1.0557	1.0275
No log	22.3333	268	1.0780	0.2590	1.0780	1.0383
No log	22.5	270	1.0165	0.1726	1.0165	1.0082
No log	22.6667	272	0.9075	0.2287	0.9075	0.9527
No log	22.8333	274	0.8659	0.2173	0.8659	0.9305
No log	23.0	276	0.9096	0.1808	0.9096	0.9537
No log	23.1667	278	0.8791	0.1962	0.8791	0.9376
No log	23.3333	280	0.8866	0.2244	0.8866	0.9416
No log	23.5	282	1.0046	0.1775	1.0046	1.0023
No log	23.6667	284	1.1312	0.2065	1.1312	1.0636
No log	23.8333	286	1.2034	0.1995	1.2034	1.0970
No log	24.0	288	1.2090	0.1796	1.2090	1.0995
No log	24.1667	290	1.2276	0.1796	1.2276	1.1080
No log	24.3333	292	1.0892	0.1729	1.0892	1.0436
No log	24.5	294	0.9735	0.1110	0.9735	0.9867
No log	24.6667	296	1.0179	0.1815	1.0179	1.0089
No log	24.8333	298	1.0586	0.1422	1.0586	1.0289
No log	25.0	300	1.1915	0.1262	1.1915	1.0916
No log	25.1667	302	1.2433	0.1490	1.2433	1.1150
No log	25.3333	304	1.1359	0.0765	1.1359	1.0658
No log	25.5	306	1.0641	0.1457	1.0641	1.0315
No log	25.6667	308	1.1136	0.0790	1.1136	1.0553
No log	25.8333	310	1.1890	0.1262	1.1890	1.0904
No log	26.0	312	1.1717	0.1086	1.1717	1.0824
No log	26.1667	314	1.2012	0.1057	1.2012	1.0960
No log	26.3333	316	1.1620	0.1116	1.1620	1.0780
No log	26.5	318	1.1240	0.1147	1.1240	1.0602
No log	26.6667	320	1.1462	0.1147	1.1462	1.0706
No log	26.8333	322	1.2817	0.1564	1.2817	1.1321
No log	27.0	324	1.3898	0.0627	1.3898	1.1789
No log	27.1667	326	1.4491	0.0826	1.4491	1.2038
No log	27.3333	328	1.4366	0.0826	1.4366	1.1986
No log	27.5	330	1.3147	0.1265	1.3147	1.1466
No log	27.6667	332	1.1163	0.1086	1.1163	1.0565
No log	27.8333	334	1.0129	0.1734	1.0129	1.0064
No log	28.0	336	1.0099	0.1734	1.0099	1.0050
No log	28.1667	338	1.0809	0.2119	1.0809	1.0397
No log	28.3333	340	1.1576	0.1564	1.1576	1.0759
No log	28.5	342	1.3503	0.1093	1.3503	1.1620
No log	28.6667	344	1.4677	0.1251	1.4677	1.2115
No log	28.8333	346	1.5886	0.0993	1.5886	1.2604
No log	29.0	348	1.6229	0.0993	1.6229	1.2739
No log	29.1667	350	1.6067	0.0993	1.6067	1.2676
No log	29.3333	352	1.5335	0.0803	1.5335	1.2384
No log	29.5	354	1.4077	0.1654	1.4077	1.1865
No log	29.6667	356	1.3311	0.1464	1.3311	1.1537
No log	29.8333	358	1.3387	0.1176	1.3387	1.1570
No log	30.0	360	1.4704	0.1067	1.4704	1.2126
No log	30.1667	362	1.7217	0.0664	1.7217	1.3121
No log	30.3333	364	1.7615	0.0632	1.7615	1.3272
No log	30.5	366	1.6133	0.0969	1.6133	1.2702
No log	30.6667	368	1.3456	0.2056	1.3456	1.1600
No log	30.8333	370	1.0714	0.2070	1.0714	1.0351
No log	31.0	372	0.9282	0.2094	0.9282	0.9634
No log	31.1667	374	0.8726	0.1962	0.8726	0.9341
No log	31.3333	376	0.8669	0.1962	0.8669	0.9311
No log	31.5	378	0.9099	0.1962	0.9099	0.9539
No log	31.6667	380	0.9906	0.2046	0.9906	0.9953
No log	31.8333	382	1.1076	0.2601	1.1076	1.0524
No log	32.0	384	1.1461	0.2782	1.1461	1.0705
No log	32.1667	386	1.1154	0.2032	1.1154	1.0561
No log	32.3333	388	1.1315	0.1896	1.1315	1.0637
No log	32.5	390	1.0655	0.2437	1.0655	1.0322
No log	32.6667	392	0.9726	0.2094	0.9726	0.9862
No log	32.8333	394	0.9163	0.1293	0.9163	0.9573
No log	33.0	396	0.9156	0.1293	0.9156	0.9569
No log	33.1667	398	0.9782	0.2410	0.9782	0.9891
No log	33.3333	400	1.0712	0.1827	1.0712	1.0350
No log	33.5	402	1.1532	0.1671	1.1532	1.0739
No log	33.6667	404	1.2271	0.2100	1.2271	1.1077
No log	33.8333	406	1.2867	0.1919	1.2867	1.1343
No log	34.0	408	1.2640	0.1919	1.2640	1.1243
No log	34.1667	410	1.1670	0.1909	1.1670	1.0803
No log	34.3333	412	1.1482	0.1909	1.1482	1.0715
No log	34.5	414	1.2283	0.1795	1.2283	1.1083
No log	34.6667	416	1.3438	0.1679	1.3438	1.1592
No log	34.8333	418	1.4283	0.1093	1.4283	1.1951
No log	35.0	420	1.3704	0.1363	1.3704	1.1706
No log	35.1667	422	1.1887	0.2567	1.1887	1.0903
No log	35.3333	424	0.9942	0.1822	0.9942	0.9971
No log	35.5	426	0.9275	0.1584	0.9275	0.9631
No log	35.6667	428	0.9199	0.1293	0.9199	0.9591
No log	35.8333	430	0.9356	0.1584	0.9356	0.9672
No log	36.0	432	0.9728	0.1542	0.9728	0.9863
No log	36.1667	434	1.1037	0.1747	1.1037	1.0505
No log	36.3333	436	1.3561	0.1458	1.3561	1.1645
No log	36.5	438	1.5599	0.1042	1.5599	1.2489
No log	36.6667	440	1.5077	0.1371	1.5077	1.2279
No log	36.8333	442	1.3266	0.1638	1.3266	1.1518
No log	37.0	444	1.1807	0.1739	1.1807	1.0866
No log	37.1667	446	1.0522	0.1521	1.0522	1.0258
No log	37.3333	448	0.9238	0.2076	0.9238	0.9611
No log	37.5	450	0.8220	0.2527	0.8220	0.9066
No log	37.6667	452	0.8250	0.2527	0.8250	0.9083
No log	37.8333	454	0.8830	0.2012	0.8830	0.9397
No log	38.0	456	0.9645	0.1822	0.9645	0.9821
No log	38.1667	458	1.0425	0.1976	1.0425	1.0210
No log	38.3333	460	1.0908	0.2482	1.0908	1.0444
No log	38.5	462	1.0574	0.2316	1.0574	1.0283
No log	38.6667	464	0.9728	0.1911	0.9728	0.9863
No log	38.8333	466	0.9590	0.2046	0.9590	0.9793
No log	39.0	468	0.9674	0.1955	0.9674	0.9836
No log	39.1667	470	0.9779	0.1869	0.9779	0.9889
No log	39.3333	472	0.9562	0.1955	0.9562	0.9779
No log	39.5	474	0.8923	0.2094	0.8923	0.9446
No log	39.6667	476	0.8531	0.2193	0.8531	0.9236
No log	39.8333	478	0.8503	0.2193	0.8503	0.9221
No log	40.0	480	0.8757	0.2193	0.8757	0.9358
No log	40.1667	482	0.9062	0.2094	0.9062	0.9520
No log	40.3333	484	0.9849	0.1535	0.9849	0.9924
No log	40.5	486	1.0250	0.2316	1.0250	1.0124
No log	40.6667	488	1.0772	0.2271	1.0772	1.0379
No log	40.8333	490	1.1539	0.2367	1.1539	1.0742
No log	41.0	492	1.2275	0.2733	1.2275	1.1079
No log	41.1667	494	1.3960	0.2107	1.3960	1.1815
No log	41.3333	496	1.4425	0.2107	1.4425	1.2010
No log	41.5	498	1.3155	0.2436	1.3155	1.1470
0.2121	41.6667	500	1.1041	0.1935	1.1041	1.0508
0.2121	41.8333	502	0.9734	0.1940	0.9734	0.9866
0.2121	42.0	504	0.9304	0.1461	0.9304	0.9646
0.2121	42.1667	506	0.9366	0.1385	0.9366	0.9678
0.2121	42.3333	508	1.0006	0.1603	1.0006	1.0003
0.2121	42.5	510	1.0937	0.1352	1.0937	1.0458
0.2121	42.6667	512	1.2399	0.2710	1.2399	1.1135
0.2121	42.8333	514	1.3378	0.2092	1.3378	1.1566
0.2121	43.0	516	1.3410	0.1815	1.3410	1.1580
0.2121	43.1667	518	1.2804	0.1931	1.2804	1.1315
0.2121	43.3333	520	1.1419	0.2271	1.1419	1.0686
0.2121	43.5	522	1.0066	0.1385	1.0066	1.0033
0.2121	43.6667	524	0.8906	0.1461	0.8906	0.9437
0.2121	43.8333	526	0.8039	0.2950	0.8039	0.8966
0.2121	44.0	528	0.7709	0.3020	0.7709	0.8780
0.2121	44.1667	530	0.7723	0.3020	0.7723	0.8788
0.2121	44.3333	532	0.8417	0.2754	0.8417	0.9174
0.2121	44.5	534	0.9453	0.1304	0.9453	0.9723
0.2121	44.6667	536	1.0246	0.1451	1.0246	1.0122
0.2121	44.8333	538	1.0757	0.1384	1.0757	1.0372
0.2121	45.0	540	1.1271	0.1846	1.1271	1.0616
0.2121	45.1667	542	1.1752	0.2710	1.1752	1.0841
0.2121	45.3333	544	1.2265	0.2223	1.2265	1.1075
0.2121	45.5	546	1.2676	0.2589	1.2676	1.1259
0.2121	45.6667	548	1.2872	0.2240	1.2872	1.1345
0.2121	45.8333	550	1.2975	0.2240	1.2975	1.1391
0.2121	46.0	552	1.2650	0.2184	1.2650	1.1247
0.2121	46.1667	554	1.1801	0.2665	1.1801	1.0863
0.2121	46.3333	556	1.0799	0.2659	1.0799	1.0392
0.2121	46.5	558	0.9917	0.1827	0.9917	0.9958
0.2121	46.6667	560	0.9372	0.2046	0.9372	0.9681
0.2121	46.8333	562	0.9219	0.2046	0.9219	0.9602
0.2121	47.0	564	0.9393	0.2046	0.9393	0.9692
0.2121	47.1667	566	0.9836	0.1573	0.9836	0.9918
0.2121	47.3333	568	1.0345	0.2075	1.0345	1.0171
0.2121	47.5	570	1.1030	0.3006	1.1030	1.0502
0.2121	47.6667	572	1.1145	0.2683	1.1145	1.0557
0.2121	47.8333	574	1.0585	0.2782	1.0585	1.0288
0.2121	48.0	576	1.0143	0.1827	1.0143	1.0071
0.2121	48.1667	578	0.9558	0.1692	0.9558	0.9776
0.2121	48.3333	580	0.9232	0.2046	0.9232	0.9608
0.2121	48.5	582	0.9423	0.1692	0.9423	0.9707
0.2121	48.6667	584	0.9606	0.1692	0.9606	0.9801
0.2121	48.8333	586	0.9962	0.1692	0.9962	0.9981
0.2121	49.0	588	1.0361	0.1612	1.0361	1.0179
0.2121	49.1667	590	1.0531	0.1451	1.0531	1.0262

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1