ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3716
• Qwk: 0.4593
• Mse: 1.3716
• Rmse: 1.1711

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0208	2	7.0532	-0.0056	7.0532	2.6558
No log	0.0417	4	4.5721	0.0928	4.5721	2.1382
No log	0.0625	6	4.6432	-0.0457	4.6432	2.1548
No log	0.0833	8	4.4227	-0.0556	4.4227	2.1030
No log	0.1042	10	3.6203	-0.0222	3.6203	1.9027
No log	0.125	12	2.2373	0.1343	2.2373	1.4958
No log	0.1458	14	1.9570	0.2333	1.9570	1.3989
No log	0.1667	16	1.9945	0.2881	1.9945	1.4123
No log	0.1875	18	2.2132	0.0157	2.2132	1.4877
No log	0.2083	20	1.9714	0.1429	1.9714	1.4041
No log	0.2292	22	1.7310	0.1651	1.7310	1.3157
No log	0.25	24	1.6006	0.1887	1.6006	1.2651
No log	0.2708	26	1.5838	0.1887	1.5838	1.2585
No log	0.2917	28	1.6661	0.1852	1.6661	1.2908
No log	0.3125	30	1.9040	0.2353	1.9040	1.3798
No log	0.3333	32	2.3456	0.0959	2.3456	1.5315
No log	0.3542	34	2.4454	0.1067	2.4454	1.5638
No log	0.375	36	2.4723	0.1053	2.4723	1.5724
No log	0.3958	38	2.3210	0.1944	2.3210	1.5235
No log	0.4167	40	2.1372	0.2553	2.1372	1.4619
No log	0.4375	42	2.2990	0.2041	2.2990	1.5162
No log	0.4583	44	2.4876	0.1745	2.4876	1.5772
No log	0.4792	46	2.7211	0.1569	2.7211	1.6496
No log	0.5	48	2.5749	0.1745	2.5749	1.6046
No log	0.5208	50	2.0393	0.2429	2.0393	1.4280
No log	0.5417	52	1.6896	0.2857	1.6896	1.2998
No log	0.5625	54	1.5746	0.2931	1.5746	1.2548
No log	0.5833	56	1.5694	0.2903	1.5694	1.2527
No log	0.6042	58	1.6643	0.3333	1.6643	1.2901
No log	0.625	60	1.9365	0.3034	1.9365	1.3916
No log	0.6458	62	1.9197	0.3151	1.9197	1.3855
No log	0.6667	64	2.0198	0.3151	2.0198	1.4212
No log	0.6875	66	2.2817	0.2133	2.2817	1.5105
No log	0.7083	68	2.5861	0.1154	2.5861	1.6081
No log	0.7292	70	2.4048	0.1053	2.4048	1.5507
No log	0.75	72	2.0756	0.1912	2.0756	1.4407
No log	0.7708	74	1.7959	0.3306	1.7959	1.3401
No log	0.7917	76	1.6688	0.2222	1.6688	1.2918
No log	0.8125	78	1.5992	0.1887	1.5992	1.2646
No log	0.8333	80	1.4948	0.1509	1.4948	1.2226
No log	0.8542	82	1.3773	0.3186	1.3773	1.1736
No log	0.875	84	1.3824	0.3826	1.3824	1.1758
No log	0.8958	86	1.3511	0.3478	1.3511	1.1624
No log	0.9167	88	1.6081	0.3333	1.6081	1.2681
No log	0.9375	90	1.9415	0.3444	1.9415	1.3934
No log	0.9583	92	2.0304	0.3399	2.0304	1.4249
No log	0.9792	94	1.5781	0.3942	1.5781	1.2562
No log	1.0	96	1.6303	0.2810	1.6303	1.2768
No log	1.0208	98	2.7338	-0.1705	2.7338	1.6534
No log	1.0417	100	3.1775	-0.2707	3.1775	1.7826
No log	1.0625	102	2.8816	-0.1805	2.8816	1.6975
No log	1.0833	104	2.6516	-0.1538	2.6516	1.6284
No log	1.1042	106	2.2098	-0.0323	2.2098	1.4865
No log	1.125	108	2.1967	0.0909	2.1967	1.4821
No log	1.1458	110	1.8310	0.2308	1.8310	1.3532
No log	1.1667	112	1.4482	0.3780	1.4482	1.2034
No log	1.1875	114	1.5300	0.2258	1.5300	1.2369
No log	1.2083	116	1.6041	0.2187	1.6041	1.2665
No log	1.2292	118	1.4304	0.3566	1.4304	1.1960
No log	1.25	120	1.2142	0.5255	1.2142	1.1019
No log	1.2708	122	1.0350	0.512	1.0350	1.0173
No log	1.2917	124	1.1085	0.576	1.1085	1.0528
No log	1.3125	126	1.0661	0.4882	1.0661	1.0325
No log	1.3333	128	1.3422	0.4818	1.3422	1.1585
No log	1.3542	130	1.6023	0.3662	1.6023	1.2658
No log	1.375	132	1.4950	0.3885	1.4950	1.2227
No log	1.3958	134	1.4848	0.3529	1.4848	1.2185
No log	1.4167	136	1.5313	0.3231	1.5313	1.2375
No log	1.4375	138	1.5359	0.3016	1.5359	1.2393
No log	1.4583	140	1.8045	0.2000	1.8045	1.3433
No log	1.4792	142	2.2467	-0.0500	2.2467	1.4989
No log	1.5	144	2.1205	0.0513	2.1205	1.4562
No log	1.5208	146	1.6665	0.2969	1.6665	1.2909
No log	1.5417	148	1.3162	0.4651	1.3162	1.1473
No log	1.5625	150	1.2794	0.5333	1.2794	1.1311
No log	1.5833	152	1.2502	0.5839	1.2502	1.1181
No log	1.6042	154	1.4462	0.4328	1.4462	1.2026
No log	1.625	156	1.5356	0.4058	1.5356	1.2392
No log	1.6458	158	1.5046	0.4234	1.5046	1.2266
No log	1.6667	160	1.3006	0.4234	1.3006	1.1404
No log	1.6875	162	1.2858	0.4234	1.2858	1.1339
No log	1.7083	164	1.2914	0.4638	1.2914	1.1364
No log	1.7292	166	1.3489	0.4328	1.3489	1.1614
No log	1.75	168	1.3793	0.4148	1.3793	1.1744
No log	1.7708	170	1.3336	0.4848	1.3336	1.1548
No log	1.7917	172	1.3267	0.4776	1.3267	1.1518
No log	1.8125	174	1.4584	0.4148	1.4584	1.2076
No log	1.8333	176	1.7427	0.3212	1.7427	1.3201
No log	1.8542	178	1.7844	0.2878	1.7844	1.3358
No log	1.875	180	1.6808	0.3212	1.6808	1.2964
No log	1.8958	182	1.4188	0.5	1.4188	1.1911
No log	1.9167	184	1.3408	0.4553	1.3408	1.1579
No log	1.9375	186	1.3416	0.4298	1.3416	1.1583
No log	1.9583	188	1.4581	0.4341	1.4581	1.2075
No log	1.9792	190	1.7408	0.3212	1.7408	1.3194
No log	2.0	192	1.8336	0.3212	1.8336	1.3541
No log	2.0208	194	1.6763	0.3556	1.6763	1.2947
No log	2.0417	196	1.4255	0.4034	1.4255	1.1939
No log	2.0625	198	1.3987	0.2500	1.3987	1.1827
No log	2.0833	200	1.3867	0.2523	1.3867	1.1776
No log	2.1042	202	1.3124	0.4034	1.3124	1.1456
No log	2.125	204	1.4080	0.4394	1.4080	1.1866
No log	2.1458	206	1.6925	0.3478	1.6925	1.3010
No log	2.1667	208	1.6742	0.3623	1.6742	1.2939
No log	2.1875	210	1.6378	0.3796	1.6378	1.2798
No log	2.2083	212	1.4304	0.4211	1.4304	1.1960
No log	2.2292	214	1.2754	0.4688	1.2754	1.1293
No log	2.25	216	1.2410	0.5197	1.2410	1.1140
No log	2.2708	218	1.2620	0.4921	1.2620	1.1234
No log	2.2917	220	1.2868	0.4688	1.2868	1.1344
No log	2.3125	222	1.3729	0.4662	1.3729	1.1717
No log	2.3333	224	1.5566	0.3796	1.5566	1.2477
No log	2.3542	226	1.7564	0.3043	1.7564	1.3253
No log	2.375	228	1.6004	0.3796	1.6004	1.2651
No log	2.3958	230	1.3346	0.4328	1.3346	1.1552
No log	2.4167	232	1.2238	0.5312	1.2238	1.1063
No log	2.4375	234	1.2358	0.5312	1.2358	1.1117
No log	2.4583	236	1.2966	0.4361	1.2966	1.1387
No log	2.4792	238	1.3434	0.4179	1.3434	1.1590
No log	2.5	240	1.2809	0.4928	1.2809	1.1318
No log	2.5208	242	1.2883	0.4812	1.2883	1.1350
No log	2.5417	244	1.4687	0.4265	1.4687	1.2119
No log	2.5625	246	1.7521	0.3453	1.7521	1.3237
No log	2.5833	248	1.8819	0.2571	1.8819	1.3718
No log	2.6042	250	1.7710	0.3066	1.7710	1.3308
No log	2.625	252	1.5543	0.4265	1.5543	1.2467
No log	2.6458	254	1.4575	0.4148	1.4575	1.2073
No log	2.6667	256	1.5595	0.4265	1.5595	1.2488
No log	2.6875	258	1.8024	0.3217	1.8024	1.3425
No log	2.7083	260	1.9396	0.2837	1.9396	1.3927
No log	2.7292	262	1.8073	0.2857	1.8073	1.3444
No log	2.75	264	1.4628	0.4088	1.4628	1.2094
No log	2.7708	266	1.3474	0.4265	1.3474	1.1608
No log	2.7917	268	1.3796	0.4265	1.3796	1.1746
No log	2.8125	270	1.3144	0.4526	1.3144	1.1465
No log	2.8333	272	1.2659	0.4965	1.2659	1.1251
No log	2.8542	274	1.1852	0.5143	1.1852	1.0887
No log	2.875	276	1.0936	0.6222	1.0936	1.0457
No log	2.8958	278	1.0713	0.6061	1.0713	1.0350
No log	2.9167	280	1.0495	0.6154	1.0495	1.0245
No log	2.9375	282	1.0798	0.5760	1.0798	1.0391
No log	2.9583	284	1.2131	0.5538	1.2131	1.1014
No log	2.9792	286	1.3420	0.4265	1.3420	1.1584
No log	3.0	288	1.2483	0.4776	1.2483	1.1173
No log	3.0208	290	1.2198	0.5333	1.2198	1.1045
No log	3.0417	292	1.0734	0.5778	1.0734	1.0361
No log	3.0625	294	1.0400	0.5926	1.0400	1.0198
No log	3.0833	296	1.2766	0.5072	1.2766	1.1299
No log	3.1042	298	1.6085	0.3944	1.6085	1.2683
No log	3.125	300	1.6930	0.3077	1.6930	1.3011
No log	3.1458	302	1.5354	0.4317	1.5354	1.2391
No log	3.1667	304	1.4115	0.4962	1.4115	1.1881
No log	3.1875	306	1.3851	0.5041	1.3851	1.1769
No log	3.2083	308	1.3666	0.5238	1.3666	1.1690
No log	3.2292	310	1.3975	0.5039	1.3975	1.1822
No log	3.25	312	1.3251	0.5152	1.3251	1.1511
No log	3.2708	314	1.1747	0.5496	1.1747	1.0838
No log	3.2917	316	1.0712	0.6	1.0712	1.0350
No log	3.3125	318	1.0786	0.5672	1.0786	1.0386
No log	3.3333	320	1.3355	0.4932	1.3355	1.1556
No log	3.3542	322	1.8840	0.4211	1.8840	1.3726
No log	3.375	324	2.3009	0.3911	2.3009	1.5169
No log	3.3958	326	2.1784	0.2968	2.1784	1.4759
No log	3.4167	328	1.6905	0.3188	1.6905	1.3002
No log	3.4375	330	1.2526	0.4697	1.2526	1.1192
No log	3.4583	332	1.0655	0.5691	1.0655	1.0322
No log	3.4792	334	0.9965	0.5806	0.9965	0.9983
No log	3.5	336	1.0268	0.5760	1.0268	1.0133
No log	3.5208	338	1.2146	0.5481	1.2146	1.1021
No log	3.5417	340	1.3246	0.4526	1.3246	1.1509
No log	3.5625	342	1.3864	0.4526	1.3864	1.1774
No log	3.5833	344	1.4259	0.3881	1.4259	1.1941
No log	3.6042	346	1.4684	0.3852	1.4684	1.2118
No log	3.625	348	1.4109	0.4688	1.4109	1.1878
No log	3.6458	350	1.2651	0.5484	1.2651	1.1248
No log	3.6667	352	1.1532	0.5574	1.1532	1.0739
No log	3.6875	354	1.0963	0.5760	1.0963	1.0470
No log	3.7083	356	1.0758	0.5984	1.0758	1.0372
No log	3.7292	358	1.1264	0.5714	1.1264	1.0613
No log	3.75	360	1.2272	0.5692	1.2272	1.1078
No log	3.7708	362	1.2341	0.5581	1.2341	1.1109
No log	3.7917	364	1.1951	0.5385	1.1951	1.0932
No log	3.8125	366	1.2500	0.5038	1.2500	1.1181
No log	3.8333	368	1.3039	0.4733	1.3039	1.1419
No log	3.8542	370	1.3179	0.4462	1.3179	1.1480
No log	3.875	372	1.3360	0.4697	1.3360	1.1559
No log	3.8958	374	1.5305	0.4203	1.5305	1.2371
No log	3.9167	376	1.6153	0.3662	1.6153	1.2709
No log	3.9375	378	1.6699	0.3662	1.6699	1.2922
No log	3.9583	380	1.5301	0.3830	1.5301	1.2370
No log	3.9792	382	1.5026	0.4143	1.5026	1.2258
No log	4.0	384	1.6012	0.3830	1.6012	1.2654
No log	4.0208	386	1.6834	0.3143	1.6834	1.2974
No log	4.0417	388	1.6039	0.3529	1.6039	1.2664
No log	4.0625	390	1.5159	0.3759	1.5159	1.2312
No log	4.0833	392	1.3007	0.4627	1.3007	1.1405
No log	4.1042	394	1.1965	0.5224	1.1965	1.0938
No log	4.125	396	1.0181	0.5985	1.0181	1.0090
No log	4.1458	398	0.9486	0.6241	0.9486	0.9740
No log	4.1667	400	1.0152	0.6143	1.0152	1.0076
No log	4.1875	402	1.3431	0.4755	1.3431	1.1589
No log	4.2083	404	1.6798	0.3636	1.6798	1.2961
No log	4.2292	406	1.8240	0.2797	1.8240	1.3506
No log	4.25	408	1.6883	0.3286	1.6883	1.2994
No log	4.2708	410	1.4253	0.4526	1.4253	1.1939
No log	4.2917	412	1.1268	0.5538	1.1268	1.0615
No log	4.3125	414	1.0355	0.6357	1.0355	1.0176
No log	4.3333	416	1.0539	0.6357	1.0539	1.0266
No log	4.3542	418	1.1572	0.5669	1.1572	1.0757
No log	4.375	420	1.3757	0.4627	1.3757	1.1729
No log	4.3958	422	1.5789	0.3504	1.5789	1.2566
No log	4.4167	424	1.6654	0.3121	1.6654	1.2905
No log	4.4375	426	1.5919	0.3497	1.5919	1.2617
No log	4.4583	428	1.3653	0.4755	1.3653	1.1685
No log	4.4792	430	1.1847	0.5588	1.1847	1.0884
No log	4.5	432	1.0796	0.5954	1.0796	1.0390
No log	4.5208	434	1.0782	0.5954	1.0782	1.0383
No log	4.5417	436	1.1682	0.6	1.1682	1.0808
No log	4.5625	438	1.2720	0.5496	1.2720	1.1278
No log	4.5833	440	1.2771	0.5496	1.2771	1.1301
No log	4.6042	442	1.2330	0.5496	1.2330	1.1104
No log	4.625	444	1.1549	0.5538	1.1549	1.0747
No log	4.6458	446	1.1436	0.5496	1.1436	1.0694
No log	4.6667	448	1.1921	0.5455	1.1921	1.0918
No log	4.6875	450	1.1809	0.5821	1.1809	1.0867
No log	4.7083	452	1.3170	0.4818	1.3170	1.1476
No log	4.7292	454	1.4624	0.4265	1.4624	1.2093
No log	4.75	456	1.4545	0.4444	1.4545	1.2060
No log	4.7708	458	1.3796	0.4706	1.3796	1.1746
No log	4.7917	460	1.2546	0.4925	1.2546	1.1201
No log	4.8125	462	1.0964	0.5692	1.0964	1.0471
No log	4.8333	464	1.0372	0.5827	1.0372	1.0184
No log	4.8542	466	1.0549	0.6154	1.0549	1.0271
No log	4.875	468	1.1645	0.5758	1.1645	1.0791
No log	4.8958	470	1.4210	0.4818	1.4210	1.1921
No log	4.9167	472	1.5907	0.4029	1.5907	1.2612
No log	4.9375	474	1.5624	0.4029	1.5624	1.2500
No log	4.9583	476	1.3747	0.4964	1.3747	1.1725
No log	4.9792	478	1.1934	0.5758	1.1934	1.0924
No log	5.0	480	1.1419	0.5984	1.1419	1.0686
No log	5.0208	482	1.1413	0.5802	1.1413	1.0683
No log	5.0417	484	1.1843	0.5758	1.1843	1.0883
No log	5.0625	486	1.2496	0.5564	1.2496	1.1179
No log	5.0833	488	1.3734	0.4638	1.3734	1.1719
No log	5.1042	490	1.4786	0.4397	1.4786	1.2160
No log	5.125	492	1.4068	0.4571	1.4068	1.1861
No log	5.1458	494	1.2146	0.5037	1.2146	1.1021
No log	5.1667	496	1.0633	0.5891	1.0633	1.0311
No log	5.1875	498	1.0312	0.5714	1.0312	1.0155
0.4989	5.2083	500	1.0607	0.56	1.0607	1.0299
0.4989	5.2292	502	1.0902	0.56	1.0902	1.0441
0.4989	5.25	504	1.1155	0.5714	1.1155	1.0562
0.4989	5.2708	506	1.1282	0.5891	1.1282	1.0622
0.4989	5.2917	508	1.0930	0.5891	1.0930	1.0455
0.4989	5.3125	510	1.0945	0.5909	1.0945	1.0462
0.4989	5.3333	512	1.0374	0.6119	1.0374	1.0185
0.4989	5.3542	514	1.0325	0.6370	1.0325	1.0161
0.4989	5.375	516	1.0917	0.6015	1.0917	1.0448
0.4989	5.3958	518	1.1845	0.5909	1.1845	1.0884
0.4989	5.4167	520	1.2376	0.5538	1.2376	1.1125
0.4989	5.4375	522	1.2293	0.5669	1.2293	1.1087
0.4989	5.4583	524	1.1793	0.544	1.1793	1.0860
0.4989	5.4792	526	1.1381	0.5645	1.1381	1.0668
0.4989	5.5	528	1.1314	0.5246	1.1314	1.0637
0.4989	5.5208	530	1.1138	0.5366	1.1138	1.0553
0.4989	5.5417	532	1.1057	0.5827	1.1057	1.0515
0.4989	5.5625	534	1.2045	0.5191	1.2045	1.0975
0.4989	5.5833	536	1.2549	0.5191	1.2549	1.1202
0.4989	5.6042	538	1.2231	0.5455	1.2231	1.1060
0.4989	5.625	540	1.1944	0.5564	1.1944	1.0929
0.4989	5.6458	542	1.1225	0.5802	1.1225	1.0595
0.4989	5.6667	544	1.0928	0.5984	1.0928	1.0454
0.4989	5.6875	546	1.0948	0.5528	1.0948	1.0463
0.4989	5.7083	548	1.1250	0.5528	1.1250	1.0607
0.4989	5.7292	550	1.2059	0.5692	1.2059	1.0981
0.4989	5.75	552	1.3372	0.5263	1.3372	1.1564
0.4989	5.7708	554	1.4016	0.4118	1.4016	1.1839
0.4989	5.7917	556	1.3676	0.4889	1.3676	1.1694
0.4989	5.8125	558	1.3040	0.5373	1.3040	1.1419
0.4989	5.8333	560	1.1513	0.5692	1.1513	1.0730
0.4989	5.8542	562	1.0873	0.5827	1.0873	1.0428
0.4989	5.875	564	1.0810	0.5528	1.0810	1.0397
0.4989	5.8958	566	1.1308	0.5574	1.1308	1.0634
0.4989	5.9167	568	1.1773	0.5366	1.1773	1.0850
0.4989	5.9375	570	1.2612	0.5496	1.2612	1.1230
0.4989	5.9583	572	1.3716	0.4593	1.3716	1.1711

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1