ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5961
• Qwk: 0.3053
• Mse: 1.5961
• Rmse: 1.2634

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0513	2	7.0797	0.0057	7.0797	2.6608
No log	0.1026	4	4.6593	0.0543	4.6593	2.1586
No log	0.1538	6	3.3142	0.0215	3.3142	1.8205
No log	0.2051	8	2.4414	0.1727	2.4414	1.5625
No log	0.2564	10	2.4297	0.0317	2.4297	1.5587
No log	0.3077	12	3.2182	-0.0417	3.2182	1.7939
No log	0.3590	14	3.0982	-0.0704	3.0982	1.7602
No log	0.4103	16	2.8719	-0.0714	2.8719	1.6947
No log	0.4615	18	2.3136	0.0	2.3136	1.5210
No log	0.5128	20	2.3764	-0.0923	2.3764	1.5416
No log	0.5641	22	2.2130	0.1157	2.2130	1.4876
No log	0.6154	24	1.9460	0.2752	1.9460	1.3950
No log	0.6667	26	1.9201	0.2018	1.9201	1.3857
No log	0.7179	28	1.8903	0.1818	1.8903	1.3749
No log	0.7692	30	1.7361	0.1346	1.7361	1.3176
No log	0.8205	32	1.7102	0.0777	1.7102	1.3077
No log	0.8718	34	1.7808	0.1333	1.7808	1.3345
No log	0.9231	36	1.8885	0.1346	1.8885	1.3742
No log	0.9744	38	2.3046	-0.0952	2.3046	1.5181
No log	1.0256	40	3.6164	-0.0252	3.6164	1.9017
No log	1.0769	42	3.6351	-0.0252	3.6351	1.9066
No log	1.1282	44	2.8153	0.0134	2.8153	1.6779
No log	1.1795	46	2.3623	-0.0280	2.3623	1.5370
No log	1.2308	48	2.4792	0.0	2.4792	1.5746
No log	1.2821	50	2.4897	0.0	2.4897	1.5779
No log	1.3333	52	2.1306	0.1789	2.1306	1.4596
No log	1.3846	54	1.8343	0.0962	1.8343	1.3544
No log	1.4359	56	1.7328	0.0588	1.7328	1.3164
No log	1.4872	58	1.6929	0.1524	1.6929	1.3011
No log	1.5385	60	1.6176	0.1333	1.6176	1.2718
No log	1.5897	62	1.6683	0.1111	1.6683	1.2916
No log	1.6410	64	1.8925	0.25	1.8925	1.3757
No log	1.6923	66	2.0083	0.2370	2.0083	1.4172
No log	1.7436	68	2.1920	0.2128	2.1920	1.4805
No log	1.7949	70	2.2527	0.1538	2.2527	1.5009
No log	1.8462	72	2.1412	0.2899	2.1412	1.4633
No log	1.8974	74	2.0825	0.2920	2.0825	1.4431
No log	1.9487	76	2.2099	0.2302	2.2099	1.4866
No log	2.0	78	2.4374	0.0685	2.4374	1.5612
No log	2.0513	80	2.3483	0.1418	2.3483	1.5324
No log	2.1026	82	1.9321	0.2537	1.9321	1.3900
No log	2.1538	84	1.5727	0.2321	1.5727	1.2541
No log	2.2051	86	1.4746	0.2202	1.4746	1.2143
No log	2.2564	88	1.4307	0.2752	1.4307	1.1961
No log	2.3077	90	1.3972	0.3091	1.3972	1.1820
No log	2.3590	92	1.3281	0.3423	1.3281	1.1524
No log	2.4103	94	1.2570	0.4138	1.2570	1.1211
No log	2.4615	96	1.2081	0.5738	1.2081	1.0991
No log	2.5128	98	1.2923	0.5410	1.2923	1.1368
No log	2.5641	100	1.2883	0.5455	1.2883	1.1350
No log	2.6154	102	1.2446	0.5620	1.2446	1.1156
No log	2.6667	104	1.2733	0.5738	1.2733	1.1284
No log	2.7179	106	1.3843	0.4103	1.3843	1.1766
No log	2.7692	108	1.5321	0.375	1.5321	1.2378
No log	2.8205	110	1.5259	0.3894	1.5259	1.2353
No log	2.8718	112	1.5115	0.4098	1.5115	1.2294
No log	2.9231	114	1.3660	0.4127	1.3660	1.1688
No log	2.9744	116	1.3533	0.4409	1.3533	1.1633
No log	3.0256	118	1.3963	0.4160	1.3963	1.1817
No log	3.0769	120	1.4335	0.4320	1.4335	1.1973
No log	3.1282	122	1.5545	0.3130	1.5545	1.2468
No log	3.1795	124	1.4954	0.3509	1.4954	1.2229
No log	3.2308	126	1.4914	0.3509	1.4914	1.2212
No log	3.2821	128	1.4678	0.3966	1.4678	1.2115
No log	3.3333	130	1.3850	0.3932	1.3850	1.1769
No log	3.3846	132	1.3677	0.3279	1.3677	1.1695
No log	3.4359	134	1.3069	0.3780	1.3069	1.1432
No log	3.4872	136	1.3853	0.375	1.3853	1.1770
No log	3.5385	138	1.5322	0.3504	1.5322	1.2378
No log	3.5897	140	1.5439	0.3404	1.5439	1.2425
No log	3.6410	142	1.3878	0.3971	1.3878	1.1781
No log	3.6923	144	1.3011	0.4094	1.3011	1.1406
No log	3.7436	146	1.4033	0.3876	1.4033	1.1846
No log	3.7949	148	1.4458	0.3876	1.4458	1.2024
No log	3.8462	150	1.3279	0.4252	1.3279	1.1523
No log	3.8974	152	1.2878	0.4286	1.2878	1.1348
No log	3.9487	154	1.3258	0.4462	1.3258	1.1514
No log	4.0	156	1.5486	0.3008	1.5486	1.2444
No log	4.0513	158	1.6589	0.2769	1.6589	1.2880
No log	4.1026	160	1.6717	0.2812	1.6717	1.2930
No log	4.1538	162	1.5680	0.2901	1.5680	1.2522
No log	4.2051	164	1.3508	0.4511	1.3508	1.1622
No log	4.2564	166	1.3035	0.4511	1.3035	1.1417
No log	4.3077	168	1.3850	0.4	1.3850	1.1768
No log	4.3590	170	1.5882	0.2857	1.5882	1.2602
No log	4.4103	172	1.6560	0.2923	1.6560	1.2869
No log	4.4615	174	1.5512	0.3175	1.5512	1.2455
No log	4.5128	176	1.4311	0.3740	1.4311	1.1963
No log	4.5641	178	1.3267	0.4806	1.3267	1.1518
No log	4.6154	180	1.3839	0.4511	1.3839	1.1764
No log	4.6667	182	1.5600	0.2687	1.5600	1.2490
No log	4.7179	184	1.6687	0.2519	1.6687	1.2918
No log	4.7692	186	1.5956	0.3385	1.5956	1.2632
No log	4.8205	188	1.4505	0.3934	1.4505	1.2043
No log	4.8718	190	1.3314	0.4538	1.3314	1.1539
No log	4.9231	192	1.3292	0.4407	1.3292	1.1529
No log	4.9744	194	1.3484	0.4274	1.3484	1.1612
No log	5.0256	196	1.3949	0.4483	1.3949	1.1811
No log	5.0769	198	1.4638	0.3529	1.4638	1.2099
No log	5.1282	200	1.5153	0.3710	1.5153	1.2310
No log	5.1795	202	1.5708	0.3206	1.5708	1.2533
No log	5.2308	204	1.4801	0.3594	1.4801	1.2166
No log	5.2821	206	1.3728	0.4320	1.3728	1.1717
No log	5.3333	208	1.3683	0.4262	1.3683	1.1697
No log	5.3846	210	1.4229	0.3934	1.4229	1.1928
No log	5.4359	212	1.4967	0.3385	1.4967	1.2234
No log	5.4872	214	1.5271	0.3511	1.5271	1.2357
No log	5.5385	216	1.4643	0.3692	1.4643	1.2101
No log	5.5897	218	1.3730	0.3721	1.3730	1.1718
No log	5.6410	220	1.2808	0.4390	1.2808	1.1317
No log	5.6923	222	1.3531	0.3810	1.3531	1.1632
No log	5.7436	224	1.5023	0.3433	1.5023	1.2257
No log	5.7949	226	1.6302	0.3358	1.6302	1.2768
No log	5.8462	228	1.5768	0.3308	1.5768	1.2557
No log	5.8974	230	1.4081	0.3415	1.4081	1.1866
No log	5.9487	232	1.2983	0.4667	1.2983	1.1394
No log	6.0	234	1.2678	0.4667	1.2678	1.1260
No log	6.0513	236	1.3095	0.4553	1.3095	1.1443
No log	6.1026	238	1.4302	0.3664	1.4302	1.1959
No log	6.1538	240	1.4449	0.3485	1.4449	1.2021
No log	6.2051	242	1.4113	0.3846	1.4113	1.1880
No log	6.2564	244	1.4477	0.3636	1.4477	1.2032
No log	6.3077	246	1.4607	0.3664	1.4607	1.2086
No log	6.3590	248	1.6457	0.3111	1.6457	1.2829
No log	6.4103	250	1.8747	0.2878	1.8747	1.3692
No log	6.4615	252	1.9202	0.2571	1.9202	1.3857
No log	6.5128	254	1.7525	0.3043	1.7525	1.3238
No log	6.5641	256	1.6425	0.3259	1.6425	1.2816
No log	6.6154	258	1.6176	0.3284	1.6176	1.2719
No log	6.6667	260	1.7207	0.3088	1.7207	1.3118
No log	6.7179	262	1.8132	0.2899	1.8132	1.3466
No log	6.7692	264	1.8706	0.2571	1.8706	1.3677
No log	6.8205	266	1.8542	0.2734	1.8542	1.3617
No log	6.8718	268	1.8768	0.2734	1.8768	1.3700
No log	6.9231	270	1.9130	0.2571	1.9130	1.3831
No log	6.9744	272	1.8499	0.2571	1.8499	1.3601
No log	7.0256	274	1.6859	0.3235	1.6859	1.2984
No log	7.0769	276	1.4822	0.3788	1.4822	1.2175
No log	7.1282	278	1.4449	0.3385	1.4449	1.2020
No log	7.1795	280	1.4753	0.3385	1.4753	1.2146
No log	7.2308	282	1.5241	0.3485	1.5241	1.2346
No log	7.2821	284	1.6145	0.3235	1.6145	1.2706
No log	7.3333	286	1.5802	0.3235	1.5802	1.2571
No log	7.3846	288	1.4984	0.3459	1.4984	1.2241
No log	7.4359	290	1.4344	0.3231	1.4344	1.1977
No log	7.4872	292	1.4498	0.3459	1.4498	1.2041
No log	7.5385	294	1.5005	0.3284	1.5005	1.2250
No log	7.5897	296	1.5934	0.3235	1.5934	1.2623
No log	7.6410	298	1.5734	0.3284	1.5734	1.2544
No log	7.6923	300	1.4762	0.3651	1.4762	1.2150
No log	7.7436	302	1.4723	0.375	1.4723	1.2134
No log	7.7949	304	1.5682	0.2985	1.5682	1.2523
No log	7.8462	306	1.7696	0.2878	1.7696	1.3303
No log	7.8974	308	1.8362	0.2411	1.8362	1.3551
No log	7.9487	310	1.7580	0.2899	1.7580	1.3259
No log	8.0	312	1.7049	0.3066	1.7049	1.3057
No log	8.0513	314	1.5449	0.3385	1.5449	1.2429
No log	8.1026	316	1.4714	0.3721	1.4714	1.2130
No log	8.1538	318	1.4260	0.4062	1.4260	1.1941
No log	8.2051	320	1.4079	0.4062	1.4079	1.1866
No log	8.2564	322	1.3726	0.3968	1.3726	1.1716
No log	8.3077	324	1.4251	0.375	1.4251	1.1938
No log	8.3590	326	1.6154	0.3358	1.6154	1.2710
No log	8.4103	328	1.6978	0.3867	1.6978	1.3030
No log	8.4615	330	1.6285	0.3776	1.6285	1.2761
No log	8.5128	332	1.5825	0.3358	1.5825	1.2580
No log	8.5641	334	1.5642	0.3358	1.5642	1.2507
No log	8.6154	336	1.4541	0.3382	1.4541	1.2058
No log	8.6667	338	1.4766	0.3504	1.4766	1.2152
No log	8.7179	340	1.4791	0.3134	1.4791	1.2162
No log	8.7692	342	1.4428	0.3511	1.4428	1.2012
No log	8.8205	344	1.4799	0.3459	1.4799	1.2165
No log	8.8718	346	1.4632	0.3511	1.4632	1.2096
No log	8.9231	348	1.5580	0.3308	1.5580	1.2482
No log	8.9744	350	1.6345	0.3407	1.6345	1.2785
No log	9.0256	352	1.5553	0.3226	1.5553	1.2471
No log	9.0769	354	1.4512	0.3419	1.4512	1.2047
No log	9.1282	356	1.4075	0.3273	1.4075	1.1864
No log	9.1795	358	1.4064	0.3894	1.4064	1.1859
No log	9.2308	360	1.4703	0.3167	1.4703	1.2126
No log	9.2821	362	1.6319	0.3307	1.6319	1.2774
No log	9.3333	364	1.7296	0.3030	1.7296	1.3151
No log	9.3846	366	1.7386	0.2946	1.7386	1.3186
No log	9.4359	368	1.6424	0.3140	1.6424	1.2816
No log	9.4872	370	1.5811	0.2617	1.5811	1.2574
No log	9.5385	372	1.6437	0.1698	1.6437	1.2821
No log	9.5897	374	1.5291	0.2752	1.5291	1.2366
No log	9.6410	376	1.3623	0.4107	1.3623	1.1672
No log	9.6923	378	1.2870	0.4426	1.2870	1.1345
No log	9.7436	380	1.3204	0.4531	1.3204	1.1491
No log	9.7949	382	1.4677	0.3846	1.4677	1.2115
No log	9.8462	384	1.6312	0.3407	1.6312	1.2772
No log	9.8974	386	1.7932	0.3043	1.7932	1.3391
No log	9.9487	388	1.8807	0.2714	1.8807	1.3714
No log	10.0	390	1.8383	0.3022	1.8383	1.3558
No log	10.0513	392	1.8401	0.3022	1.8401	1.3565
No log	10.1026	394	1.7399	0.3043	1.7399	1.3190
No log	10.1538	396	1.7158	0.3235	1.7158	1.3099
No log	10.2051	398	1.7128	0.3235	1.7128	1.3087
No log	10.2564	400	1.6862	0.3235	1.6862	1.2985
No log	10.3077	402	1.6123	0.3407	1.6123	1.2698
No log	10.3590	404	1.6032	0.3407	1.6032	1.2662
No log	10.4103	406	1.5446	0.3407	1.5446	1.2428
No log	10.4615	408	1.4549	0.4	1.4549	1.2062
No log	10.5128	410	1.3787	0.4733	1.3787	1.1742
No log	10.5641	412	1.4172	0.4030	1.4172	1.1905
No log	10.6154	414	1.5572	0.3529	1.5572	1.2479
No log	10.6667	416	1.6501	0.3623	1.6501	1.2846
No log	10.7179	418	1.6291	0.3529	1.6291	1.2764
No log	10.7692	420	1.5058	0.3704	1.5058	1.2271
No log	10.8205	422	1.4403	0.4030	1.4403	1.2001
No log	10.8718	424	1.5073	0.3582	1.5073	1.2277
No log	10.9231	426	1.5180	0.3582	1.5180	1.2321
No log	10.9744	428	1.4831	0.3609	1.4831	1.2178
No log	11.0256	430	1.4129	0.4308	1.4129	1.1887
No log	11.0769	432	1.3863	0.3968	1.3863	1.1774
No log	11.1282	434	1.4394	0.4094	1.4394	1.1998
No log	11.1795	436	1.4943	0.4219	1.4943	1.2224
No log	11.2308	438	1.4959	0.4219	1.4959	1.2231
No log	11.2821	440	1.4736	0.4341	1.4736	1.2139
No log	11.3333	442	1.3884	0.4094	1.3884	1.1783
No log	11.3846	444	1.3262	0.4160	1.3262	1.1516
No log	11.4359	446	1.3258	0.4160	1.3258	1.1514
No log	11.4872	448	1.4048	0.4154	1.4048	1.1852
No log	11.5385	450	1.4824	0.3788	1.4824	1.2175
No log	11.5897	452	1.5409	0.3582	1.5409	1.2413
No log	11.6410	454	1.5112	0.3582	1.5112	1.2293
No log	11.6923	456	1.4180	0.4462	1.4180	1.1908
No log	11.7436	458	1.3866	0.4462	1.3866	1.1775
No log	11.7949	460	1.3221	0.4615	1.3221	1.1498
No log	11.8462	462	1.3486	0.4462	1.3486	1.1613
No log	11.8974	464	1.4221	0.4091	1.4221	1.1925
No log	11.9487	466	1.6241	0.3407	1.6241	1.2744
No log	12.0	468	1.8554	0.2734	1.8554	1.3621
No log	12.0513	470	1.9083	0.2553	1.9083	1.3814
No log	12.1026	472	1.7861	0.2754	1.7861	1.3364
No log	12.1538	474	1.5854	0.3407	1.5854	1.2591
No log	12.2051	476	1.5662	0.3582	1.5662	1.2515
No log	12.2564	478	1.5594	0.3759	1.5594	1.2487
No log	12.3077	480	1.5935	0.3582	1.5935	1.2623
No log	12.3590	482	1.5891	0.3582	1.5891	1.2606
No log	12.4103	484	1.4630	0.4030	1.4630	1.2095
No log	12.4615	486	1.3659	0.4361	1.3659	1.1687
No log	12.5128	488	1.3997	0.4361	1.3997	1.1831
No log	12.5641	490	1.4936	0.3459	1.4936	1.2221
No log	12.6154	492	1.5568	0.3582	1.5568	1.2477
No log	12.6667	494	1.4759	0.3788	1.4759	1.2149
No log	12.7179	496	1.3704	0.4733	1.3704	1.1706
No log	12.7692	498	1.3792	0.4545	1.3792	1.1744
0.4804	12.8205	500	1.4618	0.4060	1.4618	1.2090
0.4804	12.8718	502	1.5509	0.3407	1.5509	1.2453
0.4804	12.9231	504	1.6413	0.3407	1.6413	1.2812
0.4804	12.9744	506	1.6499	0.3382	1.6499	1.2845
0.4804	13.0256	508	1.5395	0.3529	1.5395	1.2408
0.4804	13.0769	510	1.4071	0.4478	1.4071	1.1862
0.4804	13.1282	512	1.4144	0.4478	1.4144	1.1893
0.4804	13.1795	514	1.5213	0.3407	1.5213	1.2334
0.4804	13.2308	516	1.5946	0.3407	1.5946	1.2628
0.4804	13.2821	518	1.6406	0.3407	1.6406	1.2808
0.4804	13.3333	520	1.5896	0.3308	1.5896	1.2608
0.4804	13.3846	522	1.5961	0.3053	1.5961	1.2634

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1