ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6173
• Qwk: 0.3212
• Mse: 1.6173
• Rmse: 1.2717

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	6.9394	0.0116	6.9394	2.6343
No log	0.0656	4	5.0040	0.0513	5.0040	2.2370
No log	0.0984	6	3.3203	0.0702	3.3203	1.8222
No log	0.1311	8	3.0784	0.0602	3.0784	1.7545
No log	0.1639	10	2.5751	0.1314	2.5751	1.6047
No log	0.1967	12	2.0584	0.1374	2.0584	1.4347
No log	0.2295	14	1.7050	0.1239	1.7050	1.3058
No log	0.2623	16	1.6787	0.1524	1.6787	1.2956
No log	0.2951	18	1.8041	0.1887	1.8041	1.3432
No log	0.3279	20	1.9884	0.2185	1.9884	1.4101
No log	0.3607	22	2.0432	0.2419	2.0432	1.4294
No log	0.3934	24	1.9654	0.2783	1.9654	1.4019
No log	0.4262	26	1.9194	0.2609	1.9194	1.3854
No log	0.4590	28	2.0547	0.2537	2.0547	1.4334
No log	0.4918	30	2.2808	0.1528	2.2808	1.5102
No log	0.5246	32	2.3673	0.0405	2.3673	1.5386
No log	0.5574	34	2.2549	0.1241	2.2549	1.5016
No log	0.5902	36	1.8618	0.3220	1.8618	1.3645
No log	0.6230	38	1.6775	0.1165	1.6775	1.2952
No log	0.6557	40	1.6038	0.0784	1.6038	1.2664
No log	0.6885	42	1.5939	0.0784	1.5939	1.2625
No log	0.7213	44	1.6150	0.1165	1.6150	1.2708
No log	0.7541	46	1.6879	0.1698	1.6879	1.2992
No log	0.7869	48	1.6691	0.3009	1.6691	1.2919
No log	0.8197	50	1.8261	0.3969	1.8261	1.3513
No log	0.8525	52	1.9890	0.1831	1.9890	1.4103
No log	0.8852	54	1.9345	0.2774	1.9345	1.3909
No log	0.9180	56	1.7291	0.3906	1.7291	1.3149
No log	0.9508	58	1.6514	0.3902	1.6514	1.2851
No log	0.9836	60	1.5952	0.3077	1.5952	1.2630
No log	1.0164	62	1.6640	0.2456	1.6640	1.2900
No log	1.0492	64	1.8549	0.1833	1.8549	1.3619
No log	1.0820	66	1.8702	0.3040	1.8702	1.3675
No log	1.1148	68	1.9385	0.2388	1.9385	1.3923
No log	1.1475	70	1.9996	0.2794	1.9996	1.4141
No log	1.1803	72	2.0907	0.1277	2.0907	1.4459
No log	1.2131	74	2.2368	0.1538	2.2368	1.4956
No log	1.2459	76	2.0535	0.2286	2.0535	1.4330
No log	1.2787	78	1.7427	0.3934	1.7427	1.3201
No log	1.3115	80	1.5879	0.1682	1.5879	1.2601
No log	1.3443	82	1.5559	0.1905	1.5559	1.2474
No log	1.3770	84	1.5920	0.3361	1.5920	1.2617
No log	1.4098	86	1.5974	0.3276	1.5974	1.2639
No log	1.4426	88	1.7987	0.1636	1.7987	1.3412
No log	1.4754	90	1.7599	0.2051	1.7599	1.3266
No log	1.5082	92	1.4718	0.3130	1.4718	1.2132
No log	1.5410	94	1.3499	0.4	1.3499	1.1619
No log	1.5738	96	1.3450	0.4274	1.3450	1.1597
No log	1.6066	98	1.3292	0.3363	1.3292	1.1529
No log	1.6393	100	1.3201	0.4333	1.3201	1.1490
No log	1.6721	102	1.2607	0.4390	1.2607	1.1228
No log	1.7049	104	1.1706	0.4833	1.1706	1.0819
No log	1.7377	106	1.1452	0.5167	1.1452	1.0702
No log	1.7705	108	1.1087	0.5167	1.1087	1.0529
No log	1.8033	110	1.1038	0.5938	1.1038	1.0506
No log	1.8361	112	1.1899	0.5113	1.1899	1.0908
No log	1.8689	114	1.2722	0.4741	1.2722	1.1279
No log	1.9016	116	1.3783	0.4853	1.3783	1.1740
No log	1.9344	118	1.4580	0.4211	1.4580	1.2075
No log	1.9672	120	1.5359	0.3382	1.5359	1.2393
No log	2.0	122	1.5697	0.3404	1.5697	1.2529
No log	2.0328	124	1.3334	0.4559	1.3334	1.1547
No log	2.0656	126	1.1716	0.5736	1.1716	1.0824
No log	2.0984	128	1.2930	0.5197	1.2930	1.1371
No log	2.1311	130	1.3073	0.4553	1.3073	1.1434
No log	2.1639	132	1.2807	0.4839	1.2807	1.1317
No log	2.1967	134	1.4384	0.3697	1.4384	1.1993
No log	2.2295	136	1.6194	0.2261	1.6194	1.2725
No log	2.2623	138	1.7030	0.2353	1.7030	1.3050
No log	2.2951	140	1.5640	0.3359	1.5640	1.2506
No log	2.3279	142	1.4111	0.4211	1.4111	1.1879
No log	2.3607	144	1.3608	0.4580	1.3608	1.1665
No log	2.3934	146	1.4538	0.3664	1.4538	1.2057
No log	2.4262	148	1.4685	0.3622	1.4685	1.2118
No log	2.4590	150	1.5168	0.2542	1.5168	1.2316
No log	2.4918	152	1.4047	0.3471	1.4047	1.1852
No log	2.5246	154	1.2638	0.5	1.2638	1.1242
No log	2.5574	156	1.2625	0.5385	1.2625	1.1236
No log	2.5902	158	1.2725	0.5344	1.2725	1.1281
No log	2.6230	160	1.3677	0.5037	1.3677	1.1695
No log	2.6557	162	1.4904	0.3971	1.4904	1.2208
No log	2.6885	164	1.6055	0.3768	1.6055	1.2671
No log	2.7213	166	1.6108	0.3259	1.6108	1.2692
No log	2.7541	168	1.5263	0.4265	1.5263	1.2354
No log	2.7869	170	1.4193	0.4265	1.4193	1.1914
No log	2.8197	172	1.3184	0.4857	1.3184	1.1482
No log	2.8525	174	1.4040	0.4397	1.4040	1.1849
No log	2.8852	176	1.5103	0.4	1.5103	1.2289
No log	2.9180	178	1.6615	0.3830	1.6615	1.2890
No log	2.9508	180	1.7089	0.3043	1.7089	1.3073
No log	2.9836	182	1.6342	0.3212	1.6342	1.2784
No log	3.0164	184	1.4626	0.4706	1.4626	1.2094
No log	3.0492	186	1.3802	0.5271	1.3802	1.1748
No log	3.0820	188	1.3695	0.4651	1.3695	1.1703
No log	3.1148	190	1.4458	0.4889	1.4458	1.2024
No log	3.1475	192	1.6842	0.3650	1.6842	1.2978
No log	3.1803	194	1.7742	0.3212	1.7742	1.3320
No log	3.2131	196	1.6831	0.3650	1.6831	1.2974
No log	3.2459	198	1.5213	0.4593	1.5213	1.2334
No log	3.2787	200	1.4504	0.4511	1.4504	1.2043
No log	3.3115	202	1.4297	0.4882	1.4297	1.1957
No log	3.3443	204	1.4371	0.4882	1.4371	1.1988
No log	3.3770	206	1.4706	0.4242	1.4706	1.2127
No log	3.4098	208	1.3822	0.4394	1.3822	1.1757
No log	3.4426	210	1.4773	0.3942	1.4773	1.2154
No log	3.4754	212	1.5987	0.3650	1.5987	1.2644
No log	3.5082	214	1.5737	0.3650	1.5737	1.2545
No log	3.5410	216	1.4854	0.3824	1.4854	1.2187
No log	3.5738	218	1.6847	0.3650	1.6847	1.2980
No log	3.6066	220	1.9597	0.2817	1.9597	1.3999
No log	3.6393	222	2.0733	0.2657	2.0733	1.4399
No log	3.6721	224	1.9662	0.2657	1.9662	1.4022
No log	3.7049	226	1.8264	0.3143	1.8264	1.3515
No log	3.7377	228	1.6207	0.3704	1.6207	1.2731
No log	3.7705	230	1.5199	0.3704	1.5199	1.2329
No log	3.8033	232	1.5226	0.3704	1.5226	1.2340
No log	3.8361	234	1.6378	0.3478	1.6378	1.2798
No log	3.8689	236	1.7524	0.3309	1.7524	1.3238
No log	3.9016	238	1.8826	0.3121	1.8826	1.3721
No log	3.9344	240	1.8167	0.3143	1.8167	1.3478
No log	3.9672	242	1.6539	0.3571	1.6539	1.2860
No log	4.0	244	1.5242	0.3971	1.5242	1.2346
No log	4.0328	246	1.4867	0.4	1.4867	1.2193
No log	4.0656	248	1.5375	0.3459	1.5375	1.2400
No log	4.0984	250	1.6284	0.3284	1.6284	1.2761
No log	4.1311	252	1.5890	0.2656	1.5890	1.2606
No log	4.1639	254	1.5039	0.3040	1.5039	1.2263
No log	4.1967	256	1.4177	0.4160	1.4177	1.1907
No log	4.2295	258	1.3387	0.4	1.3387	1.1570
No log	4.2623	260	1.4615	0.3459	1.4615	1.2089
No log	4.2951	262	1.6109	0.3382	1.6109	1.2692
No log	4.3279	264	1.8519	0.2734	1.8519	1.3608
No log	4.3607	266	1.9025	0.2411	1.9025	1.3793
No log	4.3934	268	1.8836	0.2411	1.8836	1.3724
No log	4.4262	270	1.7056	0.3382	1.7056	1.3060
No log	4.4590	272	1.4928	0.3759	1.4928	1.2218
No log	4.4918	274	1.2849	0.4769	1.2849	1.1335
No log	4.5246	276	1.2514	0.5231	1.2514	1.1187
No log	4.5574	278	1.3176	0.4275	1.3176	1.1479
No log	4.5902	280	1.5075	0.3459	1.5075	1.2278
No log	4.6230	282	1.7488	0.3212	1.7488	1.3224
No log	4.6557	284	1.8014	0.3043	1.8014	1.3421
No log	4.6885	286	1.6900	0.3382	1.6900	1.3000
No log	4.7213	288	1.4308	0.3731	1.4308	1.1962
No log	4.7541	290	1.2647	0.4724	1.2647	1.1246
No log	4.7869	292	1.1898	0.5039	1.1898	1.0908
No log	4.8197	294	1.2059	0.5039	1.2059	1.0981
No log	4.8525	296	1.3484	0.3609	1.3484	1.1612
No log	4.8852	298	1.6710	0.3382	1.6710	1.2927
No log	4.9180	300	1.8131	0.2734	1.8131	1.3465
No log	4.9508	302	1.8285	0.2734	1.8285	1.3522
No log	4.9836	304	1.6854	0.3382	1.6854	1.2982
No log	5.0164	306	1.6061	0.3609	1.6061	1.2673
No log	5.0492	308	1.5579	0.3939	1.5579	1.2482
No log	5.0820	310	1.5655	0.3556	1.5655	1.2512
No log	5.1148	312	1.6093	0.3556	1.6093	1.2686
No log	5.1475	314	1.6027	0.3556	1.6027	1.2660
No log	5.1803	316	1.5437	0.3582	1.5437	1.2425
No log	5.2131	318	1.5484	0.3582	1.5484	1.2444
No log	5.2459	320	1.5114	0.3817	1.5114	1.2294
No log	5.2787	322	1.4958	0.3788	1.4958	1.2230
No log	5.3115	324	1.6088	0.3556	1.6088	1.2684
No log	5.3443	326	1.7324	0.3382	1.7324	1.3162
No log	5.3770	328	1.7750	0.3165	1.7750	1.3323
No log	5.4098	330	1.7369	0.3650	1.7369	1.3179
No log	5.4426	332	1.5987	0.3824	1.5987	1.2644
No log	5.4754	334	1.5316	0.3556	1.5316	1.2376
No log	5.5082	336	1.5093	0.3910	1.5093	1.2285
No log	5.5410	338	1.5328	0.3910	1.5328	1.2381
No log	5.5738	340	1.5205	0.3939	1.5205	1.2331
No log	5.6066	342	1.5569	0.3910	1.5569	1.2477
No log	5.6393	344	1.5322	0.3939	1.5322	1.2378
No log	5.6721	346	1.4526	0.4122	1.4526	1.2052
No log	5.7049	348	1.3870	0.4462	1.3870	1.1777
No log	5.7377	350	1.4539	0.4091	1.4539	1.2058
No log	5.7705	352	1.5668	0.3881	1.5668	1.2517
No log	5.8033	354	1.5389	0.4242	1.5389	1.2405
No log	5.8361	356	1.4661	0.4375	1.4661	1.2108
No log	5.8689	358	1.3605	0.4480	1.3605	1.1664
No log	5.9016	360	1.3645	0.4252	1.3645	1.1681
No log	5.9344	362	1.4831	0.3910	1.4831	1.2178
No log	5.9672	364	1.6220	0.3556	1.6220	1.2736
No log	6.0	366	1.7211	0.3212	1.7211	1.3119
No log	6.0328	368	1.6711	0.3212	1.6711	1.2927
No log	6.0656	370	1.6854	0.3212	1.6854	1.2982
No log	6.0984	372	1.7060	0.3212	1.7060	1.3061
No log	6.1311	374	1.6094	0.3382	1.6094	1.2686
No log	6.1639	376	1.6303	0.3382	1.6303	1.2768
No log	6.1967	378	1.5982	0.3556	1.5982	1.2642
No log	6.2295	380	1.4803	0.3556	1.4803	1.2167
No log	6.2623	382	1.4416	0.3824	1.4416	1.2007
No log	6.2951	384	1.4924	0.3556	1.4924	1.2217
No log	6.3279	386	1.6571	0.3212	1.6571	1.2873
No log	6.3607	388	1.7165	0.3043	1.7165	1.3101
No log	6.3934	390	1.5845	0.3556	1.5845	1.2588
No log	6.4262	392	1.4701	0.3731	1.4701	1.2125
No log	6.4590	394	1.5258	0.3731	1.5258	1.2352
No log	6.4918	396	1.5867	0.3731	1.5867	1.2596
No log	6.5246	398	1.6497	0.3556	1.6497	1.2844
No log	6.5574	400	1.5966	0.3382	1.5966	1.2635
No log	6.5902	402	1.5312	0.3881	1.5312	1.2374
No log	6.6230	404	1.5642	0.3382	1.5642	1.2507
No log	6.6557	406	1.6473	0.3212	1.6473	1.2835
No log	6.6885	408	1.8680	0.2714	1.8680	1.3667
No log	6.7213	410	1.9042	0.2714	1.9042	1.3799
No log	6.7541	412	1.7350	0.3188	1.7350	1.3172
No log	6.7869	414	1.6983	0.3212	1.6983	1.3032
No log	6.8197	416	1.5679	0.3556	1.5679	1.2522
No log	6.8525	418	1.5107	0.4427	1.5107	1.2291
No log	6.8852	420	1.6036	0.3556	1.6036	1.2663
No log	6.9180	422	1.7502	0.3188	1.7502	1.3229
No log	6.9508	424	1.7811	0.2878	1.7811	1.3346
No log	6.9836	426	1.6388	0.3188	1.6388	1.2802
No log	7.0164	428	1.5975	0.3478	1.5975	1.2639
No log	7.0492	430	1.6109	0.3309	1.6109	1.2692
No log	7.0820	432	1.6513	0.3309	1.6513	1.2850
No log	7.1148	434	1.5963	0.3650	1.5963	1.2635
No log	7.1475	436	1.5765	0.3650	1.5765	1.2556
No log	7.1803	438	1.5972	0.4148	1.5972	1.2638
No log	7.2131	440	1.6287	0.3650	1.6287	1.2762
No log	7.2459	442	1.5706	0.3650	1.5706	1.2532
No log	7.2787	444	1.5189	0.3824	1.5189	1.2325
No log	7.3115	446	1.6002	0.3650	1.6002	1.2650
No log	7.3443	448	1.7200	0.3143	1.7200	1.3115
No log	7.3770	450	1.7726	0.2553	1.7726	1.3314
No log	7.4098	452	1.6123	0.3650	1.6123	1.2698
No log	7.4426	454	1.4879	0.3852	1.4879	1.2198
No log	7.4754	456	1.4418	0.4	1.4418	1.2008
No log	7.5082	458	1.4708	0.4060	1.4708	1.2128
No log	7.5410	460	1.5724	0.3556	1.5724	1.2539
No log	7.5738	462	1.7735	0.3022	1.7735	1.3317
No log	7.6066	464	1.7844	0.2714	1.7844	1.3358
No log	7.6393	466	1.5812	0.3556	1.5812	1.2575
No log	7.6721	468	1.5314	0.3824	1.5314	1.2375
No log	7.7049	470	1.6355	0.3824	1.6355	1.2789
No log	7.7377	472	1.7841	0.2734	1.7841	1.3357
No log	7.7705	474	1.7977	0.3066	1.7977	1.3408
No log	7.8033	476	1.6731	0.3556	1.6731	1.2935
No log	7.8361	478	1.4899	0.3910	1.4899	1.2206
No log	7.8689	480	1.3353	0.4427	1.3353	1.1556
No log	7.9016	482	1.3740	0.4427	1.3740	1.1722
No log	7.9344	484	1.5406	0.3824	1.5406	1.2412
No log	7.9672	486	1.6168	0.3556	1.6168	1.2715
No log	8.0	488	1.7188	0.3212	1.7188	1.3110
No log	8.0328	490	1.7381	0.3212	1.7381	1.3184
No log	8.0656	492	1.5526	0.3556	1.5526	1.2460
No log	8.0984	494	1.4676	0.3852	1.4676	1.2114
No log	8.1311	496	1.4713	0.3582	1.4713	1.2130
No log	8.1639	498	1.5947	0.3212	1.5947	1.2628
0.4736	8.1967	500	1.6014	0.3382	1.6014	1.2655
0.4736	8.2295	502	1.6447	0.3212	1.6447	1.2825
0.4736	8.2623	504	1.6205	0.3382	1.6205	1.2730
0.4736	8.2951	506	1.5915	0.3382	1.5915	1.2616
0.4736	8.3279	508	1.6419	0.3212	1.6419	1.2814
0.4736	8.3607	510	1.6173	0.3212	1.6173	1.2717

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1