ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6973
• Qwk: 0.3286
• Mse: 1.6973
• Rmse: 1.3028

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	6.8417	0.0239	6.8417	2.6157
No log	0.0656	4	4.7378	0.0690	4.7378	2.1767
No log	0.0984	6	3.1378	0.0988	3.1378	1.7714
No log	0.1311	8	2.8409	0.0633	2.8409	1.6855
No log	0.1639	10	2.1719	0.1324	2.1719	1.4737
No log	0.1967	12	1.7771	0.2182	1.7771	1.3331
No log	0.2295	14	1.6982	0.1538	1.6982	1.3032
No log	0.2623	16	1.7480	0.1481	1.7480	1.3221
No log	0.2951	18	2.1433	0.1493	2.1433	1.4640
No log	0.3279	20	2.5475	0.0662	2.5475	1.5961
No log	0.3607	22	2.7186	0.0513	2.7186	1.6488
No log	0.3934	24	2.4762	0.0261	2.4762	1.5736
No log	0.4262	26	2.3151	0.0268	2.3151	1.5215
No log	0.4590	28	2.4178	0.0	2.4178	1.5549
No log	0.4918	30	2.4516	0.0	2.4516	1.5658
No log	0.5246	32	2.3473	0.0	2.3473	1.5321
No log	0.5574	34	2.1635	0.125	2.1635	1.4709
No log	0.5902	36	1.8960	0.4160	1.8960	1.3769
No log	0.6230	38	1.6598	0.2545	1.6598	1.2884
No log	0.6557	40	1.5253	0.1524	1.5253	1.2350
No log	0.6885	42	1.4885	0.2056	1.4885	1.2200
No log	0.7213	44	1.6088	0.3276	1.6088	1.2684
No log	0.7541	46	1.6051	0.3130	1.6051	1.2669
No log	0.7869	48	1.5006	0.2342	1.5006	1.2250
No log	0.8197	50	1.4319	0.2018	1.4319	1.1966
No log	0.8525	52	1.3578	0.1714	1.3578	1.1652
No log	0.8852	54	1.3709	0.2264	1.3709	1.1709
No log	0.9180	56	1.3667	0.2264	1.3667	1.1690
No log	0.9508	58	1.1901	0.3423	1.1901	1.0909
No log	0.9836	60	1.1292	0.4961	1.1292	1.0626
No log	1.0164	62	2.0280	0.4444	2.0280	1.4241
No log	1.0492	64	2.0595	0.3926	2.0595	1.4351
No log	1.0820	66	1.3255	0.5255	1.3255	1.1513
No log	1.1148	68	1.1197	0.4576	1.1197	1.0582
No log	1.1475	70	1.1825	0.3684	1.1825	1.0874
No log	1.1803	72	1.3170	0.3478	1.3170	1.1476
No log	1.2131	74	1.3576	0.3333	1.3576	1.1652
No log	1.2459	76	1.3962	0.3186	1.3962	1.1816
No log	1.2787	78	1.3712	0.2202	1.3712	1.1710
No log	1.3115	80	1.4136	0.1905	1.4136	1.1890
No log	1.3443	82	1.4820	0.2778	1.4820	1.2174
No log	1.3770	84	1.5260	0.2430	1.5260	1.2353
No log	1.4098	86	1.4310	0.3540	1.4310	1.1962
No log	1.4426	88	1.3530	0.5581	1.3530	1.1632
No log	1.4754	90	1.4032	0.4593	1.4032	1.1845
No log	1.5082	92	1.5361	0.4173	1.5361	1.2394
No log	1.5410	94	1.7015	0.3776	1.7015	1.3044
No log	1.5738	96	1.8631	0.3333	1.8631	1.3649
No log	1.6066	98	1.9452	0.3108	1.9452	1.3947
No log	1.6393	100	2.2206	0.1905	2.2206	1.4902
No log	1.6721	102	2.4478	0.2000	2.4478	1.5645
No log	1.7049	104	2.4654	0.3034	2.4654	1.5702
No log	1.7377	106	2.3853	0.3030	2.3853	1.5444
No log	1.7705	108	2.3647	0.2733	2.3647	1.5378
No log	1.8033	110	2.0989	0.2603	2.0989	1.4488
No log	1.8361	112	1.7357	0.3022	1.7357	1.3175
No log	1.8689	114	1.5838	0.3857	1.5838	1.2585
No log	1.9016	116	1.6605	0.3623	1.6605	1.2886
No log	1.9344	118	1.6732	0.3333	1.6732	1.2935
No log	1.9672	120	1.7003	0.3333	1.7003	1.3040
No log	2.0	122	1.6525	0.3333	1.6525	1.2855
No log	2.0328	124	1.6942	0.3165	1.6942	1.3016
No log	2.0656	126	1.6173	0.3429	1.6173	1.2717
No log	2.0984	128	1.4252	0.4818	1.4252	1.1938
No log	2.1311	130	1.4347	0.4638	1.4347	1.1978
No log	2.1639	132	1.6399	0.3597	1.6399	1.2806
No log	2.1967	134	1.8675	0.2695	1.8675	1.3666
No log	2.2295	136	1.8944	0.2429	1.8944	1.3764
No log	2.2623	138	1.7640	0.3358	1.7640	1.3281
No log	2.2951	140	1.6427	0.3913	1.6427	1.2817
No log	2.3279	142	1.7077	0.3913	1.7077	1.3068
No log	2.3607	144	1.9392	0.2695	1.9392	1.3925
No log	2.3934	146	2.0295	0.2361	2.0295	1.4246
No log	2.4262	148	2.0700	0.2098	2.0700	1.4388
No log	2.4590	150	1.9890	0.2676	1.9890	1.4103
No log	2.4918	152	1.7362	0.3478	1.7362	1.3177
No log	2.5246	154	1.5558	0.4029	1.5558	1.2473
No log	2.5574	156	1.4587	0.4478	1.4587	1.2078
No log	2.5902	158	1.4836	0.4848	1.4836	1.2180
No log	2.6230	160	1.3559	0.5312	1.3559	1.1644
No log	2.6557	162	1.3029	0.496	1.3029	1.1414
No log	2.6885	164	1.2901	0.5161	1.2901	1.1358
No log	2.7213	166	1.3494	0.5079	1.3494	1.1616
No log	2.7541	168	1.5458	0.3852	1.5458	1.2433
No log	2.7869	170	1.6500	0.3066	1.6500	1.2845
No log	2.8197	172	1.7069	0.3000	1.7069	1.3065
No log	2.8525	174	1.7593	0.3000	1.7593	1.3264
No log	2.8852	176	1.9542	0.2897	1.9542	1.3979
No log	2.9180	178	2.1757	0.2803	2.1757	1.4750
No log	2.9508	180	2.1209	0.2727	2.1209	1.4563
No log	2.9836	182	1.8072	0.3194	1.8072	1.3443
No log	3.0164	184	1.6423	0.3546	1.6423	1.2815
No log	3.0492	186	1.6399	0.3022	1.6399	1.2806
No log	3.0820	188	1.7197	0.2979	1.7197	1.3114
No log	3.1148	190	1.7860	0.2857	1.7860	1.3364
No log	3.1475	192	1.7037	0.2979	1.7037	1.3053
No log	3.1803	194	1.5368	0.3852	1.5368	1.2397
No log	3.2131	196	1.5519	0.3971	1.5519	1.2457
No log	3.2459	198	1.7202	0.3239	1.7202	1.3116
No log	3.2787	200	1.7498	0.3239	1.7498	1.3228
No log	3.3115	202	1.6350	0.3824	1.6350	1.2787
No log	3.3443	204	1.5413	0.4812	1.5413	1.2415
No log	3.3770	206	1.4418	0.5116	1.4418	1.2008
No log	3.4098	208	1.4437	0.4885	1.4437	1.2015
No log	3.4426	210	1.5954	0.3731	1.5954	1.2631
No log	3.4754	212	1.6583	0.2878	1.6583	1.2877
No log	3.5082	214	1.6143	0.3429	1.6143	1.2706
No log	3.5410	216	1.4909	0.4148	1.4909	1.2210
No log	3.5738	218	1.4823	0.4091	1.4823	1.2175
No log	3.6066	220	1.5604	0.3358	1.5604	1.2492
No log	3.6393	222	1.7465	0.3022	1.7465	1.3215
No log	3.6721	224	1.7563	0.3022	1.7563	1.3252
No log	3.7049	226	1.6531	0.3165	1.6531	1.2857
No log	3.7377	228	1.6238	0.3066	1.6238	1.2743
No log	3.7705	230	1.5580	0.3817	1.5580	1.2482
No log	3.8033	232	1.4375	0.496	1.4375	1.1990
No log	3.8361	234	1.4879	0.4275	1.4879	1.2198
No log	3.8689	236	1.4615	0.5038	1.4615	1.2089
No log	3.9016	238	1.4027	0.4885	1.4027	1.1844
No log	3.9344	240	1.4455	0.4328	1.4455	1.2023
No log	3.9672	242	1.6591	0.3239	1.6591	1.2881
No log	4.0	244	1.9811	0.2621	1.9811	1.4075
No log	4.0328	246	1.9957	0.2069	1.9957	1.4127
No log	4.0656	248	1.7380	0.3121	1.7380	1.3183
No log	4.0984	250	1.4768	0.5	1.4768	1.2152
No log	4.1311	252	1.3648	0.5116	1.3648	1.1682
No log	4.1639	254	1.3423	0.5	1.3423	1.1586
No log	4.1967	256	1.4729	0.4296	1.4729	1.2136
No log	4.2295	258	1.4852	0.4328	1.4852	1.2187
No log	4.2623	260	1.2898	0.5312	1.2898	1.1357
No log	4.2951	262	1.1850	0.5806	1.1850	1.0886
No log	4.3279	264	1.2273	0.5323	1.2273	1.1078
No log	4.3607	266	1.3721	0.4885	1.3721	1.1714
No log	4.3934	268	1.3889	0.4848	1.3889	1.1785
No log	4.4262	270	1.3266	0.4733	1.3266	1.1518
No log	4.4590	272	1.3189	0.4733	1.3189	1.1484
No log	4.4918	274	1.5139	0.4148	1.5139	1.2304
No log	4.5246	276	1.6783	0.3121	1.6783	1.2955
No log	4.5574	278	1.6410	0.3309	1.6410	1.2810
No log	4.5902	280	1.5474	0.4806	1.5474	1.2439
No log	4.6230	282	1.5755	0.4882	1.5755	1.2552
No log	4.6557	284	1.6493	0.3937	1.6493	1.2842
No log	4.6885	286	1.7179	0.2878	1.7179	1.3107
No log	4.7213	288	1.7212	0.3121	1.7212	1.3120
No log	4.7541	290	1.5142	0.4118	1.5142	1.2305
No log	4.7869	292	1.4764	0.4328	1.4764	1.2151
No log	4.8197	294	1.6288	0.3309	1.6288	1.2763
No log	4.8525	296	1.8781	0.2394	1.8781	1.3704
No log	4.8852	298	1.8684	0.2394	1.8684	1.3669
No log	4.9180	300	1.6915	0.3188	1.6915	1.3006
No log	4.9508	302	1.6163	0.4328	1.6163	1.2713
No log	4.9836	304	1.6427	0.3382	1.6427	1.2817
No log	5.0164	306	1.6234	0.4	1.6234	1.2741
No log	5.0492	308	1.6859	0.3309	1.6859	1.2984
No log	5.0820	310	1.7668	0.2958	1.7668	1.3292
No log	5.1148	312	1.9410	0.2222	1.9410	1.3932
No log	5.1475	314	1.9042	0.2378	1.9042	1.3799
No log	5.1803	316	1.7662	0.2937	1.7662	1.3290
No log	5.2131	318	1.5807	0.4328	1.5807	1.2572
No log	5.2459	320	1.5526	0.4697	1.5526	1.2460
No log	5.2787	322	1.6436	0.3382	1.6436	1.2820
No log	5.3115	324	1.7006	0.3358	1.7006	1.3041
No log	5.3443	326	1.7250	0.3188	1.7250	1.3134
No log	5.3770	328	1.6664	0.3358	1.6664	1.2909
No log	5.4098	330	1.4664	0.4394	1.4664	1.2109
No log	5.4426	332	1.3524	0.4806	1.3524	1.1629
No log	5.4754	334	1.3714	0.4806	1.3714	1.1711
No log	5.5082	336	1.5186	0.4462	1.5186	1.2323
No log	5.5410	338	1.6669	0.3235	1.6669	1.2911
No log	5.5738	340	1.6092	0.3556	1.6092	1.2686
No log	5.6066	342	1.4302	0.4848	1.4302	1.1959
No log	5.6393	344	1.4649	0.4580	1.4649	1.2103
No log	5.6721	346	1.6683	0.3259	1.6683	1.2916
No log	5.7049	348	1.7769	0.2143	1.7769	1.3330
No log	5.7377	350	1.8174	0.2143	1.8174	1.3481
No log	5.7705	352	1.9002	0.1986	1.9002	1.3785
No log	5.8033	354	1.9119	0.1972	1.9119	1.3827
No log	5.8361	356	1.7336	0.3043	1.7336	1.3167
No log	5.8689	358	1.4941	0.4274	1.4941	1.2223
No log	5.9016	360	1.5116	0.2478	1.5116	1.2295
No log	5.9344	362	1.3659	0.4138	1.3659	1.1687
No log	5.9672	364	1.4541	0.5152	1.4541	1.2059
No log	6.0	366	1.6998	0.2734	1.6998	1.3038
No log	6.0328	368	1.7708	0.2734	1.7708	1.3307
No log	6.0656	370	1.5611	0.3664	1.5611	1.2495
No log	6.0984	372	1.3230	0.5000	1.3230	1.1502
No log	6.1311	374	1.2711	0.5238	1.2711	1.1274
No log	6.1639	376	1.3569	0.4724	1.3569	1.1649
No log	6.1967	378	1.5603	0.3459	1.5603	1.2491
No log	6.2295	380	1.6751	0.3066	1.6751	1.2942
No log	6.2623	382	1.6145	0.3407	1.6145	1.2706
No log	6.2951	384	1.6626	0.3099	1.6626	1.2894
No log	6.3279	386	1.7420	0.2778	1.7420	1.3198
No log	6.3607	388	1.6936	0.2774	1.6936	1.3014
No log	6.3934	390	1.6364	0.3485	1.6364	1.2792
No log	6.4262	392	1.6639	0.3664	1.6639	1.2899
No log	6.4590	394	1.6319	0.4	1.6319	1.2774
No log	6.4918	396	1.6621	0.3609	1.6621	1.2892
No log	6.5246	398	1.8101	0.2714	1.8101	1.3454
No log	6.5574	400	2.0347	0.1972	2.0347	1.4264
No log	6.5902	402	2.0315	0.1986	2.0315	1.4253
No log	6.6230	404	1.7865	0.2714	1.7865	1.3366
No log	6.6557	406	1.5614	0.4211	1.5614	1.2496
No log	6.6885	408	1.5297	0.4511	1.5297	1.2368
No log	6.7213	410	1.6479	0.3188	1.6479	1.2837
No log	6.7541	412	1.7690	0.3043	1.7690	1.3300
No log	6.7869	414	1.9336	0.2128	1.9336	1.3905
No log	6.8197	416	1.9029	0.2098	1.9029	1.3795
No log	6.8525	418	1.7164	0.3043	1.7164	1.3101
No log	6.8852	420	1.5579	0.4776	1.5579	1.2482
No log	6.9180	422	1.6228	0.4234	1.6228	1.2739
No log	6.9508	424	1.8788	0.2222	1.8788	1.3707
No log	6.9836	426	2.0193	0.2098	2.0193	1.4210
No log	7.0164	428	1.8596	0.2378	1.8596	1.3637
No log	7.0492	430	1.6038	0.3731	1.6038	1.2664
No log	7.0820	432	1.4917	0.4688	1.4917	1.2214
No log	7.1148	434	1.5724	0.3939	1.5724	1.2539
No log	7.1475	436	1.8316	0.2378	1.8316	1.3534
No log	7.1803	438	1.9286	0.2098	1.9286	1.3887
No log	7.2131	440	1.8702	0.2378	1.8702	1.3676
No log	7.2459	442	1.7413	0.2676	1.7413	1.3196
No log	7.2787	444	1.5432	0.4848	1.5432	1.2422
No log	7.3115	446	1.3723	0.5156	1.3723	1.1714
No log	7.3443	448	1.3409	0.5039	1.3409	1.1580
No log	7.3770	450	1.4064	0.5156	1.4064	1.1859
No log	7.4098	452	1.6242	0.3504	1.6242	1.2744
No log	7.4426	454	1.7866	0.2553	1.7866	1.3366
No log	7.4754	456	1.7380	0.2676	1.7380	1.3183
No log	7.5082	458	1.5251	0.3881	1.5251	1.2349
No log	7.5410	460	1.3567	0.5385	1.3567	1.1648
No log	7.5738	462	1.2636	0.5469	1.2636	1.1241
No log	7.6066	464	1.2875	0.5426	1.2875	1.1347
No log	7.6393	466	1.3891	0.4848	1.3891	1.1786
No log	7.6721	468	1.4442	0.4427	1.4442	1.2017
No log	7.7049	470	1.5490	0.3609	1.5490	1.2446
No log	7.7377	472	1.4974	0.4242	1.4974	1.2237
No log	7.7705	474	1.4685	0.4776	1.4685	1.2118
No log	7.8033	476	1.4783	0.4593	1.4783	1.2159
No log	7.8361	478	1.5477	0.4234	1.5477	1.2441
No log	7.8689	480	1.6910	0.3662	1.6910	1.3004
No log	7.9016	482	1.7176	0.3043	1.7176	1.3106
No log	7.9344	484	1.5953	0.4211	1.5953	1.2631
No log	7.9672	486	1.4582	0.4769	1.4582	1.2076
No log	8.0	488	1.3458	0.5197	1.3458	1.1601
No log	8.0328	490	1.3260	0.4882	1.3260	1.1515
No log	8.0656	492	1.4487	0.4848	1.4487	1.2036
No log	8.0984	494	1.7095	0.3022	1.7095	1.3075
No log	8.1311	496	1.8596	0.2254	1.8596	1.3637
No log	8.1639	498	1.7716	0.2553	1.7716	1.3310
0.4244	8.1967	500	1.5654	0.4	1.5654	1.2512
0.4244	8.2295	502	1.4371	0.5231	1.4371	1.1988
0.4244	8.2623	504	1.4187	0.5397	1.4187	1.1911
0.4244	8.2951	506	1.5152	0.4444	1.5152	1.2310
0.4244	8.3279	508	1.5619	0.3846	1.5619	1.2497
0.4244	8.3607	510	1.4812	0.4806	1.4812	1.2171
0.4244	8.3934	512	1.4198	0.4848	1.4198	1.1915
0.4244	8.4262	514	1.4476	0.4776	1.4476	1.2032
0.4244	8.4590	516	1.6277	0.3741	1.6277	1.2758
0.4244	8.4918	518	1.9233	0.2254	1.9233	1.3868
0.4244	8.5246	520	1.9630	0.2098	1.9630	1.4011
0.4244	8.5574	522	1.8404	0.2553	1.8404	1.3566
0.4244	8.5902	524	1.6973	0.3286	1.6973	1.3028

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1