ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7627
• Qwk: 0.2270
• Mse: 1.7627
• Rmse: 1.3277

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	7.0930	0.0	7.0930	2.6633
No log	0.0606	4	4.9110	0.0760	4.9110	2.2161
No log	0.0909	6	4.1363	-0.0597	4.1363	2.0338
No log	0.1212	8	3.1378	0.0118	3.1378	1.7714
No log	0.1515	10	2.0239	0.0813	2.0239	1.4226
No log	0.1818	12	1.9105	0.2261	1.9105	1.3822
No log	0.2121	14	2.1904	0.0800	2.1904	1.4800
No log	0.2424	16	2.7634	0.0	2.7634	1.6624
No log	0.2727	18	2.6287	-0.0133	2.6287	1.6213
No log	0.3030	20	2.3181	0.0280	2.3181	1.5225
No log	0.3333	22	2.1803	0.1061	2.1803	1.4766
No log	0.3636	24	2.2490	0.0455	2.2490	1.4997
No log	0.3939	26	2.1307	0.1008	2.1307	1.4597
No log	0.4242	28	2.0900	0.1636	2.0900	1.4457
No log	0.4545	30	2.0713	0.1636	2.0713	1.4392
No log	0.4848	32	2.0739	0.2018	2.0739	1.4401
No log	0.5152	34	2.0435	0.2000	2.0435	1.4295
No log	0.5455	36	1.8575	0.0962	1.8575	1.3629
No log	0.5758	38	1.7513	0.0396	1.7513	1.3234
No log	0.6061	40	1.7365	0.0396	1.7365	1.3178
No log	0.6364	42	1.9264	0.0374	1.9264	1.3880
No log	0.6667	44	2.3416	0.0	2.3416	1.5302
No log	0.6970	46	2.0199	0.1653	2.0199	1.4212
No log	0.7273	48	1.8213	0.1165	1.8214	1.3496
No log	0.7576	50	2.0038	0.0769	2.0038	1.4156
No log	0.7879	52	2.2632	-0.0164	2.2632	1.5044
No log	0.8182	54	2.3133	-0.0615	2.3133	1.5210
No log	0.8485	56	2.2435	-0.0163	2.2435	1.4978
No log	0.8788	58	2.2378	-0.0160	2.2378	1.4959
No log	0.9091	60	2.0994	0.1043	2.0994	1.4489
No log	0.9394	62	1.9474	0.1481	1.9474	1.3955
No log	0.9697	64	1.8762	0.1481	1.8762	1.3698
No log	1.0	66	1.8291	0.1651	1.8291	1.3524
No log	1.0303	68	1.9173	0.1930	1.9173	1.3847
No log	1.0606	70	2.0423	0.1719	2.0423	1.4291
No log	1.0909	72	1.7644	0.1835	1.7644	1.3283
No log	1.1212	74	1.5375	0.1121	1.5375	1.2400
No log	1.1515	76	1.4884	0.2000	1.4884	1.2200
No log	1.1818	78	1.4650	0.2000	1.4650	1.2104
No log	1.2121	80	1.8807	0.2290	1.8807	1.3714
No log	1.2424	82	2.3818	0.125	2.3818	1.5433
No log	1.2727	84	2.3276	0.1549	2.3276	1.5256
No log	1.3030	86	1.9022	0.2748	1.9022	1.3792
No log	1.3333	88	1.4506	0.25	1.4506	1.2044
No log	1.3636	90	1.3219	0.3333	1.3219	1.1497
No log	1.3939	92	1.2831	0.4103	1.2831	1.1328
No log	1.4242	94	1.2621	0.4628	1.2621	1.1234
No log	1.4545	96	1.2729	0.4590	1.2729	1.1282
No log	1.4848	98	1.2925	0.4677	1.2925	1.1369
No log	1.5152	100	1.3873	0.3248	1.3873	1.1778
No log	1.5455	102	1.6225	0.2203	1.6225	1.2738
No log	1.5758	104	1.6705	0.2645	1.6705	1.2925
No log	1.6061	106	1.4606	0.3833	1.4606	1.2085
No log	1.6364	108	1.4433	0.35	1.4433	1.2014
No log	1.6667	110	1.4566	0.3419	1.4566	1.2069
No log	1.6970	112	1.4506	0.3621	1.4506	1.2044
No log	1.7273	114	1.4804	0.3307	1.4804	1.2167
No log	1.7576	116	1.5520	0.3817	1.5520	1.2458
No log	1.7879	118	1.6336	0.3609	1.6336	1.2781
No log	1.8182	120	1.9054	0.2590	1.9054	1.3803
No log	1.8485	122	1.9115	0.2429	1.9115	1.3826
No log	1.8788	124	2.0370	0.2270	2.0370	1.4273
No log	1.9091	126	1.9552	0.2270	1.9552	1.3983
No log	1.9394	128	1.9594	0.2254	1.9594	1.3998
No log	1.9697	130	1.9544	0.2411	1.9544	1.3980
No log	2.0	132	1.8872	0.2143	1.8872	1.3737
No log	2.0303	134	1.6464	0.3433	1.6464	1.2831
No log	2.0606	136	1.4857	0.4202	1.4857	1.2189
No log	2.0909	138	1.4940	0.3478	1.4940	1.2223
No log	2.1212	140	1.5139	0.3252	1.5139	1.2304
No log	2.1515	142	1.7301	0.3433	1.7301	1.3153
No log	2.1818	144	2.2543	0.2222	2.2543	1.5014
No log	2.2121	146	2.4497	0.1389	2.4497	1.5652
No log	2.2424	148	2.3425	0.1655	2.3425	1.5305
No log	2.2727	150	2.0571	0.2958	2.0571	1.4342
No log	2.3030	152	1.8816	0.3022	1.8816	1.3717
No log	2.3333	154	1.9917	0.2857	1.9917	1.4113
No log	2.3636	156	2.2465	0.25	2.2465	1.4988
No log	2.3939	158	2.3780	0.1655	2.3780	1.5421
No log	2.4242	160	2.3838	0.1655	2.3838	1.5440
No log	2.4545	162	2.3908	0.1655	2.3908	1.5462
No log	2.4848	164	2.3210	0.1655	2.3210	1.5235
No log	2.5152	166	2.0342	0.2734	2.0342	1.4263
No log	2.5455	168	1.8816	0.3043	1.8816	1.3717
No log	2.5758	170	1.7800	0.3165	1.7800	1.3342
No log	2.6061	172	1.8607	0.2857	1.8607	1.3641
No log	2.6364	174	1.9054	0.2857	1.9054	1.3804
No log	2.6667	176	1.9396	0.3121	1.9396	1.3927
No log	2.6970	178	1.8220	0.3286	1.8220	1.3498
No log	2.7273	180	1.6141	0.2985	1.6141	1.2705
No log	2.7576	182	1.7962	0.3358	1.7962	1.3402
No log	2.7879	184	2.0778	0.2917	2.0778	1.4414
No log	2.8182	186	2.0226	0.2837	2.0226	1.4222
No log	2.8485	188	1.6418	0.3759	1.6418	1.2813
No log	2.8788	190	1.4133	0.35	1.4133	1.1888
No log	2.9091	192	1.4297	0.4194	1.4297	1.1957
No log	2.9394	194	1.4654	0.4	1.4654	1.2105
No log	2.9697	196	1.6845	0.3768	1.6845	1.2979
No log	3.0	198	2.0013	0.2286	2.0013	1.4147
No log	3.0303	200	2.0727	0.1831	2.0727	1.4397
No log	3.0606	202	1.9267	0.2917	1.9267	1.3880
No log	3.0909	204	1.7132	0.3571	1.7132	1.3089
No log	3.1212	206	1.7073	0.3571	1.7073	1.3066
No log	3.1515	208	1.8316	0.2464	1.8316	1.3534
No log	3.1818	210	1.8642	0.2143	1.8642	1.3653
No log	3.2121	212	1.9349	0.1831	1.9349	1.3910
No log	3.2424	214	1.8334	0.2464	1.8334	1.3540
No log	3.2727	216	1.7004	0.3382	1.7004	1.3040
No log	3.3030	218	1.6704	0.3650	1.6704	1.2924
No log	3.3333	220	1.9668	0.2254	1.9668	1.4024
No log	3.3636	222	2.0138	0.2254	2.0138	1.4191
No log	3.3939	224	1.8828	0.2714	1.8828	1.3722
No log	3.4242	226	1.8822	0.2714	1.8822	1.3719
No log	3.4545	228	1.8581	0.2446	1.8581	1.3631
No log	3.4848	230	1.7748	0.2769	1.7748	1.3322
No log	3.5152	232	1.7285	0.2791	1.7285	1.3147
No log	3.5455	234	1.7801	0.2687	1.7801	1.3342
No log	3.5758	236	1.9020	0.2714	1.9020	1.3791
No log	3.6061	238	2.0471	0.2254	2.0471	1.4308
No log	3.6364	240	1.8368	0.3143	1.8368	1.3553
No log	3.6667	242	1.6870	0.3358	1.6870	1.2989
No log	3.6970	244	1.8226	0.2958	1.8226	1.3500
No log	3.7273	246	2.1946	0.2098	2.1946	1.4814
No log	3.7576	248	2.2497	0.2083	2.2497	1.4999
No log	3.7879	250	2.2003	0.2083	2.2003	1.4833
No log	3.8182	252	2.0796	0.1944	2.0796	1.4421
No log	3.8485	254	1.8016	0.3212	1.8016	1.3422
No log	3.8788	256	1.5580	0.2975	1.5580	1.2482
No log	3.9091	258	1.5162	0.3361	1.5162	1.2313
No log	3.9394	260	1.5668	0.4094	1.5668	1.2517
No log	3.9697	262	1.6991	0.3676	1.6991	1.3035
No log	4.0	264	1.7877	0.3165	1.7877	1.3370
No log	4.0303	266	1.8897	0.3143	1.8897	1.3747
No log	4.0606	268	1.8715	0.3143	1.8715	1.3680
No log	4.0909	270	1.9134	0.3143	1.9134	1.3833
No log	4.1212	272	1.9166	0.2878	1.9166	1.3844
No log	4.1515	274	1.6746	0.3066	1.6746	1.2940
No log	4.1818	276	1.5765	0.3385	1.5765	1.2556
No log	4.2121	278	1.6254	0.3881	1.6254	1.2749
No log	4.2424	280	1.7277	0.2609	1.7277	1.3144
No log	4.2727	282	1.8324	0.2000	1.8324	1.3536
No log	4.3030	284	1.9339	0.2000	1.9339	1.3907
No log	4.3333	286	2.0096	0.1844	2.0096	1.4176
No log	4.3636	288	2.2184	0.1678	2.2184	1.4894
No log	4.3939	290	2.1803	0.1678	2.1803	1.4766
No log	4.4242	292	2.0042	0.1958	2.0042	1.4157
No log	4.4545	294	1.7573	0.3165	1.7573	1.3256
No log	4.4848	296	1.5464	0.4091	1.5464	1.2435
No log	4.5152	298	1.5045	0.4762	1.5045	1.2266
No log	4.5455	300	1.5802	0.4252	1.5802	1.2571
No log	4.5758	302	1.5834	0.3721	1.5834	1.2583
No log	4.6061	304	1.6194	0.3511	1.6194	1.2726
No log	4.6364	306	1.6484	0.3459	1.6484	1.2839
No log	4.6667	308	1.5743	0.3636	1.5743	1.2547
No log	4.6970	310	1.4520	0.4480	1.4520	1.2050
No log	4.7273	312	1.3792	0.4463	1.3792	1.1744
No log	4.7576	314	1.3977	0.4167	1.3977	1.1822
No log	4.7879	316	1.4625	0.4444	1.4625	1.2094
No log	4.8182	318	1.6690	0.3235	1.6690	1.2919
No log	4.8485	320	1.7495	0.3043	1.7495	1.3227
No log	4.8788	322	1.6449	0.3407	1.6449	1.2825
No log	4.9091	324	1.5971	0.3511	1.5971	1.2638
No log	4.9394	326	1.5434	0.4154	1.5434	1.2423
No log	4.9697	328	1.6448	0.3158	1.6448	1.2825
No log	5.0	330	1.9388	0.2553	1.9388	1.3924
No log	5.0303	332	1.9812	0.2286	1.9812	1.4076
No log	5.0606	334	1.7775	0.3235	1.7775	1.3332
No log	5.0909	336	1.7088	0.375	1.7088	1.3072
No log	5.1212	338	1.7731	0.2985	1.7731	1.3316
No log	5.1515	340	1.8421	0.2734	1.8421	1.3572
No log	5.1818	342	1.9608	0.2254	1.9608	1.4003
No log	5.2121	344	1.8885	0.2270	1.8885	1.3742
No log	5.2424	346	1.6803	0.3188	1.6803	1.2963
No log	5.2727	348	1.6438	0.3407	1.6438	1.2821
No log	5.3030	350	1.7921	0.2695	1.7921	1.3387
No log	5.3333	352	1.8745	0.2270	1.8745	1.3691
No log	5.3636	354	1.8282	0.2270	1.8282	1.3521
No log	5.3939	356	1.8174	0.2429	1.8174	1.3481
No log	5.4242	358	1.8103	0.2429	1.8103	1.3455
No log	5.4545	360	1.9317	0.2270	1.9317	1.3898
No log	5.4848	362	2.0090	0.2254	2.0090	1.4174
No log	5.5152	364	2.1196	0.2254	2.1196	1.4559
No log	5.5455	366	2.2822	0.1818	2.2822	1.5107
No log	5.5758	368	2.1845	0.2254	2.1845	1.4780
No log	5.6061	370	2.0290	0.2254	2.0290	1.4244
No log	5.6364	372	1.9998	0.2254	1.9998	1.4141
No log	5.6667	374	2.0130	0.2254	2.0130	1.4188
No log	5.6970	376	1.9947	0.2254	1.9947	1.4124
No log	5.7273	378	1.8157	0.2482	1.8157	1.3475
No log	5.7576	380	1.7562	0.2815	1.7562	1.3252
No log	5.7879	382	1.8004	0.2734	1.8004	1.3418
No log	5.8182	384	1.7911	0.2734	1.7911	1.3383
No log	5.8485	386	1.6885	0.2985	1.6885	1.2994
No log	5.8788	388	1.5751	0.3937	1.5751	1.2550
No log	5.9091	390	1.6803	0.3066	1.6803	1.2963
No log	5.9394	392	2.0024	0.2254	2.0024	1.4151
No log	5.9697	394	2.1358	0.2238	2.1358	1.4615
No log	6.0	396	2.1950	0.1818	2.1950	1.4815
No log	6.0303	398	1.9416	0.2254	1.9416	1.3934
No log	6.0606	400	1.6342	0.3066	1.6342	1.2784
No log	6.0909	402	1.4727	0.4186	1.4727	1.2136
No log	6.1212	404	1.4165	0.4724	1.4165	1.1902
No log	6.1515	406	1.4560	0.4724	1.4560	1.2067
No log	6.1818	408	1.5622	0.4	1.5622	1.2499
No log	6.2121	410	1.7285	0.2734	1.7285	1.3147
No log	6.2424	412	1.7627	0.2714	1.7627	1.3277
No log	6.2727	414	1.6832	0.3212	1.6832	1.2974
No log	6.3030	416	1.5406	0.3676	1.5406	1.2412
No log	6.3333	418	1.5451	0.3796	1.5451	1.2430
No log	6.3636	420	1.7658	0.2837	1.7658	1.3289
No log	6.3939	422	2.0222	0.2394	2.0222	1.4220
No log	6.4242	424	2.1052	0.2394	2.1052	1.4509
No log	6.4545	426	1.9486	0.2394	1.9486	1.3959
No log	6.4848	428	1.8061	0.2754	1.8061	1.3439
No log	6.5152	430	1.7298	0.2556	1.7298	1.3152
No log	6.5455	432	1.7528	0.2556	1.7528	1.3239
No log	6.5758	434	1.9424	0.2553	1.9424	1.3937
No log	6.6061	436	2.0222	0.2394	2.0222	1.4220
No log	6.6364	438	1.9859	0.2394	1.9859	1.4092
No log	6.6667	440	1.9034	0.2553	1.9034	1.3797
No log	6.6970	442	1.7760	0.2734	1.7760	1.3327
No log	6.7273	444	1.7458	0.2920	1.7458	1.3213
No log	6.7576	446	1.8090	0.2553	1.8090	1.3450
No log	6.7879	448	1.8609	0.2553	1.8609	1.3642
No log	6.8182	450	1.8325	0.2553	1.8325	1.3537
No log	6.8485	452	1.8431	0.2553	1.8431	1.3576
No log	6.8788	454	1.8519	0.2553	1.8519	1.3609
No log	6.9091	456	1.7629	0.2553	1.7629	1.3277
No log	6.9394	458	1.7452	0.2714	1.7452	1.3211
No log	6.9697	460	1.6833	0.2878	1.6833	1.2974
No log	7.0	462	1.6041	0.3731	1.6041	1.2665
No log	7.0303	464	1.5435	0.3910	1.5435	1.2424
No log	7.0606	466	1.5803	0.3910	1.5803	1.2571
No log	7.0909	468	1.7500	0.2714	1.7500	1.3229
No log	7.1212	470	1.9309	0.2553	1.9309	1.3896
No log	7.1515	472	1.9411	0.2098	1.9411	1.3932
No log	7.1818	474	1.8120	0.2254	1.8120	1.3461
No log	7.2121	476	1.6986	0.2590	1.6986	1.3033
No log	7.2424	478	1.6149	0.3066	1.6149	1.2708
No log	7.2727	480	1.6462	0.3066	1.6462	1.2830
No log	7.3030	482	1.8047	0.2695	1.8047	1.3434
No log	7.3333	484	1.8448	0.2695	1.8448	1.3582
No log	7.3636	486	1.7197	0.3043	1.7197	1.3114
No log	7.3939	488	1.7625	0.2714	1.7625	1.3276
No log	7.4242	490	1.9312	0.2098	1.9312	1.3897
No log	7.4545	492	1.8298	0.2254	1.8298	1.3527
No log	7.4848	494	1.5672	0.3382	1.5672	1.2519
No log	7.5152	496	1.4659	0.4688	1.4659	1.2107
No log	7.5455	498	1.5322	0.4122	1.5322	1.2378
0.4862	7.5758	500	1.5646	0.3788	1.5646	1.2508
0.4862	7.6061	502	1.6920	0.2899	1.6920	1.3008
0.4862	7.6364	504	1.7995	0.2270	1.7995	1.3415
0.4862	7.6667	506	1.8202	0.2270	1.8202	1.3492
0.4862	7.6970	508	1.8010	0.2270	1.8010	1.3420
0.4862	7.7273	510	1.7627	0.2270	1.7627	1.3277

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1