ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8841
• Qwk: 0.3022
• Mse: 1.8841
• Rmse: 1.3726

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	6.7739	0.0239	6.7739	2.6027
No log	0.1538	4	3.9339	0.0721	3.9339	1.9834
No log	0.2308	6	2.8862	0.0617	2.8862	1.6989
No log	0.3077	8	3.5908	0.0619	3.5908	1.8949
No log	0.3846	10	3.7058	0.1068	3.7058	1.9251
No log	0.4615	12	2.2374	0.1295	2.2374	1.4958
No log	0.5385	14	2.0390	0.1440	2.0390	1.4279
No log	0.6154	16	2.3979	0.0563	2.3979	1.5485
No log	0.6923	18	2.3854	0.0423	2.3854	1.5445
No log	0.7692	20	2.0153	0.2295	2.0153	1.4196
No log	0.8462	22	1.6866	0.2222	1.6866	1.2987
No log	0.9231	24	1.6411	0.2342	1.6411	1.2810
No log	1.0	26	1.7377	0.1786	1.7377	1.3182
No log	1.0769	28	1.8674	0.1552	1.8674	1.3665
No log	1.1538	30	1.7517	0.1651	1.7517	1.3235
No log	1.2308	32	1.8220	0.2679	1.8220	1.3498
No log	1.3077	34	1.8921	0.2632	1.8921	1.3755
No log	1.3846	36	2.0424	0.1985	2.0424	1.4291
No log	1.4615	38	1.9775	0.1905	1.9775	1.4062
No log	1.5385	40	1.9406	0.2080	1.9406	1.3931
No log	1.6154	42	1.8982	0.2439	1.8982	1.3777
No log	1.6923	44	1.8198	0.2439	1.8198	1.3490
No log	1.7692	46	1.6593	0.2542	1.6593	1.2881
No log	1.8462	48	1.6205	0.2564	1.6205	1.2730
No log	1.9231	50	1.4858	0.2655	1.4858	1.2189
No log	2.0	52	1.4736	0.2679	1.4736	1.2139
No log	2.0769	54	1.5361	0.3103	1.5361	1.2394
No log	2.1538	56	1.5846	0.3577	1.5846	1.2588
No log	2.2308	58	1.4752	0.3607	1.4752	1.2146
No log	2.3077	60	1.4045	0.3103	1.4045	1.1851
No log	2.3846	62	1.3583	0.3333	1.3583	1.1655
No log	2.4615	64	1.3750	0.4615	1.3750	1.1726
No log	2.5385	66	1.4053	0.4034	1.4053	1.1855
No log	2.6154	68	1.4036	0.4127	1.4036	1.1847
No log	2.6923	70	1.4275	0.4308	1.4275	1.1948
No log	2.7692	72	1.2864	0.4923	1.2864	1.1342
No log	2.8462	74	1.1274	0.5124	1.1274	1.0618
No log	2.9231	76	1.1642	0.5167	1.1642	1.0790
No log	3.0	78	1.3349	0.4762	1.3349	1.1554
No log	3.0769	80	1.4720	0.3692	1.4720	1.2133
No log	3.1538	82	1.4531	0.3876	1.4531	1.2055
No log	3.2308	84	1.3524	0.4553	1.3524	1.1629
No log	3.3077	86	1.3841	0.4274	1.3841	1.1765
No log	3.3846	88	1.3705	0.4174	1.3705	1.1707
No log	3.4615	90	1.3295	0.3860	1.3295	1.1530
No log	3.5385	92	1.2862	0.3860	1.2862	1.1341
No log	3.6154	94	1.2739	0.4615	1.2739	1.1287
No log	3.6923	96	1.3024	0.5041	1.3024	1.1412
No log	3.7692	98	1.4071	0.4228	1.4071	1.1862
No log	3.8462	100	1.5704	0.3307	1.5704	1.2532
No log	3.9231	102	1.5990	0.3281	1.5990	1.2645
No log	4.0	104	1.5294	0.3846	1.5294	1.2367
No log	4.0769	106	1.4169	0.3937	1.4169	1.1903
No log	4.1538	108	1.5238	0.3206	1.5238	1.2344
No log	4.2308	110	1.7873	0.2537	1.7873	1.3369
No log	4.3077	112	1.8655	0.2090	1.8655	1.3658
No log	4.3846	114	1.7790	0.2615	1.7790	1.3338
No log	4.4615	116	1.6686	0.2880	1.6686	1.2918
No log	4.5385	118	1.4913	0.3664	1.4913	1.2212
No log	4.6154	120	1.4286	0.4234	1.4286	1.1952
No log	4.6923	122	1.6065	0.3597	1.6065	1.2675
No log	4.7692	124	1.7868	0.3217	1.7868	1.3367
No log	4.8462	126	2.0078	0.2817	2.0078	1.4170
No log	4.9231	128	2.0260	0.2714	2.0260	1.4234
No log	5.0	130	1.9899	0.2302	1.9899	1.4106
No log	5.0769	132	2.0154	0.2411	2.0154	1.4197
No log	5.1538	134	1.8572	0.2920	1.8572	1.3628
No log	5.2308	136	1.6582	0.3111	1.6582	1.2877
No log	5.3077	138	1.5245	0.4030	1.5245	1.2347
No log	5.3846	140	1.5370	0.3852	1.5370	1.2398
No log	5.4615	142	1.7100	0.3309	1.7100	1.3077
No log	5.5385	144	1.7260	0.3309	1.7260	1.3138
No log	5.6154	146	1.7956	0.3309	1.7956	1.3400
No log	5.6923	148	1.8817	0.2878	1.8817	1.3718
No log	5.7692	150	1.9356	0.2714	1.9356	1.3912
No log	5.8462	152	1.7042	0.3636	1.7042	1.3054
No log	5.9231	154	1.6696	0.3692	1.6696	1.2921
No log	6.0	156	1.8228	0.2920	1.8228	1.3501
No log	6.0769	158	2.0632	0.1844	2.0632	1.4364
No log	6.1538	160	2.1209	0.1678	2.1209	1.4563
No log	6.2308	162	1.8451	0.3143	1.8451	1.3584
No log	6.3077	164	1.6900	0.3582	1.6900	1.3000
No log	6.3846	166	1.7012	0.3704	1.7012	1.3043
No log	6.4615	168	1.8230	0.3000	1.8230	1.3502
No log	6.5385	170	2.1150	0.1944	2.1150	1.4543
No log	6.6154	172	2.2298	0.1944	2.2298	1.4933
No log	6.6923	174	2.0289	0.2394	2.0289	1.4244
No log	6.7692	176	1.7537	0.3333	1.7537	1.3243
No log	6.8462	178	1.7324	0.3259	1.7324	1.3162
No log	6.9231	180	1.8480	0.2899	1.8480	1.3594
No log	7.0	182	2.0008	0.2695	2.0008	1.4145
No log	7.0769	184	2.0063	0.2394	2.0063	1.4164
No log	7.1538	186	1.8978	0.2857	1.8978	1.3776
No log	7.2308	188	1.7636	0.3358	1.7636	1.3280
No log	7.3077	190	1.6640	0.3788	1.6640	1.2900
No log	7.3846	192	1.7515	0.3731	1.7515	1.3234
No log	7.4615	194	1.9271	0.2239	1.9271	1.3882
No log	7.5385	196	1.9446	0.2362	1.9446	1.3945
No log	7.6154	198	1.8849	0.2362	1.8849	1.3729
No log	7.6923	200	1.8079	0.2540	1.8079	1.3446
No log	7.7692	202	1.7705	0.2969	1.7705	1.3306
No log	7.8462	204	1.6833	0.3622	1.6833	1.2974
No log	7.9231	206	1.6406	0.3846	1.6406	1.2809
No log	8.0	208	1.6829	0.3692	1.6829	1.2973
No log	8.0769	210	1.7117	0.3407	1.7117	1.3083
No log	8.1538	212	1.7277	0.3407	1.7277	1.3144
No log	8.2308	214	1.6755	0.3433	1.6755	1.2944
No log	8.3077	216	1.7749	0.3066	1.7749	1.3322
No log	8.3846	218	1.7631	0.3088	1.7631	1.3278
No log	8.4615	220	1.7295	0.3284	1.7295	1.3151
No log	8.5385	222	1.5965	0.3910	1.5965	1.2635
No log	8.6154	224	1.4538	0.4444	1.4538	1.2057
No log	8.6923	226	1.4472	0.4444	1.4472	1.2030
No log	8.7692	228	1.5561	0.4242	1.5561	1.2474
No log	8.8462	230	1.8011	0.3088	1.8011	1.3420
No log	8.9231	232	2.0131	0.1831	2.0131	1.4188
No log	9.0	234	1.9515	0.2754	1.9515	1.3970
No log	9.0769	236	1.6959	0.3556	1.6959	1.3023
No log	9.1538	238	1.5561	0.4211	1.5561	1.2474
No log	9.2308	240	1.5741	0.3939	1.5741	1.2546
No log	9.3077	242	1.7222	0.3478	1.7222	1.3123
No log	9.3846	244	1.7806	0.3022	1.7806	1.3344
No log	9.4615	246	1.6825	0.3478	1.6825	1.2971
No log	9.5385	248	1.6486	0.3504	1.6486	1.2840
No log	9.6154	250	1.7355	0.3165	1.7355	1.3174
No log	9.6923	252	1.6974	0.3358	1.6974	1.3029
No log	9.7692	254	1.6473	0.3182	1.6473	1.2835
No log	9.8462	256	1.5926	0.3788	1.5926	1.2620
No log	9.9231	258	1.7060	0.3650	1.7060	1.3061
No log	10.0	260	1.8986	0.3429	1.8986	1.3779
No log	10.0769	262	1.9568	0.3077	1.9568	1.3988
No log	10.1538	264	1.8088	0.3239	1.8088	1.3449
No log	10.2308	266	1.8144	0.2979	1.8144	1.3470
No log	10.3077	268	1.9554	0.2714	1.9554	1.3984
No log	10.3846	270	2.1159	0.1831	2.1159	1.4546
No log	10.4615	272	2.0198	0.2714	2.0198	1.4212
No log	10.5385	274	1.8308	0.3212	1.8308	1.3531
No log	10.6154	276	1.6505	0.3284	1.6505	1.2847
No log	10.6923	278	1.6885	0.3529	1.6885	1.2994
No log	10.7692	280	1.9771	0.2411	1.9771	1.4061
No log	10.8462	282	2.3899	0.1370	2.3899	1.5459
No log	10.9231	284	2.4483	0.1370	2.4483	1.5647
No log	11.0	286	2.1569	0.1958	2.1569	1.4686
No log	11.0769	288	1.6902	0.3676	1.6902	1.3001
No log	11.1538	290	1.5076	0.4308	1.5076	1.2279
No log	11.2308	292	1.5822	0.4	1.5822	1.2578
No log	11.3077	294	1.8807	0.2857	1.8807	1.3714
No log	11.3846	296	2.1840	0.2098	2.1840	1.4778
No log	11.4615	298	2.3075	0.1944	2.3075	1.5191
No log	11.5385	300	2.2195	0.1944	2.2195	1.4898
No log	11.6154	302	2.0974	0.2553	2.0974	1.4482
No log	11.6923	304	2.0834	0.2553	2.0834	1.4434
No log	11.7692	306	2.0451	0.2778	2.0451	1.4301
No log	11.8462	308	1.8547	0.3286	1.8547	1.3619
No log	11.9231	310	1.8530	0.3022	1.8530	1.3613
No log	12.0	312	2.0421	0.2553	2.0421	1.4290
No log	12.0769	314	2.0801	0.2394	2.0801	1.4423
No log	12.1538	316	1.9876	0.2857	1.9876	1.4098
No log	12.2308	318	1.7105	0.3022	1.7105	1.3079
No log	12.3077	320	1.6141	0.3796	1.6141	1.2705
No log	12.3846	322	1.6267	0.3796	1.6267	1.2754
No log	12.4615	324	1.7970	0.3022	1.7970	1.3405
No log	12.5385	326	2.0557	0.2098	2.0557	1.4338
No log	12.6154	328	2.0505	0.2098	2.0505	1.4320
No log	12.6923	330	1.9427	0.2394	1.9427	1.3938
No log	12.7692	332	1.7743	0.3597	1.7743	1.3320
No log	12.8462	334	1.6548	0.3768	1.6548	1.2864
No log	12.9231	336	1.7022	0.3597	1.7022	1.3047
No log	13.0	338	1.8374	0.3286	1.8374	1.3555
No log	13.0769	340	1.9343	0.2394	1.9343	1.3908
No log	13.1538	342	2.1215	0.2394	2.1215	1.4565
No log	13.2308	344	2.1798	0.1655	2.1798	1.4764
No log	13.3077	346	2.0230	0.2553	2.0230	1.4223
No log	13.3846	348	1.8649	0.2857	1.8649	1.3656
No log	13.4615	350	1.7784	0.2857	1.7784	1.3336
No log	13.5385	352	1.8438	0.2857	1.8438	1.3579
No log	13.6154	354	1.8461	0.2857	1.8461	1.3587
No log	13.6923	356	1.7954	0.2857	1.7954	1.3399
No log	13.7692	358	1.7122	0.3043	1.7122	1.3085
No log	13.8462	360	1.6630	0.3824	1.6630	1.2896
No log	13.9231	362	1.6742	0.3796	1.6742	1.2939
No log	14.0	364	1.7593	0.3143	1.7593	1.3264
No log	14.0769	366	1.8276	0.3121	1.8276	1.3519
No log	14.1538	368	1.7258	0.3165	1.7258	1.3137
No log	14.2308	370	1.6135	0.4	1.6135	1.2702
No log	14.3077	372	1.5226	0.4444	1.5226	1.2339
No log	14.3846	374	1.5884	0.4265	1.5884	1.2603
No log	14.4615	376	1.7271	0.3143	1.7271	1.3142
No log	14.5385	378	1.6286	0.3796	1.6286	1.2762
No log	14.6154	380	1.6170	0.3796	1.6170	1.2716
No log	14.6923	382	1.5293	0.3971	1.5293	1.2366
No log	14.7692	384	1.5146	0.3910	1.5146	1.2307
No log	14.8462	386	1.6174	0.3382	1.6174	1.2718
No log	14.9231	388	1.8390	0.3239	1.8390	1.3561
No log	15.0	390	2.0035	0.3239	2.0035	1.4155
No log	15.0769	392	1.8991	0.3022	1.8991	1.3781
No log	15.1538	394	1.7131	0.3188	1.7131	1.3089
No log	15.2308	396	1.7418	0.3188	1.7418	1.3198
No log	15.3077	398	1.7452	0.3188	1.7452	1.3211
No log	15.3846	400	1.7948	0.3188	1.7948	1.3397
No log	15.4615	402	1.7462	0.3453	1.7462	1.3214
No log	15.5385	404	1.7083	0.3453	1.7083	1.3070
No log	15.6154	406	1.7121	0.3453	1.7121	1.3085
No log	15.6923	408	1.6163	0.4058	1.6163	1.2713
No log	15.7692	410	1.5847	0.4058	1.5847	1.2588
No log	15.8462	412	1.5691	0.4029	1.5691	1.2526
No log	15.9231	414	1.7579	0.3453	1.7579	1.3258
No log	16.0	416	1.9868	0.3286	1.9868	1.4095
No log	16.0769	418	2.0390	0.3286	2.0390	1.4279
No log	16.1538	420	1.8356	0.3286	1.8356	1.3548
No log	16.2308	422	1.5905	0.4118	1.5905	1.2611
No log	16.3077	424	1.4942	0.4444	1.4942	1.2224
No log	16.3846	426	1.6006	0.3768	1.6006	1.2652
No log	16.4615	428	1.8784	0.3286	1.8784	1.3706
No log	16.5385	430	2.1856	0.2500	2.1856	1.4784
No log	16.6154	432	2.3265	0.1644	2.3265	1.5253
No log	16.6923	434	2.2209	0.1644	2.2209	1.4903
No log	16.7692	436	2.0014	0.3121	2.0014	1.4147
No log	16.8462	438	1.8131	0.3453	1.8131	1.3465
No log	16.9231	440	1.6905	0.3768	1.6905	1.3002
No log	17.0	442	1.6761	0.3796	1.6761	1.2946
No log	17.0769	444	1.7323	0.3504	1.7323	1.3162
No log	17.1538	446	1.8610	0.3022	1.8610	1.3642
No log	17.2308	448	1.9812	0.3022	1.9812	1.4076
No log	17.3077	450	2.0735	0.2553	2.0735	1.4400
No log	17.3846	452	2.0163	0.3022	2.0163	1.4200
No log	17.4615	454	1.8003	0.3212	1.8003	1.3418
No log	17.5385	456	1.5872	0.3433	1.5872	1.2598
No log	17.6154	458	1.5753	0.3609	1.5753	1.2551
No log	17.6923	460	1.7168	0.3212	1.7168	1.3103
No log	17.7692	462	1.9232	0.3022	1.9232	1.3868
No log	17.8462	464	1.9394	0.3022	1.9394	1.3926
No log	17.9231	466	1.8084	0.3043	1.8084	1.3448
No log	18.0	468	1.6395	0.3212	1.6395	1.2804
No log	18.0769	470	1.5952	0.3504	1.5952	1.2630
No log	18.1538	472	1.6505	0.3478	1.6505	1.2847
No log	18.2308	474	1.7976	0.3043	1.7976	1.3407
No log	18.3077	476	2.0171	0.2857	2.0171	1.4202
No log	18.3846	478	2.1173	0.2238	2.1173	1.4551
No log	18.4615	480	2.0101	0.2857	2.0101	1.4178
No log	18.5385	482	1.7308	0.3286	1.7308	1.3156
No log	18.6154	484	1.5148	0.4234	1.5148	1.2308
No log	18.6923	486	1.4021	0.4885	1.4021	1.1841
No log	18.7692	488	1.4510	0.4148	1.4510	1.2046
No log	18.8462	490	1.6016	0.3478	1.6016	1.2655
No log	18.9231	492	1.8735	0.3043	1.8735	1.3688
No log	19.0	494	2.1245	0.2238	2.1245	1.4576
No log	19.0769	496	2.1759	0.2238	2.1759	1.4751
No log	19.1538	498	2.0535	0.2857	2.0535	1.4330
0.3891	19.2308	500	1.9105	0.3309	1.9105	1.3822
0.3891	19.3077	502	1.6852	0.3333	1.6852	1.2982
0.3891	19.3846	504	1.6160	0.3650	1.6160	1.2712
0.3891	19.4615	506	1.7034	0.3309	1.7034	1.3052
0.3891	19.5385	508	1.8560	0.3286	1.8560	1.3624
0.3891	19.6154	510	1.9465	0.3022	1.9465	1.3952
0.3891	19.6923	512	1.9839	0.3022	1.9839	1.4085
0.3891	19.7692	514	1.8841	0.3022	1.8841	1.3726

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1