ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k4_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9894
• Qwk: 0.2879
• Mse: 0.9894
• Rmse: 0.9947

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.0397	0.0130	4.0397	2.0099
No log	0.2222	4	2.2451	0.0093	2.2451	1.4984
No log	0.3333	6	1.6097	0.0958	1.6097	1.2688
No log	0.4444	8	1.2168	0.1725	1.2168	1.1031
No log	0.5556	10	1.1961	0.0741	1.1961	1.0937
No log	0.6667	12	1.1835	0.1675	1.1835	1.0879
No log	0.7778	14	1.1594	0.1918	1.1594	1.0768
No log	0.8889	16	1.1410	0.1573	1.1410	1.0682
No log	1.0	18	1.1779	0.3352	1.1779	1.0853
No log	1.1111	20	1.3286	0.2515	1.3286	1.1526
No log	1.2222	22	1.5540	0.1989	1.5540	1.2466
No log	1.3333	24	1.7438	0.1628	1.7438	1.3205
No log	1.4444	26	1.2049	0.3069	1.2049	1.0977
No log	1.5556	28	0.9959	0.3266	0.9959	0.9979
No log	1.6667	30	0.9924	0.2667	0.9924	0.9962
No log	1.7778	32	1.0066	0.1585	1.0066	1.0033
No log	1.8889	34	1.0656	0.2693	1.0656	1.0323
No log	2.0	36	1.0938	0.3835	1.0938	1.0459
No log	2.1111	38	1.0799	0.3741	1.0799	1.0392
No log	2.2222	40	1.1146	0.3727	1.1146	1.0558
No log	2.3333	42	1.2662	0.2087	1.2662	1.1253
No log	2.4444	44	1.6048	0.2060	1.6048	1.2668
No log	2.5556	46	1.7842	0.1187	1.7842	1.3357
No log	2.6667	48	1.4857	0.2060	1.4857	1.2189
No log	2.7778	50	1.1576	0.2647	1.1576	1.0759
No log	2.8889	52	1.0826	0.3495	1.0826	1.0405
No log	3.0	54	1.2076	0.2716	1.2076	1.0989
No log	3.1111	56	1.3298	0.2169	1.3298	1.1532
No log	3.2222	58	1.3234	0.2120	1.3234	1.1504
No log	3.3333	60	1.3951	0.1518	1.3951	1.1812
No log	3.4444	62	1.5050	0.1993	1.5050	1.2268
No log	3.5556	64	1.7182	0.2664	1.7182	1.3108
No log	3.6667	66	1.7522	0.2755	1.7522	1.3237
No log	3.7778	68	1.6499	0.2354	1.6499	1.2845
No log	3.8889	70	1.4691	0.2235	1.4691	1.2121
No log	4.0	72	1.5635	0.1760	1.5635	1.2504
No log	4.1111	74	1.5054	0.1736	1.5054	1.2269
No log	4.2222	76	1.4898	0.1647	1.4898	1.2206
No log	4.3333	78	1.4729	0.1846	1.4729	1.2136
No log	4.4444	80	1.8197	0.1465	1.8197	1.3490
No log	4.5556	82	2.6220	0.1349	2.6220	1.6193
No log	4.6667	84	2.6616	0.1283	2.6616	1.6315
No log	4.7778	86	1.8845	0.1698	1.8845	1.3728
No log	4.8889	88	1.3446	0.2174	1.3446	1.1596
No log	5.0	90	1.2172	0.2583	1.2172	1.1033
No log	5.1111	92	1.1679	0.2463	1.1679	1.0807
No log	5.2222	94	1.2293	0.2754	1.2293	1.1087
No log	5.3333	96	1.2739	0.2958	1.2739	1.1287
No log	5.4444	98	1.2357	0.2731	1.2357	1.1116
No log	5.5556	100	1.1652	0.2221	1.1652	1.0794
No log	5.6667	102	1.1288	0.2347	1.1288	1.0625
No log	5.7778	104	1.1859	0.2543	1.1859	1.0890
No log	5.8889	106	1.3475	0.3090	1.3475	1.1608
No log	6.0	108	1.4666	0.3090	1.4666	1.2110
No log	6.1111	110	1.4349	0.3090	1.4349	1.1979
No log	6.2222	112	1.3623	0.3045	1.3623	1.1672
No log	6.3333	114	1.4400	0.2728	1.4400	1.2000
No log	6.4444	116	1.4419	0.2763	1.4419	1.2008
No log	6.5556	118	1.2191	0.3165	1.2191	1.1041
No log	6.6667	120	1.0960	0.2657	1.0960	1.0469
No log	6.7778	122	1.0782	0.4328	1.0782	1.0384
No log	6.8889	124	1.0470	0.4094	1.0470	1.0232
No log	7.0	126	0.9815	0.4232	0.9815	0.9907
No log	7.1111	128	0.9819	0.4154	0.9819	0.9909
No log	7.2222	130	1.0037	0.3973	1.0037	1.0019
No log	7.3333	132	1.0038	0.3707	1.0038	1.0019
No log	7.4444	134	1.0207	0.3628	1.0207	1.0103
No log	7.5556	136	1.0728	0.4230	1.0728	1.0358
No log	7.6667	138	1.0774	0.4331	1.0774	1.0380
No log	7.7778	140	1.0266	0.3968	1.0266	1.0132
No log	7.8889	142	1.0130	0.4102	1.0130	1.0065
No log	8.0	144	1.0000	0.3840	1.0000	1.0000
No log	8.1111	146	0.9750	0.3804	0.9750	0.9874
No log	8.2222	148	0.9623	0.3437	0.9623	0.9810
No log	8.3333	150	0.9602	0.3437	0.9602	0.9799
No log	8.4444	152	0.9310	0.4197	0.9310	0.9649
No log	8.5556	154	0.9438	0.4197	0.9438	0.9715
No log	8.6667	156	0.9458	0.3223	0.9458	0.9725
No log	8.7778	158	0.9243	0.3030	0.9243	0.9614
No log	8.8889	160	0.9178	0.4065	0.9178	0.9580
No log	9.0	162	0.9449	0.4517	0.9449	0.9720
No log	9.1111	164	0.9736	0.3819	0.9736	0.9867
No log	9.2222	166	0.9867	0.3902	0.9867	0.9933
No log	9.3333	168	0.9795	0.3966	0.9795	0.9897
No log	9.4444	170	1.0152	0.3035	1.0152	1.0076
No log	9.5556	172	1.0321	0.2447	1.0321	1.0159
No log	9.6667	174	1.0110	0.3855	1.0110	1.0055
No log	9.7778	176	1.0095	0.3424	1.0095	1.0047
No log	9.8889	178	1.0163	0.3853	1.0163	1.0081
No log	10.0	180	1.0076	0.3561	1.0076	1.0038
No log	10.1111	182	1.0138	0.3682	1.0138	1.0069
No log	10.2222	184	1.0700	0.3260	1.0700	1.0344
No log	10.3333	186	1.1646	0.3893	1.1646	1.0792
No log	10.4444	188	1.0837	0.3848	1.0837	1.0410
No log	10.5556	190	0.9230	0.4242	0.9230	0.9608
No log	10.6667	192	0.9709	0.3701	0.9709	0.9853
No log	10.7778	194	1.1077	0.3913	1.1077	1.0525
No log	10.8889	196	1.1539	0.3453	1.1539	1.0742
No log	11.0	198	1.0861	0.3654	1.0861	1.0422
No log	11.1111	200	0.9867	0.375	0.9867	0.9933
No log	11.2222	202	0.9574	0.3097	0.9574	0.9785
No log	11.3333	204	1.0722	0.3784	1.0722	1.0355
No log	11.4444	206	1.1429	0.3590	1.1429	1.0691
No log	11.5556	208	1.0598	0.4176	1.0598	1.0295
No log	11.6667	210	1.0054	0.3820	1.0054	1.0027
No log	11.7778	212	1.0176	0.3947	1.0176	1.0088
No log	11.8889	214	1.0727	0.4215	1.0727	1.0357
No log	12.0	216	1.0894	0.3991	1.0894	1.0437
No log	12.1111	218	1.0527	0.3777	1.0527	1.0260
No log	12.2222	220	1.0202	0.3739	1.0202	1.0100
No log	12.3333	222	1.0116	0.3367	1.0116	1.0058
No log	12.4444	224	1.0344	0.3498	1.0344	1.0171
No log	12.5556	226	1.0328	0.3250	1.0328	1.0163
No log	12.6667	228	1.0570	0.2833	1.0570	1.0281
No log	12.7778	230	1.0658	0.3883	1.0658	1.0324
No log	12.8889	232	1.0523	0.3992	1.0523	1.0258
No log	13.0	234	1.0121	0.3740	1.0121	1.0061
No log	13.1111	236	1.0193	0.3305	1.0193	1.0096
No log	13.2222	238	1.0771	0.3466	1.0771	1.0378
No log	13.3333	240	1.0713	0.3123	1.0713	1.0350
No log	13.4444	242	1.0476	0.3310	1.0476	1.0235
No log	13.5556	244	1.0269	0.2565	1.0269	1.0134
No log	13.6667	246	1.0521	0.2529	1.0521	1.0257
No log	13.7778	248	1.0927	0.3348	1.0927	1.0453
No log	13.8889	250	1.1225	0.3265	1.1225	1.0595
No log	14.0	252	1.0852	0.2698	1.0852	1.0418
No log	14.1111	254	1.0682	0.2838	1.0682	1.0335
No log	14.2222	256	1.0399	0.2969	1.0399	1.0197
No log	14.3333	258	1.0187	0.2969	1.0187	1.0093
No log	14.4444	260	1.0112	0.2969	1.0112	1.0056
No log	14.5556	262	1.0175	0.2969	1.0175	1.0087
No log	14.6667	264	1.0222	0.2546	1.0222	1.0110
No log	14.7778	266	1.0705	0.2912	1.0705	1.0346
No log	14.8889	268	1.1316	0.3016	1.1316	1.0638
No log	15.0	270	1.1480	0.3160	1.1480	1.0714
No log	15.1111	272	1.1303	0.3067	1.1303	1.0631
No log	15.2222	274	1.0806	0.3064	1.0806	1.0395
No log	15.3333	276	1.0715	0.3312	1.0715	1.0351
No log	15.4444	278	1.0638	0.2810	1.0638	1.0314
No log	15.5556	280	1.0714	0.3348	1.0714	1.0351
No log	15.6667	282	1.0401	0.3043	1.0401	1.0199
No log	15.7778	284	1.0180	0.3964	1.0180	1.0090
No log	15.8889	286	0.9990	0.3316	0.9990	0.9995
No log	16.0	288	0.9780	0.3224	0.9780	0.9889
No log	16.1111	290	0.9754	0.2963	0.9754	0.9876
No log	16.2222	292	1.0036	0.2965	1.0036	1.0018
No log	16.3333	294	1.0358	0.3359	1.0358	1.0178
No log	16.4444	296	1.0202	0.3289	1.0202	1.0100
No log	16.5556	298	0.9896	0.2963	0.9896	0.9948
No log	16.6667	300	0.9993	0.3931	0.9993	0.9996
No log	16.7778	302	1.0305	0.3842	1.0305	1.0151
No log	16.8889	304	1.0116	0.3824	1.0116	1.0058
No log	17.0	306	0.9940	0.4297	0.9940	0.9970
No log	17.1111	308	0.9899	0.3499	0.9899	0.9949
No log	17.2222	310	1.0283	0.4136	1.0283	1.0141
No log	17.3333	312	1.0744	0.4062	1.0744	1.0365
No log	17.4444	314	1.0399	0.3600	1.0399	1.0197
No log	17.5556	316	1.0237	0.3355	1.0237	1.0118
No log	17.6667	318	0.9927	0.3379	0.9927	0.9963
No log	17.7778	320	0.9857	0.3304	0.9857	0.9928
No log	17.8889	322	0.9903	0.4065	0.9903	0.9952
No log	18.0	324	1.0278	0.2942	1.0278	1.0138
No log	18.1111	326	1.0391	0.2610	1.0391	1.0193
No log	18.2222	328	1.0015	0.3304	1.0015	1.0007
No log	18.3333	330	1.0226	0.3296	1.0226	1.0113
No log	18.4444	332	1.0441	0.3164	1.0441	1.0218
No log	18.5556	334	1.0276	0.3072	1.0276	1.0137
No log	18.6667	336	1.0138	0.3093	1.0138	1.0069
No log	18.7778	338	1.0260	0.3663	1.0260	1.0129
No log	18.8889	340	1.0837	0.4246	1.0837	1.0410
No log	19.0	342	1.0527	0.4311	1.0527	1.0260
No log	19.1111	344	0.9967	0.3354	0.9967	0.9983
No log	19.2222	346	0.9857	0.3693	0.9857	0.9928
No log	19.3333	348	0.9767	0.3427	0.9767	0.9883
No log	19.4444	350	0.9677	0.3316	0.9677	0.9837
No log	19.5556	352	0.9706	0.3693	0.9706	0.9852
No log	19.6667	354	0.9713	0.3821	0.9713	0.9856
No log	19.7778	356	0.9695	0.3559	0.9695	0.9846
No log	19.8889	358	0.9772	0.3427	0.9772	0.9886
No log	20.0	360	0.9743	0.3689	0.9743	0.9870
No log	20.1111	362	0.9822	0.3678	0.9822	0.9910
No log	20.2222	364	1.0003	0.2932	1.0003	1.0002
No log	20.3333	366	0.9789	0.3418	0.9789	0.9894
No log	20.4444	368	0.9779	0.3128	0.9779	0.9889
No log	20.5556	370	1.0110	0.2993	1.0110	1.0055
No log	20.6667	372	1.0455	0.2857	1.0455	1.0225
No log	20.7778	374	1.0600	0.2857	1.0600	1.0296
No log	20.8889	376	1.0651	0.2857	1.0651	1.0320
No log	21.0	378	1.0573	0.2857	1.0573	1.0283
No log	21.1111	380	1.0443	0.3128	1.0443	1.0219
No log	21.2222	382	1.0440	0.3128	1.0440	1.0217
No log	21.3333	384	1.0473	0.3263	1.0473	1.0234
No log	21.4444	386	1.0428	0.2900	1.0428	1.0212
No log	21.5556	388	1.0350	0.2567	1.0350	1.0174
No log	21.6667	390	1.0415	0.2903	1.0415	1.0205
No log	21.7778	392	1.0235	0.2819	1.0235	1.0117
No log	21.8889	394	0.9986	0.3577	0.9986	0.9993
No log	22.0	396	0.9947	0.3408	0.9947	0.9973
No log	22.1111	398	0.9735	0.3263	0.9735	0.9867
No log	22.2222	400	0.9589	0.3112	0.9589	0.9792
No log	22.3333	402	0.9522	0.2835	0.9522	0.9758
No log	22.4444	404	0.9696	0.2651	0.9696	0.9847
No log	22.5556	406	1.0055	0.3483	1.0055	1.0027
No log	22.6667	408	1.0024	0.3528	1.0024	1.0012
No log	22.7778	410	0.9905	0.3693	0.9905	0.9952
No log	22.8889	412	1.0298	0.2864	1.0298	1.0148
No log	23.0	414	1.0464	0.3359	1.0464	1.0229
No log	23.1111	416	1.0345	0.3578	1.0345	1.0171
No log	23.2222	418	0.9992	0.3693	0.9992	0.9996
No log	23.3333	420	0.9796	0.3437	0.9796	0.9897
No log	23.4444	422	0.9681	0.3437	0.9681	0.9839
No log	23.5556	424	0.9875	0.3144	0.9875	0.9938
No log	23.6667	426	1.0117	0.2951	1.0117	1.0058
No log	23.7778	428	1.0367	0.3842	1.0367	1.0182
No log	23.8889	430	1.0705	0.4127	1.0705	1.0347
No log	24.0	432	1.0436	0.3483	1.0436	1.0216
No log	24.1111	434	1.0000	0.3308	1.0000	1.0000
No log	24.2222	436	0.9763	0.3164	0.9763	0.9881
No log	24.3333	438	0.9645	0.3427	0.9645	0.9821
No log	24.4444	440	0.9598	0.3427	0.9598	0.9797
No log	24.5556	442	0.9677	0.3296	0.9677	0.9837
No log	24.6667	444	0.9976	0.3308	0.9976	0.9988
No log	24.7778	446	1.0442	0.3824	1.0442	1.0219
No log	24.8889	448	1.0571	0.3824	1.0571	1.0282
No log	25.0	450	1.0460	0.3858	1.0460	1.0227
No log	25.1111	452	1.0371	0.4058	1.0371	1.0184
No log	25.2222	454	1.0225	0.4029	1.0225	1.0112
No log	25.3333	456	0.9886	0.3014	0.9886	0.9943
No log	25.4444	458	0.9631	0.2879	0.9631	0.9814
No log	25.5556	460	0.9518	0.2743	0.9518	0.9756
No log	25.6667	462	0.9625	0.2766	0.9625	0.9811
No log	25.7778	464	0.9766	0.2991	0.9766	0.9882
No log	25.8889	466	0.9767	0.2487	0.9767	0.9883
No log	26.0	468	0.9822	0.2553	0.9822	0.9911
No log	26.1111	470	0.9563	0.2102	0.9563	0.9779
No log	26.2222	472	0.9446	0.2416	0.9446	0.9719
No log	26.3333	474	0.9487	0.2416	0.9487	0.9740
No log	26.4444	476	0.9700	0.2647	0.9700	0.9849
No log	26.5556	478	1.0117	0.3005	1.0117	1.0058
No log	26.6667	480	1.0077	0.3124	1.0077	1.0038
No log	26.7778	482	1.0090	0.3124	1.0090	1.0045
No log	26.8889	484	0.9916	0.3124	0.9916	0.9958
No log	27.0	486	0.9805	0.3087	0.9805	0.9902
No log	27.1111	488	0.9695	0.3032	0.9695	0.9846
No log	27.2222	490	0.9576	0.3014	0.9576	0.9786
No log	27.3333	492	0.9649	0.2741	0.9649	0.9823
No log	27.4444	494	0.9816	0.2879	0.9816	0.9907
No log	27.5556	496	0.9873	0.2879	0.9873	0.9936
No log	27.6667	498	0.9814	0.2463	0.9814	0.9906
0.2563	27.7778	500	0.9971	0.3389	0.9971	0.9986
0.2563	27.8889	502	1.0197	0.3369	1.0197	1.0098
0.2563	28.0	504	1.0154	0.3369	1.0154	1.0077
0.2563	28.1111	506	0.9964	0.3052	0.9964	0.9982
0.2563	28.2222	508	0.9902	0.2764	0.9902	0.9951
0.2563	28.3333	510	0.9894	0.2879	0.9894	0.9947

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1