ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9760
• Qwk: 0.2991
• Mse: 0.9760
• Rmse: 0.9879

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	4.5661	-0.0103	4.5661	2.1368
No log	0.125	4	2.7004	-0.0040	2.7004	1.6433
No log	0.1875	6	2.0998	-0.0233	2.0998	1.4491
No log	0.25	8	1.7543	0.0	1.7543	1.3245
No log	0.3125	10	1.5769	0.0732	1.5769	1.2558
No log	0.375	12	1.5001	0.0210	1.5001	1.2248
No log	0.4375	14	1.5465	-0.0300	1.5465	1.2436
No log	0.5	16	1.8719	-0.0149	1.8719	1.3682
No log	0.5625	18	1.8583	-0.0149	1.8583	1.3632
No log	0.625	20	1.6539	-0.0149	1.6539	1.2860
No log	0.6875	22	1.4343	0.0750	1.4343	1.1976
No log	0.75	24	1.2966	0.1587	1.2966	1.1387
No log	0.8125	26	1.2520	0.2161	1.2520	1.1189
No log	0.875	28	1.2810	0.1974	1.2810	1.1318
No log	0.9375	30	1.3079	0.2161	1.3079	1.1436
No log	1.0	32	1.3152	0.1679	1.3152	1.1468
No log	1.0625	34	1.5535	0.0575	1.5535	1.2464
No log	1.125	36	1.6949	0.0832	1.6949	1.3019
No log	1.1875	38	1.6372	0.1169	1.6372	1.2795
No log	1.25	40	1.3047	0.2161	1.3047	1.1422
No log	1.3125	42	1.2306	0.1772	1.2306	1.1093
No log	1.375	44	1.2377	0.1472	1.2377	1.1125
No log	1.4375	46	1.3611	0.1288	1.3611	1.1667
No log	1.5	48	1.7029	0.1325	1.7029	1.3050
No log	1.5625	50	1.9886	0.0887	1.9886	1.4102
No log	1.625	52	1.6975	0.0789	1.6975	1.3029
No log	1.6875	54	1.9971	-0.0044	1.9971	1.4132
No log	1.75	56	1.9662	0.0023	1.9662	1.4022
No log	1.8125	58	1.4321	0.0750	1.4321	1.1967
No log	1.875	60	1.2962	0.0210	1.2962	1.1385
No log	1.9375	62	1.7402	0.0936	1.7402	1.3192
No log	2.0	64	1.7749	0.1169	1.7749	1.3323
No log	2.0625	66	1.4020	0.1495	1.4020	1.1841
No log	2.125	68	1.1985	0.2203	1.1985	1.0947
No log	2.1875	70	1.1011	0.3135	1.1011	1.0493
No log	2.25	72	1.0838	0.3135	1.0838	1.0410
No log	2.3125	74	1.1131	0.2935	1.1131	1.0550
No log	2.375	76	1.3206	0.1570	1.3206	1.1492
No log	2.4375	78	1.4075	0.1674	1.4075	1.1864
No log	2.5	80	1.3093	0.1283	1.3093	1.1442
No log	2.5625	82	1.1038	0.3287	1.1038	1.0506
No log	2.625	84	1.0581	0.3179	1.0581	1.0286
No log	2.6875	86	1.0848	0.3224	1.0848	1.0415
No log	2.75	88	1.1256	0.3009	1.1256	1.0609
No log	2.8125	90	1.1044	0.3009	1.1044	1.0509
No log	2.875	92	1.1969	0.1730	1.1969	1.0940
No log	2.9375	94	1.1770	0.2243	1.1770	1.0849
No log	3.0	96	1.0984	0.2672	1.0984	1.0480
No log	3.0625	98	1.1561	0.2382	1.1561	1.0752
No log	3.125	100	1.1344	0.2388	1.1344	1.0651
No log	3.1875	102	1.0454	0.3558	1.0454	1.0225
No log	3.25	104	1.0480	0.3394	1.0480	1.0237
No log	3.3125	106	1.1668	0.2054	1.1668	1.0802
No log	3.375	108	1.2855	0.1756	1.2855	1.1338
No log	3.4375	110	1.2531	0.1972	1.2531	1.1194
No log	3.5	112	1.2202	0.2295	1.2202	1.1046
No log	3.5625	114	1.2345	0.2295	1.2345	1.1111
No log	3.625	116	1.3029	0.2289	1.3029	1.1414
No log	3.6875	118	1.1927	0.1966	1.1927	1.0921
No log	3.75	120	1.1434	0.2380	1.1434	1.0693
No log	3.8125	122	1.1348	0.2499	1.1348	1.0653
No log	3.875	124	1.0954	0.2993	1.0954	1.0466
No log	3.9375	126	1.0415	0.4100	1.0415	1.0205
No log	4.0	128	1.0324	0.3584	1.0324	1.0161
No log	4.0625	130	0.9937	0.4066	0.9937	0.9968
No log	4.125	132	1.0443	0.3127	1.0443	1.0219
No log	4.1875	134	0.9710	0.3897	0.9710	0.9854
No log	4.25	136	0.8947	0.4159	0.8947	0.9459
No log	4.3125	138	0.9088	0.4197	0.9088	0.9533
No log	4.375	140	0.8999	0.3458	0.8999	0.9486
No log	4.4375	142	0.9776	0.3924	0.9776	0.9887
No log	4.5	144	1.1527	0.3169	1.1527	1.0736
No log	4.5625	146	1.0142	0.4690	1.0142	1.0071
No log	4.625	148	0.8659	0.4356	0.8659	0.9305
No log	4.6875	150	1.1615	0.2450	1.1615	1.0777
No log	4.75	152	1.2445	0.2333	1.2445	1.1156
No log	4.8125	154	1.0892	0.3415	1.0892	1.0436
No log	4.875	156	0.9072	0.4397	0.9072	0.9525
No log	4.9375	158	0.9109	0.4847	0.9109	0.9544
No log	5.0	160	1.0731	0.3052	1.0731	1.0359
No log	5.0625	162	1.0953	0.3144	1.0953	1.0466
No log	5.125	164	1.0954	0.3188	1.0954	1.0466
No log	5.1875	166	1.0413	0.3452	1.0413	1.0204
No log	5.25	168	0.9326	0.3747	0.9326	0.9657
No log	5.3125	170	0.8957	0.4203	0.8957	0.9464
No log	5.375	172	0.8784	0.4676	0.8784	0.9372
No log	5.4375	174	0.8343	0.3796	0.8343	0.9134
No log	5.5	176	0.8796	0.4	0.8796	0.9379
No log	5.5625	178	1.0274	0.4136	1.0274	1.0136
No log	5.625	180	0.8825	0.4234	0.8825	0.9394
No log	5.6875	182	0.8754	0.4724	0.8754	0.9356
No log	5.75	184	0.9140	0.4565	0.9140	0.9561
No log	5.8125	186	0.9094	0.4139	0.9094	0.9536
No log	5.875	188	0.9629	0.4522	0.9629	0.9813
No log	5.9375	190	0.9268	0.3902	0.9268	0.9627
No log	6.0	192	0.9689	0.4373	0.9689	0.9843
No log	6.0625	194	0.9664	0.4064	0.9664	0.9831
No log	6.125	196	0.9792	0.4139	0.9792	0.9895
No log	6.1875	198	0.9698	0.3804	0.9698	0.9848
No log	6.25	200	0.9715	0.4102	0.9715	0.9857
No log	6.3125	202	0.9474	0.3948	0.9474	0.9733
No log	6.375	204	0.9553	0.4102	0.9553	0.9774
No log	6.4375	206	0.9548	0.3983	0.9548	0.9771
No log	6.5	208	0.9716	0.3885	0.9716	0.9857
No log	6.5625	210	0.9916	0.3555	0.9916	0.9958
No log	6.625	212	1.0015	0.4612	1.0015	1.0007
No log	6.6875	214	1.2461	0.3023	1.2461	1.1163
No log	6.75	216	1.2318	0.3184	1.2318	1.1099
No log	6.8125	218	1.0234	0.3468	1.0234	1.0117
No log	6.875	220	1.1015	0.3370	1.1015	1.0495
No log	6.9375	222	1.0966	0.2851	1.0966	1.0472
No log	7.0	224	0.9832	0.3552	0.9832	0.9916
No log	7.0625	226	1.0788	0.2409	1.0788	1.0387
No log	7.125	228	1.0759	0.2409	1.0759	1.0373
No log	7.1875	230	1.0060	0.3463	1.0060	1.0030
No log	7.25	232	0.9669	0.3522	0.9669	0.9833
No log	7.3125	234	0.9829	0.3608	0.9829	0.9914
No log	7.375	236	0.9917	0.3511	0.9917	0.9959
No log	7.4375	238	0.9961	0.4405	0.9961	0.9980
No log	7.5	240	1.0419	0.4019	1.0419	1.0207
No log	7.5625	242	1.1983	0.3404	1.1983	1.0947
No log	7.625	244	1.2573	0.3390	1.2573	1.1213
No log	7.6875	246	1.1618	0.2997	1.1618	1.0779
No log	7.75	248	1.1051	0.2583	1.1051	1.0513
No log	7.8125	250	1.0581	0.3105	1.0581	1.0286
No log	7.875	252	1.0524	0.3152	1.0524	1.0259
No log	7.9375	254	1.0827	0.3152	1.0827	1.0405
No log	8.0	256	1.1157	0.2811	1.1157	1.0563
No log	8.0625	258	1.0793	0.3724	1.0793	1.0389
No log	8.125	260	1.0571	0.3036	1.0571	1.0281
No log	8.1875	262	1.0578	0.2776	1.0578	1.0285
No log	8.25	264	1.0164	0.3705	1.0164	1.0082
No log	8.3125	266	1.0450	0.3841	1.0450	1.0223
No log	8.375	268	1.0599	0.4019	1.0599	1.0295
No log	8.4375	270	1.0738	0.3509	1.0738	1.0362
No log	8.5	272	1.1698	0.3278	1.1698	1.0816
No log	8.5625	274	1.2204	0.2660	1.2204	1.1047
No log	8.625	276	1.1856	0.1876	1.1856	1.0889
No log	8.6875	278	1.1311	0.3641	1.1311	1.0635
No log	8.75	280	1.1176	0.4110	1.1176	1.0572
No log	8.8125	282	1.0059	0.4401	1.0059	1.0030
No log	8.875	284	0.9833	0.4026	0.9833	0.9916
No log	8.9375	286	0.9660	0.4084	0.9660	0.9829
No log	9.0	288	0.9674	0.4278	0.9674	0.9836
No log	9.0625	290	1.0337	0.4031	1.0337	1.0167
No log	9.125	292	1.0152	0.4202	1.0152	1.0076
No log	9.1875	294	0.9855	0.5154	0.9855	0.9927
No log	9.25	296	0.9706	0.5154	0.9706	0.9852
No log	9.3125	298	0.9725	0.5154	0.9725	0.9861
No log	9.375	300	0.9672	0.4948	0.9672	0.9835
No log	9.4375	302	0.9626	0.3511	0.9626	0.9811
No log	9.5	304	1.0057	0.3919	1.0057	1.0028
No log	9.5625	306	1.0152	0.3297	1.0152	1.0076
No log	9.625	308	1.0175	0.3166	1.0175	1.0087
No log	9.6875	310	1.0019	0.3476	1.0019	1.0010
No log	9.75	312	0.9688	0.4349	0.9688	0.9843
No log	9.8125	314	1.0582	0.3802	1.0582	1.0287
No log	9.875	316	1.0679	0.4028	1.0679	1.0334
No log	9.9375	318	0.9964	0.3463	0.9964	0.9982
No log	10.0	320	0.9875	0.2733	0.9875	0.9937
No log	10.0625	322	0.9817	0.2942	0.9817	0.9908
No log	10.125	324	0.9857	0.3069	0.9857	0.9928
No log	10.1875	326	1.0100	0.3191	1.0100	1.0050
No log	10.25	328	0.9920	0.3652	0.9920	0.9960
No log	10.3125	330	1.0122	0.3652	1.0122	1.0061
No log	10.375	332	1.0267	0.3596	1.0267	1.0133
No log	10.4375	334	1.0233	0.3552	1.0233	1.0116
No log	10.5	336	0.9981	0.3552	0.9981	0.9991
No log	10.5625	338	1.0399	0.3436	1.0399	1.0198
No log	10.625	340	1.0471	0.3225	1.0471	1.0233
No log	10.6875	342	0.9551	0.4568	0.9551	0.9773
No log	10.75	344	0.9198	0.4079	0.9198	0.9591
No log	10.8125	346	0.9236	0.4079	0.9236	0.9610
No log	10.875	348	0.9285	0.3552	0.9285	0.9636
No log	10.9375	350	0.9821	0.4337	0.9821	0.9910
No log	11.0	352	0.9839	0.4048	0.9839	0.9919
No log	11.0625	354	0.9831	0.3650	0.9831	0.9915
No log	11.125	356	1.0629	0.4335	1.0629	1.0310
No log	11.1875	358	1.1076	0.3963	1.1076	1.0524
No log	11.25	360	1.0057	0.2966	1.0057	1.0028
No log	11.3125	362	0.9772	0.3552	0.9772	0.9886
No log	11.375	364	0.9963	0.3363	0.9963	0.9982
No log	11.4375	366	0.9684	0.3392	0.9684	0.9841
No log	11.5	368	0.9582	0.3290	0.9582	0.9789
No log	11.5625	370	1.0075	0.4027	1.0075	1.0037
No log	11.625	372	0.9814	0.4301	0.9814	0.9907
No log	11.6875	374	0.9437	0.3804	0.9437	0.9714
No log	11.75	376	0.9808	0.5124	0.9808	0.9904
No log	11.8125	378	0.9735	0.4476	0.9735	0.9867
No log	11.875	380	0.9618	0.3852	0.9618	0.9807
No log	11.9375	382	0.9922	0.4328	0.9922	0.9961
No log	12.0	384	0.9900	0.3836	0.9900	0.9950
No log	12.0625	386	0.9749	0.3608	0.9749	0.9874
No log	12.125	388	0.9610	0.3852	0.9610	0.9803
No log	12.1875	390	0.9571	0.3852	0.9571	0.9783
No log	12.25	392	0.9600	0.3852	0.9600	0.9798
No log	12.3125	394	0.9658	0.4045	0.9658	0.9828
No log	12.375	396	0.9855	0.3674	0.9855	0.9927
No log	12.4375	398	1.0652	0.4037	1.0652	1.0321
No log	12.5	400	1.0865	0.3317	1.0865	1.0424
No log	12.5625	402	1.0188	0.3237	1.0188	1.0094
No log	12.625	404	0.9577	0.3382	0.9577	0.9786
No log	12.6875	406	0.9877	0.3837	0.9877	0.9938
No log	12.75	408	1.0133	0.3783	1.0133	1.0066
No log	12.8125	410	0.9526	0.4542	0.9526	0.9760
No log	12.875	412	0.9098	0.3554	0.9098	0.9538
No log	12.9375	414	0.9145	0.3804	0.9145	0.9563
No log	13.0	416	0.9291	0.3552	0.9291	0.9639
No log	13.0625	418	0.9535	0.3327	0.9535	0.9765
No log	13.125	420	0.9590	0.2968	0.9590	0.9793
No log	13.1875	422	0.9619	0.3738	0.9619	0.9808
No log	13.25	424	0.9817	0.3879	0.9817	0.9908
No log	13.3125	426	0.9816	0.4159	0.9816	0.9908
No log	13.375	428	0.9675	0.3983	0.9675	0.9836
No log	13.4375	430	1.0239	0.3436	1.0239	1.0119
No log	13.5	432	1.0158	0.3902	1.0158	1.0079
No log	13.5625	434	0.9484	0.3327	0.9484	0.9739
No log	13.625	436	0.9266	0.3983	0.9266	0.9626
No log	13.6875	438	0.9448	0.4294	0.9448	0.9720
No log	13.75	440	0.9392	0.3983	0.9392	0.9691
No log	13.8125	442	0.9558	0.3327	0.9558	0.9777
No log	13.875	444	0.9613	0.3705	0.9613	0.9805
No log	13.9375	446	0.9423	0.3608	0.9423	0.9707
No log	14.0	448	0.9661	0.3781	0.9661	0.9829
No log	14.0625	450	0.9645	0.3827	0.9645	0.9821
No log	14.125	452	0.9086	0.4023	0.9086	0.9532
No log	14.1875	454	0.9059	0.4142	0.9059	0.9518
No log	14.25	456	0.9318	0.4931	0.9318	0.9653
No log	14.3125	458	0.9104	0.3552	0.9104	0.9541
No log	14.375	460	0.9249	0.3983	0.9249	0.9617
No log	14.4375	462	0.9435	0.3728	0.9435	0.9713
No log	14.5	464	1.0100	0.3381	1.0100	1.0050
No log	14.5625	466	1.0697	0.3682	1.0697	1.0342
No log	14.625	468	1.0102	0.3381	1.0102	1.0051
No log	14.6875	470	0.9492	0.3467	0.9492	0.9743
No log	14.75	472	0.9325	0.3652	0.9325	0.9657
No log	14.8125	474	0.9347	0.3608	0.9347	0.9668
No log	14.875	476	0.9505	0.3738	0.9505	0.9749
No log	14.9375	478	0.9874	0.3648	0.9874	0.9937
No log	15.0	480	0.9804	0.2966	0.9804	0.9902
No log	15.0625	482	0.9666	0.3738	0.9666	0.9831
No log	15.125	484	0.9763	0.3583	0.9763	0.9881
No log	15.1875	486	0.9686	0.3201	0.9686	0.9842
No log	15.25	488	0.9738	0.3404	0.9738	0.9868
No log	15.3125	490	1.0514	0.2912	1.0514	1.0254
No log	15.375	492	1.1230	0.3340	1.1230	1.0597
No log	15.4375	494	1.0912	0.3437	1.0912	1.0446
No log	15.5	496	1.0213	0.3291	1.0213	1.0106
No log	15.5625	498	0.9741	0.3095	0.9741	0.9870
0.3366	15.625	500	0.9501	0.3095	0.9501	0.9747
0.3366	15.6875	502	0.9168	0.3095	0.9168	0.9575
0.3366	15.75	504	0.8952	0.3902	0.8952	0.9462
0.3366	15.8125	506	0.8618	0.3756	0.8618	0.9283
0.3366	15.875	508	0.8584	0.4782	0.8584	0.9265
0.3366	15.9375	510	0.8572	0.4993	0.8572	0.9258
0.3366	16.0	512	0.8547	0.4256	0.8547	0.9245
0.3366	16.0625	514	0.8654	0.4256	0.8654	0.9303
0.3366	16.125	516	0.8957	0.4158	0.8957	0.9464
0.3366	16.1875	518	0.9319	0.3756	0.9319	0.9654
0.3366	16.25	520	0.9427	0.3558	0.9427	0.9709
0.3366	16.3125	522	0.9471	0.4118	0.9471	0.9732
0.3366	16.375	524	0.9620	0.3382	0.9620	0.9808
0.3366	16.4375	526	0.9802	0.3237	0.9802	0.9901
0.3366	16.5	528	1.0126	0.3337	1.0126	1.0063
0.3366	16.5625	530	1.0554	0.3262	1.0554	1.0273
0.3366	16.625	532	1.0683	0.2714	1.0683	1.0336
0.3366	16.6875	534	1.0254	0.3567	1.0254	1.0126
0.3366	16.75	536	0.9851	0.3608	0.9851	0.9925
0.3366	16.8125	538	0.9704	0.3608	0.9704	0.9851
0.3366	16.875	540	0.9566	0.3354	0.9566	0.9781
0.3366	16.9375	542	0.9680	0.3354	0.9680	0.9839
0.3366	17.0	544	1.0077	0.3039	1.0077	1.0039
0.3366	17.0625	546	1.0542	0.3104	1.0542	1.0268
0.3366	17.125	548	1.0507	0.3243	1.0507	1.0250
0.3366	17.1875	550	1.0361	0.3305	1.0361	1.0179
0.3366	17.25	552	0.9850	0.3354	0.9850	0.9925
0.3366	17.3125	554	0.9675	0.3552	0.9675	0.9836
0.3366	17.375	556	0.9488	0.3552	0.9488	0.9740
0.3366	17.4375	558	0.9131	0.3938	0.9131	0.9556
0.3366	17.5	560	0.8962	0.3869	0.8962	0.9467
0.3366	17.5625	562	0.9198	0.4247	0.9198	0.9591
0.3366	17.625	564	0.9215	0.4080	0.9215	0.9600
0.3366	17.6875	566	0.8615	0.4059	0.8615	0.9282
0.3366	17.75	568	0.8568	0.4079	0.8568	0.9256
0.3366	17.8125	570	0.9002	0.3854	0.9002	0.9488
0.3366	17.875	572	0.9185	0.4434	0.9185	0.9584
0.3366	17.9375	574	0.8828	0.3938	0.8828	0.9396
0.3366	18.0	576	0.8884	0.4197	0.8884	0.9425
0.3366	18.0625	578	0.9384	0.3852	0.9384	0.9687
0.3366	18.125	580	0.9492	0.4082	0.9492	0.9743
0.3366	18.1875	582	0.9388	0.4328	0.9388	0.9689
0.3366	18.25	584	0.9364	0.4023	0.9364	0.9677
0.3366	18.3125	586	0.9460	0.3483	0.9460	0.9726
0.3366	18.375	588	0.9561	0.3066	0.9561	0.9778
0.3366	18.4375	590	0.9613	0.3095	0.9613	0.9805
0.3366	18.5	592	0.9690	0.2991	0.9690	0.9844
0.3366	18.5625	594	0.9716	0.2991	0.9716	0.9857
0.3366	18.625	596	0.9760	0.2991	0.9760	0.9879

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1