ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run2_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8457
• Qwk: 0.6372
• Mse: 0.8457
• Rmse: 0.9196

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	5.4968	-0.0021	5.4968	2.3445
No log	0.0976	4	3.7689	-0.0049	3.7689	1.9414
No log	0.1463	6	3.0383	-0.0985	3.0383	1.7431
No log	0.1951	8	2.3807	-0.0787	2.3807	1.5429
No log	0.2439	10	1.3746	0.2139	1.3746	1.1724
No log	0.2927	12	1.3431	0.2309	1.3431	1.1589
No log	0.3415	14	1.3839	0.1890	1.3839	1.1764
No log	0.3902	16	1.0996	0.2348	1.0996	1.0486
No log	0.4390	18	1.0523	0.3037	1.0523	1.0258
No log	0.4878	20	0.9840	0.3209	0.9840	0.9920
No log	0.5366	22	0.9795	0.3467	0.9795	0.9897
No log	0.5854	24	1.3365	0.2455	1.3365	1.1561
No log	0.6341	26	1.5446	0.1912	1.5446	1.2428
No log	0.6829	28	1.1659	0.3135	1.1659	1.0798
No log	0.7317	30	0.9014	0.4253	0.9014	0.9494
No log	0.7805	32	0.9061	0.3512	0.9061	0.9519
No log	0.8293	34	0.9050	0.3650	0.9050	0.9513
No log	0.8780	36	0.9980	0.3856	0.9980	0.9990
No log	0.9268	38	1.0722	0.3303	1.0722	1.0355
No log	0.9756	40	0.9657	0.4129	0.9657	0.9827
No log	1.0244	42	0.9846	0.4599	0.9846	0.9923
No log	1.0732	44	0.9870	0.4610	0.9870	0.9935
No log	1.1220	46	0.9688	0.4248	0.9688	0.9843
No log	1.1707	48	1.0428	0.4750	1.0428	1.0212
No log	1.2195	50	1.2541	0.3688	1.2541	1.1199
No log	1.2683	52	1.1471	0.4524	1.1471	1.0710
No log	1.3171	54	0.8982	0.6164	0.8982	0.9477
No log	1.3659	56	1.1310	0.3970	1.1310	1.0635
No log	1.4146	58	1.1062	0.4092	1.1062	1.0518
No log	1.4634	60	0.8672	0.5941	0.8672	0.9312
No log	1.5122	62	1.0456	0.5177	1.0456	1.0225
No log	1.5610	64	1.3540	0.4099	1.3540	1.1636
No log	1.6098	66	1.3911	0.4199	1.3911	1.1795
No log	1.6585	68	1.0263	0.4913	1.0263	1.0131
No log	1.7073	70	0.7949	0.5955	0.7949	0.8916
No log	1.7561	72	0.8124	0.5264	0.8124	0.9013
No log	1.8049	74	0.9879	0.4794	0.9879	0.9939
No log	1.8537	76	1.0148	0.4741	1.0148	1.0074
No log	1.9024	78	1.0371	0.4830	1.0371	1.0184
No log	1.9512	80	0.9970	0.4798	0.9970	0.9985
No log	2.0	82	0.9240	0.5294	0.9240	0.9612
No log	2.0488	84	0.8730	0.5188	0.8730	0.9343
No log	2.0976	86	0.8666	0.5322	0.8666	0.9309
No log	2.1463	88	0.9163	0.4567	0.9163	0.9572
No log	2.1951	90	0.9466	0.4763	0.9466	0.9729
No log	2.2439	92	0.8207	0.5902	0.8207	0.9059
No log	2.2927	94	0.9160	0.5715	0.9160	0.9571
No log	2.3415	96	0.9770	0.5453	0.9770	0.9884
No log	2.3902	98	0.9191	0.5571	0.9191	0.9587
No log	2.4390	100	0.9119	0.5664	0.9119	0.9550
No log	2.4878	102	0.9395	0.5359	0.9395	0.9693
No log	2.5366	104	0.9079	0.6039	0.9079	0.9528
No log	2.5854	106	1.0120	0.5727	1.0120	1.0060
No log	2.6341	108	1.0512	0.5542	1.0512	1.0253
No log	2.6829	110	1.0107	0.5367	1.0108	1.0054
No log	2.7317	112	0.9432	0.5653	0.9432	0.9712
No log	2.7805	114	0.8948	0.5912	0.8948	0.9459
No log	2.8293	116	0.8476	0.5939	0.8476	0.9206
No log	2.8780	118	0.8132	0.5814	0.8132	0.9018
No log	2.9268	120	0.8172	0.6275	0.8172	0.9040
No log	2.9756	122	0.8551	0.6315	0.8551	0.9247
No log	3.0244	124	0.7824	0.6501	0.7824	0.8845
No log	3.0732	126	0.7917	0.5837	0.7917	0.8898
No log	3.1220	128	0.7926	0.5950	0.7926	0.8903
No log	3.1707	130	0.8191	0.6062	0.8191	0.9051
No log	3.2195	132	0.8431	0.6368	0.8431	0.9182
No log	3.2683	134	0.8747	0.6467	0.8747	0.9353
No log	3.3171	136	0.8910	0.6455	0.8910	0.9439
No log	3.3659	138	0.8912	0.5742	0.8912	0.9440
No log	3.4146	140	0.9301	0.5362	0.9301	0.9644
No log	3.4634	142	0.8871	0.5380	0.8871	0.9418
No log	3.5122	144	0.9112	0.5365	0.9112	0.9546
No log	3.5610	146	0.9149	0.5331	0.9149	0.9565
No log	3.6098	148	0.9212	0.5047	0.9212	0.9598
No log	3.6585	150	1.0132	0.4845	1.0132	1.0066
No log	3.7073	152	1.0996	0.4901	1.0996	1.0486
No log	3.7561	154	0.9920	0.5038	0.9920	0.9960
No log	3.8049	156	0.9299	0.5603	0.9299	0.9643
No log	3.8537	158	0.9103	0.5987	0.9103	0.9541
No log	3.9024	160	0.9146	0.5987	0.9146	0.9564
No log	3.9512	162	0.9072	0.5867	0.9072	0.9525
No log	4.0	164	0.9241	0.6142	0.9241	0.9613
No log	4.0488	166	1.0297	0.5516	1.0297	1.0147
No log	4.0976	168	1.0664	0.5388	1.0664	1.0327
No log	4.1463	170	0.8908	0.6090	0.8908	0.9438
No log	4.1951	172	0.8265	0.6228	0.8265	0.9091
No log	4.2439	174	0.8050	0.6115	0.8050	0.8972
No log	4.2927	176	0.7967	0.5931	0.7967	0.8926
No log	4.3415	178	0.8313	0.6325	0.8313	0.9118
No log	4.3902	180	0.7995	0.6559	0.7995	0.8942
No log	4.4390	182	0.7745	0.6672	0.7745	0.8801
No log	4.4878	184	0.7861	0.6622	0.7861	0.8866
No log	4.5366	186	0.8956	0.6291	0.8956	0.9464
No log	4.5854	188	1.0699	0.5312	1.0699	1.0344
No log	4.6341	190	0.9504	0.5854	0.9504	0.9749
No log	4.6829	192	0.7949	0.6635	0.7949	0.8916
No log	4.7317	194	0.7526	0.6603	0.7526	0.8675
No log	4.7805	196	0.8226	0.6234	0.8226	0.9070
No log	4.8293	198	0.8052	0.6462	0.8052	0.8973
No log	4.8780	200	0.7015	0.6919	0.7015	0.8376
No log	4.9268	202	0.6958	0.7038	0.6958	0.8342
No log	4.9756	204	0.7238	0.7175	0.7238	0.8508
No log	5.0244	206	0.6908	0.7118	0.6908	0.8311
No log	5.0732	208	0.7152	0.6475	0.7152	0.8457
No log	5.1220	210	0.7159	0.6689	0.7159	0.8461
No log	5.1707	212	0.7423	0.6557	0.7423	0.8615
No log	5.2195	214	0.7675	0.6050	0.7675	0.8761
No log	5.2683	216	0.8074	0.6416	0.8074	0.8986
No log	5.3171	218	0.7778	0.6549	0.7778	0.8819
No log	5.3659	220	0.8341	0.5738	0.8341	0.9133
No log	5.4146	222	0.7838	0.6354	0.7838	0.8853
No log	5.4634	224	0.8808	0.6299	0.8808	0.9385
No log	5.5122	226	1.0454	0.5629	1.0454	1.0225
No log	5.5610	228	0.8999	0.6095	0.8999	0.9486
No log	5.6098	230	0.7666	0.5947	0.7666	0.8755
No log	5.6585	232	0.8220	0.5771	0.8220	0.9067
No log	5.7073	234	0.8257	0.5670	0.8257	0.9087
No log	5.7561	236	0.7885	0.5501	0.7885	0.8880
No log	5.8049	238	0.8069	0.5961	0.8069	0.8983
No log	5.8537	240	0.8035	0.6776	0.8035	0.8964
No log	5.9024	242	0.7838	0.6363	0.7838	0.8853
No log	5.9512	244	0.7641	0.6508	0.7641	0.8741
No log	6.0	246	0.7895	0.6031	0.7895	0.8885
No log	6.0488	248	0.8319	0.6133	0.8319	0.9121
No log	6.0976	250	0.8186	0.6265	0.8186	0.9048
No log	6.1463	252	0.7996	0.6208	0.7996	0.8942
No log	6.1951	254	0.7656	0.6257	0.7656	0.8750
No log	6.2439	256	0.7690	0.5892	0.7690	0.8769
No log	6.2927	258	0.7616	0.6132	0.7616	0.8727
No log	6.3415	260	0.7836	0.5948	0.7836	0.8852
No log	6.3902	262	0.9443	0.5608	0.9443	0.9718
No log	6.4390	264	1.0495	0.5226	1.0495	1.0245
No log	6.4878	266	0.9258	0.5818	0.9258	0.9622
No log	6.5366	268	0.8028	0.5651	0.8028	0.8960
No log	6.5854	270	0.8122	0.5535	0.8122	0.9012
No log	6.6341	272	0.8655	0.5523	0.8655	0.9303
No log	6.6829	274	0.9520	0.5029	0.9520	0.9757
No log	6.7317	276	1.1129	0.4805	1.1129	1.0550
No log	6.7805	278	1.0475	0.4805	1.0475	1.0235
No log	6.8293	280	0.8539	0.5551	0.8539	0.9240
No log	6.8780	282	0.8095	0.5683	0.8095	0.8997
No log	6.9268	284	0.8165	0.5601	0.8165	0.9036
No log	6.9756	286	0.8885	0.5342	0.8885	0.9426
No log	7.0244	288	0.8877	0.5415	0.8877	0.9422
No log	7.0732	290	0.8774	0.5323	0.8774	0.9367
No log	7.1220	292	0.8147	0.5925	0.8147	0.9026
No log	7.1707	294	0.7986	0.5664	0.7986	0.8936
No log	7.2195	296	0.8123	0.5963	0.8123	0.9013
No log	7.2683	298	0.9119	0.5715	0.9119	0.9549
No log	7.3171	300	0.9309	0.5691	0.9309	0.9648
No log	7.3659	302	0.9913	0.5620	0.9913	0.9956
No log	7.4146	304	1.1975	0.5193	1.1975	1.0943
No log	7.4634	306	1.2285	0.4843	1.2285	1.1084
No log	7.5122	308	1.1720	0.4936	1.1720	1.0826
No log	7.5610	310	0.9707	0.5455	0.9707	0.9852
No log	7.6098	312	0.9423	0.5857	0.9423	0.9707
No log	7.6585	314	1.0719	0.5739	1.0719	1.0353
No log	7.7073	316	1.2770	0.5260	1.2770	1.1300
No log	7.7561	318	1.1932	0.5619	1.1932	1.0923
No log	7.8049	320	0.9533	0.6003	0.9533	0.9764
No log	7.8537	322	0.8154	0.6689	0.8154	0.9030
No log	7.9024	324	0.7965	0.6508	0.7965	0.8925
No log	7.9512	326	0.8274	0.6498	0.8274	0.9096
No log	8.0	328	0.9444	0.6109	0.9444	0.9718
No log	8.0488	330	0.9428	0.6109	0.9428	0.9710
No log	8.0976	332	0.8391	0.6476	0.8391	0.9160
No log	8.1463	334	0.7867	0.6472	0.7867	0.8869
No log	8.1951	336	0.7958	0.6432	0.7958	0.8921
No log	8.2439	338	0.8481	0.6026	0.8481	0.9209
No log	8.2927	340	1.0434	0.5790	1.0434	1.0215
No log	8.3415	342	1.1415	0.5443	1.1415	1.0684
No log	8.3902	344	1.0850	0.5813	1.0850	1.0417
No log	8.4390	346	0.9284	0.6217	0.9284	0.9635
No log	8.4878	348	0.8407	0.6249	0.8407	0.9169
No log	8.5366	350	0.8409	0.6233	0.8409	0.9170
No log	8.5854	352	0.8805	0.6058	0.8805	0.9383
No log	8.6341	354	1.0099	0.5839	1.0099	1.0050
No log	8.6829	356	1.2594	0.5158	1.2594	1.1222
No log	8.7317	358	1.2833	0.4933	1.2833	1.1328
No log	8.7805	360	1.1164	0.5445	1.1164	1.0566
No log	8.8293	362	0.8512	0.5803	0.8512	0.9226
No log	8.8780	364	0.7731	0.6121	0.7731	0.8793
No log	8.9268	366	0.7743	0.5985	0.7743	0.8799
No log	8.9756	368	0.7862	0.6119	0.7862	0.8867
No log	9.0244	370	0.8787	0.5754	0.8787	0.9374
No log	9.0732	372	1.0467	0.5531	1.0467	1.0231
No log	9.1220	374	1.0544	0.5393	1.0544	1.0269
No log	9.1707	376	0.9278	0.5730	0.9278	0.9632
No log	9.2195	378	0.7973	0.6241	0.7973	0.8929
No log	9.2683	380	0.7572	0.6372	0.7572	0.8702
No log	9.3171	382	0.7597	0.6505	0.7597	0.8716
No log	9.3659	384	0.8484	0.5923	0.8484	0.9211
No log	9.4146	386	1.0321	0.5595	1.0321	1.0159
No log	9.4634	388	1.0866	0.5530	1.0866	1.0424
No log	9.5122	390	1.0328	0.5672	1.0328	1.0163
No log	9.5610	392	0.8819	0.6417	0.8819	0.9391
No log	9.6098	394	0.8399	0.6228	0.8399	0.9165
No log	9.6585	396	0.7772	0.6790	0.7772	0.8816
No log	9.7073	398	0.7726	0.6524	0.7726	0.8790
No log	9.7561	400	0.8118	0.6415	0.8118	0.9010
No log	9.8049	402	0.9127	0.6517	0.9127	0.9554
No log	9.8537	404	0.9202	0.6450	0.9202	0.9593
No log	9.9024	406	0.8239	0.6450	0.8239	0.9077
No log	9.9512	408	0.8025	0.6289	0.8025	0.8958
No log	10.0	410	0.8132	0.6569	0.8132	0.9018
No log	10.0488	412	0.8080	0.6596	0.8080	0.8989
No log	10.0976	414	0.8228	0.6533	0.8228	0.9071
No log	10.1463	416	0.8542	0.6674	0.8542	0.9242
No log	10.1951	418	0.9421	0.6477	0.9421	0.9706
No log	10.2439	420	1.0213	0.5890	1.0213	1.0106
No log	10.2927	422	0.9325	0.6351	0.9325	0.9656
No log	10.3415	424	0.8755	0.6286	0.8755	0.9357
No log	10.3902	426	0.8661	0.6276	0.8661	0.9306
No log	10.4390	428	0.8324	0.6148	0.8324	0.9124
No log	10.4878	430	0.8176	0.6235	0.8176	0.9042
No log	10.5366	432	0.7955	0.6586	0.7955	0.8919
No log	10.5854	434	0.7995	0.6539	0.7995	0.8942
No log	10.6341	436	0.8220	0.6644	0.8220	0.9066
No log	10.6829	438	0.9024	0.6311	0.9024	0.9499
No log	10.7317	440	1.0153	0.5965	1.0153	1.0076
No log	10.7805	442	0.9813	0.6205	0.9813	0.9906
No log	10.8293	444	0.9238	0.6513	0.9238	0.9612
No log	10.8780	446	0.8751	0.6305	0.8751	0.9355
No log	10.9268	448	0.9534	0.6400	0.9534	0.9764
No log	10.9756	450	0.9838	0.6348	0.9838	0.9919
No log	11.0244	452	1.0171	0.6279	1.0171	1.0085
No log	11.0732	454	1.0164	0.6076	1.0164	1.0082
No log	11.1220	456	1.0027	0.5767	1.0027	1.0014
No log	11.1707	458	0.9964	0.5677	0.9964	0.9982
No log	11.2195	460	0.9459	0.5781	0.9459	0.9726
No log	11.2683	462	0.9351	0.5872	0.9351	0.9670
No log	11.3171	464	0.8621	0.5842	0.8621	0.9285
No log	11.3659	466	0.8392	0.5709	0.8392	0.9161
No log	11.4146	468	0.8718	0.6123	0.8718	0.9337
No log	11.4634	470	0.8932	0.6412	0.8932	0.9451
No log	11.5122	472	0.8749	0.6270	0.8749	0.9353
No log	11.5610	474	0.8812	0.6412	0.8812	0.9387
No log	11.6098	476	0.9967	0.5788	0.9967	0.9984
No log	11.6585	478	1.0771	0.5491	1.0771	1.0378
No log	11.7073	480	1.0278	0.5475	1.0278	1.0138
No log	11.7561	482	0.9806	0.5800	0.9806	0.9903
No log	11.8049	484	0.9126	0.625	0.9126	0.9553
No log	11.8537	486	0.8135	0.6539	0.8135	0.9019
No log	11.9024	488	0.7605	0.6584	0.7605	0.8721
No log	11.9512	490	0.7705	0.6534	0.7705	0.8778
No log	12.0	492	0.8710	0.6293	0.8710	0.9333
No log	12.0488	494	0.8838	0.6109	0.8838	0.9401
No log	12.0976	496	0.8224	0.6496	0.8224	0.9068
No log	12.1463	498	0.7520	0.6713	0.7520	0.8672
0.3876	12.1951	500	0.7098	0.7003	0.7098	0.8425
0.3876	12.2439	502	0.7045	0.7026	0.7045	0.8393
0.3876	12.2927	504	0.7278	0.7107	0.7278	0.8531
0.3876	12.3415	506	0.7477	0.6859	0.7477	0.8647
0.3876	12.3902	508	0.7385	0.6908	0.7385	0.8593
0.3876	12.4390	510	0.7528	0.6811	0.7528	0.8677
0.3876	12.4878	512	0.7884	0.6712	0.7884	0.8879
0.3876	12.5366	514	0.8457	0.6372	0.8457	0.9196

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1