ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8366
• Qwk: 0.5872
• Mse: 0.8366
• Rmse: 0.9146

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0241	2	5.6931	-0.0594	5.6931	2.3860
No log	0.0482	4	3.0752	0.0522	3.0752	1.7536
No log	0.0723	6	1.9847	0.0026	1.9847	1.4088
No log	0.0964	8	1.4090	0.1711	1.4090	1.1870
No log	0.1205	10	1.2510	0.3262	1.2510	1.1185
No log	0.1446	12	1.3940	0.1382	1.3940	1.1807
No log	0.1687	14	1.5491	0.0605	1.5491	1.2446
No log	0.1928	16	1.4741	0.0970	1.4741	1.2141
No log	0.2169	18	1.2398	0.2512	1.2398	1.1135
No log	0.2410	20	1.0988	0.2315	1.0988	1.0482
No log	0.2651	22	1.0803	0.2099	1.0803	1.0394
No log	0.2892	24	1.0895	0.3157	1.0895	1.0438
No log	0.3133	26	1.1207	0.3162	1.1207	1.0586
No log	0.3373	28	1.2898	0.2203	1.2898	1.1357
No log	0.3614	30	1.0837	0.3675	1.0837	1.0410
No log	0.3855	32	0.9854	0.3618	0.9854	0.9927
No log	0.4096	34	0.9619	0.3643	0.9619	0.9808
No log	0.4337	36	1.0498	0.3844	1.0498	1.0246
No log	0.4578	38	1.1671	0.3187	1.1671	1.0803
No log	0.4819	40	0.9774	0.4289	0.9774	0.9886
No log	0.5060	42	0.8744	0.3778	0.8744	0.9351
No log	0.5301	44	0.8866	0.3451	0.8866	0.9416
No log	0.5542	46	0.8632	0.3834	0.8632	0.9291
No log	0.5783	48	0.8355	0.3834	0.8355	0.9141
No log	0.6024	50	0.8104	0.4230	0.8104	0.9002
No log	0.6265	52	0.8163	0.5397	0.8163	0.9035
No log	0.6506	54	0.7332	0.5040	0.7332	0.8563
No log	0.6747	56	0.7001	0.6197	0.7001	0.8367
No log	0.6988	58	0.7772	0.5874	0.7772	0.8816
No log	0.7229	60	0.6589	0.6607	0.6589	0.8117
No log	0.7470	62	0.7675	0.6807	0.7675	0.8761
No log	0.7711	64	0.7801	0.6437	0.7801	0.8832
No log	0.7952	66	0.8225	0.6239	0.8225	0.9069
No log	0.8193	68	0.7509	0.6121	0.7509	0.8666
No log	0.8434	70	0.7045	0.6085	0.7045	0.8393
No log	0.8675	72	0.8206	0.5137	0.8206	0.9059
No log	0.8916	74	0.7895	0.5506	0.7895	0.8885
No log	0.9157	76	0.6833	0.6302	0.6833	0.8266
No log	0.9398	78	0.9995	0.5798	0.9995	0.9998
No log	0.9639	80	1.2050	0.4285	1.2050	1.0977
No log	0.9880	82	0.9016	0.5889	0.9016	0.9495
No log	1.0120	84	0.7609	0.5768	0.7609	0.8723
No log	1.0361	86	0.7249	0.5485	0.7249	0.8514
No log	1.0602	88	0.7379	0.5246	0.7379	0.8590
No log	1.0843	90	0.7340	0.5079	0.7340	0.8568
No log	1.1084	92	0.7468	0.5243	0.7468	0.8642
No log	1.1325	94	0.8779	0.6029	0.8779	0.9370
No log	1.1566	96	0.8080	0.5965	0.8080	0.8989
No log	1.1807	98	0.6611	0.6651	0.6611	0.8131
No log	1.2048	100	0.6483	0.7105	0.6483	0.8052
No log	1.2289	102	0.6725	0.7074	0.6725	0.8200
No log	1.2530	104	0.6800	0.7119	0.6800	0.8246
No log	1.2771	106	0.8313	0.6142	0.8313	0.9118
No log	1.3012	108	0.9190	0.5221	0.9189	0.9586
No log	1.3253	110	0.8077	0.6009	0.8077	0.8987
No log	1.3494	112	0.6933	0.6688	0.6933	0.8326
No log	1.3735	114	0.6850	0.6847	0.6850	0.8277
No log	1.3976	116	0.7140	0.6118	0.7140	0.8450
No log	1.4217	118	0.8254	0.5589	0.8254	0.9085
No log	1.4458	120	0.9128	0.4378	0.9128	0.9554
No log	1.4699	122	0.8020	0.5168	0.8020	0.8955
No log	1.4940	124	0.7293	0.5739	0.7293	0.8540
No log	1.5181	126	0.8433	0.6272	0.8433	0.9183
No log	1.5422	128	0.8914	0.5977	0.8914	0.9441
No log	1.5663	130	0.7730	0.6226	0.7730	0.8792
No log	1.5904	132	0.6869	0.5325	0.6869	0.8288
No log	1.6145	134	0.7612	0.5509	0.7612	0.8725
No log	1.6386	136	0.7825	0.6193	0.7825	0.8846
No log	1.6627	138	0.7039	0.6442	0.7039	0.8390
No log	1.6867	140	0.6570	0.6946	0.6570	0.8105
No log	1.7108	142	0.6603	0.6931	0.6603	0.8126
No log	1.7349	144	0.6731	0.6945	0.6731	0.8204
No log	1.7590	146	0.6853	0.6854	0.6853	0.8278
No log	1.7831	148	0.7047	0.6919	0.7047	0.8395
No log	1.8072	150	0.6988	0.6721	0.6988	0.8360
No log	1.8313	152	0.6961	0.6952	0.6961	0.8344
No log	1.8554	154	0.6976	0.6829	0.6976	0.8352
No log	1.8795	156	0.6984	0.6835	0.6984	0.8357
No log	1.9036	158	0.6976	0.6829	0.6976	0.8352
No log	1.9277	160	0.7326	0.7018	0.7326	0.8559
No log	1.9518	162	0.7810	0.6731	0.7810	0.8837
No log	1.9759	164	0.7915	0.6731	0.7915	0.8897
No log	2.0	166	0.7269	0.6842	0.7269	0.8526
No log	2.0241	168	0.7330	0.6742	0.7330	0.8562
No log	2.0482	170	0.7549	0.6703	0.7549	0.8688
No log	2.0723	172	0.7871	0.6495	0.7871	0.8872
No log	2.0964	174	0.7590	0.6386	0.7590	0.8712
No log	2.1205	176	0.7435	0.6363	0.7435	0.8623
No log	2.1446	178	0.7705	0.5553	0.7705	0.8778
No log	2.1687	180	0.8432	0.5520	0.8432	0.9183
No log	2.1928	182	0.8182	0.5793	0.8182	0.9046
No log	2.2169	184	0.7045	0.6267	0.7045	0.8393
No log	2.2410	186	0.7050	0.6286	0.7050	0.8396
No log	2.2651	188	0.7203	0.6555	0.7203	0.8487
No log	2.2892	190	0.7385	0.6495	0.7385	0.8594
No log	2.3133	192	0.7369	0.6683	0.7369	0.8584
No log	2.3373	194	0.8427	0.6288	0.8427	0.9180
No log	2.3614	196	0.8644	0.5976	0.8644	0.9297
No log	2.3855	198	0.7509	0.6298	0.7509	0.8666
No log	2.4096	200	0.7400	0.5913	0.7400	0.8603
No log	2.4337	202	0.7545	0.5426	0.7545	0.8686
No log	2.4578	204	0.7550	0.5621	0.7550	0.8689
No log	2.4819	206	0.7581	0.5991	0.7581	0.8707
No log	2.5060	208	0.7300	0.6205	0.7300	0.8544
No log	2.5301	210	0.7066	0.6227	0.7066	0.8406
No log	2.5542	212	0.6944	0.6595	0.6944	0.8333
No log	2.5783	214	0.7376	0.6412	0.7376	0.8589
No log	2.6024	216	0.7200	0.6569	0.7200	0.8485
No log	2.6265	218	0.6624	0.6860	0.6624	0.8139
No log	2.6506	220	0.6687	0.7048	0.6687	0.8177
No log	2.6747	222	0.6586	0.6821	0.6586	0.8116
No log	2.6988	224	0.6670	0.6707	0.6670	0.8167
No log	2.7229	226	0.6779	0.6324	0.6779	0.8233
No log	2.7470	228	0.7122	0.6413	0.7122	0.8439
No log	2.7711	230	0.7979	0.6601	0.7979	0.8932
No log	2.7952	232	0.7932	0.6738	0.7932	0.8906
No log	2.8193	234	0.7129	0.7115	0.7129	0.8443
No log	2.8434	236	0.6929	0.6852	0.6929	0.8324
No log	2.8675	238	0.6923	0.6805	0.6923	0.8321
No log	2.8916	240	0.7030	0.6805	0.7030	0.8385
No log	2.9157	242	0.6809	0.6969	0.6809	0.8252
No log	2.9398	244	0.6711	0.6967	0.6711	0.8192
No log	2.9639	246	0.6702	0.7129	0.6702	0.8186
No log	2.9880	248	0.6970	0.6856	0.6970	0.8348
No log	3.0120	250	0.7805	0.6365	0.7805	0.8834
No log	3.0361	252	0.7651	0.6313	0.7651	0.8747
No log	3.0602	254	0.7121	0.6314	0.7121	0.8439
No log	3.0843	256	0.6634	0.6148	0.6634	0.8145
No log	3.1084	258	0.6945	0.5965	0.6945	0.8333
No log	3.1325	260	0.6739	0.6026	0.6739	0.8209
No log	3.1566	262	0.6353	0.6451	0.6353	0.7971
No log	3.1807	264	0.6792	0.6645	0.6792	0.8241
No log	3.2048	266	0.7273	0.6665	0.7273	0.8528
No log	3.2289	268	0.6818	0.7103	0.6818	0.8257
No log	3.2530	270	0.7128	0.6871	0.7128	0.8443
No log	3.2771	272	0.7365	0.6928	0.7365	0.8582
No log	3.3012	274	0.6809	0.7268	0.6809	0.8252
No log	3.3253	276	0.7312	0.6990	0.7312	0.8551
No log	3.3494	278	0.8380	0.6037	0.8380	0.9154
No log	3.3735	280	0.8058	0.6139	0.8058	0.8977
No log	3.3976	282	0.7042	0.6237	0.7042	0.8391
No log	3.4217	284	0.6687	0.6572	0.6687	0.8177
No log	3.4458	286	0.6935	0.6864	0.6935	0.8328
No log	3.4699	288	0.8162	0.6622	0.8162	0.9034
No log	3.4940	290	0.8845	0.6364	0.8845	0.9405
No log	3.5181	292	0.8922	0.6106	0.8922	0.9446
No log	3.5422	294	0.7788	0.6883	0.7788	0.8825
No log	3.5663	296	0.7019	0.6896	0.7019	0.8378
No log	3.5904	298	0.7128	0.6831	0.7128	0.8443
No log	3.6145	300	0.7258	0.6913	0.7258	0.8520
No log	3.6386	302	0.7592	0.6798	0.7592	0.8713
No log	3.6627	304	0.7001	0.6684	0.7001	0.8367
No log	3.6867	306	0.6591	0.6455	0.6591	0.8118
No log	3.7108	308	0.6443	0.7092	0.6443	0.8027
No log	3.7349	310	0.6591	0.7267	0.6591	0.8119
No log	3.7590	312	0.6627	0.7253	0.6627	0.8141
No log	3.7831	314	0.6957	0.6645	0.6957	0.8341
No log	3.8072	316	0.7786	0.6155	0.7786	0.8824
No log	3.8313	318	0.7659	0.5884	0.7659	0.8751
No log	3.8554	320	0.6953	0.5843	0.6953	0.8338
No log	3.8795	322	0.6566	0.6516	0.6566	0.8103
No log	3.9036	324	0.6492	0.6605	0.6492	0.8057
No log	3.9277	326	0.6464	0.7112	0.6464	0.8040
No log	3.9518	328	0.6644	0.6519	0.6644	0.8151
No log	3.9759	330	0.7551	0.625	0.7551	0.8689
No log	4.0	332	0.8276	0.6025	0.8276	0.9097
No log	4.0241	334	0.8224	0.5942	0.8224	0.9069
No log	4.0482	336	0.7244	0.6395	0.7244	0.8511
No log	4.0723	338	0.6824	0.7206	0.6824	0.8261
No log	4.0964	340	0.6966	0.7205	0.6966	0.8346
No log	4.1205	342	0.6792	0.7090	0.6792	0.8241
No log	4.1446	344	0.7214	0.6786	0.7214	0.8494
No log	4.1687	346	0.7136	0.6636	0.7136	0.8447
No log	4.1928	348	0.6655	0.6843	0.6655	0.8158
No log	4.2169	350	0.6587	0.6443	0.6587	0.8116
No log	4.2410	352	0.6756	0.6115	0.6756	0.8220
No log	4.2651	354	0.7006	0.6228	0.7006	0.8370
No log	4.2892	356	0.7213	0.6173	0.7213	0.8493
No log	4.3133	358	0.7630	0.6166	0.7630	0.8735
No log	4.3373	360	0.7647	0.6483	0.7647	0.8745
No log	4.3614	362	0.7255	0.6684	0.7255	0.8517
No log	4.3855	364	0.7519	0.6656	0.7519	0.8671
No log	4.4096	366	0.7452	0.6656	0.7452	0.8632
No log	4.4337	368	0.6934	0.6611	0.6934	0.8327
No log	4.4578	370	0.6868	0.6462	0.6868	0.8288
No log	4.4819	372	0.7110	0.5960	0.7110	0.8432
No log	4.5060	374	0.7348	0.5838	0.7348	0.8572
No log	4.5301	376	0.7222	0.6233	0.7222	0.8498
No log	4.5542	378	0.7092	0.6508	0.7092	0.8422
No log	4.5783	380	0.7040	0.6701	0.7040	0.8391
No log	4.6024	382	0.6928	0.6990	0.6928	0.8324
No log	4.6265	384	0.6814	0.6811	0.6814	0.8254
No log	4.6506	386	0.6586	0.6866	0.6586	0.8115
No log	4.6747	388	0.6553	0.7030	0.6553	0.8095
No log	4.6988	390	0.6968	0.6828	0.6968	0.8347
No log	4.7229	392	0.8071	0.6207	0.8071	0.8984
No log	4.7470	394	0.7873	0.6293	0.7873	0.8873
No log	4.7711	396	0.6787	0.6939	0.6787	0.8238
No log	4.7952	398	0.6312	0.7244	0.6312	0.7945
No log	4.8193	400	0.6407	0.7108	0.6407	0.8005
No log	4.8434	402	0.6612	0.6904	0.6612	0.8131
No log	4.8675	404	0.7020	0.6817	0.7020	0.8378
No log	4.8916	406	0.7013	0.6790	0.7013	0.8374
No log	4.9157	408	0.6705	0.6642	0.6705	0.8189
No log	4.9398	410	0.6629	0.6609	0.6629	0.8142
No log	4.9639	412	0.6784	0.6245	0.6784	0.8237
No log	4.9880	414	0.6792	0.6034	0.6792	0.8241
No log	5.0120	416	0.6989	0.6388	0.6989	0.8360
No log	5.0361	418	0.7494	0.6585	0.7494	0.8657
No log	5.0602	420	0.7901	0.6570	0.7901	0.8889
No log	5.0843	422	0.7724	0.6757	0.7724	0.8789
No log	5.1084	424	0.7037	0.6896	0.7037	0.8389
No log	5.1325	426	0.6719	0.6969	0.6719	0.8197
No log	5.1566	428	0.6684	0.7052	0.6684	0.8176
No log	5.1807	430	0.6635	0.7067	0.6635	0.8145
No log	5.2048	432	0.7144	0.6759	0.7144	0.8452
No log	5.2289	434	0.7869	0.6483	0.7869	0.8871
No log	5.2530	436	0.8706	0.5971	0.8706	0.9331
No log	5.2771	438	0.8535	0.5937	0.8535	0.9239
No log	5.3012	440	0.7882	0.6260	0.7882	0.8878
No log	5.3253	442	0.7240	0.6711	0.7240	0.8509
No log	5.3494	444	0.7038	0.6905	0.7038	0.8389
No log	5.3735	446	0.7040	0.6986	0.7040	0.8390
No log	5.3976	448	0.7153	0.7076	0.7153	0.8457
No log	5.4217	450	0.7276	0.7092	0.7276	0.8530
No log	5.4458	452	0.8265	0.6900	0.8265	0.9091
No log	5.4699	454	0.9771	0.6116	0.9771	0.9885
No log	5.4940	456	1.0217	0.5647	1.0217	1.0108
No log	5.5181	458	0.9173	0.5640	0.9173	0.9578
No log	5.5422	460	0.7840	0.6475	0.7840	0.8854
No log	5.5663	462	0.7242	0.6789	0.7242	0.8510
No log	5.5904	464	0.6895	0.6770	0.6895	0.8304
No log	5.6145	466	0.6901	0.7090	0.6901	0.8307
No log	5.6386	468	0.7564	0.6674	0.7564	0.8697
No log	5.6627	470	0.8169	0.6704	0.8169	0.9038
No log	5.6867	472	0.8467	0.6619	0.8467	0.9201
No log	5.7108	474	0.8026	0.6426	0.8026	0.8959
No log	5.7349	476	0.7236	0.6656	0.7236	0.8506
No log	5.7590	478	0.6760	0.7018	0.6760	0.8222
No log	5.7831	480	0.6881	0.6971	0.6881	0.8295
No log	5.8072	482	0.7357	0.6705	0.7357	0.8577
No log	5.8313	484	0.7953	0.6314	0.7953	0.8918
No log	5.8554	486	0.8382	0.6325	0.8382	0.9155
No log	5.8795	488	0.8481	0.6257	0.8481	0.9209
No log	5.9036	490	0.7933	0.6262	0.7933	0.8907
No log	5.9277	492	0.7216	0.6762	0.7216	0.8495
No log	5.9518	494	0.7193	0.6811	0.7193	0.8481
No log	5.9759	496	0.7028	0.6691	0.7028	0.8383
No log	6.0	498	0.6845	0.6578	0.6845	0.8274
0.4171	6.0241	500	0.6836	0.6874	0.6836	0.8268
0.4171	6.0482	502	0.7654	0.6787	0.7654	0.8749
0.4171	6.0723	504	0.9468	0.5863	0.9468	0.9731
0.4171	6.0964	506	0.9617	0.5681	0.9617	0.9807
0.4171	6.1205	508	0.9463	0.5679	0.9463	0.9728
0.4171	6.1446	510	0.8366	0.5872	0.8366	0.9146

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1