ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7469
• Qwk: 0.7334
• Mse: 0.7469
• Rmse: 0.8642

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	2.1765	-0.0201	2.1765	1.4753
No log	0.0976	4	1.5723	0.1372	1.5723	1.2539
No log	0.1463	6	1.4383	0.2002	1.4383	1.1993
No log	0.1951	8	1.5270	0.2404	1.5270	1.2357
No log	0.2439	10	1.3294	0.2032	1.3294	1.1530
No log	0.2927	12	1.3250	0.2437	1.3250	1.1511
No log	0.3415	14	1.1990	0.2894	1.1990	1.0950
No log	0.3902	16	1.0730	0.4105	1.0730	1.0358
No log	0.4390	18	0.9734	0.4773	0.9734	0.9866
No log	0.4878	20	0.9602	0.5382	0.9602	0.9799
No log	0.5366	22	0.9574	0.5267	0.9574	0.9784
No log	0.5854	24	0.9330	0.5152	0.9330	0.9659
No log	0.6341	26	0.9305	0.4975	0.9305	0.9646
No log	0.6829	28	0.8976	0.5182	0.8976	0.9474
No log	0.7317	30	0.9030	0.4972	0.9030	0.9503
No log	0.7805	32	0.8729	0.5205	0.8729	0.9343
No log	0.8293	34	0.8649	0.5273	0.8649	0.9300
No log	0.8780	36	0.9165	0.4540	0.9165	0.9574
No log	0.9268	38	0.8277	0.6192	0.8277	0.9098
No log	0.9756	40	0.8561	0.5619	0.8561	0.9252
No log	1.0244	42	0.8315	0.6558	0.8315	0.9119
No log	1.0732	44	1.1510	0.5358	1.1510	1.0728
No log	1.1220	46	1.3231	0.4855	1.3231	1.1503
No log	1.1707	48	1.0290	0.5556	1.0290	1.0144
No log	1.2195	50	0.8074	0.6420	0.8074	0.8985
No log	1.2683	52	0.8009	0.6138	0.8009	0.8949
No log	1.3171	54	0.7702	0.6430	0.7702	0.8776
No log	1.3659	56	1.0095	0.6217	1.0095	1.0048
No log	1.4146	58	1.2811	0.4216	1.2811	1.1318
No log	1.4634	60	1.1685	0.5069	1.1685	1.0810
No log	1.5122	62	0.8137	0.6098	0.8137	0.9020
No log	1.5610	64	0.7500	0.6655	0.7500	0.8660
No log	1.6098	66	0.7584	0.6441	0.7584	0.8709
No log	1.6585	68	0.9452	0.5796	0.9452	0.9722
No log	1.7073	70	1.4340	0.4976	1.4340	1.1975
No log	1.7561	72	1.4854	0.4677	1.4854	1.2188
No log	1.8049	74	1.1891	0.5131	1.1891	1.0905
No log	1.8537	76	0.9286	0.5583	0.9286	0.9636
No log	1.9024	78	0.8462	0.5597	0.8462	0.9199
No log	1.9512	80	0.8188	0.5641	0.8188	0.9049
No log	2.0	82	0.7932	0.6535	0.7932	0.8906
No log	2.0488	84	0.9798	0.6170	0.9798	0.9898
No log	2.0976	86	1.1158	0.5679	1.1158	1.0563
No log	2.1463	88	0.9533	0.6184	0.9533	0.9763
No log	2.1951	90	0.7653	0.6988	0.7653	0.8748
No log	2.2439	92	0.7200	0.6926	0.7200	0.8485
No log	2.2927	94	0.7684	0.7015	0.7684	0.8766
No log	2.3415	96	0.8644	0.6640	0.8644	0.9297
No log	2.3902	98	1.0139	0.5862	1.0139	1.0069
No log	2.4390	100	1.0363	0.5875	1.0363	1.0180
No log	2.4878	102	0.9115	0.6385	0.9115	0.9547
No log	2.5366	104	0.7943	0.6847	0.7943	0.8912
No log	2.5854	106	0.8245	0.6959	0.8245	0.9080
No log	2.6341	108	1.0071	0.5280	1.0071	1.0035
No log	2.6829	110	1.0449	0.5637	1.0449	1.0222
No log	2.7317	112	0.8558	0.6600	0.8558	0.9251
No log	2.7805	114	0.7740	0.6745	0.7740	0.8798
No log	2.8293	116	0.7393	0.6479	0.7393	0.8598
No log	2.8780	118	0.7362	0.6554	0.7362	0.8580
No log	2.9268	120	0.7572	0.6967	0.7572	0.8702
No log	2.9756	122	0.8784	0.6483	0.8784	0.9373
No log	3.0244	124	1.1083	0.5723	1.1083	1.0528
No log	3.0732	126	1.0974	0.5723	1.0974	1.0476
No log	3.1220	128	0.8956	0.6410	0.8956	0.9464
No log	3.1707	130	0.8383	0.6706	0.8383	0.9156
No log	3.2195	132	0.9196	0.6139	0.9196	0.9590
No log	3.2683	134	0.8936	0.6085	0.8936	0.9453
No log	3.3171	136	0.7932	0.6860	0.7932	0.8906
No log	3.3659	138	0.7590	0.7047	0.7590	0.8712
No log	3.4146	140	0.7886	0.7132	0.7886	0.8880
No log	3.4634	142	0.9130	0.6255	0.9130	0.9555
No log	3.5122	144	0.9143	0.6508	0.9143	0.9562
No log	3.5610	146	0.7807	0.6887	0.7807	0.8836
No log	3.6098	148	0.6896	0.7075	0.6896	0.8304
No log	3.6585	150	0.6886	0.6970	0.6886	0.8298
No log	3.7073	152	0.7063	0.7071	0.7063	0.8404
No log	3.7561	154	0.7474	0.7071	0.7474	0.8645
No log	3.8049	156	0.7748	0.7144	0.7748	0.8802
No log	3.8537	158	0.7178	0.7014	0.7178	0.8473
No log	3.9024	160	0.6786	0.6817	0.6786	0.8238
No log	3.9512	162	0.6833	0.7096	0.6833	0.8266
No log	4.0	164	0.7210	0.6978	0.7210	0.8491
No log	4.0488	166	0.7764	0.7004	0.7764	0.8811
No log	4.0976	168	0.8756	0.6440	0.8756	0.9358
No log	4.1463	170	1.0230	0.6034	1.0230	1.0115
No log	4.1951	172	1.0857	0.5913	1.0857	1.0420
No log	4.2439	174	0.9324	0.6261	0.9324	0.9656
No log	4.2927	176	0.7802	0.7137	0.7802	0.8833
No log	4.3415	178	0.7389	0.6990	0.7389	0.8596
No log	4.3902	180	0.7522	0.7225	0.7522	0.8673
No log	4.4390	182	0.7603	0.7072	0.7603	0.8720
No log	4.4878	184	0.7252	0.7024	0.7252	0.8516
No log	4.5366	186	0.6868	0.7014	0.6868	0.8287
No log	4.5854	188	0.6769	0.6945	0.6769	0.8227
No log	4.6341	190	0.6724	0.7188	0.6724	0.8200
No log	4.6829	192	0.6600	0.7426	0.6600	0.8124
No log	4.7317	194	0.6522	0.7579	0.6522	0.8076
No log	4.7805	196	0.6353	0.7281	0.6353	0.7971
No log	4.8293	198	0.6306	0.7195	0.6306	0.7941
No log	4.8780	200	0.6469	0.7578	0.6469	0.8043
No log	4.9268	202	0.7597	0.7405	0.7597	0.8716
No log	4.9756	204	0.8686	0.6679	0.8686	0.9320
No log	5.0244	206	0.9394	0.6406	0.9394	0.9692
No log	5.0732	208	0.8698	0.6391	0.8698	0.9326
No log	5.1220	210	0.7369	0.7626	0.7369	0.8585
No log	5.1707	212	0.6716	0.7557	0.6716	0.8195
No log	5.2195	214	0.6799	0.7610	0.6799	0.8246
No log	5.2683	216	0.7445	0.7216	0.7445	0.8628
No log	5.3171	218	0.7841	0.7302	0.7841	0.8855
No log	5.3659	220	0.7490	0.7407	0.7490	0.8654
No log	5.4146	222	0.7031	0.7455	0.7031	0.8385
No log	5.4634	224	0.6543	0.7475	0.6543	0.8089
No log	5.5122	226	0.6437	0.7570	0.6437	0.8023
No log	5.5610	228	0.6419	0.7570	0.6419	0.8012
No log	5.6098	230	0.6480	0.7570	0.6480	0.8050
No log	5.6585	232	0.6685	0.7270	0.6685	0.8176
No log	5.7073	234	0.7376	0.7329	0.7376	0.8588
No log	5.7561	236	0.7927	0.7316	0.7927	0.8904
No log	5.8049	238	0.8229	0.7051	0.8229	0.9071
No log	5.8537	240	0.7874	0.7336	0.7874	0.8873
No log	5.9024	242	0.7572	0.7302	0.7572	0.8702
No log	5.9512	244	0.7783	0.7171	0.7783	0.8822
No log	6.0	246	0.7784	0.7247	0.7784	0.8823
No log	6.0488	248	0.8172	0.7090	0.8172	0.9040
No log	6.0976	250	0.7971	0.7217	0.7971	0.8928
No log	6.1463	252	0.7928	0.7294	0.7928	0.8904
No log	6.1951	254	0.7440	0.7431	0.7440	0.8626
No log	6.2439	256	0.6987	0.7577	0.6987	0.8359
No log	6.2927	258	0.6832	0.7305	0.6832	0.8265
No log	6.3415	260	0.6845	0.7451	0.6845	0.8273
No log	6.3902	262	0.6732	0.7540	0.6732	0.8205
No log	6.4390	264	0.6895	0.7449	0.6895	0.8303
No log	6.4878	266	0.7278	0.7567	0.7278	0.8531
No log	6.5366	268	0.7939	0.6919	0.7939	0.8910
No log	6.5854	270	0.8708	0.6496	0.8708	0.9331
No log	6.6341	272	0.8699	0.6586	0.8699	0.9327
No log	6.6829	274	0.8757	0.6633	0.8757	0.9358
No log	6.7317	276	0.8326	0.6757	0.8326	0.9125
No log	6.7805	278	0.7692	0.7122	0.7692	0.8770
No log	6.8293	280	0.7334	0.7186	0.7334	0.8564
No log	6.8780	282	0.7211	0.7280	0.7211	0.8492
No log	6.9268	284	0.7558	0.7162	0.7558	0.8694
No log	6.9756	286	0.8400	0.6576	0.8400	0.9165
No log	7.0244	288	0.8944	0.6557	0.8944	0.9457
No log	7.0732	290	0.8726	0.6468	0.8726	0.9341
No log	7.1220	292	0.8030	0.6678	0.8030	0.8961
No log	7.1707	294	0.7568	0.7308	0.7568	0.8700
No log	7.2195	296	0.7337	0.7501	0.7337	0.8565
No log	7.2683	298	0.7511	0.7384	0.7511	0.8667
No log	7.3171	300	0.7397	0.7190	0.7397	0.8600
No log	7.3659	302	0.7156	0.7294	0.7156	0.8459
No log	7.4146	304	0.7384	0.7190	0.7384	0.8593
No log	7.4634	306	0.7533	0.7032	0.7533	0.8679
No log	7.5122	308	0.7987	0.6981	0.7987	0.8937
No log	7.5610	310	0.8245	0.7033	0.8245	0.9080
No log	7.6098	312	0.8486	0.6821	0.8486	0.9212
No log	7.6585	314	0.8596	0.6734	0.8596	0.9272
No log	7.7073	316	0.8389	0.6848	0.8389	0.9159
No log	7.7561	318	0.7808	0.7089	0.7808	0.8836
No log	7.8049	320	0.7136	0.7194	0.7136	0.8447
No log	7.8537	322	0.6636	0.7641	0.6636	0.8146
No log	7.9024	324	0.6439	0.7322	0.6439	0.8024
No log	7.9512	326	0.6372	0.7267	0.6372	0.7982
No log	8.0	328	0.6414	0.7306	0.6414	0.8009
No log	8.0488	330	0.6616	0.7614	0.6616	0.8134
No log	8.0976	332	0.7070	0.7358	0.7070	0.8408
No log	8.1463	334	0.7661	0.7032	0.7661	0.8753
No log	8.1951	336	0.7936	0.6896	0.7936	0.8908
No log	8.2439	338	0.8137	0.7010	0.8137	0.9020
No log	8.2927	340	0.8071	0.7010	0.8071	0.8984
No log	8.3415	342	0.7818	0.6896	0.7818	0.8842
No log	8.3902	344	0.7569	0.6893	0.7569	0.8700
No log	8.4390	346	0.7426	0.6798	0.7426	0.8617
No log	8.4878	348	0.7236	0.7036	0.7236	0.8506
No log	8.5366	350	0.7151	0.7236	0.7151	0.8456
No log	8.5854	352	0.7264	0.6883	0.7264	0.8523
No log	8.6341	354	0.7368	0.6919	0.7368	0.8584
No log	8.6829	356	0.7449	0.6882	0.7449	0.8631
No log	8.7317	358	0.7521	0.6961	0.7521	0.8672
No log	8.7805	360	0.7596	0.7017	0.7596	0.8715
No log	8.8293	362	0.7640	0.7017	0.7640	0.8741
No log	8.8780	364	0.7543	0.6822	0.7543	0.8685
No log	8.9268	366	0.7396	0.6798	0.7396	0.8600
No log	8.9756	368	0.7249	0.7032	0.7249	0.8514
No log	9.0244	370	0.7086	0.7279	0.7086	0.8418
No log	9.0732	372	0.6886	0.7574	0.6886	0.8298
No log	9.1220	374	0.6772	0.7461	0.6772	0.8229
No log	9.1707	376	0.6749	0.7461	0.6749	0.8215
No log	9.2195	378	0.6739	0.7461	0.6739	0.8209
No log	9.2683	380	0.6819	0.7518	0.6819	0.8258
No log	9.3171	382	0.6966	0.7489	0.6966	0.8346
No log	9.3659	384	0.7165	0.7358	0.7165	0.8465
No log	9.4146	386	0.7374	0.7020	0.7374	0.8587
No log	9.4634	388	0.7566	0.6968	0.7566	0.8698
No log	9.5122	390	0.7699	0.6961	0.7699	0.8774
No log	9.5610	392	0.7735	0.7039	0.7735	0.8795
No log	9.6098	394	0.7719	0.7080	0.7719	0.8786
No log	9.6585	396	0.7711	0.7046	0.7711	0.8781
No log	9.7073	398	0.7670	0.7046	0.7670	0.8758
No log	9.7561	400	0.7619	0.7160	0.7619	0.8729
No log	9.8049	402	0.7564	0.7126	0.7564	0.8697
No log	9.8537	404	0.7524	0.7126	0.7524	0.8674
No log	9.9024	406	0.7493	0.7334	0.7493	0.8656
No log	9.9512	408	0.7472	0.7334	0.7472	0.8644
No log	10.0	410	0.7469	0.7334	0.7469	0.8642

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1