ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k7_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9971
• Qwk: 0.2842
• Mse: 0.9971
• Rmse: 0.9985

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	3.1011	-0.0194	3.1011	1.7610
No log	0.0930	4	1.5266	0.0168	1.5266	1.2355
No log	0.1395	6	1.4844	0.0210	1.4844	1.2184
No log	0.1860	8	1.9207	0.0682	1.9207	1.3859
No log	0.2326	10	1.4313	0.0689	1.4313	1.1964
No log	0.2791	12	0.9204	0.2191	0.9204	0.9594
No log	0.3256	14	0.8332	0.1873	0.8332	0.9128
No log	0.3721	16	0.7782	0.1730	0.7782	0.8822
No log	0.4186	18	0.7114	0.1398	0.7114	0.8434
No log	0.4651	20	0.7645	0.1321	0.7645	0.8744
No log	0.5116	22	0.8025	0.1133	0.8025	0.8958
No log	0.5581	24	0.7876	0.1698	0.7876	0.8875
No log	0.6047	26	0.7272	0.3224	0.7272	0.8528
No log	0.6512	28	0.9564	0.0843	0.9564	0.9780
No log	0.6977	30	0.8561	0.1333	0.8561	0.9252
No log	0.7442	32	0.8776	0.0843	0.8776	0.9368
No log	0.7907	34	0.9005	0.0843	0.9005	0.9489
No log	0.8372	36	0.9237	0.1165	0.9237	0.9611
No log	0.8837	38	0.7642	0.1746	0.7642	0.8742
No log	0.9302	40	0.8844	0.0933	0.8844	0.9404
No log	0.9767	42	0.8565	0.2000	0.8565	0.9255
No log	1.0233	44	0.9912	0.1605	0.9912	0.9956
No log	1.0698	46	0.9220	0.1795	0.9220	0.9602
No log	1.1163	48	0.7760	0.1475	0.7760	0.8809
No log	1.1628	50	0.7531	0.0667	0.7531	0.8678
No log	1.2093	52	0.8071	0.1691	0.8071	0.8984
No log	1.2558	54	0.7131	0.0123	0.7131	0.8444
No log	1.3023	56	0.6381	0.2308	0.6381	0.7988
No log	1.3488	58	0.6013	0.2308	0.6013	0.7755
No log	1.3953	60	0.6429	0.2593	0.6429	0.8018
No log	1.4419	62	0.8056	0.1481	0.8056	0.8976
No log	1.4884	64	0.8257	0.1652	0.8257	0.9087
No log	1.5349	66	0.6693	0.2281	0.6693	0.8181
No log	1.5814	68	0.6291	0.0071	0.6291	0.7932
No log	1.6279	70	0.6029	0.1329	0.6029	0.7764
No log	1.6744	72	0.5557	0.2533	0.5557	0.7454
No log	1.7209	74	0.7466	0.2780	0.7466	0.8641
No log	1.7674	76	0.8902	0.2124	0.8902	0.9435
No log	1.8140	78	0.7013	0.2332	0.7013	0.8375
No log	1.8605	80	0.6694	0.1304	0.6694	0.8181
No log	1.9070	82	0.7094	0.0361	0.7094	0.8422
No log	1.9535	84	0.7364	0.0698	0.7364	0.8581
No log	2.0	86	0.6527	0.1373	0.6527	0.8079
No log	2.0465	88	0.5731	0.2000	0.5731	0.7570
No log	2.0930	90	0.5710	0.3289	0.5710	0.7556
No log	2.1395	92	0.5876	0.2973	0.5876	0.7665
No log	2.1860	94	0.6035	0.2000	0.6035	0.7768
No log	2.2326	96	0.6165	0.1461	0.6165	0.7852
No log	2.2791	98	0.6157	0.2000	0.6157	0.7847
No log	2.3256	100	0.6505	0.3263	0.6505	0.8065
No log	2.3721	102	0.6231	0.1910	0.6231	0.7894
No log	2.4186	104	0.6686	0.1579	0.6686	0.8176
No log	2.4651	106	0.7678	0.2793	0.7678	0.8763
No log	2.5116	108	0.5567	0.2195	0.5567	0.7461
No log	2.5581	110	0.4990	0.3032	0.4990	0.7064
No log	2.6047	112	0.4848	0.3377	0.4848	0.6963
No log	2.6512	114	0.5953	0.2883	0.5953	0.7716
No log	2.6977	116	0.6707	0.3161	0.6707	0.8190
No log	2.7442	118	0.5501	0.3659	0.5501	0.7417
No log	2.7907	120	0.4913	0.3865	0.4913	0.7009
No log	2.8372	122	0.5105	0.3953	0.5105	0.7145
No log	2.8837	124	0.5097	0.4556	0.5097	0.7140
No log	2.9302	126	0.6469	0.2646	0.6469	0.8043
No log	2.9767	128	0.7747	0.2314	0.7747	0.8801
No log	3.0233	130	1.0950	0.1622	1.0950	1.0464
No log	3.0698	132	1.1922	0.1399	1.1922	1.0919
No log	3.1163	134	0.9132	0.125	0.9132	0.9556
No log	3.1628	136	0.5700	0.4475	0.5700	0.7550
No log	3.2093	138	0.5935	0.3786	0.5935	0.7704
No log	3.2558	140	0.7824	0.2711	0.7824	0.8846
No log	3.3023	142	0.6129	0.2653	0.6129	0.7829
No log	3.3488	144	0.5414	0.4222	0.5414	0.7358
No log	3.3953	146	0.6814	0.2871	0.6814	0.8255
No log	3.4419	148	0.7606	0.2203	0.7606	0.8721
No log	3.4884	150	0.5646	0.3913	0.5646	0.7514
No log	3.5349	152	0.5420	0.3708	0.5420	0.7362
No log	3.5814	154	0.5496	0.3898	0.5496	0.7413
No log	3.6279	156	0.5317	0.375	0.5317	0.7291
No log	3.6744	158	0.6185	0.2963	0.6185	0.7865
No log	3.7209	160	0.6883	0.2511	0.6883	0.8297
No log	3.7674	162	0.6287	0.3462	0.6287	0.7929
No log	3.8140	164	0.6144	0.2830	0.6144	0.7838
No log	3.8605	166	0.6088	0.3242	0.6088	0.7802
No log	3.9070	168	0.6149	0.3247	0.6149	0.7841
No log	3.9535	170	0.7238	0.3414	0.7238	0.8508
No log	4.0	172	0.7332	0.3571	0.7332	0.8563
No log	4.0465	174	0.7177	0.3702	0.7177	0.8472
No log	4.0930	176	0.6714	0.3388	0.6714	0.8194
No log	4.1395	178	0.7312	0.3115	0.7312	0.8551
No log	4.1860	180	0.8735	0.2604	0.8735	0.9346
No log	4.2326	182	0.9279	0.2604	0.9279	0.9633
No log	4.2791	184	0.8956	0.2548	0.8956	0.9464
No log	4.3256	186	0.8473	0.2558	0.8473	0.9205
No log	4.3721	188	0.7964	0.1933	0.7964	0.8924
No log	4.4186	190	0.8313	0.1935	0.8313	0.9117
No log	4.4651	192	0.7393	0.3527	0.7393	0.8598
No log	4.5116	194	0.6532	0.3103	0.6532	0.8082
No log	4.5581	196	0.6827	0.3242	0.6827	0.8263
No log	4.6047	198	0.8827	0.0820	0.8827	0.9395
No log	4.6512	200	1.1290	0.0725	1.1290	1.0625
No log	4.6977	202	1.1016	0.1601	1.1016	1.0496
No log	4.7442	204	0.8046	0.3407	0.8046	0.8970
No log	4.7907	206	0.5538	0.3939	0.5538	0.7442
No log	4.8372	208	0.6863	0.3580	0.6863	0.8284
No log	4.8837	210	0.6377	0.3905	0.6377	0.7985
No log	4.9302	212	0.4921	0.4225	0.4921	0.7015
No log	4.9767	214	0.5963	0.4930	0.5963	0.7722
No log	5.0233	216	0.8848	0.1882	0.8848	0.9406
No log	5.0698	218	0.8354	0.1150	0.8354	0.9140
No log	5.1163	220	0.7210	0.1781	0.7210	0.8491
No log	5.1628	222	0.7597	0.1852	0.7597	0.8716
No log	5.2093	224	0.7395	0.2227	0.7395	0.8600
No log	5.2558	226	0.7171	0.3128	0.7171	0.8468
No log	5.3023	228	0.7720	0.2134	0.7720	0.8786
No log	5.3488	230	0.9284	0.2177	0.9284	0.9635
No log	5.3953	232	0.8986	0.2360	0.8986	0.9479
No log	5.4419	234	0.8012	0.2558	0.8012	0.8951
No log	5.4884	236	0.7765	0.2253	0.7765	0.8812
No log	5.5349	238	0.8078	0.2537	0.8078	0.8988
No log	5.5814	240	0.9353	0.2409	0.9353	0.9671
No log	5.6279	242	1.0236	0.2394	1.0236	1.0117
No log	5.6744	244	0.9858	0.2613	0.9858	0.9929
No log	5.7209	246	0.7873	0.2836	0.7873	0.8873
No log	5.7674	248	0.6753	0.3195	0.6753	0.8218
No log	5.8140	250	0.6654	0.3138	0.6654	0.8157
No log	5.8605	252	0.6286	0.4234	0.6286	0.7928
No log	5.9070	254	0.7181	0.2881	0.7181	0.8474
No log	5.9535	256	0.8880	0.1464	0.8880	0.9423
No log	6.0	258	0.9769	0.1741	0.9769	0.9884
No log	6.0465	260	0.9782	0.1660	0.9782	0.9890
No log	6.0930	262	0.8830	0.1588	0.8830	0.9397
No log	6.1395	264	0.8098	0.2287	0.8098	0.8999
No log	6.1860	266	0.7755	0.2771	0.7755	0.8807
No log	6.2326	268	0.7243	0.3251	0.7243	0.8511
No log	6.2791	270	0.7016	0.3527	0.7016	0.8376
No log	6.3256	272	0.7812	0.2481	0.7812	0.8839
No log	6.3721	274	1.0193	0.2680	1.0193	1.0096
No log	6.4186	276	1.3367	0.1182	1.3367	1.1562
No log	6.4651	278	1.4401	0.1411	1.4401	1.2000
No log	6.5116	280	1.3060	0.1640	1.3060	1.1428
No log	6.5581	282	1.0192	0.2571	1.0192	1.0095
No log	6.6047	284	0.7794	0.375	0.7794	0.8828
No log	6.6512	286	0.7062	0.4286	0.7062	0.8404
No log	6.6977	288	0.6761	0.4093	0.6761	0.8222
No log	6.7442	290	0.7552	0.3438	0.7552	0.8690
No log	6.7907	292	0.9502	0.3025	0.9502	0.9748
No log	6.8372	294	1.1009	0.1587	1.1009	1.0492
No log	6.8837	296	1.1778	0.1661	1.1778	1.0853
No log	6.9302	298	1.1296	0.1608	1.1296	1.0628
No log	6.9767	300	1.0959	0.2276	1.0959	1.0469
No log	7.0233	302	1.0034	0.2792	1.0034	1.0017
No log	7.0698	304	0.9754	0.3094	0.9754	0.9876
No log	7.1163	306	0.9120	0.3684	0.9120	0.9550
No log	7.1628	308	0.9055	0.3684	0.9055	0.9516
No log	7.2093	310	0.9492	0.3114	0.9492	0.9743
No log	7.2558	312	0.9778	0.25	0.9778	0.9889
No log	7.3023	314	1.0375	0.2542	1.0375	1.0186
No log	7.3488	316	1.1244	0.1661	1.1244	1.0604
No log	7.3953	318	1.0975	0.1941	1.0975	1.0476
No log	7.4419	320	0.9974	0.1587	0.9974	0.9987
No log	7.4884	322	0.9844	0.1587	0.9844	0.9922
No log	7.5349	324	0.9029	0.2366	0.9029	0.9502
No log	7.5814	326	0.8107	0.2829	0.8107	0.9004
No log	7.6279	328	0.7866	0.3466	0.7866	0.8869
No log	7.6744	330	0.8345	0.3488	0.8345	0.9135
No log	7.7209	332	0.9155	0.1818	0.9155	0.9568
No log	7.7674	334	0.9281	0.1818	0.9281	0.9634
No log	7.8140	336	0.9204	0.2593	0.9204	0.9594
No log	7.8605	338	0.8618	0.3460	0.8618	0.9283
No log	7.9070	340	0.7911	0.3488	0.7911	0.8895
No log	7.9535	342	0.8008	0.3488	0.8008	0.8949
No log	8.0	344	0.8084	0.3488	0.8084	0.8991
No log	8.0465	346	0.8413	0.3460	0.8413	0.9172
No log	8.0930	348	0.8842	0.2906	0.8842	0.9403
No log	8.1395	350	0.8494	0.3460	0.8494	0.9216
No log	8.1860	352	0.8200	0.3460	0.8200	0.9055
No log	8.2326	354	0.8196	0.3460	0.8196	0.9053
No log	8.2791	356	0.8573	0.3460	0.8573	0.9259
No log	8.3256	358	0.9161	0.2593	0.9161	0.9571
No log	8.3721	360	0.9231	0.2593	0.9231	0.9608
No log	8.4186	362	0.8682	0.2797	0.8682	0.9318
No log	8.4651	364	0.8320	0.3125	0.8320	0.9121
No log	8.5116	366	0.8463	0.3125	0.8463	0.9200
No log	8.5581	368	0.8809	0.2481	0.8809	0.9386
No log	8.6047	370	0.8901	0.2836	0.8901	0.9434
No log	8.6512	372	0.8871	0.2836	0.8871	0.9419
No log	8.6977	374	0.8343	0.3716	0.8343	0.9134
No log	8.7442	376	0.7770	0.3716	0.7770	0.8815
No log	8.7907	378	0.7555	0.3716	0.7555	0.8692
No log	8.8372	380	0.7853	0.3716	0.7853	0.8862
No log	8.8837	382	0.8368	0.3083	0.8368	0.9148
No log	8.9302	384	0.9004	0.3043	0.9004	0.9489
No log	8.9767	386	0.9792	0.2973	0.9792	0.9895
No log	9.0233	388	1.0218	0.2765	1.0218	1.0108
No log	9.0698	390	1.0159	0.2765	1.0159	1.0079
No log	9.1163	392	1.0041	0.3074	1.0041	1.0020
No log	9.1628	394	0.9742	0.2806	0.9742	0.9870
No log	9.2093	396	0.9277	0.2836	0.9277	0.9632
No log	9.2558	398	0.8884	0.3383	0.8884	0.9425
No log	9.3023	400	0.8821	0.3383	0.8821	0.9392
No log	9.3488	402	0.8836	0.3103	0.8836	0.9400
No log	9.3953	404	0.9046	0.2782	0.9046	0.9511
No log	9.4419	406	0.9377	0.2177	0.9377	0.9684
No log	9.4884	408	0.9573	0.2464	0.9573	0.9784
No log	9.5349	410	0.9698	0.2464	0.9698	0.9848
No log	9.5814	412	0.9926	0.2509	0.9926	0.9963
No log	9.6279	414	1.0233	0.2613	1.0233	1.0116
No log	9.6744	416	1.0363	0.2676	1.0363	1.0180
No log	9.7209	418	1.0338	0.2613	1.0338	1.0168
No log	9.7674	420	1.0232	0.2828	1.0232	1.0115
No log	9.8140	422	1.0173	0.2828	1.0173	1.0086
No log	9.8605	424	1.0111	0.2828	1.0111	1.0055
No log	9.9070	426	1.0038	0.2842	1.0038	1.0019
No log	9.9535	428	0.9978	0.2842	0.9978	0.9989
No log	10.0	430	0.9971	0.2842	0.9971	0.9985

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1