ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7495
• Qwk: 0.3921
• Mse: 0.7495
• Rmse: 0.8657

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	4.0092	-0.0020	4.0092	2.0023
No log	0.0930	4	2.1554	0.1065	2.1554	1.4681
No log	0.1395	6	1.4637	0.0143	1.4637	1.2098
No log	0.1860	8	1.8026	0.1152	1.8026	1.3426
No log	0.2326	10	1.2285	0.0380	1.2285	1.1084
No log	0.2791	12	1.0905	0.1671	1.0905	1.0443
No log	0.3256	14	1.1919	0.0981	1.1919	1.0918
No log	0.3721	16	1.2533	0.0385	1.2533	1.1195
No log	0.4186	18	1.2420	0.0793	1.2420	1.1144
No log	0.4651	20	1.1915	0.0824	1.1915	1.0916
No log	0.5116	22	1.1351	0.1418	1.1351	1.0654
No log	0.5581	24	1.0957	0.1601	1.0957	1.0468
No log	0.6047	26	1.0759	0.2187	1.0759	1.0372
No log	0.6512	28	1.1177	0.1509	1.1177	1.0572
No log	0.6977	30	1.0984	0.1971	1.0984	1.0480
No log	0.7442	32	1.0804	0.2391	1.0804	1.0394
No log	0.7907	34	1.0726	0.2416	1.0726	1.0357
No log	0.8372	36	1.0759	0.1901	1.0759	1.0373
No log	0.8837	38	1.0795	0.0374	1.0795	1.0390
No log	0.9302	40	1.1480	0.0436	1.1480	1.0714
No log	0.9767	42	1.1301	0.0287	1.1301	1.0631
No log	1.0233	44	1.0533	0.0761	1.0533	1.0263
No log	1.0698	46	0.9975	0.2049	0.9975	0.9988
No log	1.1163	48	1.0267	0.3326	1.0267	1.0132
No log	1.1628	50	1.0568	0.1671	1.0568	1.0280
No log	1.2093	52	0.9544	0.3281	0.9544	0.9769
No log	1.2558	54	0.9292	0.3774	0.9292	0.9639
No log	1.3023	56	0.9664	0.3207	0.9664	0.9831
No log	1.3488	58	0.9662	0.3207	0.9662	0.9829
No log	1.3953	60	0.9357	0.3071	0.9357	0.9673
No log	1.4419	62	0.9386	0.3339	0.9386	0.9688
No log	1.4884	64	0.9960	0.3603	0.9960	0.9980
No log	1.5349	66	0.9739	0.3603	0.9739	0.9869
No log	1.5814	68	0.8631	0.4277	0.8631	0.9290
No log	1.6279	70	0.8544	0.4204	0.8544	0.9244
No log	1.6744	72	0.7868	0.4745	0.7868	0.8870
No log	1.7209	74	0.7659	0.4745	0.7659	0.8751
No log	1.7674	76	0.7628	0.4503	0.7628	0.8734
No log	1.8140	78	0.7809	0.4962	0.7809	0.8837
No log	1.8605	80	0.8620	0.4686	0.8620	0.9284
No log	1.9070	82	0.6949	0.5046	0.6949	0.8336
No log	1.9535	84	1.0246	0.4857	1.0246	1.0122
No log	2.0	86	1.4107	0.3096	1.4107	1.1877
No log	2.0465	88	1.0670	0.4857	1.0670	1.0330
No log	2.0930	90	0.6866	0.5088	0.6866	0.8286
No log	2.1395	92	0.6687	0.5847	0.6687	0.8177
No log	2.1860	94	0.6922	0.4847	0.6922	0.8320
No log	2.2326	96	0.9226	0.4560	0.9226	0.9605
No log	2.2791	98	1.0962	0.4103	1.0962	1.0470
No log	2.3256	100	1.0523	0.3787	1.0523	1.0258
No log	2.3721	102	0.8450	0.4456	0.8450	0.9192
No log	2.4186	104	0.8066	0.3651	0.8066	0.8981
No log	2.4651	106	0.8271	0.3503	0.8271	0.9095
No log	2.5116	108	0.8290	0.3765	0.8290	0.9105
No log	2.5581	110	0.8291	0.4012	0.8291	0.9105
No log	2.6047	112	0.8535	0.4713	0.8535	0.9238
No log	2.6512	114	0.7903	0.4145	0.7903	0.8890
No log	2.6977	116	0.7851	0.4691	0.7851	0.8861
No log	2.7442	118	0.8863	0.5690	0.8863	0.9415
No log	2.7907	120	1.1394	0.3609	1.1394	1.0674
No log	2.8372	122	0.9527	0.4982	0.9527	0.9761
No log	2.8837	124	0.7321	0.4644	0.7321	0.8556
No log	2.9302	126	0.8160	0.5355	0.8160	0.9033
No log	2.9767	128	0.9213	0.5	0.9213	0.9599
No log	3.0233	130	0.8378	0.4799	0.8378	0.9153
No log	3.0698	132	0.8076	0.4697	0.8076	0.8987
No log	3.1163	134	0.7848	0.3682	0.7848	0.8859
No log	3.1628	136	0.8079	0.3658	0.8079	0.8989
No log	3.2093	138	0.8502	0.3339	0.8502	0.9221
No log	3.2558	140	0.8696	0.3339	0.8696	0.9325
No log	3.3023	142	0.8416	0.3485	0.8416	0.9174
No log	3.3488	144	0.7924	0.3933	0.7924	0.8902
No log	3.3953	146	0.7640	0.5325	0.7640	0.8740
No log	3.4419	148	0.7326	0.5047	0.7326	0.8559
No log	3.4884	150	0.7471	0.5487	0.7471	0.8643
No log	3.5349	152	0.7507	0.5301	0.7507	0.8664
No log	3.5814	154	0.7847	0.4856	0.7847	0.8858
No log	3.6279	156	0.7794	0.4145	0.7794	0.8828
No log	3.6744	158	1.1201	0.4796	1.1201	1.0584
No log	3.7209	160	1.4113	0.3491	1.4113	1.1880
No log	3.7674	162	1.1274	0.3624	1.1274	1.0618
No log	3.8140	164	0.9097	0.3446	0.9097	0.9538
No log	3.8605	166	0.9666	0.2024	0.9666	0.9831
No log	3.9070	168	0.9718	0.2392	0.9718	0.9858
No log	3.9535	170	0.8604	0.3902	0.8604	0.9276
No log	4.0	172	0.7272	0.5259	0.7272	0.8528
No log	4.0465	174	0.7296	0.5459	0.7296	0.8542
No log	4.0930	176	0.6796	0.5419	0.6796	0.8244
No log	4.1395	178	0.7114	0.5054	0.7114	0.8434
No log	4.1860	180	0.8333	0.5208	0.8333	0.9128
No log	4.2326	182	0.7858	0.5006	0.7858	0.8864
No log	4.2791	184	0.6825	0.5079	0.6825	0.8261
No log	4.3256	186	0.6627	0.4843	0.6627	0.8141
No log	4.3721	188	0.6510	0.5334	0.6510	0.8069
No log	4.4186	190	0.6704	0.4847	0.6704	0.8188
No log	4.4651	192	0.7419	0.5059	0.7419	0.8613
No log	4.5116	194	0.7739	0.4797	0.7739	0.8797
No log	4.5581	196	0.7328	0.5059	0.7328	0.8561
No log	4.6047	198	0.6934	0.4327	0.6934	0.8327
No log	4.6512	200	0.6902	0.4597	0.6902	0.8308
No log	4.6977	202	0.7401	0.4928	0.7401	0.8603
No log	4.7442	204	0.7325	0.4928	0.7325	0.8559
No log	4.7907	206	0.6647	0.3922	0.6647	0.8153
No log	4.8372	208	0.6867	0.5933	0.6867	0.8287
No log	4.8837	210	0.7158	0.5586	0.7158	0.8461
No log	4.9302	212	0.6678	0.6028	0.6678	0.8172
No log	4.9767	214	0.6810	0.4630	0.6810	0.8252
No log	5.0233	216	0.8311	0.4902	0.8311	0.9116
No log	5.0698	218	0.8515	0.5343	0.8515	0.9228
No log	5.1163	220	0.7049	0.5188	0.7049	0.8396
No log	5.1628	222	0.7245	0.5870	0.7245	0.8512
No log	5.2093	224	0.7163	0.5667	0.7163	0.8463
No log	5.2558	226	0.7004	0.4743	0.7004	0.8369
No log	5.3023	228	0.8150	0.4057	0.8150	0.9028
No log	5.3488	230	0.9452	0.3846	0.9452	0.9722
No log	5.3953	232	0.9259	0.4439	0.9259	0.9623
No log	5.4419	234	0.7874	0.4102	0.7874	0.8874
No log	5.4884	236	0.6733	0.5510	0.6733	0.8206
No log	5.5349	238	0.6858	0.6099	0.6858	0.8281
No log	5.5814	240	0.6595	0.5890	0.6595	0.8121
No log	5.6279	242	0.6427	0.5234	0.6427	0.8017
No log	5.6744	244	0.6966	0.4102	0.6966	0.8346
No log	5.7209	246	0.7186	0.4335	0.7186	0.8477
No log	5.7674	248	0.6731	0.4473	0.6731	0.8204
No log	5.8140	250	0.6495	0.5570	0.6495	0.8059
No log	5.8605	252	0.6611	0.6238	0.6611	0.8131
No log	5.9070	254	0.6642	0.6129	0.6642	0.8150
No log	5.9535	256	0.6580	0.5485	0.6580	0.8112
No log	6.0	258	0.7691	0.4089	0.7691	0.8770
No log	6.0465	260	0.8717	0.3394	0.8717	0.9337
No log	6.0930	262	0.8171	0.3531	0.8171	0.9039
No log	6.1395	264	0.6969	0.4344	0.6969	0.8348
No log	6.1860	266	0.6365	0.5610	0.6365	0.7978
No log	6.2326	268	0.6291	0.5820	0.6291	0.7932
No log	6.2791	270	0.6456	0.5121	0.6456	0.8035
No log	6.3256	272	0.6870	0.5279	0.6870	0.8288
No log	6.3721	274	0.6807	0.5067	0.6807	0.8251
No log	6.4186	276	0.6228	0.5833	0.6228	0.7892
No log	6.4651	278	0.6073	0.6175	0.6073	0.7793
No log	6.5116	280	0.6008	0.6875	0.6008	0.7751
No log	6.5581	282	0.5813	0.6488	0.5813	0.7624
No log	6.6047	284	0.5678	0.6364	0.5678	0.7535
No log	6.6512	286	0.5640	0.6593	0.5640	0.7510
No log	6.6977	288	0.5910	0.6768	0.5910	0.7688
No log	6.7442	290	0.6326	0.6515	0.6326	0.7954
No log	6.7907	292	0.6424	0.6272	0.6424	0.8015
No log	6.8372	294	0.6323	0.6195	0.6323	0.7952
No log	6.8837	296	0.6209	0.5934	0.6209	0.7880
No log	6.9302	298	0.6234	0.6039	0.6234	0.7896
No log	6.9767	300	0.6385	0.6078	0.6385	0.7991
No log	7.0233	302	0.6494	0.5795	0.6494	0.8059
No log	7.0698	304	0.6548	0.5910	0.6548	0.8092
No log	7.1163	306	0.6759	0.4729	0.6759	0.8222
No log	7.1628	308	0.7317	0.4568	0.7317	0.8554
No log	7.2093	310	0.7098	0.5334	0.7098	0.8425
No log	7.2558	312	0.6576	0.4995	0.6576	0.8109
No log	7.3023	314	0.6523	0.6006	0.6523	0.8076
No log	7.3488	316	0.6445	0.5402	0.6445	0.8028
No log	7.3953	318	0.6869	0.5963	0.6869	0.8288
No log	7.4419	320	0.7855	0.5484	0.7855	0.8863
No log	7.4884	322	0.7900	0.5186	0.7900	0.8888
No log	7.5349	324	0.7850	0.4881	0.7850	0.8860
No log	7.5814	326	0.7469	0.5375	0.7469	0.8642
No log	7.6279	328	0.6698	0.4461	0.6698	0.8184
No log	7.6744	330	0.6629	0.3941	0.6629	0.8142
No log	7.7209	332	0.6930	0.3922	0.6930	0.8325
No log	7.7674	334	0.7976	0.3648	0.7976	0.8931
No log	7.8140	336	0.8898	0.3953	0.8898	0.9433
No log	7.8605	338	0.8504	0.4222	0.8504	0.9222
No log	7.9070	340	0.7242	0.4610	0.7242	0.8510
No log	7.9535	342	0.6769	0.5428	0.6769	0.8228
No log	8.0	344	0.6786	0.5441	0.6786	0.8238
No log	8.0465	346	0.6830	0.5342	0.6830	0.8265
No log	8.0930	348	0.6674	0.5441	0.6674	0.8170
No log	8.1395	350	0.6741	0.4644	0.6742	0.8211
No log	8.1860	352	0.6798	0.4644	0.6798	0.8245
No log	8.2326	354	0.6779	0.4888	0.6779	0.8233
No log	8.2791	356	0.6867	0.4995	0.6867	0.8287
No log	8.3256	358	0.6654	0.5121	0.6654	0.8157
No log	8.3721	360	0.6414	0.5121	0.6414	0.8009
No log	8.4186	362	0.6396	0.5121	0.6396	0.7998
No log	8.4651	364	0.6452	0.5121	0.6452	0.8032
No log	8.5116	366	0.6677	0.5112	0.6677	0.8172
No log	8.5581	368	0.6208	0.5112	0.6208	0.7879
No log	8.6047	370	0.5811	0.6239	0.5811	0.7623
No log	8.6512	372	0.5741	0.6133	0.5741	0.7577
No log	8.6977	374	0.5674	0.6133	0.5674	0.7533
No log	8.7442	376	0.6018	0.6275	0.6018	0.7758
No log	8.7907	378	0.6382	0.5958	0.6382	0.7988
No log	8.8372	380	0.6114	0.6157	0.6114	0.7819
No log	8.8837	382	0.5900	0.5939	0.5900	0.7681
No log	8.9302	384	0.6121	0.6195	0.6121	0.7823
No log	8.9767	386	0.6205	0.5747	0.6205	0.7877
No log	9.0233	388	0.6306	0.5288	0.6306	0.7941
No log	9.0698	390	0.6406	0.5160	0.6406	0.8004
No log	9.1163	392	0.6371	0.5287	0.6371	0.7982
No log	9.1628	394	0.6551	0.5928	0.6551	0.8094
No log	9.2093	396	0.6457	0.6238	0.6457	0.8036
No log	9.2558	398	0.6446	0.5665	0.6446	0.8029
No log	9.3023	400	0.6131	0.6238	0.6131	0.7830
No log	9.3488	402	0.5935	0.6017	0.5935	0.7704
No log	9.3953	404	0.5861	0.6241	0.5861	0.7656
No log	9.4419	406	0.5914	0.6024	0.5914	0.7690
No log	9.4884	408	0.6043	0.5809	0.6043	0.7774
No log	9.5349	410	0.6231	0.5905	0.6231	0.7894
No log	9.5814	412	0.6294	0.5505	0.6294	0.7933
No log	9.6279	414	0.6521	0.5712	0.6521	0.8075
No log	9.6744	416	0.6527	0.5712	0.6527	0.8079
No log	9.7209	418	0.6560	0.5455	0.6560	0.8099
No log	9.7674	420	0.6356	0.5260	0.6356	0.7972
No log	9.8140	422	0.6162	0.5669	0.6162	0.7850
No log	9.8605	424	0.6242	0.5794	0.6242	0.7901
No log	9.9070	426	0.6009	0.5921	0.6009	0.7752
No log	9.9535	428	0.6166	0.5700	0.6166	0.7852
No log	10.0	430	0.7317	0.5292	0.7317	0.8554
No log	10.0465	432	0.7248	0.5056	0.7248	0.8514
No log	10.0930	434	0.6510	0.5333	0.6510	0.8068
No log	10.1395	436	0.6119	0.5302	0.6119	0.7822
No log	10.1860	438	0.6233	0.5562	0.6233	0.7895
No log	10.2326	440	0.6241	0.5288	0.6241	0.7900
No log	10.2791	442	0.6422	0.5361	0.6422	0.8014
No log	10.3256	444	0.6459	0.5459	0.6459	0.8037
No log	10.3721	446	0.6360	0.4893	0.6360	0.7975
No log	10.4186	448	0.6326	0.5938	0.6326	0.7953
No log	10.4651	450	0.6339	0.5950	0.6339	0.7962
No log	10.5116	452	0.6212	0.5562	0.6212	0.7881
No log	10.5581	454	0.6366	0.6055	0.6366	0.7979
No log	10.6047	456	0.6541	0.6078	0.6541	0.8088
No log	10.6512	458	0.6442	0.6078	0.6442	0.8026
No log	10.6977	460	0.6137	0.6078	0.6137	0.7834
No log	10.7442	462	0.5926	0.5432	0.5926	0.7698
No log	10.7907	464	0.6139	0.5391	0.6139	0.7835
No log	10.8372	466	0.5970	0.5391	0.5970	0.7727
No log	10.8837	468	0.5744	0.5549	0.5744	0.7579
No log	10.9302	470	0.5759	0.5809	0.5759	0.7589
No log	10.9767	472	0.5780	0.6078	0.5780	0.7603
No log	11.0233	474	0.5792	0.5938	0.5792	0.7610
No log	11.0698	476	0.5933	0.5288	0.5933	0.7703
No log	11.1163	478	0.5989	0.5288	0.5989	0.7739
No log	11.1628	480	0.6236	0.5992	0.6236	0.7897
No log	11.2093	482	0.6433	0.6101	0.6433	0.8021
No log	11.2558	484	0.5977	0.6422	0.5977	0.7731
No log	11.3023	486	0.5657	0.5921	0.5657	0.7521
No log	11.3488	488	0.5539	0.6006	0.5539	0.7443
No log	11.3953	490	0.5713	0.6422	0.5713	0.7558
No log	11.4419	492	0.5923	0.6422	0.5923	0.7696
No log	11.4884	494	0.5690	0.6373	0.5690	0.7543
No log	11.5349	496	0.5947	0.5485	0.5947	0.7712
No log	11.5814	498	0.6635	0.4858	0.6635	0.8145
0.3055	11.6279	500	0.6826	0.4597	0.6826	0.8262
0.3055	11.6744	502	0.6373	0.5002	0.6373	0.7983
0.3055	11.7209	504	0.6136	0.5522	0.6136	0.7833
0.3055	11.7674	506	0.5893	0.6391	0.5893	0.7677
0.3055	11.8140	508	0.5771	0.6230	0.5771	0.7597
0.3055	11.8605	510	0.5750	0.5859	0.5750	0.7583
0.3055	11.9070	512	0.6036	0.6025	0.6036	0.7769
0.3055	11.9535	514	0.6369	0.5988	0.6369	0.7980
0.3055	12.0	516	0.6408	0.5912	0.6408	0.8005
0.3055	12.0465	518	0.5907	0.5722	0.5907	0.7686
0.3055	12.0930	520	0.5520	0.6219	0.5520	0.7430
0.3055	12.1395	522	0.5362	0.6427	0.5362	0.7323
0.3055	12.1860	524	0.5295	0.6427	0.5295	0.7276
0.3055	12.2326	526	0.5304	0.6556	0.5304	0.7283
0.3055	12.2791	528	0.5346	0.6556	0.5346	0.7311
0.3055	12.3256	530	0.5388	0.6667	0.5388	0.7340
0.3055	12.3721	532	0.5496	0.6667	0.5496	0.7413
0.3055	12.4186	534	0.5563	0.6343	0.5563	0.7459
0.3055	12.4651	536	0.5616	0.6219	0.5616	0.7494
0.3055	12.5116	538	0.5504	0.6219	0.5504	0.7419
0.3055	12.5581	540	0.5319	0.6667	0.5319	0.7293
0.3055	12.6047	542	0.5296	0.7245	0.5296	0.7277
0.3055	12.6512	544	0.5343	0.7193	0.5343	0.7309
0.3055	12.6977	546	0.5532	0.6593	0.5532	0.7438
0.3055	12.7442	548	0.5679	0.6488	0.5679	0.7536
0.3055	12.7907	550	0.5841	0.6424	0.5841	0.7642
0.3055	12.8372	552	0.6194	0.6073	0.6194	0.7870
0.3055	12.8837	554	0.6342	0.5885	0.6342	0.7964
0.3055	12.9302	556	0.6288	0.5304	0.6288	0.7930
0.3055	12.9767	558	0.5879	0.6123	0.5879	0.7667
0.3055	13.0233	560	0.5745	0.6536	0.5745	0.7580
0.3055	13.0698	562	0.5741	0.6347	0.5741	0.7577
0.3055	13.1163	564	0.5688	0.6676	0.5688	0.7542
0.3055	13.1628	566	0.5752	0.5735	0.5752	0.7584
0.3055	13.2093	568	0.6278	0.5373	0.6278	0.7923
0.3055	13.2558	570	0.6517	0.5210	0.6517	0.8073
0.3055	13.3023	572	0.6475	0.5221	0.6475	0.8046
0.3055	13.3488	574	0.6224	0.5797	0.6224	0.7889
0.3055	13.3953	576	0.6091	0.5917	0.6091	0.7805
0.3055	13.4419	578	0.5925	0.5917	0.5925	0.7697
0.3055	13.4884	580	0.5926	0.5917	0.5926	0.7698
0.3055	13.5349	582	0.6242	0.6133	0.6242	0.7901
0.3055	13.5814	584	0.6155	0.6133	0.6155	0.7846
0.3055	13.6279	586	0.5787	0.6335	0.5787	0.7607
0.3055	13.6744	588	0.5651	0.5917	0.5651	0.7517
0.3055	13.7209	590	0.5592	0.6317	0.5592	0.7478
0.3055	13.7674	592	0.5722	0.6107	0.5722	0.7565
0.3055	13.8140	594	0.5840	0.5859	0.5840	0.7642
0.3055	13.8605	596	0.5919	0.5859	0.5919	0.7693
0.3055	13.9070	598	0.6044	0.5735	0.6044	0.7774
0.3055	13.9535	600	0.6109	0.6065	0.6109	0.7816
0.3055	14.0	602	0.6513	0.5467	0.6513	0.8070
0.3055	14.0465	604	0.6613	0.5467	0.6613	0.8132
0.3055	14.0930	606	0.6549	0.5373	0.6549	0.8093
0.3055	14.1395	608	0.6871	0.4760	0.6871	0.8289
0.3055	14.1860	610	0.7546	0.4078	0.7546	0.8687
0.3055	14.2326	612	0.7695	0.3339	0.7695	0.8772
0.3055	14.2791	614	0.7241	0.4223	0.7241	0.8509
0.3055	14.3256	616	0.7117	0.4223	0.7117	0.8436
0.3055	14.3721	618	0.7495	0.3921	0.7495	0.8657

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1