ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0297
• Qwk: 0.3676
• Mse: 1.0297
• Rmse: 1.0147

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.6810	0.0010	4.6810	2.1636
No log	0.0976	4	2.8211	-0.0233	2.8211	1.6796
No log	0.1463	6	1.9576	0.0062	1.9576	1.3991
No log	0.1951	8	1.4039	0.0393	1.4039	1.1849
No log	0.2439	10	1.4997	0.0037	1.4997	1.2246
No log	0.2927	12	1.5257	-0.0277	1.5257	1.2352
No log	0.3415	14	1.2734	0.1203	1.2734	1.1285
No log	0.3902	16	1.2566	0.1009	1.2566	1.1210
No log	0.4390	18	1.2323	0.1649	1.2323	1.1101
No log	0.4878	20	1.1994	0.2083	1.1994	1.0952
No log	0.5366	22	1.2102	0.1593	1.2102	1.1001
No log	0.5854	24	1.1975	0.2520	1.1975	1.0943
No log	0.6341	26	1.1697	0.1176	1.1697	1.0815
No log	0.6829	28	1.1800	0.1585	1.1800	1.0863
No log	0.7317	30	1.2564	0.0446	1.2564	1.1209
No log	0.7805	32	1.2053	0.1042	1.2053	1.0979
No log	0.8293	34	1.1440	0.1417	1.1440	1.0696
No log	0.8780	36	1.2890	0.0050	1.2890	1.1354
No log	0.9268	38	1.4968	0.0254	1.4968	1.2235
No log	0.9756	40	1.5965	0.0	1.5965	1.2635
No log	1.0244	42	1.5294	0.0	1.5294	1.2367
No log	1.0732	44	1.4084	0.0403	1.4084	1.1868
No log	1.1220	46	1.3651	0.0104	1.3651	1.1684
No log	1.1707	48	1.3585	0.0275	1.3585	1.1655
No log	1.2195	50	1.2897	0.1865	1.2897	1.1356
No log	1.2683	52	1.2565	0.1507	1.2565	1.1209
No log	1.3171	54	1.2142	0.2478	1.2142	1.1019
No log	1.3659	56	1.2215	0.3038	1.2215	1.1052
No log	1.4146	58	1.1742	0.2155	1.1742	1.0836
No log	1.4634	60	1.1696	0.1042	1.1696	1.0815
No log	1.5122	62	1.1720	0.1711	1.1720	1.0826
No log	1.5610	64	1.1676	0.2360	1.1676	1.0805
No log	1.6098	66	1.1724	0.1693	1.1724	1.0828
No log	1.6585	68	1.1830	0.1654	1.1830	1.0876
No log	1.7073	70	1.1430	0.3041	1.1430	1.0691
No log	1.7561	72	1.1393	0.3041	1.1393	1.0674
No log	1.8049	74	1.1072	0.2520	1.1072	1.0522
No log	1.8537	76	1.1331	0.2569	1.1331	1.0645
No log	1.9024	78	1.1403	0.1979	1.1403	1.0679
No log	1.9512	80	1.1307	0.1752	1.1307	1.0634
No log	2.0	82	1.1247	0.1857	1.1247	1.0605
No log	2.0488	84	1.1520	0.1585	1.1520	1.0733
No log	2.0976	86	1.1888	0.1076	1.1888	1.0903
No log	2.1463	88	1.2366	0.0442	1.2366	1.1120
No log	2.1951	90	1.2435	0.1637	1.2435	1.1151
No log	2.2439	92	1.3021	0.1313	1.3021	1.1411
No log	2.2927	94	1.6031	0.2644	1.6031	1.2661
No log	2.3415	96	1.6921	0.2393	1.6921	1.3008
No log	2.3902	98	1.3970	0.3500	1.3970	1.1819
No log	2.4390	100	1.0936	0.3710	1.0936	1.0458
No log	2.4878	102	1.1174	0.2539	1.1174	1.0571
No log	2.5366	104	1.0289	0.3639	1.0289	1.0144
No log	2.5854	106	1.0121	0.2871	1.0121	1.0060
No log	2.6341	108	1.0471	0.4625	1.0471	1.0233
No log	2.6829	110	0.9471	0.3697	0.9471	0.9732
No log	2.7317	112	0.9089	0.4512	0.9089	0.9534
No log	2.7805	114	0.9554	0.4513	0.9554	0.9775
No log	2.8293	116	1.0229	0.4166	1.0229	1.0114
No log	2.8780	118	0.9622	0.3256	0.9622	0.9809
No log	2.9268	120	0.9696	0.2995	0.9696	0.9847
No log	2.9756	122	1.0085	0.3869	1.0085	1.0042
No log	3.0244	124	1.1325	0.3188	1.1325	1.0642
No log	3.0732	126	1.0123	0.3773	1.0123	1.0062
No log	3.1220	128	0.9799	0.3371	0.9799	0.9899
No log	3.1707	130	0.9819	0.3445	0.9819	0.9909
No log	3.2195	132	1.2146	0.3574	1.2146	1.1021
No log	3.2683	134	1.2497	0.3042	1.2497	1.1179
No log	3.3171	136	0.9471	0.3849	0.9471	0.9732
No log	3.3659	138	1.1496	0.4368	1.1496	1.0722
No log	3.4146	140	1.1163	0.4166	1.1163	1.0565
No log	3.4634	142	0.9184	0.3756	0.9184	0.9583
No log	3.5122	144	0.9866	0.4755	0.9866	0.9933
No log	3.5610	146	0.9698	0.4808	0.9698	0.9848
No log	3.6098	148	0.9362	0.3927	0.9362	0.9676
No log	3.6585	150	0.9389	0.3196	0.9389	0.9690
No log	3.7073	152	0.9356	0.3139	0.9356	0.9673
No log	3.7561	154	0.9536	0.4867	0.9536	0.9765
No log	3.8049	156	1.3529	0.3039	1.3529	1.1632
No log	3.8537	158	1.5000	0.2374	1.5000	1.2247
No log	3.9024	160	1.1035	0.4689	1.1035	1.0505
No log	3.9512	162	0.9930	0.3200	0.9930	0.9965
No log	4.0	164	1.1729	0.3404	1.1729	1.0830
No log	4.0488	166	1.1255	0.4076	1.1255	1.0609
No log	4.0976	168	0.9927	0.3088	0.9927	0.9963
No log	4.1463	170	0.9871	0.4352	0.9871	0.9935
No log	4.1951	172	0.9904	0.3424	0.9904	0.9952
No log	4.2439	174	1.0153	0.3380	1.0153	1.0076
No log	4.2927	176	1.0098	0.3522	1.0098	1.0049
No log	4.3415	178	1.0401	0.2947	1.0401	1.0198
No log	4.3902	180	1.0293	0.3093	1.0293	1.0146
No log	4.4390	182	1.0209	0.3139	1.0209	1.0104
No log	4.4878	184	1.0212	0.3639	1.0212	1.0105
No log	4.5366	186	1.0166	0.3535	1.0166	1.0083
No log	4.5854	188	1.1197	0.3478	1.1197	1.0581
No log	4.6341	190	1.1670	0.4219	1.1670	1.0803
No log	4.6829	192	1.3062	0.3263	1.3062	1.1429
No log	4.7317	194	1.2768	0.3448	1.2768	1.1299
No log	4.7805	196	1.1406	0.4552	1.1406	1.0680
No log	4.8293	198	1.0281	0.3707	1.0281	1.0140
No log	4.8780	200	0.9180	0.3380	0.9180	0.9581
No log	4.9268	202	0.8998	0.3596	0.8998	0.9486
No log	4.9756	204	0.9003	0.4297	0.9003	0.9488
No log	5.0244	206	0.8696	0.3230	0.8696	0.9325
No log	5.0732	208	0.8751	0.2898	0.8751	0.9355
No log	5.1220	210	0.8660	0.3230	0.8660	0.9306
No log	5.1707	212	0.8744	0.3089	0.8744	0.9351
No log	5.2195	214	0.8920	0.2898	0.8920	0.9445
No log	5.2683	216	0.8931	0.3185	0.8931	0.9450
No log	5.3171	218	0.9215	0.2947	0.9215	0.9600
No log	5.3659	220	0.9387	0.2947	0.9387	0.9689
No log	5.4146	222	0.9208	0.3185	0.9208	0.9596
No log	5.4634	224	1.0328	0.4214	1.0328	1.0163
No log	5.5122	226	1.2524	0.3271	1.2524	1.1191
No log	5.5610	228	1.2119	0.3025	1.2119	1.1009
No log	5.6098	230	0.9970	0.4434	0.9970	0.9985
No log	5.6585	232	0.9599	0.3565	0.9599	0.9797
No log	5.7073	234	0.9666	0.3396	0.9666	0.9832
No log	5.7561	236	0.9934	0.3697	0.9934	0.9967
No log	5.8049	238	0.9843	0.3449	0.9843	0.9921
No log	5.8537	240	1.0116	0.3560	1.0116	1.0058
No log	5.9024	242	1.0001	0.3115	1.0001	1.0001
No log	5.9512	244	0.9862	0.4023	0.9862	0.9931
No log	6.0	246	0.9830	0.3780	0.9830	0.9914
No log	6.0488	248	1.0106	0.3400	1.0106	1.0053
No log	6.0976	250	1.1576	0.4098	1.1576	1.0759
No log	6.1463	252	1.1431	0.4094	1.1431	1.0692
No log	6.1951	254	1.0381	0.3022	1.0381	1.0189
No log	6.2439	256	1.0108	0.2970	1.0108	1.0054
No log	6.2927	258	1.0048	0.2993	1.0048	1.0024
No log	6.3415	260	1.0061	0.3237	1.0061	1.0030
No log	6.3902	262	0.9966	0.3090	0.9966	0.9983
No log	6.4390	264	1.0159	0.3115	1.0159	1.0079
No log	6.4878	266	1.0408	0.3046	1.0408	1.0202
No log	6.5366	268	0.9871	0.3093	0.9871	0.9935
No log	6.5854	270	0.9867	0.3814	0.9867	0.9933
No log	6.6341	272	1.0030	0.4371	1.0030	1.0015
No log	6.6829	274	0.9577	0.4081	0.9577	0.9786
No log	6.7317	276	1.0224	0.3113	1.0224	1.0111
No log	6.7805	278	1.0510	0.3556	1.0510	1.0252
No log	6.8293	280	0.9979	0.2997	0.9979	0.9990
No log	6.8780	282	0.9817	0.3535	0.9817	0.9908
No log	6.9268	284	0.9838	0.3396	0.9838	0.9919
No log	6.9756	286	1.0244	0.3113	1.0244	1.0121
No log	7.0244	288	1.1204	0.3515	1.1204	1.0585
No log	7.0732	290	1.0900	0.2791	1.0900	1.0440
No log	7.1220	292	1.0196	0.3113	1.0196	1.0098
No log	7.1707	294	0.9888	0.2850	0.9888	0.9944
No log	7.2195	296	1.0273	0.3113	1.0273	1.0135
No log	7.2683	298	1.0235	0.3113	1.0235	1.0117
No log	7.3171	300	0.9526	0.3282	0.9526	0.9760
No log	7.3659	302	0.9815	0.3571	0.9815	0.9907
No log	7.4146	304	1.0335	0.3480	1.0335	1.0166
No log	7.4634	306	0.9949	0.3855	0.9949	0.9975
No log	7.5122	308	0.9557	0.3539	0.9557	0.9776
No log	7.5610	310	1.0446	0.2821	1.0446	1.0221
No log	7.6098	312	1.1635	0.3023	1.1635	1.0787
No log	7.6585	314	1.2585	0.3658	1.2585	1.1218
No log	7.7073	316	1.1877	0.3771	1.1877	1.0898
No log	7.7561	318	0.9903	0.3115	0.9903	0.9951
No log	7.8049	320	0.9589	0.3974	0.9589	0.9792
No log	7.8537	322	0.9645	0.4016	0.9645	0.9821
No log	7.9024	324	0.9506	0.3424	0.9506	0.9750
No log	7.9512	326	1.0119	0.3848	1.0119	1.0059
No log	8.0	328	1.0123	0.3725	1.0123	1.0061
No log	8.0488	330	0.9350	0.3771	0.9350	0.9669
No log	8.0976	332	0.9895	0.3614	0.9895	0.9947
No log	8.1463	334	1.0946	0.3508	1.0946	1.0462
No log	8.1951	336	1.0436	0.2702	1.0436	1.0216
No log	8.2439	338	0.9473	0.3873	0.9473	0.9733
No log	8.2927	340	0.9693	0.2973	0.9693	0.9845
No log	8.3415	342	1.0723	0.3237	1.0723	1.0355
No log	8.3902	344	1.1275	0.3117	1.1275	1.0618
No log	8.4390	346	1.0863	0.3237	1.0863	1.0422
No log	8.4878	348	0.9849	0.3263	0.9849	0.9924
No log	8.5366	350	0.9341	0.3908	0.9341	0.9665
No log	8.5854	352	0.9320	0.3811	0.9320	0.9654
No log	8.6341	354	0.9518	0.4603	0.9518	0.9756
No log	8.6829	356	0.9511	0.4377	0.9511	0.9752
No log	8.7317	358	0.9551	0.3966	0.9551	0.9773
No log	8.7805	360	0.9378	0.4181	0.9378	0.9684
No log	8.8293	362	0.9600	0.4233	0.9600	0.9798
No log	8.8780	364	0.9813	0.3688	0.9813	0.9906
No log	8.9268	366	0.9484	0.4023	0.9484	0.9738
No log	8.9756	368	0.9719	0.3405	0.9719	0.9858
No log	9.0244	370	1.1362	0.3413	1.1362	1.0659
No log	9.0732	372	1.2023	0.3658	1.2023	1.0965
No log	9.1220	374	1.1277	0.3413	1.1277	1.0620
No log	9.1707	376	1.0486	0.3625	1.0486	1.0240
No log	9.2195	378	0.9756	0.3115	0.9756	0.9877
No log	9.2683	380	0.9713	0.3535	0.9713	0.9856
No log	9.3171	382	0.9797	0.3062	0.9797	0.9898
No log	9.3659	384	0.9664	0.3117	0.9664	0.9830
No log	9.4146	386	0.9822	0.3308	0.9822	0.9911
No log	9.4634	388	1.0296	0.4	1.0296	1.0147
No log	9.5122	390	1.0450	0.4	1.0450	1.0222
No log	9.5610	392	0.9990	0.3762	0.9990	0.9995
No log	9.6098	394	0.9411	0.3069	0.9411	0.9701
No log	9.6585	396	0.9051	0.3453	0.9051	0.9514
No log	9.7073	398	0.9028	0.3879	0.9028	0.9502
No log	9.7561	400	0.8865	0.3453	0.8865	0.9416
No log	9.8049	402	0.8932	0.3632	0.8932	0.9451
No log	9.8537	404	0.8907	0.3535	0.8907	0.9438
No log	9.9024	406	0.8828	0.4081	0.8828	0.9396
No log	9.9512	408	0.8997	0.4626	0.8997	0.9485
No log	10.0	410	0.9848	0.4805	0.9848	0.9923
No log	10.0488	412	0.9962	0.4497	0.9962	0.9981
No log	10.0976	414	0.9198	0.4331	0.9198	0.9591
No log	10.1463	416	0.9025	0.3747	0.9025	0.9500
No log	10.1951	418	0.9050	0.3908	0.9050	0.9513
No log	10.2439	420	0.9177	0.3880	0.9177	0.9579
No log	10.2927	422	0.9543	0.3400	0.9543	0.9769
No log	10.3415	424	1.0194	0.4339	1.0194	1.0096
No log	10.3902	426	1.0200	0.3686	1.0200	1.0100
No log	10.4390	428	1.0179	0.3421	1.0179	1.0089
No log	10.4878	430	1.0262	0.3144	1.0262	1.0130
No log	10.5366	432	1.0083	0.3021	1.0083	1.0041
No log	10.5854	434	0.9809	0.2944	0.9809	0.9904
No log	10.6341	436	0.9761	0.2792	0.9761	0.9880
No log	10.6829	438	1.0014	0.2721	1.0014	1.0007
No log	10.7317	440	1.0106	0.2721	1.0106	1.0053
No log	10.7805	442	1.0221	0.3503	1.0221	1.0110
No log	10.8293	444	0.9811	0.3045	0.9811	0.9905
No log	10.8780	446	0.9886	0.3645	0.9886	0.9943
No log	10.9268	448	0.9811	0.3434	0.9811	0.9905
No log	10.9756	450	0.9625	0.2970	0.9625	0.9811
No log	11.0244	452	0.9797	0.3169	0.9797	0.9898
No log	11.0732	454	1.0244	0.3281	1.0244	1.0121
No log	11.1220	456	1.1518	0.3001	1.1518	1.0732
No log	11.1707	458	1.2087	0.3488	1.2087	1.0994
No log	11.2195	460	1.1388	0.2953	1.1388	1.0671
No log	11.2683	462	1.0147	0.3289	1.0147	1.0073
No log	11.3171	464	0.9891	0.3380	0.9891	0.9945
No log	11.3659	466	0.9749	0.2920	0.9749	0.9874
No log	11.4146	468	1.0075	0.2877	1.0075	1.0038
No log	11.4634	470	1.1126	0.4098	1.1126	1.0548
No log	11.5122	472	1.2187	0.3947	1.2187	1.1039
No log	11.5610	474	1.2826	0.4038	1.2826	1.1325
No log	11.6098	476	1.1898	0.4355	1.1898	1.0908
No log	11.6585	478	1.0180	0.4007	1.0180	1.0089
No log	11.7073	480	0.9095	0.3282	0.9095	0.9537
No log	11.7561	482	0.8975	0.3845	0.8975	0.9474
No log	11.8049	484	0.8998	0.3619	0.8998	0.9486
No log	11.8537	486	0.9377	0.3809	0.9377	0.9683
No log	11.9024	488	1.0456	0.4563	1.0456	1.0225
No log	11.9512	490	1.0171	0.4563	1.0171	1.0085
No log	12.0	492	0.9508	0.3934	0.9508	0.9751
No log	12.0488	494	0.9303	0.3998	0.9303	0.9645
No log	12.0976	496	0.9220	0.4385	0.9220	0.9602
No log	12.1463	498	0.9105	0.4508	0.9105	0.9542
0.3968	12.1951	500	0.9042	0.4508	0.9042	0.9509
0.3968	12.2439	502	0.8870	0.4311	0.8870	0.9418
0.3968	12.2927	504	0.9106	0.3902	0.9106	0.9543
0.3968	12.3415	506	0.9462	0.4043	0.9462	0.9727
0.3968	12.3902	508	1.0113	0.3676	1.0113	1.0056
0.3968	12.4390	510	1.0297	0.3676	1.0297	1.0147

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1