ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0283
• Qwk: 0.3978
• Mse: 1.0283
• Rmse: 1.0141

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0870	2	4.8180	-0.0104	4.8180	2.1950
No log	0.1739	4	2.5644	0.0332	2.5644	1.6014
No log	0.2609	6	1.6466	0.0372	1.6466	1.2832
No log	0.3478	8	1.6210	0.0451	1.6210	1.2732
No log	0.4348	10	1.7016	-0.0798	1.7016	1.3044
No log	0.5217	12	1.5404	-0.0577	1.5404	1.2411
No log	0.6087	14	1.3550	0.0464	1.3550	1.1640
No log	0.6957	16	1.2937	0.1142	1.2937	1.1374
No log	0.7826	18	1.3090	0.0020	1.3090	1.1441
No log	0.8696	20	1.3557	-0.0974	1.3557	1.1643
No log	0.9565	22	1.3392	0.0038	1.3392	1.1572
No log	1.0435	24	1.3298	0.0339	1.3298	1.1532
No log	1.1304	26	1.4213	0.0317	1.4213	1.1922
No log	1.2174	28	1.4356	0.0317	1.4356	1.1982
No log	1.3043	30	1.3268	0.0488	1.3268	1.1519
No log	1.3913	32	1.1804	0.2986	1.1804	1.0865
No log	1.4783	34	1.0980	0.2155	1.0980	1.0478
No log	1.5652	36	1.0860	0.2624	1.0860	1.0421
No log	1.6522	38	1.1138	0.1814	1.1138	1.0553
No log	1.7391	40	1.1083	0.2290	1.1083	1.0527
No log	1.8261	42	1.0568	0.3094	1.0568	1.0280
No log	1.9130	44	1.0109	0.3190	1.0109	1.0055
No log	2.0	46	1.0194	0.3806	1.0194	1.0096
No log	2.0870	48	1.0958	0.4415	1.0958	1.0468
No log	2.1739	50	1.3668	0.2576	1.3668	1.1691
No log	2.2609	52	1.2130	0.3354	1.2130	1.1014
No log	2.3478	54	0.9226	0.4400	0.9226	0.9605
No log	2.4348	56	0.9144	0.5058	0.9144	0.9562
No log	2.5217	58	0.9604	0.4685	0.9604	0.9800
No log	2.6087	60	0.9112	0.5756	0.9112	0.9546
No log	2.6957	62	0.9581	0.4260	0.9581	0.9788
No log	2.7826	64	0.9878	0.4649	0.9878	0.9939
No log	2.8696	66	1.2928	0.3503	1.2928	1.1370
No log	2.9565	68	1.5461	0.2172	1.5461	1.2434
No log	3.0435	70	1.4246	0.2399	1.4246	1.1936
No log	3.1304	72	1.0969	0.3954	1.0969	1.0474
No log	3.2174	74	1.0487	0.4035	1.0487	1.0240
No log	3.3043	76	1.2058	0.3913	1.2058	1.0981
No log	3.3913	78	1.1347	0.3872	1.1347	1.0652
No log	3.4783	80	0.9809	0.4233	0.9809	0.9904
No log	3.5652	82	1.0107	0.3491	1.0107	1.0053
No log	3.6522	84	1.0703	0.4497	1.0703	1.0345
No log	3.7391	86	1.0664	0.4414	1.0665	1.0327
No log	3.8261	88	0.9899	0.4894	0.9899	0.9949
No log	3.9130	90	1.0432	0.4607	1.0432	1.0214
No log	4.0	92	1.2793	0.4245	1.2793	1.1311
No log	4.0870	94	1.1476	0.4921	1.1476	1.0712
No log	4.1739	96	0.9871	0.4591	0.9871	0.9935
No log	4.2609	98	0.9573	0.5324	0.9573	0.9784
No log	4.3478	100	0.9663	0.5012	0.9663	0.9830
No log	4.4348	102	0.9492	0.4530	0.9492	0.9743
No log	4.5217	104	1.0936	0.4260	1.0936	1.0458
No log	4.6087	106	1.0554	0.4313	1.0554	1.0273
No log	4.6957	108	0.9838	0.4128	0.9838	0.9919
No log	4.7826	110	1.2074	0.3525	1.2074	1.0988
No log	4.8696	112	1.2502	0.3631	1.2502	1.1181
No log	4.9565	114	1.1197	0.4219	1.1197	1.0581
No log	5.0435	116	1.0236	0.3927	1.0236	1.0117
No log	5.1304	118	1.0205	0.4014	1.0205	1.0102
No log	5.2174	120	1.1082	0.4551	1.1082	1.0527
No log	5.3043	122	1.3466	0.3772	1.3466	1.1605
No log	5.3913	124	1.3288	0.3772	1.3288	1.1527
No log	5.4783	126	1.0765	0.4485	1.0765	1.0375
No log	5.5652	128	1.0288	0.3993	1.0288	1.0143
No log	5.6522	130	1.0703	0.4372	1.0703	1.0345
No log	5.7391	132	1.0316	0.4078	1.0316	1.0157
No log	5.8261	134	1.0382	0.3872	1.0382	1.0189
No log	5.9130	136	1.0493	0.4286	1.0493	1.0244
No log	6.0	138	1.1129	0.4655	1.1129	1.0549
No log	6.0870	140	1.1349	0.4136	1.1349	1.0653
No log	6.1739	142	1.1365	0.4516	1.1365	1.0661
No log	6.2609	144	0.9872	0.5114	0.9872	0.9936
No log	6.3478	146	0.9661	0.4737	0.9661	0.9829
No log	6.4348	148	0.9585	0.4690	0.9585	0.9790
No log	6.5217	150	0.9777	0.4794	0.9777	0.9888
No log	6.6087	152	0.9722	0.4764	0.9722	0.9860
No log	6.6957	154	0.9461	0.3973	0.9461	0.9727
No log	6.7826	156	0.9944	0.3728	0.9944	0.9972
No log	6.8696	158	0.9655	0.3688	0.9655	0.9826
No log	6.9565	160	0.9696	0.4722	0.9696	0.9847
No log	7.0435	162	1.1089	0.4186	1.1089	1.0530
No log	7.1304	164	1.1272	0.4300	1.1272	1.0617
No log	7.2174	166	0.9688	0.4552	0.9688	0.9843
No log	7.3043	168	0.9597	0.5216	0.9597	0.9797
No log	7.3913	170	0.9672	0.4932	0.9672	0.9835
No log	7.4783	172	0.9299	0.4998	0.9299	0.9643
No log	7.5652	174	1.0557	0.3601	1.0557	1.0275
No log	7.6522	176	1.1940	0.3917	1.1940	1.0927
No log	7.7391	178	1.1055	0.3697	1.1055	1.0514
No log	7.8261	180	0.9524	0.4681	0.9524	0.9759
No log	7.9130	182	0.9398	0.4681	0.9398	0.9694
No log	8.0	184	1.0492	0.3601	1.0492	1.0243
No log	8.0870	186	1.1011	0.3827	1.1011	1.0493
No log	8.1739	188	1.1308	0.3429	1.1308	1.0634
No log	8.2609	190	0.9923	0.4339	0.9923	0.9962
No log	8.3478	192	0.9066	0.5418	0.9066	0.9522
No log	8.4348	194	0.9102	0.5391	0.9102	0.9540
No log	8.5217	196	0.9373	0.5098	0.9373	0.9682
No log	8.6087	198	0.9139	0.4871	0.9139	0.9560
No log	8.6957	200	0.9318	0.3969	0.9318	0.9653
No log	8.7826	202	0.9788	0.4774	0.9788	0.9893
No log	8.8696	204	0.9572	0.4326	0.9572	0.9784
No log	8.9565	206	0.9719	0.4718	0.9719	0.9858
No log	9.0435	208	1.0019	0.4898	1.0019	1.0010
No log	9.1304	210	1.1194	0.4284	1.1194	1.0580
No log	9.2174	212	1.0742	0.4942	1.0742	1.0364
No log	9.3043	214	1.0345	0.4718	1.0345	1.0171
No log	9.3913	216	1.0111	0.4727	1.0111	1.0055
No log	9.4783	218	1.0188	0.4724	1.0188	1.0093
No log	9.5652	220	1.0566	0.4220	1.0566	1.0279
No log	9.6522	222	1.0059	0.3838	1.0059	1.0030
No log	9.7391	224	0.9353	0.4454	0.9353	0.9671
No log	9.8261	226	0.9079	0.3948	0.9079	0.9528
No log	9.9130	228	0.9017	0.4920	0.9017	0.9496
No log	10.0	230	1.0059	0.4811	1.0059	1.0029
No log	10.0870	232	1.1182	0.4521	1.1182	1.0574
No log	10.1739	234	1.0251	0.5098	1.0251	1.0125
No log	10.2609	236	0.9153	0.5305	0.9153	0.9567
No log	10.3478	238	0.9115	0.5098	0.9115	0.9547
No log	10.4348	240	1.0294	0.4563	1.0294	1.0146
No log	10.5217	242	1.0521	0.4418	1.0521	1.0257
No log	10.6087	244	0.9705	0.5	0.9705	0.9851
No log	10.6957	246	0.9080	0.4808	0.9080	0.9529
No log	10.7826	248	0.9034	0.4499	0.9034	0.9505
No log	10.8696	250	0.9103	0.4894	0.9103	0.9541
No log	10.9565	252	1.0274	0.4741	1.0274	1.0136
No log	11.0435	254	1.0410	0.4453	1.0410	1.0203
No log	11.1304	256	0.9994	0.5227	0.9994	0.9997
No log	11.2174	258	0.9500	0.4823	0.9500	0.9747
No log	11.3043	260	0.9476	0.4835	0.9476	0.9734
No log	11.3913	262	1.0410	0.4458	1.0410	1.0203
No log	11.4783	264	1.1444	0.3491	1.1444	1.0698
No log	11.5652	266	1.0896	0.3918	1.0896	1.0438
No log	11.6522	268	1.0803	0.3567	1.0803	1.0394
No log	11.7391	270	1.1371	0.3629	1.1371	1.0664
No log	11.8261	272	1.1238	0.3629	1.1238	1.0601
No log	11.9130	274	1.0546	0.3596	1.0546	1.0269
No log	12.0	276	1.0356	0.3409	1.0356	1.0177
No log	12.0870	278	0.9791	0.4775	0.9791	0.9895
No log	12.1739	280	0.9771	0.4816	0.9771	0.9885
No log	12.2609	282	0.9973	0.4726	0.9973	0.9987
No log	12.3478	284	1.0604	0.4167	1.0604	1.0298
No log	12.4348	286	1.2324	0.3811	1.2324	1.1101
No log	12.5217	288	1.2224	0.3719	1.2224	1.1056
No log	12.6087	290	1.1160	0.3340	1.1160	1.0564
No log	12.6957	292	1.1289	0.3503	1.1289	1.0625
No log	12.7826	294	1.1671	0.3947	1.1671	1.0803
No log	12.8696	296	1.0854	0.3629	1.0854	1.0418
No log	12.9565	298	0.9813	0.3886	0.9813	0.9906
No log	13.0435	300	0.9543	0.4369	0.9543	0.9769
No log	13.1304	302	0.9732	0.4607	0.9732	0.9865
No log	13.2174	304	1.0482	0.4217	1.0482	1.0238
No log	13.3043	306	1.0604	0.4813	1.0604	1.0298
No log	13.3913	308	1.0096	0.4199	1.0096	1.0048
No log	13.4783	310	0.9419	0.5411	0.9419	0.9705
No log	13.5652	312	0.9221	0.5268	0.9221	0.9602
No log	13.6522	314	0.9507	0.5022	0.9507	0.9751
No log	13.7391	316	0.9509	0.5053	0.9509	0.9752
No log	13.8261	318	0.9165	0.4586	0.9165	0.9573
No log	13.9130	320	1.0098	0.4048	1.0098	1.0049
No log	14.0	322	1.0820	0.4219	1.0820	1.0402
No log	14.0870	324	1.0119	0.4408	1.0119	1.0059
No log	14.1739	326	0.9460	0.4125	0.9460	0.9726
No log	14.2609	328	0.9527	0.4841	0.9527	0.9761
No log	14.3478	330	0.9544	0.4053	0.9544	0.9769
No log	14.4348	332	0.9799	0.4533	0.9799	0.9899
No log	14.5217	334	0.9662	0.4540	0.9662	0.9830
No log	14.6087	336	0.9331	0.5165	0.9331	0.9660
No log	14.6957	338	0.9510	0.4488	0.9510	0.9752
No log	14.7826	340	0.9597	0.4998	0.9597	0.9796
No log	14.8696	342	0.9435	0.4273	0.9435	0.9713
No log	14.9565	344	0.9478	0.3826	0.9478	0.9735
No log	15.0435	346	0.9636	0.3729	0.9636	0.9816
No log	15.1304	348	0.9799	0.4164	0.9799	0.9899
No log	15.2174	350	1.0375	0.3249	1.0375	1.0186
No log	15.3043	352	1.0554	0.4060	1.0554	1.0273
No log	15.3913	354	1.0887	0.3658	1.0887	1.0434
No log	15.4783	356	1.0420	0.4311	1.0420	1.0208
No log	15.5652	358	1.0080	0.4606	1.0080	1.0040
No log	15.6522	360	0.9438	0.4397	0.9438	0.9715
No log	15.7391	362	0.9480	0.4907	0.9480	0.9736
No log	15.8261	364	1.0531	0.4102	1.0531	1.0262
No log	15.9130	366	1.0871	0.3986	1.0871	1.0426
No log	16.0	368	0.9762	0.5000	0.9762	0.9880
No log	16.0870	370	0.8942	0.4728	0.8942	0.9456
No log	16.1739	372	0.9049	0.4233	0.9049	0.9512
No log	16.2609	374	0.8924	0.4346	0.8924	0.9447
No log	16.3478	376	0.9653	0.52	0.9653	0.9825
No log	16.4348	378	1.1273	0.3734	1.1273	1.0617
No log	16.5217	380	1.3018	0.3650	1.3018	1.1410
No log	16.6087	382	1.2540	0.3650	1.2540	1.1198
No log	16.6957	384	1.0764	0.4304	1.0764	1.0375
No log	16.7826	386	0.9603	0.5029	0.9603	0.9800
No log	16.8696	388	0.9671	0.4583	0.9671	0.9834
No log	16.9565	390	1.0398	0.4453	1.0398	1.0197
No log	17.0435	392	1.1613	0.3650	1.1613	1.0776
No log	17.1304	394	1.0907	0.3902	1.0907	1.0443
No log	17.2174	396	0.9574	0.5102	0.9574	0.9785
No log	17.3043	398	0.8702	0.5315	0.8702	0.9328
No log	17.3913	400	1.0092	0.4012	1.0092	1.0046
No log	17.4783	402	1.0499	0.4260	1.0499	1.0247
No log	17.5652	404	0.9210	0.4792	0.9210	0.9597
No log	17.6522	406	0.8727	0.5432	0.8727	0.9342
No log	17.7391	408	1.0464	0.4440	1.0464	1.0229
No log	17.8261	410	1.1889	0.3959	1.1889	1.0904
No log	17.9130	412	1.1300	0.3959	1.1300	1.0630
No log	18.0	414	0.9661	0.4365	0.9661	0.9829
No log	18.0870	416	0.8582	0.4540	0.8582	0.9264
No log	18.1739	418	0.8559	0.4847	0.8559	0.9251
No log	18.2609	420	0.8542	0.4847	0.8542	0.9242
No log	18.3478	422	0.8668	0.5267	0.8668	0.9310
No log	18.4348	424	0.9130	0.5151	0.9130	0.9555
No log	18.5217	426	0.9739	0.4906	0.9739	0.9869
No log	18.6087	428	0.9890	0.4894	0.9890	0.9945
No log	18.6957	430	0.9224	0.4754	0.9224	0.9604
No log	18.7826	432	0.8773	0.5194	0.8773	0.9367
No log	18.8696	434	0.8568	0.5229	0.8568	0.9256
No log	18.9565	436	0.8713	0.5068	0.8713	0.9335
No log	19.0435	438	0.8511	0.5562	0.8511	0.9226
No log	19.1304	440	0.8029	0.5752	0.8029	0.8960
No log	19.2174	442	0.7918	0.5455	0.7918	0.8898
No log	19.3043	444	0.7984	0.5752	0.7984	0.8936
No log	19.3913	446	0.8174	0.5898	0.8174	0.9041
No log	19.4783	448	0.8364	0.5279	0.8364	0.9145
No log	19.5652	450	0.8047	0.5944	0.8047	0.8970
No log	19.6522	452	0.7996	0.6075	0.7996	0.8942
No log	19.7391	454	0.8052	0.6025	0.8052	0.8973
No log	19.8261	456	0.8109	0.6108	0.8109	0.9005
No log	19.9130	458	0.8227	0.5484	0.8227	0.9070
No log	20.0	460	0.8252	0.5884	0.8252	0.9084
No log	20.0870	462	0.8389	0.5528	0.8389	0.9159
No log	20.1739	464	0.9015	0.4998	0.9015	0.9495
No log	20.2609	466	1.0000	0.4013	1.0000	1.0000
No log	20.3478	468	1.1332	0.3956	1.1332	1.0645
No log	20.4348	470	1.1284	0.3956	1.1284	1.0622
No log	20.5217	472	1.0414	0.4200	1.0414	1.0205
No log	20.6087	474	0.9723	0.4764	0.9723	0.9860
No log	20.6957	476	0.9623	0.4527	0.9623	0.9810
No log	20.7826	478	0.9624	0.4273	0.9624	0.9810
No log	20.8696	480	1.0132	0.3986	1.0132	1.0066
No log	20.9565	482	1.1440	0.3466	1.1440	1.0696
No log	21.0435	484	1.1768	0.3676	1.1768	1.0848
No log	21.1304	486	1.0845	0.4219	1.0845	1.0414
No log	21.2174	488	0.9196	0.4826	0.9196	0.9590
No log	21.3043	490	0.8516	0.4450	0.8516	0.9228
No log	21.3913	492	0.8439	0.4583	0.8439	0.9187
No log	21.4783	494	0.8485	0.5045	0.8485	0.9211
No log	21.5652	496	0.9112	0.5029	0.9112	0.9546
No log	21.6522	498	0.9495	0.4874	0.9495	0.9744
0.3331	21.7391	500	0.9674	0.4751	0.9674	0.9836
0.3331	21.8261	502	0.8772	0.4914	0.8772	0.9366
0.3331	21.9130	504	0.8042	0.6247	0.8042	0.8968
0.3331	22.0	506	0.8300	0.4648	0.8300	0.9110
0.3331	22.0870	508	0.8332	0.4648	0.8332	0.9128
0.3331	22.1739	510	0.8280	0.5253	0.8280	0.9100
0.3331	22.2609	512	0.8735	0.5396	0.8735	0.9346
0.3331	22.3478	514	0.9408	0.5306	0.9408	0.9699
0.3331	22.4348	516	0.9786	0.4633	0.9786	0.9892
0.3331	22.5217	518	0.9307	0.4712	0.9307	0.9647
0.3331	22.6087	520	0.9510	0.4345	0.9510	0.9752
0.3331	22.6957	522	0.9834	0.4311	0.9834	0.9917
0.3331	22.7826	524	1.0283	0.3978	1.0283	1.0141

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1