ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7784
• Qwk: 0.4871
• Mse: 0.7784
• Rmse: 0.8822

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.8028	0.0010	4.8028	2.1915
No log	0.1379	4	2.6949	-0.0084	2.6949	1.6416
No log	0.2069	6	1.8071	0.0198	1.8071	1.3443
No log	0.2759	8	1.3700	0.0226	1.3700	1.1705
No log	0.3448	10	1.5007	0.1143	1.5007	1.2250
No log	0.4138	12	1.2546	0.0547	1.2546	1.1201
No log	0.4828	14	1.2334	0.2023	1.2334	1.1106
No log	0.5517	16	1.2049	0.1918	1.2049	1.0977
No log	0.6207	18	1.1504	0.2369	1.1504	1.0726
No log	0.6897	20	1.1352	0.3038	1.1352	1.0655
No log	0.7586	22	1.1618	0.3131	1.1618	1.0779
No log	0.8276	24	1.1830	0.1679	1.1830	1.0877
No log	0.8966	26	1.2053	0.1076	1.2053	1.0979
No log	0.9655	28	1.2099	0.1371	1.2099	1.1000
No log	1.0345	30	1.1130	0.3476	1.1130	1.0550
No log	1.1034	32	1.0708	0.3117	1.0708	1.0348
No log	1.1724	34	1.2027	0.1864	1.2027	1.0967
No log	1.2414	36	1.1687	0.2024	1.1687	1.0811
No log	1.3103	38	1.1107	0.3514	1.1107	1.0539
No log	1.3793	40	1.1367	0.2091	1.1367	1.0661
No log	1.4483	42	1.1553	0.2230	1.1553	1.0748
No log	1.5172	44	1.0977	0.3711	1.0977	1.0477
No log	1.5862	46	1.1183	0.3062	1.1183	1.0575
No log	1.6552	48	1.1111	0.3301	1.1111	1.0541
No log	1.7241	50	1.0816	0.4079	1.0816	1.0400
No log	1.7931	52	1.0832	0.2689	1.0832	1.0407
No log	1.8621	54	1.0239	0.3511	1.0239	1.0119
No log	1.9310	56	1.0352	0.3596	1.0352	1.0174
No log	2.0	58	1.2792	0.3238	1.2792	1.1310
No log	2.0690	60	1.2630	0.3798	1.2630	1.1238
No log	2.1379	62	1.0276	0.4396	1.0276	1.0137
No log	2.2069	64	0.9486	0.4042	0.9486	0.9740
No log	2.2759	66	0.9748	0.3256	0.9748	0.9873
No log	2.3448	68	0.9688	0.3434	0.9688	0.9843
No log	2.4138	70	0.9023	0.4104	0.9023	0.9499
No log	2.4828	72	0.9282	0.3645	0.9282	0.9634
No log	2.5517	74	0.9316	0.3689	0.9316	0.9652
No log	2.6207	76	0.9459	0.3145	0.9459	0.9726
No log	2.6897	78	0.9186	0.3616	0.9186	0.9584
No log	2.7586	80	1.0328	0.3333	1.0328	1.0163
No log	2.8276	82	1.2082	0.3757	1.2082	1.0992
No log	2.8966	84	1.1057	0.3757	1.1057	1.0515
No log	2.9655	86	0.8822	0.4278	0.8822	0.9392
No log	3.0345	88	0.9693	0.4406	0.9693	0.9845
No log	3.1034	90	0.9474	0.5006	0.9474	0.9734
No log	3.1724	92	0.8476	0.4272	0.8476	0.9207
No log	3.2414	94	1.1129	0.4462	1.1129	1.0549
No log	3.3103	96	1.0879	0.4216	1.0879	1.0430
No log	3.3793	98	0.8747	0.5012	0.8747	0.9353
No log	3.4483	100	0.8346	0.5025	0.8346	0.9136
No log	3.5172	102	0.8253	0.4737	0.8253	0.9085
No log	3.5862	104	0.8887	0.5339	0.8887	0.9427
No log	3.6552	106	0.8955	0.5083	0.8955	0.9463
No log	3.7241	108	0.8263	0.5308	0.8263	0.9090
No log	3.7931	110	0.8125	0.4962	0.8125	0.9014
No log	3.8621	112	1.0749	0.4872	1.0749	1.0368
No log	3.9310	114	0.8689	0.5485	0.8689	0.9322
No log	4.0	116	0.7508	0.4393	0.7508	0.8665
No log	4.0690	118	0.7520	0.4893	0.7520	0.8672
No log	4.1379	120	0.7748	0.4444	0.7748	0.8802
No log	4.2069	122	0.8084	0.4757	0.8084	0.8991
No log	4.2759	124	0.8055	0.4902	0.8055	0.8975
No log	4.3448	126	0.9066	0.4166	0.9066	0.9522
No log	4.4138	128	1.0092	0.4567	1.0092	1.0046
No log	4.4828	130	0.9797	0.4013	0.9797	0.9898
No log	4.5517	132	0.8855	0.4757	0.8855	0.9410
No log	4.6207	134	0.9095	0.4767	0.9095	0.9537
No log	4.6897	136	1.1056	0.3552	1.1056	1.0515
No log	4.7586	138	1.3373	0.3467	1.3373	1.1564
No log	4.8276	140	1.3186	0.3026	1.3186	1.1483
No log	4.8966	142	1.1047	0.2439	1.1047	1.0510
No log	4.9655	144	1.0201	0.2028	1.0201	1.0100
No log	5.0345	146	1.0688	0.2604	1.0688	1.0338
No log	5.1034	148	1.1702	0.3046	1.1702	1.0818
No log	5.1724	150	1.2537	0.3772	1.2537	1.1197
No log	5.2414	152	1.1896	0.4186	1.1896	1.0907
No log	5.3103	154	1.0089	0.3400	1.0089	1.0044
No log	5.3793	156	0.9548	0.3948	0.9548	0.9771
No log	5.4483	158	0.9323	0.4256	0.9323	0.9655
No log	5.5172	160	0.9180	0.4749	0.9180	0.9581
No log	5.5862	162	0.9287	0.3705	0.9287	0.9637
No log	5.6552	164	0.9363	0.3914	0.9363	0.9676
No log	5.7241	166	0.8978	0.4311	0.8978	0.9475
No log	5.7931	168	0.8535	0.4916	0.8535	0.9238
No log	5.8621	170	0.8960	0.5759	0.8960	0.9466
No log	5.9310	172	0.8577	0.5409	0.8577	0.9261
No log	6.0	174	0.8391	0.4653	0.8391	0.9160
No log	6.0690	176	0.9971	0.4551	0.9971	0.9985
No log	6.1379	178	1.1822	0.4186	1.1822	1.0873
No log	6.2069	180	1.0582	0.4685	1.0582	1.0287
No log	6.2759	182	0.8562	0.4142	0.8562	0.9253
No log	6.3448	184	0.8517	0.4142	0.8517	0.9229
No log	6.4138	186	0.8932	0.4203	0.8932	0.9451
No log	6.4828	188	0.8498	0.3663	0.8498	0.9219
No log	6.5517	190	0.8396	0.3943	0.8396	0.9163
No log	6.6207	192	0.8217	0.3695	0.8217	0.9065
No log	6.6897	194	0.8240	0.3695	0.8240	0.9077
No log	6.7586	196	0.8852	0.4526	0.8852	0.9408
No log	6.8276	198	1.0398	0.4776	1.0398	1.0197
No log	6.8966	200	1.0082	0.4577	1.0082	1.0041
No log	6.9655	202	0.7911	0.5012	0.7911	0.8894
No log	7.0345	204	0.7447	0.5793	0.7447	0.8630
No log	7.1034	206	0.7405	0.5793	0.7405	0.8605
No log	7.1724	208	0.7682	0.5298	0.7682	0.8765
No log	7.2414	210	0.7845	0.5060	0.7845	0.8857
No log	7.3103	212	0.8598	0.5129	0.8598	0.9272
No log	7.3793	214	0.8475	0.4565	0.8475	0.9206
No log	7.4483	216	0.8065	0.4163	0.8065	0.8981
No log	7.5172	218	0.7988	0.3448	0.7988	0.8937
No log	7.5862	220	0.7879	0.4754	0.7879	0.8876
No log	7.6552	222	0.8001	0.4845	0.8001	0.8945
No log	7.7241	224	0.8509	0.5242	0.8509	0.9225
No log	7.7931	226	0.8879	0.5290	0.8879	0.9423
No log	7.8621	228	0.7954	0.4858	0.7954	0.8919
No log	7.9310	230	0.7616	0.3868	0.7616	0.8727
No log	8.0	232	0.8060	0.4871	0.8060	0.8978
No log	8.0690	234	0.9886	0.5501	0.9886	0.9943
No log	8.1379	236	1.0931	0.4731	1.0931	1.0455
No log	8.2069	238	0.9862	0.5247	0.9862	0.9931
No log	8.2759	240	0.8163	0.4439	0.8163	0.9035
No log	8.3448	242	0.7626	0.4772	0.7626	0.8733
No log	8.4138	244	0.7481	0.5120	0.7481	0.8650
No log	8.4828	246	0.7454	0.4993	0.7454	0.8633
No log	8.5517	248	0.7805	0.5043	0.7805	0.8835
No log	8.6207	250	0.8363	0.5374	0.8363	0.9145
No log	8.6897	252	0.8061	0.5045	0.8061	0.8978
No log	8.7586	254	0.7833	0.4491	0.7833	0.8850
No log	8.8276	256	0.8017	0.4719	0.8017	0.8954
No log	8.8966	258	0.8251	0.4752	0.8251	0.9083
No log	8.9655	260	0.8010	0.4297	0.8010	0.8950
No log	9.0345	262	0.7998	0.4724	0.7998	0.8943
No log	9.1034	264	0.8983	0.5306	0.8983	0.9478
No log	9.1724	266	0.9810	0.5707	0.9810	0.9904
No log	9.2414	268	0.9155	0.5421	0.9155	0.9568
No log	9.3103	270	0.8248	0.5239	0.8248	0.9082
No log	9.3793	272	0.8042	0.4652	0.8042	0.8967
No log	9.4483	274	0.8319	0.3508	0.8319	0.9121
No log	9.5172	276	0.9353	0.4920	0.9353	0.9671
No log	9.5862	278	1.0498	0.4186	1.0498	1.0246
No log	9.6552	280	1.0182	0.4449	1.0182	1.0090
No log	9.7241	282	0.9243	0.3098	0.9243	0.9614
No log	9.7931	284	0.8559	0.3493	0.8559	0.9251
No log	9.8621	286	0.8272	0.4220	0.8272	0.9095
No log	9.9310	288	0.8100	0.3796	0.8100	0.9000
No log	10.0	290	0.8323	0.4858	0.8323	0.9123
No log	10.0690	292	0.9195	0.4845	0.9195	0.9589
No log	10.1379	294	0.9110	0.4663	0.9110	0.9544
No log	10.2069	296	0.8386	0.5090	0.8386	0.9157
No log	10.2759	298	0.7975	0.3896	0.7975	0.8930
No log	10.3448	300	0.7911	0.4429	0.7911	0.8894
No log	10.4138	302	0.7815	0.4527	0.7815	0.8840
No log	10.4828	304	0.8030	0.4377	0.8030	0.8961
No log	10.5517	306	0.8971	0.4712	0.8971	0.9472
No log	10.6207	308	0.9170	0.4822	0.9170	0.9576
No log	10.6897	310	0.8604	0.5073	0.8604	0.9276
No log	10.7586	312	0.8580	0.4681	0.8580	0.9263
No log	10.8276	314	0.9044	0.4690	0.9044	0.9510
No log	10.8966	316	1.0017	0.3971	1.0017	1.0008
No log	10.9655	318	1.1235	0.4532	1.1235	1.0599
No log	11.0345	320	1.1820	0.4511	1.1820	1.0872
No log	11.1034	322	1.0804	0.4620	1.0804	1.0394
No log	11.1724	324	0.8970	0.5	0.8970	0.9471
No log	11.2414	326	0.7856	0.4217	0.7856	0.8863
No log	11.3103	328	0.7866	0.4197	0.7866	0.8869
No log	11.3793	330	0.7698	0.4292	0.7698	0.8774
No log	11.4483	332	0.7581	0.4828	0.7581	0.8707
No log	11.5172	334	0.8744	0.5750	0.8744	0.9351
No log	11.5862	336	1.0367	0.5290	1.0367	1.0182
No log	11.6552	338	0.9916	0.5392	0.9916	0.9958
No log	11.7241	340	0.8108	0.5448	0.8108	0.9004
No log	11.7931	342	0.7384	0.5073	0.7384	0.8593
No log	11.8621	344	0.7825	0.5376	0.7825	0.8846
No log	11.9310	346	0.8104	0.4991	0.8104	0.9002
No log	12.0	348	0.7885	0.5009	0.7885	0.8880
No log	12.0690	350	0.7892	0.4595	0.7892	0.8884
No log	12.1379	352	0.8476	0.4037	0.8476	0.9207
No log	12.2069	354	0.9503	0.5483	0.9503	0.9749
No log	12.2759	356	1.0051	0.5255	1.0051	1.0026
No log	12.3448	358	0.9509	0.5830	0.9509	0.9751
No log	12.4138	360	0.9096	0.5672	0.9096	0.9537
No log	12.4828	362	0.8603	0.5291	0.8603	0.9275
No log	12.5517	364	0.8059	0.4620	0.8059	0.8977
No log	12.6207	366	0.7959	0.4337	0.7959	0.8921
No log	12.6897	368	0.8005	0.4527	0.8005	0.8947
No log	12.7586	370	0.8070	0.4527	0.8070	0.8983
No log	12.8276	372	0.8016	0.4343	0.8016	0.8953
No log	12.8966	374	0.8074	0.4548	0.8074	0.8986
No log	12.9655	376	0.8121	0.4066	0.8121	0.9012
No log	13.0345	378	0.8215	0.4409	0.8215	0.9064
No log	13.1034	380	0.8528	0.4465	0.8528	0.9235
No log	13.1724	382	0.8536	0.4889	0.8536	0.9239
No log	13.2414	384	0.8586	0.4889	0.8586	0.9266
No log	13.3103	386	0.8334	0.4934	0.8334	0.9129
No log	13.3793	388	0.8164	0.4450	0.8164	0.9035
No log	13.4483	390	0.8397	0.4489	0.8397	0.9163
No log	13.5172	392	0.8206	0.4489	0.8206	0.9059
No log	13.5862	394	0.7910	0.4898	0.7910	0.8894
No log	13.6552	396	0.8521	0.5470	0.8521	0.9231
No log	13.7241	398	0.9375	0.4986	0.9375	0.9682
No log	13.7931	400	0.9239	0.4792	0.9239	0.9612
No log	13.8621	402	0.8609	0.5470	0.8609	0.9278
No log	13.9310	404	0.8043	0.5380	0.8043	0.8968
No log	14.0	406	0.7995	0.5223	0.7995	0.8941
No log	14.0690	408	0.8031	0.5621	0.8031	0.8962
No log	14.1379	410	0.8278	0.5102	0.8278	0.9098
No log	14.2069	412	0.8895	0.5283	0.8895	0.9431
No log	14.2759	414	0.8789	0.5211	0.8789	0.9375
No log	14.3448	416	0.8769	0.4107	0.8769	0.9364
No log	14.4138	418	0.8885	0.3609	0.8885	0.9426
No log	14.4828	420	0.8904	0.3596	0.8904	0.9436
No log	14.5517	422	0.8867	0.3744	0.8867	0.9416
No log	14.6207	424	0.8855	0.3744	0.8855	0.9410
No log	14.6897	426	0.8701	0.3744	0.8701	0.9328
No log	14.7586	428	0.8624	0.4920	0.8624	0.9286
No log	14.8276	430	0.8813	0.4920	0.8813	0.9388
No log	14.8966	432	0.8849	0.4998	0.8849	0.9407
No log	14.9655	434	0.8497	0.4726	0.8497	0.9218
No log	15.0345	436	0.8352	0.4343	0.8352	0.9139
No log	15.1034	438	0.8360	0.3885	0.8360	0.9143
No log	15.1724	440	0.8507	0.3885	0.8507	0.9223
No log	15.2414	442	0.8937	0.4141	0.8937	0.9453
No log	15.3103	444	0.9620	0.4062	0.9620	0.9808
No log	15.3793	446	0.9878	0.3931	0.9878	0.9939
No log	15.4483	448	0.9549	0.4553	0.9549	0.9772
No log	15.5172	450	0.9112	0.4881	0.9112	0.9545
No log	15.5862	452	0.8619	0.4898	0.8619	0.9284
No log	15.6552	454	0.8325	0.5159	0.8325	0.9124
No log	15.7241	456	0.8102	0.4877	0.8102	0.9001
No log	15.7931	458	0.8244	0.4757	0.8244	0.9080
No log	15.8621	460	0.8336	0.4316	0.8336	0.9130
No log	15.9310	462	0.8349	0.3983	0.8349	0.9137
No log	16.0	464	0.8379	0.3983	0.8379	0.9154
No log	16.0690	466	0.8372	0.4316	0.8372	0.9150
No log	16.1379	468	0.8114	0.4316	0.8114	0.9008
No log	16.2069	470	0.7960	0.4316	0.7960	0.8922
No log	16.2759	472	0.7847	0.4424	0.7847	0.8859
No log	16.3448	474	0.7699	0.4782	0.7699	0.8774
No log	16.4138	476	0.7525	0.4866	0.7525	0.8675
No log	16.4828	478	0.7725	0.5194	0.7725	0.8789
No log	16.5517	480	0.7725	0.4985	0.7725	0.8789
No log	16.6207	482	0.7104	0.5532	0.7104	0.8428
No log	16.6897	484	0.7000	0.5646	0.7000	0.8367
No log	16.7586	486	0.7037	0.5820	0.7037	0.8389
No log	16.8276	488	0.7009	0.5820	0.7009	0.8372
No log	16.8966	490	0.7404	0.5495	0.7404	0.8605
No log	16.9655	492	0.8016	0.5472	0.8016	0.8953
No log	17.0345	494	0.8374	0.5360	0.8374	0.9151
No log	17.1034	496	0.9026	0.5042	0.9026	0.9501
No log	17.1724	498	0.8806	0.5379	0.8806	0.9384
0.3375	17.2414	500	0.8374	0.5044	0.8374	0.9151
0.3375	17.3103	502	0.8280	0.5044	0.8280	0.9099
0.3375	17.3793	504	0.8553	0.5218	0.8553	0.9248
0.3375	17.4483	506	0.8566	0.5060	0.8566	0.9255
0.3375	17.5172	508	0.8550	0.5060	0.8550	0.9246
0.3375	17.5862	510	0.8574	0.5060	0.8574	0.9260
0.3375	17.6552	512	0.8610	0.5153	0.8610	0.9279
0.3375	17.7241	514	0.8824	0.5030	0.8824	0.9394
0.3375	17.7931	516	0.8940	0.5173	0.8940	0.9455
0.3375	17.8621	518	0.8522	0.5287	0.8522	0.9231
0.3375	17.9310	520	0.7916	0.5060	0.7916	0.8897
0.3375	18.0	522	0.7548	0.4242	0.7548	0.8688
0.3375	18.0690	524	0.7360	0.4865	0.7360	0.8579
0.3375	18.1379	526	0.7447	0.5124	0.7447	0.8630
0.3375	18.2069	528	0.7695	0.5107	0.7695	0.8772
0.3375	18.2759	530	0.7751	0.4884	0.7751	0.8804
0.3375	18.3448	532	0.7616	0.4884	0.7616	0.8727
0.3375	18.4138	534	0.7720	0.4884	0.7720	0.8787
0.3375	18.4828	536	0.7620	0.4884	0.7620	0.8729
0.3375	18.5517	538	0.7784	0.4871	0.7784	0.8822

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1