ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6120
• Qwk: 0.6046
• Mse: 0.6120
• Rmse: 0.7823

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	3.8567	-0.0047	3.8567	1.9639
No log	0.1111	4	2.0105	0.0727	2.0105	1.4179
No log	0.1667	6	1.2549	-0.0148	1.2549	1.1202
No log	0.2222	8	1.3524	-0.0245	1.3524	1.1629
No log	0.2778	10	2.0828	0.0342	2.0828	1.4432
No log	0.3333	12	1.9277	0.0733	1.9277	1.3884
No log	0.3889	14	1.3579	-0.0212	1.3579	1.1653
No log	0.4444	16	1.1292	0.2068	1.1292	1.0626
No log	0.5	18	1.0421	0.2140	1.0421	1.0209
No log	0.5556	20	1.0086	0.1504	1.0086	1.0043
No log	0.6111	22	1.0858	0.2873	1.0858	1.0420
No log	0.6667	24	1.0611	0.4051	1.0611	1.0301
No log	0.7222	26	1.0456	0.3014	1.0456	1.0226
No log	0.7778	28	1.1047	0.2004	1.1047	1.0510
No log	0.8333	30	1.1097	0.2030	1.1097	1.0534
No log	0.8889	32	1.0770	0.2100	1.0770	1.0378
No log	0.9444	34	1.0185	0.3540	1.0185	1.0092
No log	1.0	36	1.0004	0.2416	1.0004	1.0002
No log	1.0556	38	1.0030	0.2978	1.0030	1.0015
No log	1.1111	40	0.9584	0.2214	0.9584	0.9790
No log	1.1667	42	1.0020	0.2611	1.0020	1.0010
No log	1.2222	44	0.9942	0.2196	0.9942	0.9971
No log	1.2778	46	0.9484	0.2114	0.9484	0.9738
No log	1.3333	48	0.9981	0.2077	0.9981	0.9991
No log	1.3889	50	1.1638	0.2188	1.1638	1.0788
No log	1.4444	52	1.0401	0.2604	1.0401	1.0199
No log	1.5	54	0.8369	0.4	0.8369	0.9148
No log	1.5556	56	0.9467	0.3541	0.9467	0.9730
No log	1.6111	58	0.9212	0.3666	0.9212	0.9598
No log	1.6667	60	0.8263	0.3876	0.8263	0.9090
No log	1.7222	62	0.8329	0.3961	0.8329	0.9126
No log	1.7778	64	0.9074	0.4025	0.9074	0.9526
No log	1.8333	66	0.9100	0.4273	0.9100	0.9539
No log	1.8889	68	0.7956	0.4516	0.7956	0.8920
No log	1.9444	70	0.7761	0.4019	0.7761	0.8810
No log	2.0	72	0.7772	0.4086	0.7772	0.8816
No log	2.0556	74	0.8137	0.3071	0.8137	0.9021
No log	2.1111	76	0.8307	0.3476	0.8307	0.9114
No log	2.1667	78	0.8999	0.3569	0.8999	0.9486
No log	2.2222	80	0.9731	0.3308	0.9731	0.9865
No log	2.2778	82	0.9680	0.4533	0.9680	0.9839
No log	2.3333	84	0.8660	0.5176	0.8660	0.9306
No log	2.3889	86	0.8541	0.3721	0.8541	0.9242
No log	2.4444	88	0.9334	0.3654	0.9334	0.9661
No log	2.5	90	1.0240	0.2794	1.0240	1.0119
No log	2.5556	92	0.9528	0.2618	0.9528	0.9761
No log	2.6111	94	1.0162	0.2171	1.0162	1.0081
No log	2.6667	96	1.0311	0.2465	1.0311	1.0154
No log	2.7222	98	0.8802	0.3414	0.8802	0.9382
No log	2.7778	100	0.8379	0.4301	0.8379	0.9153
No log	2.8333	102	0.9871	0.3400	0.9871	0.9935
No log	2.8889	104	1.0134	0.3663	1.0134	1.0067
No log	2.9444	106	1.1833	0.3293	1.1833	1.0878
No log	3.0	108	1.0381	0.3744	1.0381	1.0188
No log	3.0556	110	0.7991	0.5680	0.7991	0.8939
No log	3.1111	112	0.8049	0.4734	0.8049	0.8971
No log	3.1667	114	0.7846	0.4644	0.7846	0.8858
No log	3.2222	116	0.8865	0.2873	0.8865	0.9415
No log	3.2778	118	0.8347	0.3658	0.8347	0.9136
No log	3.3333	120	0.7584	0.4822	0.7584	0.8709
No log	3.3889	122	0.7849	0.4472	0.7849	0.8859
No log	3.4444	124	0.7474	0.4914	0.7474	0.8645
No log	3.5	126	0.8043	0.4697	0.8043	0.8968
No log	3.5556	128	0.7462	0.5572	0.7462	0.8638
No log	3.6111	130	0.6858	0.5302	0.6858	0.8281
No log	3.6667	132	0.6944	0.5428	0.6944	0.8333
No log	3.7222	134	0.6680	0.5635	0.6680	0.8173
No log	3.7778	136	0.6674	0.5635	0.6674	0.8169
No log	3.8333	138	0.6549	0.5635	0.6549	0.8093
No log	3.8889	140	0.6604	0.6001	0.6604	0.8127
No log	3.9444	142	0.6668	0.5302	0.6668	0.8166
No log	4.0	144	0.8031	0.5359	0.8031	0.8962
No log	4.0556	146	0.9385	0.4764	0.9385	0.9688
No log	4.1111	148	0.8552	0.4752	0.8552	0.9248
No log	4.1667	150	0.6833	0.4960	0.6833	0.8266
No log	4.2222	152	0.7377	0.4560	0.7377	0.8589
No log	4.2778	154	0.7602	0.4162	0.7602	0.8719
No log	4.3333	156	0.7128	0.5108	0.7128	0.8443
No log	4.3889	158	0.6752	0.6127	0.6752	0.8217
No log	4.4444	160	0.7131	0.5083	0.7131	0.8444
No log	4.5	162	0.9322	0.3847	0.9322	0.9655
No log	4.5556	164	1.0387	0.3744	1.0387	1.0192
No log	4.6111	166	0.8694	0.4284	0.8694	0.9324
No log	4.6667	168	0.7007	0.5712	0.7007	0.8371
No log	4.7222	170	0.7061	0.5202	0.7061	0.8403
No log	4.7778	172	0.6832	0.5060	0.6832	0.8266
No log	4.8333	174	0.7470	0.4714	0.7470	0.8643
No log	4.8889	176	0.8303	0.3864	0.8303	0.9112
No log	4.9444	178	0.8761	0.4407	0.8761	0.9360
No log	5.0	180	0.7324	0.5400	0.7324	0.8558
No log	5.0556	182	0.6685	0.5432	0.6685	0.8176
No log	5.1111	184	0.6773	0.5441	0.6773	0.8230
No log	5.1667	186	0.6485	0.6475	0.6485	0.8053
No log	5.2222	188	0.6540	0.6465	0.6540	0.8087
No log	5.2778	190	0.6347	0.5432	0.6347	0.7967
No log	5.3333	192	0.7254	0.4893	0.7254	0.8517
No log	5.3889	194	0.8568	0.4841	0.8568	0.9256
No log	5.4444	196	0.7387	0.5459	0.7387	0.8595
No log	5.5	198	0.6585	0.5386	0.6585	0.8115
No log	5.5556	200	0.7647	0.5356	0.7647	0.8745
No log	5.6111	202	0.8171	0.4907	0.8171	0.9039
No log	5.6667	204	0.7598	0.4599	0.7598	0.8717
No log	5.7222	206	0.7313	0.5171	0.7313	0.8552
No log	5.7778	208	0.8570	0.4578	0.8570	0.9257
No log	5.8333	210	0.8708	0.4240	0.8708	0.9332
No log	5.8889	212	0.7538	0.4998	0.7538	0.8682
No log	5.9444	214	0.6797	0.5156	0.6797	0.8244
No log	6.0	216	0.7300	0.5433	0.7300	0.8544
No log	6.0556	218	0.7433	0.5618	0.7433	0.8622
No log	6.1111	220	0.6788	0.5605	0.6788	0.8239
No log	6.1667	222	0.6499	0.5635	0.6499	0.8062
No log	6.2222	224	0.6514	0.5647	0.6514	0.8071
No log	6.2778	226	0.6461	0.5626	0.6461	0.8038
No log	6.3333	228	0.6460	0.5274	0.6460	0.8037
No log	6.3889	230	0.6562	0.6073	0.6562	0.8101
No log	6.4444	232	0.6529	0.5505	0.6529	0.8080
No log	6.5	234	0.6522	0.5523	0.6522	0.8076
No log	6.5556	236	0.6652	0.6262	0.6652	0.8156
No log	6.6111	238	0.6950	0.6415	0.6950	0.8336
No log	6.6667	240	0.6933	0.6051	0.6933	0.8327
No log	6.7222	242	0.6607	0.6311	0.6607	0.8128
No log	6.7778	244	0.6321	0.6076	0.6321	0.7950
No log	6.8333	246	0.6478	0.5830	0.6478	0.8049
No log	6.8889	248	0.6474	0.6144	0.6474	0.8046
No log	6.9444	250	0.6121	0.6046	0.6121	0.7824
No log	7.0	252	0.6462	0.6479	0.6462	0.8039
No log	7.0556	254	0.7545	0.5346	0.7545	0.8686
No log	7.1111	256	0.7366	0.5346	0.7366	0.8582
No log	7.1667	258	0.6423	0.6441	0.6423	0.8014
No log	7.2222	260	0.6026	0.6606	0.6026	0.7763
No log	7.2778	262	0.6481	0.5536	0.6481	0.8051
No log	7.3333	264	0.6515	0.5635	0.6515	0.8072
No log	7.3889	266	0.6822	0.5763	0.6822	0.8259
No log	7.4444	268	0.7182	0.5400	0.7182	0.8475
No log	7.5	270	0.6971	0.5688	0.6971	0.8349
No log	7.5556	272	0.6897	0.5415	0.6897	0.8305
No log	7.6111	274	0.7154	0.5312	0.7154	0.8458
No log	7.6667	276	0.6993	0.5300	0.6993	0.8362
No log	7.7222	278	0.7227	0.5748	0.7227	0.8501
No log	7.7778	280	0.7097	0.6035	0.7097	0.8425
No log	7.8333	282	0.7235	0.5648	0.7235	0.8506
No log	7.8889	284	0.6724	0.5726	0.6724	0.8200
No log	7.9444	286	0.6498	0.6123	0.6498	0.8061
No log	8.0	288	0.6483	0.6154	0.6483	0.8052
No log	8.0556	290	0.6548	0.6143	0.6548	0.8092
No log	8.1111	292	0.6564	0.5932	0.6564	0.8102
No log	8.1667	294	0.6588	0.6325	0.6588	0.8117
No log	8.2222	296	0.6608	0.6325	0.6608	0.8129
No log	8.2778	298	0.6578	0.6325	0.6578	0.8111
No log	8.3333	300	0.6559	0.5722	0.6559	0.8099
No log	8.3889	302	0.6820	0.5522	0.6820	0.8259
No log	8.4444	304	0.6980	0.4473	0.6980	0.8354
No log	8.5	306	0.6680	0.5549	0.6680	0.8173
No log	8.5556	308	0.6804	0.5103	0.6804	0.8249
No log	8.6111	310	0.6710	0.5103	0.6710	0.8192
No log	8.6667	312	0.6489	0.5747	0.6489	0.8055
No log	8.7222	314	0.6455	0.6286	0.6455	0.8034
No log	8.7778	316	0.6657	0.6325	0.6657	0.8159
No log	8.8333	318	0.6814	0.5949	0.6814	0.8255
No log	8.8889	320	0.6818	0.5156	0.6818	0.8257
No log	8.9444	322	0.6956	0.4914	0.6956	0.8340
No log	9.0	324	0.7000	0.5156	0.7000	0.8367
No log	9.0556	326	0.7158	0.5490	0.7158	0.8460
No log	9.1111	328	0.7003	0.5490	0.7003	0.8369
No log	9.1667	330	0.6672	0.5490	0.6672	0.8168
No log	9.2222	332	0.6757	0.5676	0.6757	0.8220
No log	9.2778	334	0.6713	0.5688	0.6713	0.8193
No log	9.3333	336	0.6453	0.5590	0.6453	0.8033
No log	9.3889	338	0.6426	0.5590	0.6426	0.8016
No log	9.4444	340	0.6225	0.6143	0.6225	0.7890
No log	9.5	342	0.5808	0.6673	0.5808	0.7621
No log	9.5556	344	0.5825	0.6806	0.5825	0.7632
No log	9.6111	346	0.6347	0.6438	0.6347	0.7967
No log	9.6667	348	0.6379	0.6740	0.6379	0.7987
No log	9.7222	350	0.6172	0.6291	0.6172	0.7856
No log	9.7778	352	0.5874	0.6230	0.5874	0.7664
No log	9.8333	354	0.6500	0.5141	0.6500	0.8062
No log	9.8889	356	0.6575	0.5141	0.6575	0.8108
No log	9.9444	358	0.6291	0.5343	0.6291	0.7932
No log	10.0	360	0.6073	0.6107	0.6073	0.7793
No log	10.0556	362	0.6277	0.6096	0.6277	0.7923
No log	10.1111	364	0.6468	0.5735	0.6468	0.8043
No log	10.1667	366	0.6330	0.6096	0.6330	0.7956
No log	10.2222	368	0.6330	0.6488	0.6330	0.7956
No log	10.2778	370	0.6737	0.6187	0.6737	0.8208
No log	10.3333	372	0.6981	0.5774	0.6981	0.8355
No log	10.3889	374	0.6492	0.5712	0.6492	0.8058
No log	10.4444	376	0.6207	0.5955	0.6207	0.7878
No log	10.5	378	0.6155	0.5955	0.6155	0.7845
No log	10.5556	380	0.6347	0.6113	0.6347	0.7967
No log	10.6111	382	0.6851	0.5728	0.6851	0.8277
No log	10.6667	384	0.6878	0.5521	0.6878	0.8294
No log	10.7222	386	0.6938	0.4812	0.6938	0.8329
No log	10.7778	388	0.6836	0.4828	0.6836	0.8268
No log	10.8333	390	0.6612	0.4613	0.6612	0.8131
No log	10.8889	392	0.6436	0.4613	0.6436	0.8023
No log	10.9444	394	0.6510	0.6109	0.6510	0.8068
No log	11.0	396	0.6643	0.6640	0.6643	0.8151
No log	11.0556	398	0.6011	0.6626	0.6011	0.7753
No log	11.1111	400	0.5987	0.6249	0.5987	0.7738
No log	11.1667	402	0.6101	0.6057	0.6101	0.7811
No log	11.2222	404	0.6229	0.5647	0.6229	0.7892
No log	11.2778	406	0.6391	0.5647	0.6391	0.7994
No log	11.3333	408	0.6474	0.5647	0.6474	0.8046
No log	11.3889	410	0.6420	0.5647	0.6420	0.8013
No log	11.4444	412	0.6431	0.5040	0.6431	0.8020
No log	11.5	414	0.6482	0.5156	0.6482	0.8051
No log	11.5556	416	0.6329	0.5724	0.6329	0.7955
No log	11.6111	418	0.6270	0.6057	0.6270	0.7918
No log	11.6667	420	0.6355	0.6249	0.6355	0.7972
No log	11.7222	422	0.6464	0.6078	0.6464	0.8040
No log	11.7778	424	0.6387	0.6297	0.6387	0.7992
No log	11.8333	426	0.6299	0.6288	0.6299	0.7936
No log	11.8889	428	0.6349	0.6623	0.6349	0.7968
No log	11.9444	430	0.6178	0.5874	0.6178	0.7860
No log	12.0	432	0.6276	0.5874	0.6276	0.7922
No log	12.0556	434	0.6195	0.5759	0.6195	0.7871
No log	12.1111	436	0.6037	0.5647	0.6037	0.7770
No log	12.1667	438	0.6080	0.6380	0.6080	0.7797
No log	12.2222	440	0.6311	0.6557	0.6311	0.7944
No log	12.2778	442	0.6545	0.6664	0.6545	0.8090
No log	12.3333	444	0.6549	0.5274	0.6549	0.8093
No log	12.3889	446	0.6784	0.4960	0.6784	0.8237
No log	12.4444	448	0.6854	0.4960	0.6854	0.8279
No log	12.5	450	0.6694	0.5302	0.6694	0.8182
No log	12.5556	452	0.7126	0.5403	0.7126	0.8441
No log	12.6111	454	0.7584	0.5266	0.7584	0.8708
No log	12.6667	456	0.7056	0.5416	0.7056	0.8400
No log	12.7222	458	0.6440	0.5798	0.6440	0.8025
No log	12.7778	460	0.6260	0.5932	0.6260	0.7912
No log	12.8333	462	0.6428	0.5921	0.6428	0.8018
No log	12.8889	464	0.7283	0.5387	0.7283	0.8534
No log	12.9444	466	0.8123	0.4652	0.8123	0.9013
No log	13.0	468	0.8597	0.4332	0.8597	0.9272
No log	13.0556	470	0.8106	0.4311	0.8106	0.9003
No log	13.1111	472	0.6799	0.5925	0.6799	0.8246
No log	13.1667	474	0.6002	0.5759	0.6002	0.7747
No log	13.2222	476	0.6067	0.5894	0.6067	0.7789
No log	13.2778	478	0.6128	0.6822	0.6128	0.7828
No log	13.3333	480	0.5939	0.6708	0.5939	0.7706
No log	13.3889	482	0.5826	0.6374	0.5826	0.7633
No log	13.4444	484	0.5855	0.6057	0.5855	0.7652
No log	13.5	486	0.5978	0.6164	0.5978	0.7732
No log	13.5556	488	0.6360	0.5638	0.6360	0.7975
No log	13.6111	490	0.7245	0.6172	0.7245	0.8512
No log	13.6667	492	0.8100	0.5709	0.8100	0.9000
No log	13.7222	494	0.7283	0.6081	0.7283	0.8534
No log	13.7778	496	0.6334	0.5614	0.6334	0.7959
No log	13.8333	498	0.6697	0.6252	0.6697	0.8183
0.2857	13.8889	500	0.6828	0.6252	0.6828	0.8263
0.2857	13.9444	502	0.6378	0.6380	0.6378	0.7986
0.2857	14.0	504	0.6040	0.5939	0.6040	0.7772
0.2857	14.0556	506	0.6202	0.6078	0.6202	0.7875
0.2857	14.1111	508	0.6160	0.5868	0.6160	0.7849
0.2857	14.1667	510	0.6052	0.5939	0.6052	0.7779
0.2857	14.2222	512	0.6120	0.6046	0.6120	0.7823

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1