Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask7_style

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5691
• Qwk: 0.5934
• Mse: 0.5691
• Rmse: 0.7544

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0202	2	4.3227	-0.0076	4.3227	2.0791
No log	0.0404	4	3.3441	0.0382	3.3441	1.8287
No log	0.0606	6	2.0985	0.0954	2.0985	1.4486
No log	0.0808	8	1.0333	0.1558	1.0333	1.0165
No log	0.1010	10	0.9785	0.0674	0.9785	0.9892
No log	0.1212	12	1.1256	0.0217	1.1256	1.0610
No log	0.1414	14	1.0783	0.0335	1.0783	1.0384
No log	0.1616	16	1.0217	0.0369	1.0217	1.0108
No log	0.1818	18	0.8597	0.0521	0.8597	0.9272
No log	0.2020	20	0.7914	0.3960	0.7914	0.8896
No log	0.2222	22	0.7767	0.3927	0.7767	0.8813
No log	0.2424	24	0.7361	0.3352	0.7361	0.8579
No log	0.2626	26	0.7923	0.1627	0.7923	0.8901
No log	0.2828	28	0.9069	0.2643	0.9069	0.9523
No log	0.3030	30	0.9257	0.3637	0.9257	0.9621
No log	0.3232	32	0.8165	0.3388	0.8165	0.9036
No log	0.3434	34	0.6222	0.4287	0.6222	0.7888
No log	0.3636	36	0.6558	0.4753	0.6558	0.8098
No log	0.3838	38	0.8271	0.4929	0.8271	0.9094
No log	0.4040	40	0.7103	0.4946	0.7103	0.8428
No log	0.4242	42	0.5704	0.5378	0.5704	0.7553
No log	0.4444	44	0.6903	0.3934	0.6903	0.8308
No log	0.4646	46	0.8405	0.3595	0.8405	0.9168
No log	0.4848	48	0.8106	0.3798	0.8106	0.9004
No log	0.5051	50	0.6715	0.4954	0.6715	0.8195
No log	0.5253	52	0.6224	0.5983	0.6224	0.7889
No log	0.5455	54	0.5985	0.5916	0.5985	0.7737
No log	0.5657	56	0.6678	0.4897	0.6678	0.8172
No log	0.5859	58	0.7085	0.3478	0.7085	0.8417
No log	0.6061	60	0.6377	0.3655	0.6377	0.7985
No log	0.6263	62	0.5574	0.5211	0.5574	0.7466
No log	0.6465	64	0.5220	0.5762	0.5220	0.7225
No log	0.6667	66	0.5125	0.6235	0.5125	0.7159
No log	0.6869	68	0.6175	0.5939	0.6175	0.7858
No log	0.7071	70	0.8685	0.4753	0.8685	0.9319
No log	0.7273	72	0.9142	0.4615	0.9142	0.9562
No log	0.7475	74	0.7465	0.5525	0.7465	0.8640
No log	0.7677	76	0.7036	0.5645	0.7036	0.8388
No log	0.7879	78	0.6430	0.6032	0.6430	0.8019
No log	0.8081	80	0.6659	0.5375	0.6659	0.8160
No log	0.8283	82	0.6573	0.4816	0.6573	0.8107
No log	0.8485	84	0.5860	0.5350	0.5860	0.7655
No log	0.8687	86	0.5704	0.5408	0.5704	0.7552
No log	0.8889	88	0.5770	0.5211	0.5770	0.7596
No log	0.9091	90	0.6026	0.4672	0.6026	0.7763
No log	0.9293	92	0.7363	0.3651	0.7363	0.8581
No log	0.9495	94	0.7383	0.2972	0.7383	0.8592
No log	0.9697	96	0.5971	0.5644	0.5971	0.7727
No log	0.9899	98	0.5701	0.5462	0.5701	0.7551
No log	1.0101	100	0.5929	0.5615	0.5929	0.7700
No log	1.0303	102	0.5784	0.5788	0.5784	0.7605
No log	1.0505	104	0.8489	0.4259	0.8489	0.9214
No log	1.0707	106	0.9222	0.4096	0.9222	0.9603
No log	1.0909	108	0.7488	0.5165	0.7488	0.8653
No log	1.1111	110	0.5634	0.6133	0.5634	0.7506
No log	1.1313	112	0.5388	0.6289	0.5388	0.7340
No log	1.1515	114	0.5292	0.5817	0.5292	0.7275
No log	1.1717	116	0.6410	0.4290	0.6410	0.8006
No log	1.1919	118	0.7270	0.3362	0.7270	0.8526
No log	1.2121	120	0.7174	0.3499	0.7174	0.8470
No log	1.2323	122	0.6384	0.4166	0.6384	0.7990
No log	1.2525	124	0.5768	0.4900	0.5768	0.7595
No log	1.2727	126	0.5918	0.4689	0.5918	0.7693
No log	1.2929	128	0.6255	0.4107	0.6255	0.7909
No log	1.3131	130	0.6855	0.4140	0.6855	0.8280
No log	1.3333	132	0.7496	0.4062	0.7496	0.8658
No log	1.3535	134	0.6520	0.5457	0.6520	0.8075
No log	1.3737	136	0.5287	0.6302	0.5287	0.7271
No log	1.3939	138	0.5653	0.5930	0.5653	0.7519
No log	1.4141	140	0.5424	0.6368	0.5424	0.7365
No log	1.4343	142	0.6257	0.6163	0.6257	0.7910
No log	1.4545	144	0.9229	0.4740	0.9229	0.9607
No log	1.4747	146	0.9626	0.4129	0.9626	0.9811
No log	1.4949	148	0.8675	0.3682	0.8675	0.9314
No log	1.5152	150	0.8801	0.2882	0.8801	0.9381
No log	1.5354	152	0.8192	0.3050	0.8192	0.9051
No log	1.5556	154	0.7076	0.3616	0.7076	0.8412
No log	1.5758	156	0.6195	0.4366	0.6195	0.7871
No log	1.5960	158	0.5819	0.5847	0.5819	0.7628
No log	1.6162	160	0.5775	0.6515	0.5775	0.7599
No log	1.6364	162	0.6608	0.6197	0.6608	0.8129
No log	1.6566	164	0.7693	0.5788	0.7693	0.8771
No log	1.6768	166	0.7804	0.5864	0.7804	0.8834
No log	1.6970	168	0.6908	0.6237	0.6908	0.8311
No log	1.7172	170	0.6364	0.6200	0.6364	0.7977
No log	1.7374	172	0.5606	0.6180	0.5606	0.7487
No log	1.7576	174	0.5387	0.6213	0.5387	0.7339
No log	1.7778	176	0.5461	0.6376	0.5461	0.7390
No log	1.7980	178	0.5569	0.6289	0.5569	0.7462
No log	1.8182	180	0.6621	0.5448	0.6621	0.8137
No log	1.8384	182	0.9491	0.4308	0.9491	0.9742
No log	1.8586	184	1.1170	0.3868	1.1170	1.0569
No log	1.8788	186	1.0276	0.4114	1.0276	1.0137
No log	1.8990	188	0.8119	0.4457	0.8119	0.9010
No log	1.9192	190	0.5863	0.5680	0.5863	0.7657
No log	1.9394	192	0.5041	0.6458	0.5041	0.7100
No log	1.9596	194	0.5001	0.6036	0.5001	0.7072
No log	1.9798	196	0.4987	0.6188	0.4987	0.7062
No log	2.0	198	0.6112	0.5217	0.6112	0.7818
No log	2.0202	200	0.8518	0.4263	0.8518	0.9229
No log	2.0404	202	0.9952	0.4017	0.9952	0.9976
No log	2.0606	204	1.0115	0.4025	1.0115	1.0057
No log	2.0808	206	0.8517	0.4047	0.8517	0.9229
No log	2.1010	208	0.6378	0.5148	0.6378	0.7986
No log	2.1212	210	0.5423	0.6080	0.5423	0.7364
No log	2.1414	212	0.5301	0.6226	0.5301	0.7281
No log	2.1616	214	0.5391	0.6306	0.5391	0.7342
No log	2.1818	216	0.5636	0.6278	0.5636	0.7507
No log	2.2020	218	0.6132	0.5218	0.6132	0.7831
No log	2.2222	220	0.6496	0.5393	0.6496	0.8060
No log	2.2424	222	0.6348	0.5798	0.6348	0.7968
No log	2.2626	224	0.6422	0.5727	0.6422	0.8014
No log	2.2828	226	0.5769	0.6163	0.5769	0.7595
No log	2.3030	228	0.5454	0.6383	0.5454	0.7385
No log	2.3232	230	0.5983	0.6179	0.5983	0.7735
No log	2.3434	232	0.6365	0.5899	0.6365	0.7978
No log	2.3636	234	0.7032	0.5715	0.7032	0.8386
No log	2.3838	236	0.6467	0.6055	0.6467	0.8042
No log	2.4040	238	0.6618	0.5570	0.6618	0.8135
No log	2.4242	240	0.7326	0.5313	0.7326	0.8559
No log	2.4444	242	0.7653	0.5062	0.7653	0.8748
No log	2.4646	244	0.7849	0.5098	0.7849	0.8859
No log	2.4848	246	0.8622	0.5059	0.8622	0.9285
No log	2.5051	248	0.6836	0.5651	0.6836	0.8268
No log	2.5253	250	0.5455	0.6528	0.5455	0.7386
No log	2.5455	252	0.5205	0.7104	0.5205	0.7215
No log	2.5657	254	0.5215	0.6931	0.5215	0.7222
No log	2.5859	256	0.6165	0.5772	0.6165	0.7852
No log	2.6061	258	0.5917	0.5789	0.5917	0.7692
No log	2.6263	260	0.5687	0.6056	0.5687	0.7541
No log	2.6465	262	0.5365	0.6648	0.5365	0.7324
No log	2.6667	264	0.5402	0.6674	0.5402	0.7350
No log	2.6869	266	0.5750	0.6219	0.5750	0.7583
No log	2.7071	268	0.5831	0.6213	0.5831	0.7636
No log	2.7273	270	0.5139	0.6493	0.5139	0.7168
No log	2.7475	272	0.5196	0.6633	0.5196	0.7209
No log	2.7677	274	0.5262	0.6585	0.5262	0.7254
No log	2.7879	276	0.5101	0.6615	0.5101	0.7142
No log	2.8081	278	0.5417	0.6379	0.5417	0.7360
No log	2.8283	280	0.6072	0.6038	0.6072	0.7793
No log	2.8485	282	0.7814	0.5119	0.7814	0.8839
No log	2.8687	284	0.8375	0.4621	0.8375	0.9152
No log	2.8889	286	0.7040	0.4843	0.7040	0.8390
No log	2.9091	288	0.5452	0.5967	0.5452	0.7384
No log	2.9293	290	0.5068	0.6396	0.5068	0.7119
No log	2.9495	292	0.5138	0.6217	0.5138	0.7168
No log	2.9697	294	0.4974	0.6450	0.4974	0.7053
No log	2.9899	296	0.5627	0.5746	0.5627	0.7502
No log	3.0101	298	0.7295	0.5013	0.7295	0.8541
No log	3.0303	300	0.8356	0.5049	0.8356	0.9141
No log	3.0505	302	0.7753	0.5118	0.7753	0.8805
No log	3.0707	304	0.6846	0.5536	0.6846	0.8274
No log	3.0909	306	0.5385	0.6199	0.5385	0.7338
No log	3.1111	308	0.5071	0.6561	0.5071	0.7121
No log	3.1313	310	0.5143	0.6647	0.5143	0.7172
No log	3.1515	312	0.5466	0.6369	0.5466	0.7393
No log	3.1717	314	0.7019	0.5511	0.7019	0.8378
No log	3.1919	316	0.7837	0.4970	0.7837	0.8853
No log	3.2121	318	0.7284	0.5002	0.7284	0.8535
No log	3.2323	320	0.6626	0.4889	0.6626	0.8140
No log	3.2525	322	0.6234	0.5464	0.6234	0.7896
No log	3.2727	324	0.5535	0.6353	0.5535	0.7440
No log	3.2929	326	0.5547	0.6518	0.5547	0.7448
No log	3.3131	328	0.5456	0.6543	0.5456	0.7386
No log	3.3333	330	0.5715	0.6091	0.5715	0.7560
No log	3.3535	332	0.7431	0.5692	0.7431	0.8620
No log	3.3737	334	0.8491	0.5427	0.8491	0.9214
No log	3.3939	336	0.7505	0.5756	0.7505	0.8663
No log	3.4141	338	0.6251	0.6375	0.6251	0.7907
No log	3.4343	340	0.6228	0.6379	0.6228	0.7892
No log	3.4545	342	0.7063	0.5736	0.7063	0.8404
No log	3.4747	344	0.7545	0.5069	0.7545	0.8686
No log	3.4949	346	0.6721	0.5250	0.6721	0.8198
No log	3.5152	348	0.5940	0.5858	0.5940	0.7707
No log	3.5354	350	0.5540	0.6158	0.5540	0.7443
No log	3.5556	352	0.4976	0.6233	0.4976	0.7054
No log	3.5758	354	0.4931	0.6618	0.4931	0.7022
No log	3.5960	356	0.5244	0.6686	0.5244	0.7241
No log	3.6162	358	0.6516	0.5930	0.6516	0.8072
No log	3.6364	360	0.7216	0.5860	0.7216	0.8495
No log	3.6566	362	0.7013	0.5851	0.7013	0.8374
No log	3.6768	364	0.6782	0.6190	0.6782	0.8235
No log	3.6970	366	0.5630	0.6564	0.5630	0.7503
No log	3.7172	368	0.5299	0.6753	0.5299	0.7279
No log	3.7374	370	0.5338	0.6586	0.5338	0.7306
No log	3.7576	372	0.5443	0.6242	0.5443	0.7378
No log	3.7778	374	0.5804	0.5983	0.5804	0.7618
No log	3.7980	376	0.6050	0.5953	0.6050	0.7778
No log	3.8182	378	0.5503	0.6399	0.5503	0.7418
No log	3.8384	380	0.4983	0.6654	0.4983	0.7059
No log	3.8586	382	0.4848	0.6469	0.4848	0.6963
No log	3.8788	384	0.5111	0.6280	0.5111	0.7149
No log	3.8990	386	0.5853	0.5841	0.5853	0.7651
No log	3.9192	388	0.6641	0.5336	0.6641	0.8150
No log	3.9394	390	0.6720	0.5475	0.6720	0.8197
No log	3.9596	392	0.5882	0.6217	0.5882	0.7669
No log	3.9798	394	0.5329	0.6749	0.5329	0.7300
No log	4.0	396	0.5446	0.6623	0.5446	0.7380
No log	4.0202	398	0.5276	0.6637	0.5276	0.7264
No log	4.0404	400	0.5509	0.6534	0.5509	0.7422
No log	4.0606	402	0.5937	0.6243	0.5937	0.7705
No log	4.0808	404	0.5930	0.6052	0.5930	0.7700
No log	4.1010	406	0.5499	0.6457	0.5499	0.7416
No log	4.1212	408	0.5322	0.6796	0.5322	0.7295
No log	4.1414	410	0.5445	0.6366	0.5445	0.7379
No log	4.1616	412	0.5389	0.6413	0.5389	0.7341
No log	4.1818	414	0.5292	0.6136	0.5292	0.7275
No log	4.2020	416	0.5515	0.6118	0.5515	0.7427
No log	4.2222	418	0.5571	0.6003	0.5571	0.7464
No log	4.2424	420	0.5783	0.6083	0.5783	0.7605
No log	4.2626	422	0.6579	0.5266	0.6579	0.8111
No log	4.2828	424	0.7728	0.4997	0.7728	0.8791
No log	4.3030	426	0.8254	0.5064	0.8254	0.9085
No log	4.3232	428	0.6786	0.5913	0.6786	0.8238
No log	4.3434	430	0.6127	0.6620	0.6127	0.7828
No log	4.3636	432	0.5379	0.6827	0.5379	0.7334
No log	4.3838	434	0.5790	0.6308	0.5790	0.7609
No log	4.4040	436	0.7856	0.5031	0.7856	0.8863
No log	4.4242	438	1.0101	0.4137	1.0101	1.0050
No log	4.4444	440	0.9490	0.4196	0.9490	0.9742
No log	4.4646	442	0.6945	0.5454	0.6945	0.8333
No log	4.4848	444	0.4930	0.6505	0.4930	0.7022
No log	4.5051	446	0.4982	0.6436	0.4982	0.7058
No log	4.5253	448	0.4962	0.6387	0.4962	0.7044
No log	4.5455	450	0.4992	0.6301	0.4992	0.7066
No log	4.5657	452	0.5726	0.6390	0.5726	0.7567
No log	4.5859	454	0.6681	0.6146	0.6681	0.8174
No log	4.6061	456	0.6627	0.5674	0.6627	0.8141
No log	4.6263	458	0.6111	0.6073	0.6111	0.7817
No log	4.6465	460	0.5460	0.6625	0.5460	0.7389
No log	4.6667	462	0.5326	0.6865	0.5326	0.7298
No log	4.6869	464	0.5196	0.6822	0.5196	0.7208
No log	4.7071	466	0.5701	0.6151	0.5701	0.7550
No log	4.7273	468	0.5705	0.6115	0.5705	0.7553
No log	4.7475	470	0.5705	0.5856	0.5705	0.7553
No log	4.7677	472	0.6239	0.5577	0.6239	0.7898
No log	4.7879	474	0.8004	0.5118	0.8004	0.8946
No log	4.8081	476	0.9206	0.4838	0.9206	0.9595
No log	4.8283	478	0.8521	0.5289	0.8521	0.9231
No log	4.8485	480	0.7690	0.6133	0.7690	0.8769
No log	4.8687	482	0.6569	0.6158	0.6569	0.8105
No log	4.8889	484	0.5814	0.6426	0.5814	0.7625
No log	4.9091	486	0.5785	0.6212	0.5785	0.7606
No log	4.9293	488	0.6568	0.5166	0.6568	0.8104
No log	4.9495	490	0.6658	0.5226	0.6658	0.8159
No log	4.9697	492	0.6055	0.5284	0.6055	0.7782
No log	4.9899	494	0.5939	0.5511	0.5939	0.7706
No log	5.0101	496	0.5528	0.5822	0.5528	0.7435
No log	5.0303	498	0.5732	0.5964	0.5732	0.7571
0.4876	5.0505	500	0.6873	0.6186	0.6873	0.8290
0.4876	5.0707	502	0.8884	0.6061	0.8884	0.9426
0.4876	5.0909	504	0.8593	0.6336	0.8593	0.9270
0.4876	5.1111	506	0.8956	0.6180	0.8956	0.9464
0.4876	5.1313	508	0.7881	0.6336	0.7881	0.8877
0.4876	5.1515	510	0.5734	0.6585	0.5734	0.7572
0.4876	5.1717	512	0.4950	0.6904	0.4950	0.7036
0.4876	5.1919	514	0.5015	0.6835	0.5015	0.7081
0.4876	5.2121	516	0.5933	0.6268	0.5933	0.7703
0.4876	5.2323	518	0.7506	0.5706	0.7506	0.8663
0.4876	5.2525	520	0.7081	0.6079	0.7081	0.8415
0.4876	5.2727	522	0.5472	0.6717	0.5472	0.7397
0.4876	5.2929	524	0.5032	0.6665	0.5032	0.7094
0.4876	5.3131	526	0.4883	0.6676	0.4883	0.6988
0.4876	5.3333	528	0.5352	0.6655	0.5352	0.7316
0.4876	5.3535	530	0.7012	0.5468	0.7012	0.8374
0.4876	5.3737	532	0.7671	0.5028	0.7671	0.8758
0.4876	5.3939	534	0.6626	0.5728	0.6626	0.8140
0.4876	5.4141	536	0.5954	0.6111	0.5954	0.7716
0.4876	5.4343	538	0.5575	0.6613	0.5575	0.7467
0.4876	5.4545	540	0.5687	0.6405	0.5687	0.7541
0.4876	5.4747	542	0.6631	0.6029	0.6631	0.8143
0.4876	5.4949	544	0.8537	0.5212	0.8537	0.9240
0.4876	5.5152	546	0.8623	0.5287	0.8623	0.9286
0.4876	5.5354	548	0.7179	0.5904	0.7179	0.8473
0.4876	5.5556	550	0.5310	0.6952	0.5310	0.7287
0.4876	5.5758	552	0.5100	0.6914	0.5100	0.7142
0.4876	5.5960	554	0.5379	0.6800	0.5379	0.7334
0.4876	5.6162	556	0.6673	0.5900	0.6673	0.8169
0.4876	5.6364	558	0.8003	0.5491	0.8003	0.8946
0.4876	5.6566	560	0.7417	0.5467	0.7417	0.8612
0.4876	5.6768	562	0.6314	0.5719	0.6314	0.7946
0.4876	5.6970	564	0.5691	0.5934	0.5691	0.7544

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1