Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask2_vocabulary

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4993
• Qwk: 0.5835
• Mse: 0.4993
• Rmse: 0.7066

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0213	2	4.2599	0.0248	4.2599	2.0640
No log	0.0426	4	3.2548	0.0438	3.2548	1.8041
No log	0.0638	6	1.4261	0.1444	1.4261	1.1942
No log	0.0851	8	0.7892	0.3197	0.7892	0.8884
No log	0.1064	10	0.8769	0.0590	0.8769	0.9365
No log	0.1277	12	0.8390	0.1313	0.8390	0.9160
No log	0.1489	14	0.7697	0.2454	0.7697	0.8773
No log	0.1702	16	0.7076	0.3815	0.7076	0.8412
No log	0.1915	18	0.6699	0.4591	0.6699	0.8185
No log	0.2128	20	0.6259	0.5125	0.6259	0.7912
No log	0.2340	22	0.6924	0.4146	0.6924	0.8321
No log	0.2553	24	0.7447	0.3334	0.7447	0.8630
No log	0.2766	26	0.7794	0.3470	0.7794	0.8828
No log	0.2979	28	0.6036	0.4731	0.6036	0.7769
No log	0.3191	30	0.5922	0.5222	0.5922	0.7696
No log	0.3404	32	0.6168	0.4987	0.6168	0.7853
No log	0.3617	34	0.5570	0.4804	0.5570	0.7463
No log	0.3830	36	0.5771	0.4240	0.5771	0.7597
No log	0.4043	38	0.6077	0.4160	0.6077	0.7796
No log	0.4255	40	0.6154	0.4371	0.6154	0.7845
No log	0.4468	42	0.7086	0.3680	0.7086	0.8418
No log	0.4681	44	0.8188	0.2563	0.8188	0.9049
No log	0.4894	46	0.7640	0.2987	0.7640	0.8741
No log	0.5106	48	0.6275	0.3945	0.6275	0.7921
No log	0.5319	50	0.5236	0.5473	0.5236	0.7236
No log	0.5532	52	0.5255	0.5700	0.5255	0.7249
No log	0.5745	54	0.5455	0.5967	0.5455	0.7386
No log	0.5957	56	0.7034	0.4794	0.7034	0.8387
No log	0.6170	58	0.8000	0.4645	0.8000	0.8944
No log	0.6383	60	0.8136	0.4404	0.8136	0.9020
No log	0.6596	62	0.5897	0.4515	0.5897	0.7680
No log	0.6809	64	0.5166	0.5266	0.5166	0.7187
No log	0.7021	66	0.5348	0.5085	0.5348	0.7313
No log	0.7234	68	0.5513	0.5772	0.5513	0.7425
No log	0.7447	70	0.6082	0.5630	0.6082	0.7799
No log	0.7660	72	0.5911	0.5750	0.5911	0.7688
No log	0.7872	74	0.6037	0.5970	0.6037	0.7770
No log	0.8085	76	0.6165	0.6025	0.6165	0.7852
No log	0.8298	78	0.6060	0.5972	0.6060	0.7784
No log	0.8511	80	0.6649	0.5576	0.6649	0.8154
No log	0.8723	82	0.6275	0.5357	0.6275	0.7921
No log	0.8936	84	0.5660	0.5423	0.5660	0.7523
No log	0.9149	86	0.6302	0.4989	0.6302	0.7938
No log	0.9362	88	0.6504	0.4734	0.6504	0.8065
No log	0.9574	90	0.6862	0.4847	0.6862	0.8283
No log	0.9787	92	0.7094	0.4958	0.7094	0.8422
No log	1.0	94	0.6274	0.5316	0.6274	0.7921
No log	1.0213	96	0.7749	0.5145	0.7749	0.8803
No log	1.0426	98	0.7613	0.5216	0.7613	0.8725
No log	1.0638	100	0.6439	0.5427	0.6439	0.8024
No log	1.0851	102	0.7337	0.4954	0.7337	0.8565
No log	1.1064	104	1.0208	0.3939	1.0208	1.0104
No log	1.1277	106	1.0349	0.3664	1.0349	1.0173
No log	1.1489	108	0.7956	0.4552	0.7956	0.8919
No log	1.1702	110	0.4919	0.5947	0.4919	0.7014
No log	1.1915	112	0.4759	0.5858	0.4759	0.6898
No log	1.2128	114	0.4800	0.5554	0.4800	0.6928
No log	1.2340	116	0.6755	0.3897	0.6755	0.8219
No log	1.2553	118	0.7304	0.3454	0.7304	0.8546
No log	1.2766	120	0.6875	0.4771	0.6875	0.8292
No log	1.2979	122	0.5206	0.5370	0.5206	0.7216
No log	1.3191	124	0.4611	0.6111	0.4611	0.6791
No log	1.3404	126	0.4832	0.6066	0.4832	0.6951
No log	1.3617	128	0.4945	0.5885	0.4945	0.7032
No log	1.3830	130	0.4613	0.5858	0.4613	0.6792
No log	1.4043	132	0.5392	0.4873	0.5392	0.7343
No log	1.4255	134	0.6444	0.3848	0.6444	0.8027
No log	1.4468	136	0.5786	0.4864	0.5786	0.7607
No log	1.4681	138	0.4876	0.5689	0.4876	0.6983
No log	1.4894	140	0.4588	0.6382	0.4588	0.6773
No log	1.5106	142	0.4805	0.6788	0.4805	0.6932
No log	1.5319	144	0.5481	0.6285	0.5481	0.7403
No log	1.5532	146	0.6807	0.5541	0.6807	0.8250
No log	1.5745	148	0.7402	0.4882	0.7402	0.8604
No log	1.5957	150	0.7620	0.4923	0.7620	0.8729
No log	1.6170	152	0.6038	0.5778	0.6038	0.7770
No log	1.6383	154	0.5799	0.6060	0.5799	0.7615
No log	1.6596	156	0.6034	0.5799	0.6034	0.7768
No log	1.6809	158	0.5690	0.5925	0.5690	0.7544
No log	1.7021	160	0.5228	0.6052	0.5228	0.7230
No log	1.7234	162	0.5427	0.6155	0.5427	0.7367
No log	1.7447	164	0.4656	0.6408	0.4656	0.6824
No log	1.7660	166	0.4575	0.6494	0.4575	0.6764
No log	1.7872	168	0.5042	0.6405	0.5042	0.7101
No log	1.8085	170	0.6379	0.5323	0.6379	0.7987
No log	1.8298	172	0.6798	0.4894	0.6798	0.8245
No log	1.8511	174	0.6494	0.5350	0.6494	0.8058
No log	1.8723	176	0.5745	0.6109	0.5745	0.7580
No log	1.8936	178	0.6239	0.5911	0.6239	0.7899
No log	1.9149	180	0.7570	0.5312	0.7570	0.8701
No log	1.9362	182	0.8399	0.5148	0.8399	0.9165
No log	1.9574	184	0.6523	0.5531	0.6523	0.8076
No log	1.9787	186	0.4372	0.6258	0.4372	0.6612
No log	2.0	188	0.4277	0.6153	0.4277	0.6540
No log	2.0213	190	0.4305	0.5948	0.4305	0.6561
No log	2.0426	192	0.5248	0.5447	0.5248	0.7244
No log	2.0638	194	0.5829	0.5628	0.5829	0.7635
No log	2.0851	196	0.4889	0.6377	0.4889	0.6992
No log	2.1064	198	0.4895	0.6801	0.4895	0.6997
No log	2.1277	200	0.5283	0.6628	0.5283	0.7268
No log	2.1489	202	0.6234	0.6371	0.6234	0.7895
No log	2.1702	204	0.7637	0.6213	0.7637	0.8739
No log	2.1915	206	0.7789	0.6268	0.7789	0.8825
No log	2.2128	208	0.6287	0.6247	0.6287	0.7929
No log	2.2340	210	0.6710	0.6208	0.6710	0.8192
No log	2.2553	212	0.8498	0.5412	0.8498	0.9219
No log	2.2766	214	0.7732	0.5929	0.7732	0.8793
No log	2.2979	216	0.5643	0.6820	0.5643	0.7512
No log	2.3191	218	0.5265	0.6820	0.5265	0.7256
No log	2.3404	220	0.6980	0.5906	0.6980	0.8354
No log	2.3617	222	1.1463	0.4360	1.1463	1.0707
No log	2.3830	224	1.2363	0.3601	1.2363	1.1119
No log	2.4043	226	1.0154	0.4220	1.0154	1.0077
No log	2.4255	228	0.6700	0.5448	0.6700	0.8186
No log	2.4468	230	0.4485	0.6619	0.4485	0.6697
No log	2.4681	232	0.4590	0.6382	0.4590	0.6775
No log	2.4894	234	0.4423	0.6055	0.4423	0.6651
No log	2.5106	236	0.4511	0.5544	0.4511	0.6717
No log	2.5319	238	0.5838	0.4651	0.5838	0.7641
No log	2.5532	240	0.7038	0.4542	0.7038	0.8389
No log	2.5745	242	0.6515	0.5136	0.6515	0.8071
No log	2.5957	244	0.5028	0.5638	0.5028	0.7091
No log	2.6170	246	0.4667	0.6243	0.4667	0.6831
No log	2.6383	248	0.4814	0.6435	0.4814	0.6939
No log	2.6596	250	0.5504	0.6265	0.5504	0.7419
No log	2.6809	252	0.6320	0.5764	0.6320	0.7950
No log	2.7021	254	0.7161	0.5223	0.7161	0.8462
No log	2.7234	256	0.6490	0.5502	0.6490	0.8056
No log	2.7447	258	0.5328	0.6205	0.5328	0.7299
No log	2.7660	260	0.4620	0.5921	0.4620	0.6797
No log	2.7872	262	0.4747	0.5926	0.4747	0.6890
No log	2.8085	264	0.5623	0.5591	0.5623	0.7499
No log	2.8298	266	0.6620	0.5159	0.6620	0.8137
No log	2.8511	268	0.6399	0.5100	0.6399	0.7999
No log	2.8723	270	0.5785	0.5483	0.5785	0.7606
No log	2.8936	272	0.4901	0.5813	0.4901	0.7000
No log	2.9149	274	0.5129	0.5670	0.5129	0.7162
No log	2.9362	276	0.5279	0.5950	0.5279	0.7266
No log	2.9574	278	0.5136	0.5563	0.5136	0.7167
No log	2.9787	280	0.5914	0.5291	0.5914	0.7690
No log	3.0	282	0.7857	0.4476	0.7857	0.8864
No log	3.0213	284	0.8164	0.4335	0.8164	0.9036
No log	3.0426	286	0.6855	0.4456	0.6855	0.8279
No log	3.0638	288	0.5350	0.5002	0.5350	0.7314
No log	3.0851	290	0.4838	0.5357	0.4838	0.6955
No log	3.1064	292	0.5142	0.5846	0.5142	0.7171
No log	3.1277	294	0.5573	0.6273	0.5573	0.7465
No log	3.1489	296	0.6063	0.6183	0.6063	0.7786
No log	3.1702	298	0.6628	0.5735	0.6628	0.8141
No log	3.1915	300	0.6091	0.5782	0.6091	0.7804
No log	3.2128	302	0.4991	0.5915	0.4991	0.7065
No log	3.2340	304	0.5330	0.5662	0.5330	0.7301
No log	3.2553	306	0.6675	0.5491	0.6675	0.8170
No log	3.2766	308	0.7318	0.5339	0.7318	0.8554
No log	3.2979	310	0.6797	0.5448	0.6797	0.8245
No log	3.3191	312	0.5611	0.5808	0.5611	0.7491
No log	3.3404	314	0.4756	0.6116	0.4756	0.6897
No log	3.3617	316	0.4734	0.6277	0.4734	0.6880
No log	3.3830	318	0.5708	0.5625	0.5708	0.7555
No log	3.4043	320	0.7503	0.5786	0.7503	0.8662
No log	3.4255	322	0.7682	0.5877	0.7682	0.8765
No log	3.4468	324	0.6378	0.6063	0.6378	0.7986
No log	3.4681	326	0.4942	0.6431	0.4942	0.7030
No log	3.4894	328	0.4967	0.6468	0.4967	0.7048
No log	3.5106	330	0.5074	0.6598	0.5074	0.7123
No log	3.5319	332	0.5115	0.6252	0.5115	0.7152
No log	3.5532	334	0.6148	0.5910	0.6148	0.7841
No log	3.5745	336	0.6538	0.5824	0.6538	0.8086
No log	3.5957	338	0.5447	0.5859	0.5447	0.7380
No log	3.6170	340	0.4669	0.6458	0.4669	0.6833
No log	3.6383	342	0.4756	0.6520	0.4756	0.6896
No log	3.6596	344	0.4869	0.6426	0.4869	0.6978
No log	3.6809	346	0.8507	0.5364	0.8507	0.9223
No log	3.7021	348	1.1037	0.4661	1.1037	1.0506
No log	3.7234	350	0.9378	0.4997	0.9378	0.9684
No log	3.7447	352	0.6046	0.5721	0.6046	0.7775
No log	3.7660	354	0.5002	0.6551	0.5002	0.7073
No log	3.7872	356	0.4645	0.6547	0.4645	0.6816
No log	3.8085	358	0.5192	0.6457	0.5192	0.7205
No log	3.8298	360	0.5464	0.6579	0.5464	0.7392
No log	3.8511	362	0.5131	0.6538	0.5131	0.7163
No log	3.8723	364	0.5333	0.6519	0.5333	0.7303
No log	3.8936	366	0.6321	0.6126	0.6321	0.7950
No log	3.9149	368	0.7459	0.5601	0.7459	0.8637
No log	3.9362	370	0.6076	0.5913	0.6076	0.7795
No log	3.9574	372	0.6091	0.5768	0.6091	0.7804
No log	3.9787	374	0.6635	0.5598	0.6635	0.8145
No log	4.0	376	0.6180	0.5476	0.6180	0.7861
No log	4.0213	378	0.6741	0.5401	0.6741	0.8211
No log	4.0426	380	0.5356	0.5577	0.5356	0.7318
No log	4.0638	382	0.5294	0.5816	0.5294	0.7276
No log	4.0851	384	0.5640	0.6170	0.5640	0.7510
No log	4.1064	386	0.6740	0.5768	0.6740	0.8210
No log	4.1277	388	0.7292	0.5809	0.7292	0.8539
No log	4.1489	390	0.6174	0.6068	0.6174	0.7858
No log	4.1702	392	0.6401	0.6100	0.6401	0.8000
No log	4.1915	394	0.7470	0.5937	0.7470	0.8643
No log	4.2128	396	1.0807	0.4815	1.0807	1.0396
No log	4.2340	398	1.0329	0.4840	1.0329	1.0163
No log	4.2553	400	0.5895	0.5979	0.5895	0.7678
No log	4.2766	402	0.4775	0.6585	0.4775	0.6910
No log	4.2979	404	0.4457	0.6371	0.4457	0.6676
No log	4.3191	406	0.5662	0.5755	0.5662	0.7525
No log	4.3404	408	1.0167	0.4205	1.0167	1.0083
No log	4.3617	410	1.1826	0.3642	1.1826	1.0875
No log	4.3830	412	0.9286	0.4288	0.9286	0.9636
No log	4.4043	414	0.5812	0.5281	0.5812	0.7624
No log	4.4255	416	0.4636	0.5924	0.4636	0.6808
No log	4.4468	418	0.4409	0.6376	0.4409	0.6640
No log	4.4681	420	0.5566	0.6213	0.5566	0.7461
No log	4.4894	422	0.8202	0.5570	0.8202	0.9056
No log	4.5106	424	1.0053	0.5049	1.0053	1.0027
No log	4.5319	426	0.8532	0.5415	0.8532	0.9237
No log	4.5532	428	0.6191	0.6140	0.6191	0.7868
No log	4.5745	430	0.5144	0.6393	0.5144	0.7172
No log	4.5957	432	0.5300	0.6550	0.5300	0.7280
No log	4.6170	434	0.4765	0.6602	0.4765	0.6903
No log	4.6383	436	0.5505	0.6026	0.5505	0.7420
No log	4.6596	438	0.7048	0.5460	0.7048	0.8395
No log	4.6809	440	0.6904	0.5472	0.6904	0.8309
No log	4.7021	442	0.5538	0.5889	0.5538	0.7441
No log	4.7234	444	0.4978	0.5896	0.4978	0.7055
No log	4.7447	446	0.5456	0.5940	0.5456	0.7386
No log	4.7660	448	0.5997	0.5860	0.5997	0.7744
No log	4.7872	450	0.7598	0.5389	0.7598	0.8717
No log	4.8085	452	0.6954	0.5720	0.6954	0.8339
No log	4.8298	454	0.5533	0.6094	0.5533	0.7438
No log	4.8511	456	0.4938	0.6749	0.4938	0.7027
No log	4.8723	458	0.5801	0.6148	0.5801	0.7617
No log	4.8936	460	0.7869	0.5193	0.7869	0.8871
No log	4.9149	462	0.9379	0.4804	0.9379	0.9685
No log	4.9362	464	0.7583	0.5549	0.7583	0.8708
No log	4.9574	466	0.4390	0.6912	0.4390	0.6626
No log	4.9787	468	0.4065	0.7169	0.4065	0.6376
No log	5.0	470	0.4528	0.6800	0.4528	0.6729
No log	5.0213	472	0.5929	0.6327	0.5929	0.7700
No log	5.0426	474	0.8274	0.5566	0.8274	0.9096
No log	5.0638	476	0.7658	0.5627	0.7658	0.8751
No log	5.0851	478	0.5419	0.6300	0.5419	0.7361
No log	5.1064	480	0.4544	0.6528	0.4544	0.6741
No log	5.1277	482	0.4983	0.6548	0.4983	0.7059
No log	5.1489	484	0.6572	0.5786	0.6572	0.8107
No log	5.1702	486	0.7528	0.5532	0.7528	0.8677
No log	5.1915	488	0.6250	0.6076	0.6250	0.7906
No log	5.2128	490	0.5689	0.6111	0.5689	0.7543
No log	5.2340	492	0.5734	0.6240	0.5734	0.7572
No log	5.2553	494	0.6084	0.6073	0.6084	0.7800
No log	5.2766	496	0.5636	0.6231	0.5636	0.7508
No log	5.2979	498	0.7039	0.6077	0.7039	0.8390
0.4781	5.3191	500	0.7077	0.5950	0.7077	0.8412
0.4781	5.3404	502	0.5091	0.6616	0.5091	0.7135
0.4781	5.3617	504	0.5030	0.6625	0.5030	0.7093
0.4781	5.3830	506	0.6449	0.6344	0.6449	0.8031
0.4781	5.4043	508	0.7133	0.5526	0.7133	0.8445
0.4781	5.4255	510	0.7317	0.5510	0.7317	0.8554
0.4781	5.4468	512	0.5532	0.6279	0.5532	0.7438
0.4781	5.4681	514	0.4913	0.6515	0.4913	0.7009
0.4781	5.4894	516	0.5698	0.6292	0.5698	0.7549
0.4781	5.5106	518	0.8520	0.4823	0.8520	0.9230
0.4781	5.5319	520	0.9721	0.4662	0.9721	0.9859
0.4781	5.5532	522	0.7515	0.5300	0.7515	0.8669
0.4781	5.5745	524	0.4886	0.6098	0.4886	0.6990
0.4781	5.5957	526	0.4456	0.6068	0.4456	0.6675
0.4781	5.6170	528	0.5031	0.5992	0.5031	0.7093
0.4781	5.6383	530	0.6047	0.5820	0.6047	0.7776
0.4781	5.6596	532	0.5962	0.6149	0.5962	0.7722
0.4781	5.6809	534	0.4947	0.6325	0.4947	0.7033
0.4781	5.7021	536	0.4843	0.6507	0.4843	0.6959
0.4781	5.7234	538	0.4908	0.6501	0.4908	0.7006
0.4781	5.7447	540	0.5816	0.6079	0.5816	0.7626
0.4781	5.7660	542	0.6535	0.5816	0.6535	0.8084
0.4781	5.7872	544	0.7210	0.5498	0.7210	0.8491
0.4781	5.8085	546	0.7455	0.5363	0.7455	0.8634
0.4781	5.8298	548	0.6788	0.5820	0.6788	0.8239
0.4781	5.8511	550	0.6233	0.5953	0.6233	0.7895
0.4781	5.8723	552	0.7581	0.5695	0.7581	0.8707
0.4781	5.8936	554	0.7169	0.5759	0.7169	0.8467
0.4781	5.9149	556	0.6104	0.6048	0.6104	0.7813
0.4781	5.9362	558	0.5378	0.6467	0.5378	0.7334
0.4781	5.9574	560	0.6047	0.5969	0.6047	0.7776
0.4781	5.9787	562	0.6658	0.5781	0.6658	0.8160
0.4781	6.0	564	0.7321	0.5401	0.7321	0.8556
0.4781	6.0213	566	0.6668	0.5544	0.6668	0.8166
0.4781	6.0426	568	0.5762	0.6165	0.5762	0.7591
0.4781	6.0638	570	0.5444	0.6406	0.5444	0.7379
0.4781	6.0851	572	0.5151	0.6532	0.5151	0.7177
0.4781	6.1064	574	0.5535	0.6302	0.5535	0.7440
0.4781	6.1277	576	0.5859	0.6260	0.5859	0.7655
0.4781	6.1489	578	0.6133	0.6283	0.6134	0.7832
0.4781	6.1702	580	0.6852	0.6321	0.6852	0.8278
0.4781	6.1915	582	0.7301	0.6108	0.7301	0.8545
0.4781	6.2128	584	0.7238	0.5984	0.7238	0.8507
0.4781	6.2340	586	0.8828	0.5445	0.8828	0.9396
0.4781	6.2553	588	0.7221	0.5682	0.7221	0.8498
0.4781	6.2766	590	0.4986	0.6037	0.4986	0.7061
0.4781	6.2979	592	0.4465	0.6193	0.4465	0.6682
0.4781	6.3191	594	0.4900	0.5943	0.4900	0.7000
0.4781	6.3404	596	0.5734	0.5730	0.5734	0.7572
0.4781	6.3617	598	0.5842	0.5819	0.5842	0.7643
0.4781	6.3830	600	0.5743	0.6145	0.5743	0.7578
0.4781	6.4043	602	0.5544	0.6533	0.5544	0.7446
0.4781	6.4255	604	0.4883	0.6327	0.4883	0.6988
0.4781	6.4468	606	0.5479	0.6479	0.5479	0.7402
0.4781	6.4681	608	0.6360	0.6151	0.6360	0.7975
0.4781	6.4894	610	0.5986	0.5933	0.5986	0.7737
0.4781	6.5106	612	0.4824	0.6269	0.4824	0.6945
0.4781	6.5319	614	0.4935	0.6102	0.4935	0.7025
0.4781	6.5532	616	0.7140	0.5452	0.7140	0.8450
0.4781	6.5745	618	0.8646	0.5111	0.8646	0.9298
0.4781	6.5957	620	0.6788	0.5710	0.6788	0.8239
0.4781	6.6170	622	0.4876	0.6263	0.4876	0.6983
0.4781	6.6383	624	0.4792	0.6318	0.4792	0.6922
0.4781	6.6596	626	0.5651	0.5991	0.5651	0.7517
0.4781	6.6809	628	0.7456	0.5545	0.7456	0.8635
0.4781	6.7021	630	0.9130	0.4915	0.9130	0.9555
0.4781	6.7234	632	0.8689	0.5012	0.8689	0.9321
0.4781	6.7447	634	0.5897	0.5658	0.5897	0.7679
0.4781	6.7660	636	0.4993	0.5835	0.4993	0.7066

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1