README.md

metadata

library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask5_style
    results: []

Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask5_style

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5705
• Qwk: 0.5583
• Mse: 0.5705
• Rmse: 0.7553

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0198	2	4.2244	-0.0026	4.2244	2.0553
No log	0.0396	4	2.9368	0.0459	2.9368	1.7137
No log	0.0594	6	1.4729	0.0059	1.4729	1.2136
No log	0.0792	8	0.9333	0.0915	0.9333	0.9661
No log	0.0990	10	0.7506	0.1245	0.7506	0.8664
No log	0.1188	12	0.8095	0.0565	0.8095	0.8997
No log	0.1386	14	0.8107	0.1593	0.8107	0.9004
No log	0.1584	16	0.6680	0.2785	0.6680	0.8173
No log	0.1782	18	0.6275	0.4380	0.6275	0.7921
No log	0.1980	20	0.5977	0.4277	0.5977	0.7731
No log	0.2178	22	0.6109	0.2878	0.6109	0.7816
No log	0.2376	24	0.6240	0.2878	0.6240	0.7899
No log	0.2574	26	0.6054	0.3293	0.6054	0.7781
No log	0.2772	28	0.6090	0.3054	0.6090	0.7804
No log	0.2970	30	0.5789	0.3121	0.5789	0.7609
No log	0.3168	32	0.5348	0.3778	0.5348	0.7313
No log	0.3366	34	0.5215	0.4081	0.5215	0.7221
No log	0.3564	36	0.5402	0.5202	0.5402	0.7350
No log	0.3762	38	0.5040	0.5071	0.5040	0.7099
No log	0.3960	40	0.5986	0.4767	0.5986	0.7737
No log	0.4158	42	0.6328	0.5036	0.6328	0.7955
No log	0.4356	44	0.5686	0.5416	0.5686	0.7541
No log	0.4554	46	0.5498	0.5556	0.5498	0.7415
No log	0.4752	48	0.5875	0.5042	0.5875	0.7665
No log	0.4950	50	0.5480	0.5329	0.5480	0.7403
No log	0.5149	52	0.4840	0.5353	0.4840	0.6957
No log	0.5347	54	0.4987	0.4858	0.4987	0.7062
No log	0.5545	56	0.6363	0.3960	0.6363	0.7977
No log	0.5743	58	0.7962	0.2936	0.7962	0.8923
No log	0.5941	60	0.7815	0.3127	0.7815	0.8840
No log	0.6139	62	0.6122	0.4381	0.6122	0.7824
No log	0.6337	64	0.5006	0.5804	0.5006	0.7075
No log	0.6535	66	0.5267	0.5835	0.5267	0.7257
No log	0.6733	68	0.5583	0.5872	0.5583	0.7472
No log	0.6931	70	0.5859	0.5920	0.5859	0.7654
No log	0.7129	72	0.5630	0.5823	0.5630	0.7504
No log	0.7327	74	0.5126	0.5583	0.5126	0.7160
No log	0.7525	76	0.4844	0.5410	0.4844	0.6960
No log	0.7723	78	0.5018	0.4492	0.5018	0.7084
No log	0.7921	80	0.4826	0.4389	0.4826	0.6947
No log	0.8119	82	0.4657	0.4876	0.4657	0.6824
No log	0.8317	84	0.4753	0.4577	0.4753	0.6894
No log	0.8515	86	0.5439	0.4682	0.5439	0.7375
No log	0.8713	88	0.5935	0.4771	0.5935	0.7704
No log	0.8911	90	0.6344	0.4879	0.6344	0.7965
No log	0.9109	92	0.5282	0.5254	0.5282	0.7268
No log	0.9307	94	0.4862	0.5611	0.4862	0.6973
No log	0.9505	96	0.5130	0.5587	0.5130	0.7162
No log	0.9703	98	0.5009	0.5721	0.5009	0.7077
No log	0.9901	100	0.5292	0.5001	0.5292	0.7275
No log	1.0099	102	0.5799	0.4425	0.5799	0.7615
No log	1.0297	104	0.5400	0.3915	0.5400	0.7348
No log	1.0495	106	0.5131	0.3848	0.5131	0.7163
No log	1.0693	108	0.4775	0.4408	0.4775	0.6910
No log	1.0891	110	0.4805	0.5073	0.4805	0.6932
No log	1.1089	112	0.5244	0.5543	0.5244	0.7241
No log	1.1287	114	0.4984	0.6325	0.4984	0.7060
No log	1.1485	116	0.4746	0.6643	0.4746	0.6889
No log	1.1683	118	0.4739	0.6568	0.4739	0.6884
No log	1.1881	120	0.4621	0.6654	0.4621	0.6798
No log	1.2079	122	0.5582	0.5043	0.5582	0.7471
No log	1.2277	124	0.5868	0.4742	0.5868	0.7660
No log	1.2475	126	0.4825	0.6040	0.4825	0.6947
No log	1.2673	128	0.4912	0.5704	0.4912	0.7009
No log	1.2871	130	0.4693	0.5978	0.4693	0.6851
No log	1.3069	132	0.4417	0.6209	0.4417	0.6646
No log	1.3267	134	0.5091	0.6026	0.5091	0.7135
No log	1.3465	136	0.5345	0.5780	0.5345	0.7311
No log	1.3663	138	0.5366	0.5788	0.5366	0.7325
No log	1.3861	140	0.4922	0.5521	0.4922	0.7016
No log	1.4059	142	0.4786	0.5066	0.4786	0.6918
No log	1.4257	144	0.4795	0.5264	0.4795	0.6925
No log	1.4455	146	0.4910	0.5283	0.4910	0.7007
No log	1.4653	148	0.4802	0.4932	0.4802	0.6929
No log	1.4851	150	0.5041	0.4905	0.5041	0.7100
No log	1.5050	152	0.5059	0.4792	0.5059	0.7113
No log	1.5248	154	0.5087	0.4735	0.5087	0.7132
No log	1.5446	156	0.5191	0.4691	0.5191	0.7205
No log	1.5644	158	0.5784	0.3956	0.5784	0.7605
No log	1.5842	160	0.6929	0.3844	0.6929	0.8324
No log	1.6040	162	0.7163	0.3803	0.7163	0.8463
No log	1.6238	164	0.6149	0.4583	0.6149	0.7842
No log	1.6436	166	0.5160	0.4680	0.5160	0.7183
No log	1.6634	168	0.5861	0.4382	0.5861	0.7655
No log	1.6832	170	0.6335	0.4023	0.6335	0.7959
No log	1.7030	172	0.5613	0.4589	0.5613	0.7492
No log	1.7228	174	0.5384	0.3854	0.5384	0.7337
No log	1.7426	176	0.6251	0.3381	0.6251	0.7906
No log	1.7624	178	0.6171	0.5126	0.6171	0.7856
No log	1.7822	180	0.5821	0.5240	0.5821	0.7630
No log	1.8020	182	0.6732	0.4901	0.6732	0.8205
No log	1.8218	184	0.6049	0.5314	0.6049	0.7778
No log	1.8416	186	0.6856	0.5023	0.6856	0.8280
No log	1.8614	188	0.8999	0.3778	0.8999	0.9486
No log	1.8812	190	0.9941	0.3219	0.9941	0.9971
No log	1.9010	192	0.6968	0.3741	0.6968	0.8347
No log	1.9208	194	0.6158	0.4469	0.6158	0.7847
No log	1.9406	196	0.5927	0.4743	0.5927	0.7699
No log	1.9604	198	0.6464	0.4450	0.6464	0.8040
No log	1.9802	200	0.6228	0.5225	0.6228	0.7892
No log	2.0	202	0.8286	0.3868	0.8286	0.9103
No log	2.0198	204	0.9116	0.3823	0.9116	0.9548
No log	2.0396	206	0.7794	0.4052	0.7794	0.8829
No log	2.0594	208	0.6396	0.4583	0.6396	0.7997
No log	2.0792	210	0.5545	0.4652	0.5545	0.7446
No log	2.0990	212	0.5259	0.4448	0.5259	0.7252
No log	2.1188	214	0.5111	0.4614	0.5111	0.7149
No log	2.1386	216	0.5247	0.5058	0.5247	0.7244
No log	2.1584	218	0.5363	0.5172	0.5363	0.7323
No log	2.1782	220	0.4865	0.6010	0.4865	0.6975
No log	2.1980	222	0.4856	0.6324	0.4856	0.6968
No log	2.2178	224	0.5049	0.6151	0.5049	0.7105
No log	2.2376	226	0.5938	0.5132	0.5938	0.7706
No log	2.2574	228	0.5976	0.5038	0.5976	0.7730
No log	2.2772	230	0.5546	0.5312	0.5546	0.7447
No log	2.2970	232	0.5116	0.5490	0.5116	0.7152
No log	2.3168	234	0.5047	0.5554	0.5047	0.7104
No log	2.3366	236	0.5361	0.5485	0.5361	0.7322
No log	2.3564	238	0.5266	0.5847	0.5266	0.7257
No log	2.3762	240	0.4938	0.6217	0.4938	0.7027
No log	2.3960	242	0.4678	0.6413	0.4678	0.6840
No log	2.4158	244	0.5058	0.6257	0.5058	0.7112
No log	2.4356	246	0.5023	0.5828	0.5023	0.7087
No log	2.4554	248	0.4760	0.5557	0.4760	0.6900
No log	2.4752	250	0.4806	0.5581	0.4806	0.6933
No log	2.4950	252	0.4520	0.6126	0.4520	0.6723
No log	2.5149	254	0.4557	0.6299	0.4557	0.6751
No log	2.5347	256	0.4683	0.6370	0.4683	0.6843
No log	2.5545	258	0.4980	0.6231	0.4980	0.7057
No log	2.5743	260	0.5635	0.5634	0.5635	0.7506
No log	2.5941	262	0.5636	0.5343	0.5636	0.7508
No log	2.6139	264	0.4922	0.6077	0.4922	0.7016
No log	2.6337	266	0.4837	0.6435	0.4837	0.6955
No log	2.6535	268	0.4789	0.6600	0.4789	0.6920
No log	2.6733	270	0.6097	0.5274	0.6097	0.7809
No log	2.6931	272	0.6209	0.5392	0.6209	0.7880
No log	2.7129	274	0.5749	0.5761	0.5749	0.7582
No log	2.7327	276	0.4992	0.6308	0.4992	0.7066
No log	2.7525	278	0.5315	0.6130	0.5315	0.7290
No log	2.7723	280	0.5640	0.5739	0.5640	0.7510
No log	2.7921	282	0.5246	0.5947	0.5246	0.7243
No log	2.8119	284	0.5049	0.5805	0.5049	0.7106
No log	2.8317	286	0.4752	0.5799	0.4752	0.6894
No log	2.8515	288	0.4647	0.5786	0.4647	0.6817
No log	2.8713	290	0.5799	0.5335	0.5799	0.7615
No log	2.8911	292	0.8815	0.3798	0.8815	0.9389
No log	2.9109	294	1.0348	0.3279	1.0348	1.0173
No log	2.9307	296	0.9051	0.4074	0.9051	0.9513
No log	2.9505	298	0.6188	0.5424	0.6188	0.7866
No log	2.9703	300	0.4537	0.6378	0.4537	0.6736
No log	2.9901	302	0.4639	0.6367	0.4639	0.6811
No log	3.0099	304	0.4401	0.6350	0.4401	0.6634
No log	3.0297	306	0.4437	0.6157	0.4437	0.6661
No log	3.0495	308	0.5255	0.5816	0.5255	0.7249
No log	3.0693	310	0.5476	0.5529	0.5476	0.7400
No log	3.0891	312	0.4888	0.5911	0.4888	0.6991
No log	3.1089	314	0.4276	0.5676	0.4276	0.6539
No log	3.1287	316	0.4254	0.5537	0.4254	0.6522
No log	3.1485	318	0.4480	0.5905	0.4480	0.6693
No log	3.1683	320	0.4203	0.5676	0.4203	0.6483
No log	3.1881	322	0.4765	0.5951	0.4765	0.6903
No log	3.2079	324	0.5687	0.5883	0.5687	0.7542
No log	3.2277	326	0.5646	0.5941	0.5646	0.7514
No log	3.2475	328	0.4980	0.6197	0.4980	0.7057
No log	3.2673	330	0.4097	0.6162	0.4097	0.6400
No log	3.2871	332	0.3896	0.6591	0.3896	0.6242
No log	3.3069	334	0.3990	0.6572	0.3990	0.6317
No log	3.3267	336	0.4585	0.6602	0.4585	0.6771
No log	3.3465	338	0.5288	0.6287	0.5288	0.7272
No log	3.3663	340	0.5540	0.5843	0.5540	0.7443
No log	3.3861	342	0.5735	0.5736	0.5735	0.7573
No log	3.4059	344	0.5225	0.5768	0.5225	0.7229
No log	3.4257	346	0.4938	0.5908	0.4938	0.7027
No log	3.4455	348	0.5935	0.5408	0.5935	0.7704
No log	3.4653	350	0.6452	0.4566	0.6452	0.8033
No log	3.4851	352	0.6249	0.4583	0.6249	0.7905
No log	3.5050	354	0.5794	0.4997	0.5794	0.7612
No log	3.5248	356	0.5035	0.5768	0.5035	0.7096
No log	3.5446	358	0.4768	0.6504	0.4768	0.6905
No log	3.5644	360	0.5514	0.6272	0.5514	0.7425
No log	3.5842	362	0.5728	0.6195	0.5728	0.7568
No log	3.6040	364	0.5310	0.6335	0.5310	0.7287
No log	3.6238	366	0.5185	0.6193	0.5185	0.7200
No log	3.6436	368	0.5522	0.6178	0.5522	0.7431
No log	3.6634	370	0.6056	0.5805	0.6056	0.7782
No log	3.6832	372	0.6224	0.5587	0.6224	0.7889
No log	3.7030	374	0.5488	0.5821	0.5488	0.7408
No log	3.7228	376	0.5148	0.5873	0.5148	0.7175
No log	3.7426	378	0.5430	0.5878	0.5430	0.7369
No log	3.7624	380	0.5806	0.5780	0.5806	0.7620
No log	3.7822	382	0.6253	0.4880	0.6253	0.7908
No log	3.8020	384	0.7179	0.4708	0.7179	0.8473
No log	3.8218	386	0.7220	0.4571	0.7220	0.8497
No log	3.8416	388	0.6558	0.5352	0.6558	0.8098
No log	3.8614	390	0.5226	0.5996	0.5226	0.7229
No log	3.8812	392	0.4771	0.6257	0.4771	0.6907
No log	3.9010	394	0.4664	0.6253	0.4664	0.6830
No log	3.9208	396	0.4882	0.6287	0.4882	0.6987
No log	3.9406	398	0.5571	0.6200	0.5571	0.7464
No log	3.9604	400	0.6986	0.5493	0.6986	0.8358
No log	3.9802	402	0.7403	0.5415	0.7403	0.8604
No log	4.0	404	0.7231	0.5818	0.7231	0.8504
No log	4.0198	406	0.6436	0.5975	0.6436	0.8022
No log	4.0396	408	0.5594	0.5989	0.5594	0.7479
No log	4.0594	410	0.5251	0.5935	0.5251	0.7247
No log	4.0792	412	0.4995	0.5892	0.4995	0.7068
No log	4.0990	414	0.6776	0.5147	0.6776	0.8231
No log	4.1188	416	0.8703	0.3981	0.8703	0.9329
No log	4.1386	418	0.8965	0.3903	0.8965	0.9468
No log	4.1584	420	0.7560	0.4225	0.7560	0.8695
No log	4.1782	422	0.6107	0.4733	0.6107	0.7815
No log	4.1980	424	0.4889	0.5122	0.4889	0.6992
No log	4.2178	426	0.4738	0.5192	0.4738	0.6884
No log	4.2376	428	0.4964	0.5090	0.4964	0.7046
No log	4.2574	430	0.5861	0.5455	0.5861	0.7656
No log	4.2772	432	0.6618	0.5285	0.6618	0.8135
No log	4.2970	434	0.6761	0.5604	0.6761	0.8223
No log	4.3168	436	0.5690	0.6085	0.5690	0.7543
No log	4.3366	438	0.5271	0.6033	0.5271	0.7260
No log	4.3564	440	0.5969	0.5869	0.5969	0.7726
No log	4.3762	442	0.5492	0.6088	0.5492	0.7411
No log	4.3960	444	0.5130	0.6261	0.5130	0.7163
No log	4.4158	446	0.5983	0.5908	0.5983	0.7735
No log	4.4356	448	0.6330	0.5648	0.6330	0.7956
No log	4.4554	450	0.5773	0.5612	0.5773	0.7598
No log	4.4752	452	0.4904	0.5814	0.4904	0.7003
No log	4.4950	454	0.4566	0.5996	0.4566	0.6757
No log	4.5149	456	0.4826	0.6155	0.4826	0.6947
No log	4.5347	458	0.5790	0.5645	0.5790	0.7609
No log	4.5545	460	0.6902	0.5745	0.6902	0.8308
No log	4.5743	462	0.7205	0.5905	0.7205	0.8488
No log	4.5941	464	0.6902	0.6135	0.6902	0.8308
No log	4.6139	466	0.6225	0.6113	0.6225	0.7890
No log	4.6337	468	0.5521	0.6185	0.5521	0.7430
No log	4.6535	470	0.5718	0.6076	0.5718	0.7562
No log	4.6733	472	0.6828	0.5925	0.6828	0.8263
No log	4.6931	474	0.7151	0.5779	0.7151	0.8456
No log	4.7129	476	0.6134	0.5901	0.6134	0.7832
No log	4.7327	478	0.5356	0.5923	0.5356	0.7319
No log	4.7525	480	0.5328	0.5884	0.5328	0.7299
No log	4.7723	482	0.4821	0.6312	0.4821	0.6943
No log	4.7921	484	0.4674	0.6076	0.4674	0.6837
No log	4.8119	486	0.4996	0.5995	0.4996	0.7068
No log	4.8317	488	0.5655	0.5417	0.5655	0.7520
No log	4.8515	490	0.6328	0.5383	0.6328	0.7955
No log	4.8713	492	0.5947	0.5256	0.5947	0.7712
No log	4.8911	494	0.6077	0.5483	0.6077	0.7796
No log	4.9109	496	0.5424	0.5739	0.5424	0.7365
No log	4.9307	498	0.4834	0.6249	0.4834	0.6953
0.494	4.9505	500	0.4813	0.6382	0.4813	0.6938
0.494	4.9703	502	0.5511	0.6129	0.5511	0.7424
0.494	4.9901	504	0.7097	0.4703	0.7097	0.8424
0.494	5.0099	506	0.7715	0.4114	0.7715	0.8783
0.494	5.0297	508	0.6739	0.4589	0.6739	0.8209
0.494	5.0495	510	0.5705	0.5583	0.5705	0.7553

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1