README.md

metadata

library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask1_development
    results: []

Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask1_development

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4088
• Qwk: 0.5376
• Mse: 0.4088
• Rmse: 0.6394

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0213	2	3.9661	0.0006	3.9661	1.9915
No log	0.0426	4	2.8142	0.0570	2.8142	1.6775
No log	0.0638	6	1.3758	0.0502	1.3758	1.1729
No log	0.0851	8	0.8573	0.0440	0.8573	0.9259
No log	0.1064	10	0.7581	0.0668	0.7581	0.8707
No log	0.1277	12	0.7360	0.0830	0.7360	0.8579
No log	0.1489	14	0.6776	0.0832	0.6776	0.8232
No log	0.1702	16	0.6691	0.3161	0.6691	0.8180
No log	0.1915	18	0.6032	0.3937	0.6032	0.7767
No log	0.2128	20	0.5791	0.3812	0.5791	0.7610
No log	0.2340	22	0.6016	0.3765	0.6016	0.7757
No log	0.2553	24	0.6617	0.3275	0.6617	0.8135
No log	0.2766	26	0.6540	0.3498	0.6540	0.8087
No log	0.2979	28	0.5786	0.3889	0.5786	0.7607
No log	0.3191	30	0.5534	0.3950	0.5534	0.7439
No log	0.3404	32	0.6693	0.2150	0.6693	0.8181
No log	0.3617	34	0.6927	0.2867	0.6927	0.8323
No log	0.3830	36	0.5389	0.4632	0.5389	0.7341
No log	0.4043	38	0.5280	0.4822	0.5280	0.7266
No log	0.4255	40	0.5358	0.4835	0.5358	0.7320
No log	0.4468	42	0.4939	0.4966	0.4939	0.7028
No log	0.4681	44	0.4797	0.5075	0.4797	0.6926
No log	0.4894	46	0.4909	0.4695	0.4909	0.7006
No log	0.5106	48	0.4905	0.4695	0.4905	0.7004
No log	0.5319	50	0.4793	0.5410	0.4793	0.6923
No log	0.5532	52	0.5706	0.5437	0.5706	0.7554
No log	0.5745	54	0.5039	0.5471	0.5039	0.7098
No log	0.5957	56	0.4814	0.4922	0.4814	0.6938
No log	0.6170	58	0.4793	0.4941	0.4793	0.6923
No log	0.6383	60	0.4930	0.4755	0.4930	0.7021
No log	0.6596	62	0.5077	0.4415	0.5077	0.7125
No log	0.6809	64	0.5329	0.4281	0.5329	0.7300
No log	0.7021	66	0.4572	0.5173	0.4572	0.6762
No log	0.7234	68	0.4331	0.5397	0.4331	0.6581
No log	0.7447	70	0.4294	0.5499	0.4294	0.6553
No log	0.7660	72	0.4208	0.5787	0.4208	0.6487
No log	0.7872	74	0.4638	0.5604	0.4638	0.6810
No log	0.8085	76	0.4346	0.5684	0.4346	0.6592
No log	0.8298	78	0.4511	0.5609	0.4511	0.6716
No log	0.8511	80	0.4506	0.6079	0.4506	0.6713
No log	0.8723	82	0.4315	0.5578	0.4315	0.6569
No log	0.8936	84	0.4510	0.5739	0.4510	0.6716
No log	0.9149	86	0.6624	0.3852	0.6624	0.8139
No log	0.9362	88	0.7905	0.1659	0.7905	0.8891
No log	0.9574	90	0.7080	0.2767	0.7080	0.8414
No log	0.9787	92	0.5450	0.4255	0.5450	0.7382
No log	1.0	94	0.4271	0.5839	0.4271	0.6535
No log	1.0213	96	0.4668	0.6117	0.4668	0.6833
No log	1.0426	98	0.4931	0.6038	0.4931	0.7022
No log	1.0638	100	0.4532	0.6076	0.4532	0.6732
No log	1.0851	102	0.4919	0.6031	0.4919	0.7013
No log	1.1064	104	0.5006	0.5543	0.5006	0.7075
No log	1.1277	106	0.4613	0.5426	0.4613	0.6792
No log	1.1489	108	0.4891	0.5035	0.4891	0.6993
No log	1.1702	110	0.5031	0.4745	0.5031	0.7093
No log	1.1915	112	0.4780	0.4819	0.4780	0.6914
No log	1.2128	114	0.4851	0.4873	0.4851	0.6965
No log	1.2340	116	0.4726	0.5470	0.4726	0.6875
No log	1.2553	118	0.4432	0.5399	0.4432	0.6657
No log	1.2766	120	0.4471	0.5840	0.4471	0.6687
No log	1.2979	122	0.4497	0.5659	0.4497	0.6706
No log	1.3191	124	0.5107	0.5062	0.5107	0.7146
No log	1.3404	126	0.4501	0.5327	0.4501	0.6709
No log	1.3617	128	0.4368	0.5911	0.4368	0.6609
No log	1.3830	130	0.4683	0.5990	0.4683	0.6844
No log	1.4043	132	0.6832	0.5579	0.6832	0.8266
No log	1.4255	134	0.7875	0.4894	0.7875	0.8874
No log	1.4468	136	0.6340	0.5699	0.6340	0.7962
No log	1.4681	138	0.5137	0.5868	0.5137	0.7167
No log	1.4894	140	0.4678	0.5620	0.4678	0.6840
No log	1.5106	142	0.4385	0.5585	0.4385	0.6622
No log	1.5319	144	0.4237	0.6041	0.4237	0.6509
No log	1.5532	146	0.4305	0.5749	0.4305	0.6562
No log	1.5745	148	0.5813	0.5527	0.5813	0.7624
No log	1.5957	150	0.6819	0.4978	0.6819	0.8258
No log	1.6170	152	0.7632	0.5356	0.7632	0.8736
No log	1.6383	154	0.6873	0.5606	0.6873	0.8290
No log	1.6596	156	0.5527	0.6069	0.5527	0.7434
No log	1.6809	158	0.4914	0.6235	0.4914	0.7010
No log	1.7021	160	0.4513	0.5698	0.4513	0.6718
No log	1.7234	162	0.4922	0.5259	0.4922	0.7016
No log	1.7447	164	0.5357	0.4956	0.5357	0.7319
No log	1.7660	166	0.6366	0.4833	0.6366	0.7979
No log	1.7872	168	0.6920	0.4236	0.6920	0.8319
No log	1.8085	170	0.5774	0.4567	0.5774	0.7599
No log	1.8298	172	0.4541	0.4634	0.4541	0.6739
No log	1.8511	174	0.4664	0.4809	0.4664	0.6829
No log	1.8723	176	0.4637	0.5181	0.4637	0.6810
No log	1.8936	178	0.4448	0.5077	0.4448	0.6669
No log	1.9149	180	0.4541	0.4803	0.4541	0.6739
No log	1.9362	182	0.4787	0.4465	0.4787	0.6919
No log	1.9574	184	0.4791	0.4509	0.4791	0.6922
No log	1.9787	186	0.4859	0.4643	0.4859	0.6970
No log	2.0	188	0.4916	0.4921	0.4916	0.7011
No log	2.0213	190	0.5040	0.5278	0.5040	0.7099
No log	2.0426	192	0.4947	0.5283	0.4947	0.7034
No log	2.0638	194	0.4736	0.5391	0.4736	0.6882
No log	2.0851	196	0.4618	0.4665	0.4618	0.6796
No log	2.1064	198	0.4611	0.4778	0.4611	0.6790
No log	2.1277	200	0.4483	0.5074	0.4483	0.6696
No log	2.1489	202	0.4489	0.5480	0.4489	0.6700
No log	2.1702	204	0.4656	0.5593	0.4656	0.6823
No log	2.1915	206	0.4482	0.5474	0.4482	0.6695
No log	2.2128	208	0.4487	0.5227	0.4487	0.6699
No log	2.2340	210	0.5469	0.4400	0.5469	0.7395
No log	2.2553	212	0.7247	0.3853	0.7247	0.8513
No log	2.2766	214	0.6856	0.3684	0.6856	0.8280
No log	2.2979	216	0.5270	0.3905	0.5270	0.7259
No log	2.3191	218	0.4537	0.4889	0.4537	0.6736
No log	2.3404	220	0.4555	0.5166	0.4555	0.6749
No log	2.3617	222	0.4364	0.5333	0.4364	0.6606
No log	2.3830	224	0.4357	0.5555	0.4357	0.6600
No log	2.4043	226	0.5339	0.5511	0.5339	0.7307
No log	2.4255	228	0.6457	0.5215	0.6457	0.8036
No log	2.4468	230	0.6696	0.5236	0.6696	0.8183
No log	2.4681	232	0.6229	0.5307	0.6229	0.7892
No log	2.4894	234	0.5367	0.5788	0.5367	0.7326
No log	2.5106	236	0.5040	0.5810	0.5040	0.7099
No log	2.5319	238	0.4577	0.5682	0.4577	0.6765
No log	2.5532	240	0.4783	0.5195	0.4783	0.6916
No log	2.5745	242	0.4666	0.4917	0.4666	0.6831
No log	2.5957	244	0.4885	0.4597	0.4885	0.6989
No log	2.6170	246	0.4939	0.4501	0.4939	0.7028
No log	2.6383	248	0.4492	0.5435	0.4492	0.6703
No log	2.6596	250	0.4392	0.5359	0.4392	0.6628
No log	2.6809	252	0.5860	0.5539	0.5860	0.7655
No log	2.7021	254	0.5884	0.5417	0.5884	0.7671
No log	2.7234	256	0.4743	0.5152	0.4743	0.6887
No log	2.7447	258	0.4565	0.5130	0.4565	0.6756
No log	2.7660	260	0.5037	0.3659	0.5037	0.7097
No log	2.7872	262	0.5783	0.2961	0.5783	0.7605
No log	2.8085	264	0.5960	0.3071	0.5960	0.7720
No log	2.8298	266	0.5651	0.3744	0.5651	0.7517
No log	2.8511	268	0.4834	0.5467	0.4834	0.6952
No log	2.8723	270	0.4120	0.6208	0.4120	0.6418
No log	2.8936	272	0.4382	0.6142	0.4382	0.6620
No log	2.9149	274	0.4525	0.6080	0.4525	0.6727
No log	2.9362	276	0.4681	0.6217	0.4681	0.6841
No log	2.9574	278	0.5913	0.5677	0.5913	0.7689
No log	2.9787	280	0.6915	0.4377	0.6915	0.8316
No log	3.0	282	0.8460	0.3413	0.8460	0.9198
No log	3.0213	284	0.8891	0.2589	0.8891	0.9429
No log	3.0426	286	0.7502	0.3368	0.7502	0.8662
No log	3.0638	288	0.5640	0.4077	0.5640	0.7510
No log	3.0851	290	0.6634	0.3049	0.6634	0.8145
No log	3.1064	292	0.6560	0.3207	0.6560	0.8099
No log	3.1277	294	0.5246	0.5175	0.5246	0.7243
No log	3.1489	296	0.4454	0.5169	0.4454	0.6674
No log	3.1702	298	0.4860	0.4285	0.4860	0.6971
No log	3.1915	300	0.5543	0.5088	0.5543	0.7445
No log	3.2128	302	0.5703	0.5592	0.5703	0.7552
No log	3.2340	304	0.6814	0.5316	0.6814	0.8255
No log	3.2553	306	0.5497	0.5704	0.5497	0.7414
No log	3.2766	308	0.4852	0.5788	0.4852	0.6966
No log	3.2979	310	0.4808	0.5853	0.4808	0.6934
No log	3.3191	312	0.4876	0.6232	0.4876	0.6983
No log	3.3404	314	0.4442	0.5722	0.4442	0.6665
No log	3.3617	316	0.4602	0.5201	0.4602	0.6784
No log	3.3830	318	0.5018	0.4900	0.5018	0.7084
No log	3.4043	320	0.4665	0.5059	0.4665	0.6830
No log	3.4255	322	0.4330	0.5721	0.4330	0.6580
No log	3.4468	324	0.4265	0.5661	0.4265	0.6531
No log	3.4681	326	0.4309	0.5708	0.4309	0.6565
No log	3.4894	328	0.4452	0.5651	0.4452	0.6672
No log	3.5106	330	0.4438	0.5648	0.4438	0.6662
No log	3.5319	332	0.4198	0.5478	0.4198	0.6479
No log	3.5532	334	0.4053	0.5411	0.4053	0.6366
No log	3.5745	336	0.4120	0.5259	0.4120	0.6419
No log	3.5957	338	0.4094	0.5385	0.4094	0.6398
No log	3.6170	340	0.4232	0.5686	0.4232	0.6505
No log	3.6383	342	0.4051	0.5656	0.4051	0.6365
No log	3.6596	344	0.4120	0.5688	0.4120	0.6419
No log	3.6809	346	0.4502	0.5418	0.4502	0.6710
No log	3.7021	348	0.4652	0.5069	0.4652	0.6820
No log	3.7234	350	0.4670	0.5426	0.4670	0.6834
No log	3.7447	352	0.5051	0.5283	0.5051	0.7107
No log	3.7660	354	0.4791	0.5605	0.4791	0.6921
No log	3.7872	356	0.4123	0.5928	0.4123	0.6421
No log	3.8085	358	0.3877	0.5926	0.3877	0.6226
No log	3.8298	360	0.3934	0.5989	0.3934	0.6273
No log	3.8511	362	0.3935	0.5523	0.3935	0.6273
No log	3.8723	364	0.4069	0.5750	0.4069	0.6379
No log	3.8936	366	0.4524	0.5934	0.4524	0.6726
No log	3.9149	368	0.5945	0.5394	0.5945	0.7711
No log	3.9362	370	0.6755	0.5534	0.6755	0.8219
No log	3.9574	372	0.6053	0.5956	0.6053	0.7780
No log	3.9787	374	0.4928	0.6326	0.4928	0.7020
No log	4.0	376	0.4880	0.6508	0.4880	0.6986
No log	4.0213	378	0.4584	0.6462	0.4584	0.6771
No log	4.0426	380	0.4568	0.6149	0.4568	0.6758
No log	4.0638	382	0.4601	0.5931	0.4601	0.6783
No log	4.0851	384	0.4218	0.5833	0.4218	0.6495
No log	4.1064	386	0.4170	0.5574	0.4170	0.6458
No log	4.1277	388	0.4103	0.5575	0.4103	0.6406
No log	4.1489	390	0.4059	0.5597	0.4059	0.6371
No log	4.1702	392	0.4462	0.5944	0.4462	0.6680
No log	4.1915	394	0.4308	0.6010	0.4308	0.6563
No log	4.2128	396	0.4690	0.5524	0.4690	0.6848
No log	4.2340	398	0.4814	0.5282	0.4814	0.6938
No log	4.2553	400	0.5534	0.5092	0.5534	0.7439
No log	4.2766	402	0.6290	0.5354	0.6290	0.7931
No log	4.2979	404	0.6553	0.5475	0.6553	0.8095
No log	4.3191	406	0.5146	0.6036	0.5146	0.7174
No log	4.3404	408	0.5226	0.6054	0.5226	0.7229
No log	4.3617	410	0.6431	0.5968	0.6431	0.8020
No log	4.3830	412	0.6137	0.5980	0.6137	0.7834
No log	4.4043	414	0.6730	0.5499	0.6730	0.8204
No log	4.4255	416	0.5656	0.5738	0.5656	0.7521
No log	4.4468	418	0.4316	0.6334	0.4316	0.6570
No log	4.4681	420	0.4480	0.5767	0.4480	0.6693
No log	4.4894	422	0.4281	0.5523	0.4281	0.6543
No log	4.5106	424	0.4249	0.5525	0.4249	0.6518
No log	4.5319	426	0.4029	0.5712	0.4029	0.6348
No log	4.5532	428	0.4092	0.6486	0.4092	0.6397
No log	4.5745	430	0.4363	0.6061	0.4363	0.6606
No log	4.5957	432	0.4401	0.5857	0.4401	0.6634
No log	4.6170	434	0.4174	0.6027	0.4174	0.6460
No log	4.6383	436	0.4183	0.5956	0.4183	0.6467
No log	4.6596	438	0.3976	0.6053	0.3976	0.6305
No log	4.6809	440	0.4289	0.6319	0.4289	0.6549
No log	4.7021	442	0.5079	0.6080	0.5079	0.7126
No log	4.7234	444	0.5477	0.5795	0.5477	0.7401
No log	4.7447	446	0.5512	0.5918	0.5512	0.7424
No log	4.7660	448	0.5499	0.6019	0.5499	0.7415
No log	4.7872	450	0.4962	0.5989	0.4962	0.7044
No log	4.8085	452	0.4837	0.6148	0.4837	0.6955
No log	4.8298	454	0.4119	0.6346	0.4119	0.6418
No log	4.8511	456	0.4047	0.5990	0.4047	0.6362
No log	4.8723	458	0.4108	0.5605	0.4108	0.6409
No log	4.8936	460	0.4426	0.4997	0.4426	0.6653
No log	4.9149	462	0.5077	0.4524	0.5077	0.7125
No log	4.9362	464	0.4933	0.5046	0.4933	0.7024
No log	4.9574	466	0.4723	0.5452	0.4723	0.6872
No log	4.9787	468	0.4308	0.5926	0.4308	0.6564
No log	5.0	470	0.4272	0.5785	0.4272	0.6536
No log	5.0213	472	0.4132	0.5911	0.4132	0.6428
No log	5.0426	474	0.4730	0.6206	0.4730	0.6877
No log	5.0638	476	0.5411	0.5917	0.5411	0.7356
No log	5.0851	478	0.4614	0.6025	0.4614	0.6792
No log	5.1064	480	0.4207	0.5840	0.4207	0.6486
No log	5.1277	482	0.4282	0.5737	0.4282	0.6544
No log	5.1489	484	0.5156	0.5876	0.5156	0.7181
No log	5.1702	486	0.5548	0.5716	0.5548	0.7448
No log	5.1915	488	0.4640	0.6395	0.4640	0.6812
No log	5.2128	490	0.4520	0.6008	0.4520	0.6723
No log	5.2340	492	0.4696	0.6422	0.4696	0.6852
No log	5.2553	494	0.5115	0.6101	0.5115	0.7152
No log	5.2766	496	0.5953	0.5710	0.5953	0.7716
No log	5.2979	498	0.5338	0.6147	0.5338	0.7306
0.4408	5.3191	500	0.4227	0.5767	0.4227	0.6502
0.4408	5.3404	502	0.4154	0.5858	0.4154	0.6445
0.4408	5.3617	504	0.4910	0.6080	0.4910	0.7007
0.4408	5.3830	506	0.6428	0.5427	0.6428	0.8017
0.4408	5.4043	508	0.5662	0.5934	0.5662	0.7525
0.4408	5.4255	510	0.4544	0.6087	0.4544	0.6741
0.4408	5.4468	512	0.4561	0.5974	0.4561	0.6753
0.4408	5.4681	514	0.5265	0.5743	0.5265	0.7256
0.4408	5.4894	516	0.6612	0.5555	0.6612	0.8131
0.4408	5.5106	518	0.5593	0.6011	0.5593	0.7479
0.4408	5.5319	520	0.4783	0.6292	0.4783	0.6916
0.4408	5.5532	522	0.4702	0.5976	0.4702	0.6857
0.4408	5.5745	524	0.4426	0.6160	0.4426	0.6653
0.4408	5.5957	526	0.4581	0.6378	0.4581	0.6769
0.4408	5.6170	528	0.5307	0.5955	0.5307	0.7285
0.4408	5.6383	530	0.5133	0.6090	0.5133	0.7164
0.4408	5.6596	532	0.4372	0.6279	0.4372	0.6612
0.4408	5.6809	534	0.4346	0.6228	0.4346	0.6592
0.4408	5.7021	536	0.4987	0.5880	0.4987	0.7062
0.4408	5.7234	538	0.6290	0.5233	0.6290	0.7931
0.4408	5.7447	540	0.5660	0.5294	0.5660	0.7523
0.4408	5.7660	542	0.4648	0.6267	0.4648	0.6818
0.4408	5.7872	544	0.4184	0.6184	0.4184	0.6468
0.4408	5.8085	546	0.4122	0.6284	0.4122	0.6420
0.4408	5.8298	548	0.4384	0.6273	0.4384	0.6621
0.4408	5.8511	550	0.5868	0.5337	0.5868	0.7660
0.4408	5.8723	552	0.7145	0.5199	0.7145	0.8453
0.4408	5.8936	554	0.5561	0.5821	0.5561	0.7457
0.4408	5.9149	556	0.4488	0.6387	0.4488	0.6700
0.4408	5.9362	558	0.4575	0.6300	0.4575	0.6764
0.4408	5.9574	560	0.5166	0.6150	0.5166	0.7188
0.4408	5.9787	562	0.7070	0.5283	0.7070	0.8408
0.4408	6.0	564	0.6845	0.5256	0.6845	0.8273
0.4408	6.0213	566	0.4975	0.5945	0.4975	0.7054
0.4408	6.0426	568	0.4445	0.5716	0.4445	0.6667
0.4408	6.0638	570	0.4293	0.5760	0.4293	0.6552
0.4408	6.0851	572	0.4427	0.6201	0.4427	0.6653
0.4408	6.1064	574	0.5550	0.5536	0.5550	0.7450
0.4408	6.1277	576	0.5314	0.5714	0.5314	0.7290
0.4408	6.1489	578	0.4474	0.5914	0.4474	0.6689
0.4408	6.1702	580	0.4070	0.6072	0.4070	0.6380
0.4408	6.1915	582	0.4053	0.5952	0.4053	0.6366
0.4408	6.2128	584	0.4212	0.6040	0.4212	0.6490
0.4408	6.2340	586	0.5671	0.5313	0.5671	0.7531
0.4408	6.2553	588	0.6355	0.4988	0.6355	0.7972
0.4408	6.2766	590	0.5195	0.5689	0.5195	0.7208
0.4408	6.2979	592	0.4083	0.5654	0.4083	0.6390
0.4408	6.3191	594	0.4088	0.5376	0.4088	0.6394

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1