ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k4_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5273
• Qwk: 0.4286
• Mse: 0.5273
• Rmse: 0.7262

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	3.2547	0.0159	3.2547	1.8041
No log	0.1538	4	1.6804	0.0210	1.6804	1.2963
No log	0.2308	6	0.8618	0.1613	0.8618	0.9283
No log	0.3077	8	1.0109	0.1440	1.0109	1.0054
No log	0.3846	10	0.7456	0.3242	0.7456	0.8635
No log	0.4615	12	0.9219	0.0	0.9219	0.9601
No log	0.5385	14	1.3320	0.0	1.3320	1.1541
No log	0.6154	16	1.1749	0.0	1.1749	1.0839
No log	0.6923	18	0.8131	0.0745	0.8131	0.9017
No log	0.7692	20	0.7463	0.0980	0.7463	0.8639
No log	0.8462	22	0.8301	0.0698	0.8301	0.9111
No log	0.9231	24	0.9166	0.0	0.9166	0.9574
No log	1.0	26	1.0304	0.0	1.0304	1.0151
No log	1.0769	28	1.1139	0.0	1.1139	1.0554
No log	1.1538	30	1.3076	0.0	1.3076	1.1435
No log	1.2308	32	1.2693	0.0	1.2693	1.1267
No log	1.3077	34	1.0426	0.0	1.0426	1.0211
No log	1.3846	36	0.9335	0.0388	0.9335	0.9662
No log	1.4615	38	0.8353	0.2263	0.8353	0.9140
No log	1.5385	40	0.6791	0.1724	0.6791	0.8241
No log	1.6154	42	0.6626	0.0123	0.6626	0.8140
No log	1.6923	44	0.7135	0.1556	0.7135	0.8447
No log	1.7692	46	0.8532	0.2711	0.8532	0.9237
No log	1.8462	48	0.6406	0.0545	0.6406	0.8004
No log	1.9231	50	0.6559	0.25	0.6559	0.8099
No log	2.0	52	0.5563	0.0327	0.5563	0.7458
No log	2.0769	54	0.6014	0.2444	0.6014	0.7755
No log	2.1538	56	0.6494	0.2917	0.6494	0.8059
No log	2.2308	58	0.5053	0.0365	0.5053	0.7109
No log	2.3077	60	0.5058	0.1781	0.5058	0.7112
No log	2.3846	62	0.5611	0.2941	0.5611	0.7491
No log	2.4615	64	0.6388	0.3208	0.6388	0.7992
No log	2.5385	66	0.5848	0.3631	0.5848	0.7647
No log	2.6154	68	0.7085	0.0601	0.7085	0.8417
No log	2.6923	70	0.5750	0.4091	0.5750	0.7583
No log	2.7692	72	0.6160	0.3730	0.6160	0.7849
No log	2.8462	74	0.5721	0.3706	0.5721	0.7564
No log	2.9231	76	0.6024	0.3803	0.6024	0.7762
No log	3.0	78	0.5691	0.4419	0.5691	0.7544
No log	3.0769	80	0.7751	0.1193	0.7751	0.8804
No log	3.1538	82	0.7559	0.1211	0.7559	0.8694
No log	3.2308	84	0.4871	0.4350	0.4871	0.6980
No log	3.3077	86	0.5039	0.4286	0.5039	0.7099
No log	3.3846	88	0.4797	0.4152	0.4797	0.6926
No log	3.4615	90	0.7171	0.2208	0.7171	0.8468
No log	3.5385	92	0.6443	0.3333	0.6443	0.8027
No log	3.6154	94	0.4980	0.4747	0.4980	0.7057
No log	3.6923	96	0.5639	0.3874	0.5639	0.7509
No log	3.7692	98	0.4978	0.4819	0.4978	0.7055
No log	3.8462	100	0.5998	0.2780	0.5998	0.7745
No log	3.9231	102	0.8160	0.2248	0.8160	0.9033
No log	4.0	104	0.6277	0.3116	0.6277	0.7923
No log	4.0769	106	0.4882	0.4536	0.4882	0.6987
No log	4.1538	108	0.5122	0.4409	0.5122	0.7157
No log	4.2308	110	0.5111	0.4839	0.5111	0.7149
No log	4.3077	112	0.4925	0.4607	0.4925	0.7018
No log	4.3846	114	0.5041	0.4105	0.5041	0.7100
No log	4.4615	116	0.5053	0.4118	0.5053	0.7108
No log	4.5385	118	0.4929	0.4652	0.4929	0.7021
No log	4.6154	120	0.5155	0.4400	0.5155	0.7180
No log	4.6923	122	0.5656	0.3744	0.5656	0.7520
No log	4.7692	124	0.5230	0.4468	0.5230	0.7232
No log	4.8462	126	0.5985	0.4510	0.5985	0.7736
No log	4.9231	128	0.6279	0.3744	0.6279	0.7924
No log	5.0	130	0.5922	0.4573	0.5922	0.7696
No log	5.0769	132	0.5705	0.4341	0.5705	0.7553
No log	5.1538	134	0.5655	0.4286	0.5655	0.7520
No log	5.2308	136	0.6195	0.3744	0.6195	0.7871
No log	5.3077	138	0.6941	0.3722	0.6941	0.8331
No log	5.3846	140	0.5691	0.3846	0.5691	0.7544
No log	5.4615	142	0.6296	0.4236	0.6296	0.7935
No log	5.5385	144	0.5729	0.3761	0.5729	0.7569
No log	5.6154	146	0.6431	0.3077	0.6431	0.8019
No log	5.6923	148	1.0534	0.1672	1.0534	1.0264
No log	5.7692	150	1.1277	0.1409	1.1277	1.0619
No log	5.8462	152	0.7980	0.3071	0.7980	0.8933
No log	5.9231	154	0.5151	0.4051	0.5151	0.7177
No log	6.0	156	0.6884	0.2787	0.6884	0.8297
No log	6.0769	158	0.7381	0.3125	0.7381	0.8591
No log	6.1538	160	0.5715	0.3706	0.5715	0.7560
No log	6.2308	162	0.4949	0.4652	0.4949	0.7035
No log	6.3077	164	0.5938	0.4286	0.5938	0.7706
No log	6.3846	166	0.5868	0.4286	0.5868	0.7660
No log	6.4615	168	0.4994	0.5132	0.4994	0.7067
No log	6.5385	170	0.4911	0.3978	0.4911	0.7008
No log	6.6154	172	0.5629	0.3706	0.5629	0.7503
No log	6.6923	174	0.6010	0.3180	0.6010	0.7753
No log	6.7692	176	0.5230	0.4051	0.5230	0.7232
No log	6.8462	178	0.5246	0.5183	0.5246	0.7243
No log	6.9231	180	0.7006	0.2743	0.7006	0.8370
No log	7.0	182	0.7735	0.2713	0.7735	0.8795
No log	7.0769	184	0.6511	0.3905	0.6511	0.8069
No log	7.1538	186	0.5393	0.5464	0.5393	0.7344
No log	7.2308	188	0.5238	0.5080	0.5238	0.7237
No log	7.3077	190	0.5098	0.4222	0.5098	0.7140
No log	7.3846	192	0.5085	0.4222	0.5085	0.7131
No log	7.4615	194	0.5057	0.4222	0.5057	0.7111
No log	7.5385	196	0.5192	0.5464	0.5192	0.7206
No log	7.6154	198	0.5205	0.5602	0.5205	0.7215
No log	7.6923	200	0.5076	0.4483	0.5076	0.7125
No log	7.7692	202	0.5030	0.4483	0.5030	0.7092
No log	7.8462	204	0.4954	0.4483	0.4954	0.7038
No log	7.9231	206	0.4931	0.4483	0.4931	0.7022
No log	8.0	208	0.5068	0.4483	0.5068	0.7119
No log	8.0769	210	0.5558	0.5368	0.5558	0.7455
No log	8.1538	212	0.5887	0.4112	0.5887	0.7673
No log	8.2308	214	0.6144	0.4059	0.6144	0.7839
No log	8.3077	216	0.5685	0.3892	0.5685	0.7540
No log	8.3846	218	0.5306	0.5052	0.5306	0.7284
No log	8.4615	220	0.5034	0.4483	0.5034	0.7095
No log	8.5385	222	0.5067	0.4413	0.5067	0.7118
No log	8.6154	224	0.5303	0.4709	0.5303	0.7282
No log	8.6923	226	0.5681	0.4175	0.5681	0.7537
No log	8.7692	228	0.5992	0.3892	0.5992	0.7741
No log	8.8462	230	0.6065	0.3846	0.6065	0.7788
No log	8.9231	232	0.5736	0.3892	0.5736	0.7573
No log	9.0	234	0.5283	0.4227	0.5283	0.7268
No log	9.0769	236	0.5072	0.4413	0.5072	0.7122
No log	9.1538	238	0.4993	0.4413	0.4993	0.7066
No log	9.2308	240	0.4971	0.4350	0.4971	0.7050
No log	9.3077	242	0.4970	0.4350	0.4970	0.7050
No log	9.3846	244	0.4984	0.4350	0.4984	0.7060
No log	9.4615	246	0.5050	0.4413	0.5050	0.7106
No log	9.5385	248	0.5122	0.4413	0.5122	0.7157
No log	9.6154	250	0.5157	0.3913	0.5157	0.7182
No log	9.6923	252	0.5205	0.3913	0.5205	0.7215
No log	9.7692	254	0.5228	0.3913	0.5228	0.7230
No log	9.8462	256	0.5239	0.3913	0.5239	0.7238
No log	9.9231	258	0.5259	0.3913	0.5259	0.7252
No log	10.0	260	0.5273	0.4286	0.5273	0.7262

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1