ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k6_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6832
• Qwk: 0.3860
• Mse: 0.6832
• Rmse: 0.8265

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	3.4647	0.0068	3.4647	1.8614
No log	0.1333	4	1.8390	-0.0101	1.8390	1.3561
No log	0.2	6	1.1469	0.0588	1.1469	1.0709
No log	0.2667	8	0.8104	0.3214	0.8104	0.9002
No log	0.3333	10	0.5635	0.0638	0.5635	0.7507
No log	0.4	12	0.6087	0.3455	0.6087	0.7802
No log	0.4667	14	0.5415	0.0476	0.5415	0.7359
No log	0.5333	16	0.5439	0.0	0.5439	0.7375
No log	0.6	18	0.5375	0.0	0.5375	0.7331
No log	0.6667	20	0.5670	0.0303	0.5670	0.7530
No log	0.7333	22	0.8921	0.0578	0.8921	0.9445
No log	0.8	24	0.7937	0.2077	0.7937	0.8909
No log	0.8667	26	0.6060	0.0256	0.6060	0.7785
No log	0.9333	28	0.8202	0.1050	0.8202	0.9057
No log	1.0	30	0.7407	0.2821	0.7407	0.8607
No log	1.0667	32	0.5694	0.1304	0.5694	0.7546
No log	1.1333	34	0.6196	0.0123	0.6196	0.7872
No log	1.2	36	0.7270	0.2323	0.7270	0.8526
No log	1.2667	38	0.9803	0.1333	0.9803	0.9901
No log	1.3333	40	0.7227	0.25	0.7227	0.8501
No log	1.4	42	0.5786	0.0388	0.5786	0.7606
No log	1.4667	44	0.6573	0.0	0.6573	0.8107
No log	1.5333	46	0.6238	-0.0159	0.6238	0.7898
No log	1.6	48	0.5851	0.1304	0.5851	0.7649
No log	1.6667	50	0.8096	0.1549	0.8096	0.8998
No log	1.7333	52	0.7727	0.1238	0.7727	0.8790
No log	1.8	54	0.6314	0.1364	0.6314	0.7946
No log	1.8667	56	0.6431	0.1364	0.6431	0.8019
No log	1.9333	58	0.7555	0.0739	0.7555	0.8692
No log	2.0	60	0.6413	0.4105	0.6413	0.8008
No log	2.0667	62	0.7240	0.1538	0.7240	0.8509
No log	2.1333	64	0.7077	0.3561	0.7077	0.8412
No log	2.2	66	0.9390	0.2184	0.9390	0.9690
No log	2.2667	68	1.3296	0.1948	1.3296	1.1531
No log	2.3333	70	0.9336	0.2195	0.9336	0.9662
No log	2.4	72	0.6311	0.3161	0.6311	0.7944
No log	2.4667	74	0.8872	0.1597	0.8872	0.9419
No log	2.5333	76	0.7874	0.1493	0.7874	0.8874
No log	2.6	78	0.5735	0.1895	0.5735	0.7573
No log	2.6667	80	0.6158	0.1467	0.6158	0.7847
No log	2.7333	82	0.6397	0.1030	0.6397	0.7998
No log	2.8	84	0.6207	0.2485	0.6207	0.7878
No log	2.8667	86	0.6525	0.2857	0.6525	0.8078
No log	2.9333	88	0.7242	0.1848	0.7242	0.8510
No log	3.0	90	0.7516	0.2646	0.7516	0.8669
No log	3.0667	92	0.8236	0.2593	0.8236	0.9075
No log	3.1333	94	0.7577	0.2414	0.7577	0.8705
No log	3.2	96	0.7641	0.2348	0.7641	0.8741
No log	3.2667	98	0.7307	0.2661	0.7307	0.8548
No log	3.3333	100	1.0304	0.0861	1.0304	1.0151
No log	3.4	102	1.1677	0.1293	1.1677	1.0806
No log	3.4667	104	0.8122	0.2727	0.8122	0.9012
No log	3.5333	106	0.7939	0.2727	0.7939	0.8910
No log	3.6	108	0.9559	0.0903	0.9559	0.9777
No log	3.6667	110	0.7055	0.3333	0.7055	0.8399
No log	3.7333	112	0.6382	0.3367	0.6382	0.7989
No log	3.8	114	0.6310	0.3200	0.6310	0.7943
No log	3.8667	116	0.6372	0.3561	0.6372	0.7983
No log	3.9333	118	0.9689	0.0929	0.9689	0.9843
No log	4.0	120	1.1290	0.1304	1.1290	1.0625
No log	4.0667	122	0.7408	0.2961	0.7408	0.8607
No log	4.1333	124	0.5840	0.3439	0.5840	0.7642
No log	4.2	126	0.5916	0.2889	0.5916	0.7692
No log	4.2667	128	0.6353	0.3191	0.6353	0.7970
No log	4.3333	130	1.1777	0.1399	1.1777	1.0852
No log	4.4	132	1.3861	0.0968	1.3861	1.1773
No log	4.4667	134	1.0842	0.1317	1.0842	1.0413
No log	4.5333	136	0.6137	0.4033	0.6137	0.7834
No log	4.6	138	0.6697	0.2850	0.6697	0.8183
No log	4.6667	140	0.6778	0.2850	0.6778	0.8233
No log	4.7333	142	0.5941	0.3661	0.5941	0.7707
No log	4.8	144	0.7439	0.2727	0.7439	0.8625
No log	4.8667	146	0.6946	0.3561	0.6946	0.8335
No log	4.9333	148	0.5719	0.4652	0.5719	0.7562
No log	5.0	150	0.6274	0.2709	0.6274	0.7921
No log	5.0667	152	0.5896	0.3575	0.5896	0.7678
No log	5.1333	154	0.5838	0.4783	0.5838	0.7640
No log	5.2	156	0.6471	0.3535	0.6471	0.8044
No log	5.2667	158	0.6420	0.3535	0.6420	0.8013
No log	5.3333	160	0.5707	0.4652	0.5707	0.7554
No log	5.4	162	0.5653	0.4652	0.5653	0.7519
No log	5.4667	164	0.6721	0.3535	0.6721	0.8198
No log	5.5333	166	1.0225	0.1280	1.0225	1.0112
No log	5.6	168	1.0722	0.1293	1.0722	1.0355
No log	5.6667	170	0.8410	0.2389	0.8410	0.9171
No log	5.7333	172	0.6327	0.3575	0.6327	0.7954
No log	5.8	174	0.5691	0.3730	0.5691	0.7544
No log	5.8667	176	0.5849	0.4286	0.5849	0.7648
No log	5.9333	178	0.7100	0.4	0.7100	0.8426
No log	6.0	180	0.9548	0.1496	0.9548	0.9771
No log	6.0667	182	1.0670	0.0968	1.0670	1.0329
No log	6.1333	184	1.0053	0.1496	1.0053	1.0026
No log	6.2	186	0.8287	0.2727	0.8287	0.9104
No log	6.2667	188	0.6888	0.4123	0.6888	0.8299
No log	6.3333	190	0.6669	0.4123	0.6669	0.8166
No log	6.4	192	0.8144	0.3103	0.8144	0.9025
No log	6.4667	194	1.2792	0.1316	1.2792	1.1310
No log	6.5333	196	1.5176	0.0886	1.5176	1.2319
No log	6.6	198	1.4073	0.1111	1.4073	1.1863
No log	6.6667	200	1.0436	0.1756	1.0436	1.0216
No log	6.7333	202	0.7170	0.4027	0.7170	0.8468
No log	6.8	204	0.6231	0.2487	0.6231	0.7894
No log	6.8667	206	0.6145	0.2000	0.6145	0.7839
No log	6.9333	208	0.6361	0.3978	0.6361	0.7975
No log	7.0	210	0.8235	0.2405	0.8235	0.9075
No log	7.0667	212	0.9104	0.1811	0.9104	0.9542
No log	7.1333	214	0.8290	0.2405	0.8290	0.9105
No log	7.2	216	0.6530	0.2821	0.6530	0.8081
No log	7.2667	218	0.5823	0.2370	0.5823	0.7631
No log	7.3333	220	0.5845	0.1638	0.5845	0.7645
No log	7.4	222	0.5746	0.2370	0.5746	0.7580
No log	7.4667	224	0.6184	0.3757	0.6184	0.7864
No log	7.5333	226	0.7700	0.2423	0.7700	0.8775
No log	7.6	228	0.8989	0.1496	0.8989	0.9481
No log	7.6667	230	0.8760	0.1799	0.8760	0.9360
No log	7.7333	232	0.7375	0.3180	0.7375	0.8588
No log	7.8	234	0.6015	0.4536	0.6015	0.7756
No log	7.8667	236	0.5696	0.4545	0.5696	0.7547
No log	7.9333	238	0.5729	0.4545	0.5729	0.7569
No log	8.0	240	0.6024	0.4468	0.6024	0.7762
No log	8.0667	242	0.7053	0.3585	0.7053	0.8398
No log	8.1333	244	0.7603	0.2423	0.7603	0.8719
No log	8.2	246	0.7511	0.2423	0.7511	0.8667
No log	8.2667	248	0.6863	0.3623	0.6863	0.8284
No log	8.3333	250	0.6356	0.3369	0.6356	0.7972
No log	8.4	252	0.6137	0.3730	0.6137	0.7834
No log	8.4667	254	0.6333	0.3684	0.6333	0.7958
No log	8.5333	256	0.6401	0.3684	0.6401	0.8000
No log	8.6	258	0.6781	0.3905	0.6781	0.8235
No log	8.6667	260	0.7633	0.2423	0.7633	0.8737
No log	8.7333	262	0.8696	0.2381	0.8696	0.9325
No log	8.8	264	0.8814	0.2381	0.8814	0.9388
No log	8.8667	266	0.8360	0.2743	0.8360	0.9143
No log	8.9333	268	0.7472	0.2423	0.7472	0.8644
No log	9.0	270	0.6864	0.3905	0.6864	0.8285
No log	9.0667	272	0.6673	0.3561	0.6673	0.8169
No log	9.1333	274	0.6762	0.3905	0.6762	0.8223
No log	9.2	276	0.7002	0.3455	0.7002	0.8368
No log	9.2667	278	0.7209	0.3180	0.7209	0.8491
No log	9.3333	280	0.7423	0.2793	0.7423	0.8616
No log	9.4	282	0.7603	0.2423	0.7603	0.8720
No log	9.4667	284	0.7583	0.2423	0.7583	0.8708
No log	9.5333	286	0.7371	0.2793	0.7371	0.8586
No log	9.6	288	0.7203	0.3180	0.7203	0.8487
No log	9.6667	290	0.7068	0.3455	0.7068	0.8407
No log	9.7333	292	0.6992	0.3455	0.6992	0.8362
No log	9.8	294	0.6857	0.3860	0.6857	0.8281
No log	9.8667	296	0.6822	0.3905	0.6822	0.8260
No log	9.9333	298	0.6823	0.3860	0.6823	0.8260
No log	10.0	300	0.6832	0.3860	0.6832	0.8265

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1