ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k6_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2919
• Qwk: 0.5518
• Mse: 1.2919
• Rmse: 1.1366

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.08	2	2.2184	0.0250	2.2185	1.4894
No log	0.16	4	1.4533	0.2897	1.4533	1.2055
No log	0.24	6	1.3299	0.1508	1.3299	1.1532
No log	0.32	8	1.4607	0.3470	1.4607	1.2086
No log	0.4	10	1.6223	0.3667	1.6223	1.2737
No log	0.48	12	1.7388	0.3603	1.7388	1.3186
No log	0.56	14	1.5734	0.1505	1.5734	1.2544
No log	0.64	16	1.4878	0.1478	1.4878	1.2198
No log	0.72	18	1.4731	0.1627	1.4731	1.2137
No log	0.8	20	1.4938	0.0963	1.4938	1.2222
No log	0.88	22	1.4882	0.1246	1.4882	1.2199
No log	0.96	24	1.5181	0.1227	1.5181	1.2321
No log	1.04	26	1.5026	0.1055	1.5026	1.2258
No log	1.12	28	1.5275	0.1039	1.5275	1.2359
No log	1.2	30	1.5205	0.1646	1.5205	1.2331
No log	1.28	32	1.6301	0.3682	1.6301	1.2768
No log	1.3600	34	1.5907	0.3517	1.5907	1.2612
No log	1.44	36	1.4949	0.3765	1.4949	1.2227
No log	1.52	38	1.4758	0.3921	1.4758	1.2148
No log	1.6	40	1.4570	0.3789	1.4570	1.2071
No log	1.6800	42	1.5323	0.3810	1.5323	1.2378
No log	1.76	44	1.6804	0.3440	1.6804	1.2963
No log	1.8400	46	1.6111	0.3511	1.6111	1.2693
No log	1.92	48	1.3659	0.3718	1.3659	1.1687
No log	2.0	50	1.1503	0.3646	1.1503	1.0725
No log	2.08	52	1.1603	0.3770	1.1603	1.0772
No log	2.16	54	1.1498	0.3507	1.1498	1.0723
No log	2.24	56	1.1117	0.3809	1.1117	1.0544
No log	2.32	58	1.1982	0.4247	1.1982	1.0946
No log	2.4	60	1.3339	0.4216	1.3339	1.1550
No log	2.48	62	1.4058	0.4107	1.4058	1.1857
No log	2.56	64	1.3846	0.4485	1.3846	1.1767
No log	2.64	66	1.3318	0.4192	1.3318	1.1540
No log	2.7200	68	1.3251	0.4210	1.3251	1.1511
No log	2.8	70	1.2138	0.4711	1.2138	1.1017
No log	2.88	72	1.1335	0.5518	1.1335	1.0646
No log	2.96	74	1.0679	0.5379	1.0679	1.0334
No log	3.04	76	1.1388	0.5531	1.1388	1.0671
No log	3.12	78	1.3197	0.4684	1.3197	1.1488
No log	3.2	80	1.4361	0.4421	1.4361	1.1984
No log	3.2800	82	1.5171	0.4423	1.5171	1.2317
No log	3.36	84	1.3889	0.4592	1.3889	1.1785
No log	3.44	86	1.0652	0.5883	1.0652	1.0321
No log	3.52	88	0.9485	0.5768	0.9485	0.9739
No log	3.6	90	0.9644	0.5637	0.9644	0.9820
No log	3.68	92	1.1144	0.6150	1.1144	1.0557
No log	3.76	94	1.4658	0.4759	1.4658	1.2107
No log	3.84	96	1.9338	0.4523	1.9338	1.3906
No log	3.92	98	2.2070	0.4017	2.2070	1.4856
No log	4.0	100	2.0367	0.4171	2.0367	1.4271
No log	4.08	102	1.8154	0.4155	1.8154	1.3474
No log	4.16	104	1.4250	0.4799	1.4250	1.1937
No log	4.24	106	1.1543	0.5252	1.1543	1.0744
No log	4.32	108	1.1572	0.5428	1.1572	1.0757
No log	4.4	110	1.3256	0.5169	1.3256	1.1514
No log	4.48	112	1.5475	0.4369	1.5475	1.2440
No log	4.5600	114	1.6582	0.4034	1.6582	1.2877
No log	4.64	116	1.6433	0.4118	1.6433	1.2819
No log	4.72	118	1.4569	0.4792	1.4569	1.2070
No log	4.8	120	1.2543	0.5174	1.2543	1.1200
No log	4.88	122	1.1000	0.5458	1.1000	1.0488
No log	4.96	124	1.0053	0.5742	1.0053	1.0026
No log	5.04	126	0.9747	0.5662	0.9747	0.9873
No log	5.12	128	1.0339	0.5729	1.0339	1.0168
No log	5.2	130	1.1926	0.6076	1.1926	1.0921
No log	5.28	132	1.4631	0.5083	1.4631	1.2096
No log	5.36	134	1.6711	0.4739	1.6711	1.2927
No log	5.44	136	1.7201	0.4566	1.7201	1.3115
No log	5.52	138	1.5746	0.4730	1.5746	1.2548
No log	5.6	140	1.3918	0.5259	1.3918	1.1797
No log	5.68	142	1.2692	0.5179	1.2692	1.1266
No log	5.76	144	1.2835	0.5179	1.2835	1.1329
No log	5.84	146	1.3943	0.4950	1.3943	1.1808
No log	5.92	148	1.5533	0.4476	1.5533	1.2463
No log	6.0	150	1.6178	0.4565	1.6178	1.2719
No log	6.08	152	1.5788	0.4807	1.5788	1.2565
No log	6.16	154	1.4042	0.5046	1.4042	1.1850
No log	6.24	156	1.2861	0.5212	1.2861	1.1340
No log	6.32	158	1.2007	0.5552	1.2007	1.0958
No log	6.4	160	1.1878	0.5710	1.1878	1.0899
No log	6.48	162	1.1423	0.6075	1.1423	1.0688
No log	6.5600	164	1.1742	0.5629	1.1742	1.0836
No log	6.64	166	1.2844	0.5524	1.2844	1.1333
No log	6.72	168	1.4362	0.4862	1.4362	1.1984
No log	6.8	170	1.4726	0.4852	1.4726	1.2135
No log	6.88	172	1.4024	0.4869	1.4024	1.1842
No log	6.96	174	1.2796	0.5058	1.2796	1.1312
No log	7.04	176	1.2257	0.5453	1.2257	1.1071
No log	7.12	178	1.1602	0.5722	1.1602	1.0771
No log	7.2	180	1.1178	0.6061	1.1178	1.0572
No log	7.28	182	1.1349	0.5779	1.1349	1.0653
No log	7.36	184	1.1698	0.5498	1.1698	1.0816
No log	7.44	186	1.1875	0.5146	1.1875	1.0897
No log	7.52	188	1.2250	0.5058	1.2250	1.1068
No log	7.6	190	1.2914	0.5051	1.2914	1.1364
No log	7.68	192	1.3259	0.5149	1.3259	1.1515
No log	7.76	194	1.2962	0.5120	1.2962	1.1385
No log	7.84	196	1.2964	0.5184	1.2964	1.1386
No log	7.92	198	1.2627	0.5174	1.2627	1.1237
No log	8.0	200	1.2008	0.5669	1.2008	1.0958
No log	8.08	202	1.1797	0.5924	1.1797	1.0862
No log	8.16	204	1.1852	0.5935	1.1852	1.0887
No log	8.24	206	1.2178	0.5639	1.2178	1.1035
No log	8.32	208	1.2675	0.5498	1.2675	1.1258
No log	8.4	210	1.2897	0.5383	1.2897	1.1357
No log	8.48	212	1.3403	0.5160	1.3403	1.1577
No log	8.56	214	1.3830	0.5067	1.3830	1.1760
No log	8.64	216	1.4107	0.5152	1.4107	1.1877
No log	8.72	218	1.3802	0.5062	1.3802	1.1748
No log	8.8	220	1.3282	0.5219	1.3282	1.1525
No log	8.88	222	1.2834	0.5254	1.2834	1.1329
No log	8.96	224	1.2547	0.5307	1.2547	1.1202
No log	9.04	226	1.2362	0.5388	1.2362	1.1118
No log	9.12	228	1.2334	0.5495	1.2334	1.1106
No log	9.2	230	1.2361	0.5495	1.2361	1.1118
No log	9.28	232	1.2430	0.5495	1.2430	1.1149
No log	9.36	234	1.2532	0.5495	1.2532	1.1194
No log	9.44	236	1.2465	0.5495	1.2465	1.1165
No log	9.52	238	1.2430	0.5495	1.2430	1.1149
No log	9.6	240	1.2531	0.5495	1.2531	1.1194
No log	9.68	242	1.2692	0.5565	1.2692	1.1266
No log	9.76	244	1.2772	0.5565	1.2772	1.1301
No log	9.84	246	1.2859	0.5518	1.2859	1.1340
No log	9.92	248	1.2904	0.5518	1.2904	1.1360
No log	10.0	250	1.2919	0.5518	1.2919	1.1366

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1