ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k13_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4710
• Qwk: 0.4857
• Mse: 0.4710
• Rmse: 0.6863

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	2.5594	-0.0449	2.5594	1.5998
No log	0.1176	4	1.4126	0.0745	1.4126	1.1885
No log	0.1765	6	1.0381	-0.0970	1.0381	1.0189
No log	0.2353	8	0.8738	-0.0025	0.8738	0.9348
No log	0.2941	10	0.7635	0.0444	0.7635	0.8738
No log	0.3529	12	0.7323	0.1660	0.7323	0.8558
No log	0.4118	14	0.7389	0.2085	0.7389	0.8596
No log	0.4706	16	0.6634	0.2374	0.6634	0.8145
No log	0.5294	18	0.8164	0.2672	0.8164	0.9035
No log	0.5882	20	0.9101	0.1521	0.9101	0.9540
No log	0.6471	22	0.7448	0.2642	0.7448	0.8630
No log	0.7059	24	0.6353	0.2740	0.6353	0.7970
No log	0.7647	26	0.7678	0.2227	0.7678	0.8763
No log	0.8235	28	1.0758	0.0713	1.0758	1.0372
No log	0.8824	30	1.1740	0.0263	1.1740	1.0835
No log	0.9412	32	0.9041	0.1822	0.9041	0.9509
No log	1.0	34	0.8479	0.1373	0.8479	0.9208
No log	1.0588	36	0.9137	0.1501	0.9137	0.9559
No log	1.1176	38	1.2658	0.0688	1.2658	1.1251
No log	1.1765	40	1.3941	-0.0102	1.3941	1.1807
No log	1.2353	42	1.0966	0.1599	1.0966	1.0472
No log	1.2941	44	0.7795	0.1416	0.7795	0.8829
No log	1.3529	46	0.7401	0.2319	0.7401	0.8603
No log	1.4118	48	0.7150	0.3197	0.7150	0.8456
No log	1.4706	50	0.7576	0.1815	0.7576	0.8704
No log	1.5294	52	0.7473	0.2227	0.7473	0.8645
No log	1.5882	54	0.7126	0.2857	0.7126	0.8442
No log	1.6471	56	0.7179	0.2857	0.7179	0.8473
No log	1.7059	58	0.7864	0.2012	0.7864	0.8868
No log	1.7647	60	0.9939	0.2363	0.9939	0.9970
No log	1.8235	62	1.0253	0.1827	1.0253	1.0126
No log	1.8824	64	0.7689	0.3519	0.7689	0.8769
No log	1.9412	66	0.6555	0.4308	0.6555	0.8097
No log	2.0	68	0.6892	0.4283	0.6892	0.8302
No log	2.0588	70	0.6777	0.4234	0.6777	0.8232
No log	2.1176	72	0.5715	0.4265	0.5715	0.7560
No log	2.1765	74	0.7043	0.4404	0.7043	0.8392
No log	2.2353	76	0.7034	0.4328	0.7034	0.8387
No log	2.2941	78	0.5727	0.4808	0.5727	0.7568
No log	2.3529	80	0.6822	0.2853	0.6822	0.8259
No log	2.4118	82	0.6656	0.2886	0.6656	0.8158
No log	2.4706	84	0.5700	0.4019	0.5700	0.7550
No log	2.5294	86	0.6587	0.4576	0.6587	0.8116
No log	2.5882	88	0.7495	0.3822	0.7495	0.8658
No log	2.6471	90	0.6609	0.4576	0.6609	0.8130
No log	2.7059	92	0.5779	0.4701	0.5779	0.7602
No log	2.7647	94	0.6975	0.3402	0.6975	0.8351
No log	2.8235	96	0.7107	0.3941	0.7107	0.8430
No log	2.8824	98	0.6058	0.4972	0.6058	0.7783
No log	2.9412	100	0.6761	0.4409	0.6761	0.8223
No log	3.0	102	0.8333	0.4255	0.8333	0.9129
No log	3.0588	104	0.7381	0.4409	0.7381	0.8591
No log	3.1176	106	0.6812	0.4167	0.6812	0.8253
No log	3.1765	108	0.6351	0.4617	0.6351	0.7969
No log	3.2353	110	0.6972	0.5200	0.6972	0.8350
No log	3.2941	112	0.8106	0.4724	0.8106	0.9004
No log	3.3529	114	0.8025	0.4596	0.8025	0.8958
No log	3.4118	116	0.7718	0.3760	0.7718	0.8785
No log	3.4706	118	0.7435	0.3710	0.7435	0.8623
No log	3.5294	120	0.7155	0.4036	0.7155	0.8458
No log	3.5882	122	0.6147	0.4516	0.6147	0.7840
No log	3.6471	124	0.6805	0.4373	0.6805	0.8249
No log	3.7059	126	0.6564	0.4373	0.6564	0.8102
No log	3.7647	128	0.6117	0.4398	0.6117	0.7821
No log	3.8235	130	0.7010	0.4335	0.7010	0.8372
No log	3.8824	132	0.7199	0.3976	0.7199	0.8485
No log	3.9412	134	0.6022	0.4753	0.6022	0.7760
No log	4.0	136	0.6192	0.4783	0.6192	0.7869
No log	4.0588	138	0.6277	0.4800	0.6277	0.7923
No log	4.1176	140	0.6009	0.4824	0.6009	0.7752
No log	4.1765	142	0.6273	0.4315	0.6273	0.7920
No log	4.2353	144	0.6566	0.5235	0.6566	0.8103
No log	4.2941	146	0.6621	0.5355	0.6621	0.8137
No log	4.3529	148	0.6602	0.5103	0.6602	0.8125
No log	4.4118	150	0.6367	0.5070	0.6367	0.7979
No log	4.4706	152	0.5829	0.4806	0.5829	0.7635
No log	4.5294	154	0.5611	0.4444	0.5611	0.7491
No log	4.5882	156	0.5573	0.4681	0.5573	0.7465
No log	4.6471	158	0.5586	0.4419	0.5586	0.7474
No log	4.7059	160	0.5702	0.4206	0.5702	0.7551
No log	4.7647	162	0.5815	0.4206	0.5815	0.7626
No log	4.8235	164	0.5933	0.4459	0.5933	0.7702
No log	4.8824	166	0.6114	0.4100	0.6114	0.7819
No log	4.9412	168	0.6897	0.4582	0.6897	0.8305
No log	5.0	170	0.6732	0.4602	0.6732	0.8205
No log	5.0588	172	0.6249	0.4721	0.6249	0.7905
No log	5.1176	174	0.6367	0.4721	0.6367	0.7979
No log	5.1765	176	0.6103	0.4724	0.6103	0.7812
No log	5.2353	178	0.5876	0.4493	0.5876	0.7666
No log	5.2941	180	0.5842	0.4493	0.5842	0.7643
No log	5.3529	182	0.5684	0.4828	0.5684	0.7539
No log	5.4118	184	0.5709	0.4234	0.5709	0.7556
No log	5.4706	186	0.5671	0.4234	0.5671	0.7530
No log	5.5294	188	0.5975	0.3918	0.5975	0.7730
No log	5.5882	190	0.5822	0.4190	0.5822	0.7630
No log	5.6471	192	0.6083	0.4190	0.6083	0.7800
No log	5.7059	194	0.5861	0.4081	0.5861	0.7656
No log	5.7647	196	0.5656	0.5725	0.5656	0.7521
No log	5.8235	198	0.6276	0.5471	0.6276	0.7922
No log	5.8824	200	0.6140	0.5471	0.6140	0.7836
No log	5.9412	202	0.5669	0.5434	0.5669	0.7529
No log	6.0	204	0.7558	0.4933	0.7558	0.8694
No log	6.0588	206	0.8153	0.4275	0.8153	0.9029
No log	6.1176	208	0.6218	0.4007	0.6218	0.7886
No log	6.1765	210	0.5865	0.4990	0.5865	0.7658
No log	6.2353	212	0.6046	0.3315	0.6046	0.7776
No log	6.2941	214	0.5711	0.5114	0.5711	0.7557
No log	6.3529	216	0.5513	0.4493	0.5513	0.7425
No log	6.4118	218	0.5240	0.5488	0.5240	0.7239
No log	6.4706	220	0.5629	0.5621	0.5629	0.7503
No log	6.5294	222	0.5588	0.5268	0.5588	0.7475
No log	6.5882	224	0.5230	0.5604	0.5230	0.7232
No log	6.6471	226	0.5384	0.5725	0.5384	0.7337
No log	6.7059	228	0.5778	0.5317	0.5778	0.7601
No log	6.7647	230	0.5756	0.5304	0.5756	0.7587
No log	6.8235	232	0.5854	0.4504	0.5854	0.7651
No log	6.8824	234	0.5899	0.4542	0.5899	0.7680
No log	6.9412	236	0.5546	0.5444	0.5546	0.7447
No log	7.0	238	0.6250	0.4290	0.6250	0.7906
No log	7.0588	240	0.7060	0.4511	0.7060	0.8403
No log	7.1176	242	0.6591	0.4396	0.6591	0.8118
No log	7.1765	244	0.6027	0.4789	0.6027	0.7763
No log	7.2353	246	0.5492	0.4984	0.5492	0.7411
No log	7.2941	248	0.5631	0.5104	0.5631	0.7504
No log	7.3529	250	0.5554	0.5159	0.5554	0.7453
No log	7.4118	252	0.6393	0.4616	0.6393	0.7995
No log	7.4706	254	0.7505	0.4051	0.7505	0.8663
No log	7.5294	256	0.6849	0.4670	0.6849	0.8276
No log	7.5882	258	0.5870	0.5662	0.5870	0.7662
No log	7.6471	260	0.6523	0.4165	0.6523	0.8077
No log	7.7059	262	0.6691	0.3844	0.6691	0.8180
No log	7.7647	264	0.6057	0.4948	0.6057	0.7782
No log	7.8235	266	0.6602	0.4923	0.6602	0.8125
No log	7.8824	268	0.7148	0.4281	0.7148	0.8455
No log	7.9412	270	0.6536	0.4655	0.6536	0.8085
No log	8.0	272	0.5957	0.5101	0.5957	0.7718
No log	8.0588	274	0.5885	0.5574	0.5885	0.7671
No log	8.1176	276	0.5904	0.5101	0.5904	0.7684
No log	8.1765	278	0.6001	0.4806	0.6001	0.7747
No log	8.2353	280	0.6104	0.4806	0.6104	0.7813
No log	8.2941	282	0.6005	0.4475	0.6005	0.7749
No log	8.3529	284	0.6201	0.5016	0.6201	0.7875
No log	8.4118	286	0.6259	0.4769	0.6259	0.7912
No log	8.4706	288	0.6322	0.4769	0.6322	0.7951
No log	8.5294	290	0.6148	0.4639	0.6148	0.7841
No log	8.5882	292	0.6114	0.5195	0.6114	0.7819
No log	8.6471	294	0.6450	0.5016	0.6450	0.8031
No log	8.7059	296	0.6802	0.5195	0.6802	0.8248
No log	8.7647	298	0.6408	0.5639	0.6408	0.8005
No log	8.8235	300	0.6119	0.4692	0.6119	0.7822
No log	8.8824	302	0.6196	0.4939	0.6196	0.7871
No log	8.9412	304	0.5822	0.4841	0.5822	0.7630
No log	9.0	306	0.5475	0.5550	0.5475	0.7400
No log	9.0588	308	0.5614	0.5086	0.5614	0.7493
No log	9.1176	310	0.5474	0.5345	0.5474	0.7399
No log	9.1765	312	0.5384	0.5092	0.5384	0.7338
No log	9.2353	314	0.5997	0.4463	0.5997	0.7744
No log	9.2941	316	0.6247	0.4765	0.6247	0.7904
No log	9.3529	318	0.5928	0.4463	0.5928	0.7699
No log	9.4118	320	0.5294	0.5538	0.5294	0.7276
No log	9.4706	322	0.5188	0.5784	0.5188	0.7203
No log	9.5294	324	0.5295	0.5625	0.5295	0.7277
No log	9.5882	326	0.5354	0.5301	0.5354	0.7317
No log	9.6471	328	0.5403	0.5442	0.5403	0.7351
No log	9.7059	330	0.5380	0.5854	0.5380	0.7335
No log	9.7647	332	0.5338	0.5565	0.5338	0.7306
No log	9.8235	334	0.5364	0.5937	0.5364	0.7324
No log	9.8824	336	0.5611	0.5081	0.5611	0.7490
No log	9.9412	338	0.5357	0.5543	0.5357	0.7319
No log	10.0	340	0.5291	0.5677	0.5291	0.7274
No log	10.0588	342	0.5283	0.5677	0.5283	0.7269
No log	10.1176	344	0.5295	0.5272	0.5295	0.7276
No log	10.1765	346	0.5408	0.5166	0.5408	0.7354
No log	10.2353	348	0.5423	0.5237	0.5423	0.7364
No log	10.2941	350	0.5127	0.5214	0.5127	0.7160
No log	10.3529	352	0.5116	0.5625	0.5116	0.7153
No log	10.4118	354	0.5127	0.5549	0.5127	0.7161
No log	10.4706	356	0.5183	0.5687	0.5183	0.7199
No log	10.5294	358	0.5118	0.5609	0.5118	0.7154
No log	10.5882	360	0.5013	0.5703	0.5013	0.7080
No log	10.6471	362	0.4989	0.5472	0.4989	0.7063
No log	10.7059	364	0.5071	0.5533	0.5071	0.7121
No log	10.7647	366	0.4875	0.5703	0.4875	0.6982
No log	10.8235	368	0.5024	0.6411	0.5024	0.7088
No log	10.8824	370	0.5462	0.5623	0.5462	0.7391
No log	10.9412	372	0.5236	0.6111	0.5236	0.7236
No log	11.0	374	0.4608	0.6411	0.4608	0.6788
No log	11.0588	376	0.4516	0.6574	0.4516	0.6720
No log	11.1176	378	0.4832	0.5786	0.4832	0.6951
No log	11.1765	380	0.4690	0.5723	0.4690	0.6848
No log	11.2353	382	0.4747	0.6222	0.4747	0.6890
No log	11.2941	384	0.6047	0.4914	0.6047	0.7776
No log	11.3529	386	0.6454	0.5190	0.6454	0.8034
No log	11.4118	388	0.6098	0.4914	0.6098	0.7809
No log	11.4706	390	0.5884	0.4914	0.5884	0.7671
No log	11.5294	392	0.5159	0.5840	0.5159	0.7183
No log	11.5882	394	0.5462	0.4901	0.5462	0.7391
No log	11.6471	396	0.5594	0.4622	0.5594	0.7479
No log	11.7059	398	0.5167	0.5687	0.5167	0.7188
No log	11.7647	400	0.5252	0.4876	0.5252	0.7247
No log	11.8235	402	0.5700	0.4237	0.5700	0.7550
No log	11.8824	404	0.5568	0.3635	0.5568	0.7462
No log	11.9412	406	0.5168	0.4898	0.5168	0.7189
No log	12.0	408	0.5236	0.4774	0.5236	0.7236
No log	12.0588	410	0.6443	0.4749	0.6443	0.8027
No log	12.1176	412	0.6730	0.5045	0.6730	0.8204
No log	12.1765	414	0.5804	0.4835	0.5804	0.7618
No log	12.2353	416	0.4948	0.5784	0.4948	0.7034
No log	12.2941	418	0.5241	0.5266	0.5241	0.7239
No log	12.3529	420	0.5404	0.4589	0.5404	0.7351
No log	12.4118	422	0.5144	0.5010	0.5144	0.7172
No log	12.4706	424	0.5061	0.4444	0.5061	0.7114
No log	12.5294	426	0.5214	0.4614	0.5214	0.7221
No log	12.5882	428	0.5189	0.4867	0.5189	0.7204
No log	12.6471	430	0.5001	0.5170	0.5001	0.7072
No log	12.7059	432	0.4908	0.5567	0.4908	0.7005
No log	12.7647	434	0.4868	0.5784	0.4868	0.6977
No log	12.8235	436	0.4950	0.5550	0.4950	0.7036
No log	12.8824	438	0.5090	0.5455	0.5090	0.7134
No log	12.9412	440	0.5280	0.5859	0.5280	0.7266
No log	13.0	442	0.5633	0.5117	0.5633	0.7505
No log	13.0588	444	0.5890	0.4966	0.5890	0.7674
No log	13.1176	446	0.5411	0.5512	0.5411	0.7356
No log	13.1765	448	0.4962	0.5177	0.4962	0.7044
No log	13.2353	450	0.5377	0.5015	0.5377	0.7333
No log	13.2941	452	0.5772	0.4842	0.5772	0.7597
No log	13.3529	454	0.5351	0.5438	0.5351	0.7315
No log	13.4118	456	0.5227	0.5250	0.5227	0.7230
No log	13.4706	458	0.5099	0.5143	0.5099	0.7141
No log	13.5294	460	0.5149	0.5753	0.5149	0.7176
No log	13.5882	462	0.5170	0.5143	0.5170	0.7190
No log	13.6471	464	0.5199	0.4768	0.5199	0.7211
No log	13.7059	466	0.5241	0.3865	0.5241	0.7239
No log	13.7647	468	0.5344	0.4705	0.5344	0.7311
No log	13.8235	470	0.5539	0.4705	0.5539	0.7442
No log	13.8824	472	0.5832	0.5158	0.5832	0.7637
No log	13.9412	474	0.6376	0.4749	0.6376	0.7985
No log	14.0	476	0.6733	0.4664	0.6733	0.8206
No log	14.0588	478	0.6167	0.4664	0.6167	0.7853
No log	14.1176	480	0.5259	0.4705	0.5259	0.7252
No log	14.1765	482	0.5230	0.5463	0.5230	0.7232
No log	14.2353	484	0.6115	0.5129	0.6115	0.7820
No log	14.2941	486	0.6605	0.5065	0.6605	0.8127
No log	14.3529	488	0.5881	0.5528	0.5881	0.7669
No log	14.4118	490	0.4997	0.5507	0.4997	0.7069
No log	14.4706	492	0.5070	0.5056	0.5070	0.7120
No log	14.5294	494	0.5054	0.5151	0.5054	0.7109
No log	14.5882	496	0.5036	0.5580	0.5036	0.7097
No log	14.6471	498	0.5642	0.5692	0.5642	0.7511
0.2865	14.7059	500	0.5951	0.5528	0.5951	0.7714
0.2865	14.7647	502	0.5905	0.5528	0.5905	0.7684
0.2865	14.8235	504	0.5376	0.5765	0.5376	0.7332
0.2865	14.8824	506	0.4990	0.5160	0.4990	0.7064
0.2865	14.9412	508	0.4956	0.5505	0.4956	0.7040
0.2865	15.0	510	0.5017	0.5846	0.5017	0.7083
0.2865	15.0588	512	0.5078	0.6027	0.5078	0.7126
0.2865	15.1176	514	0.5164	0.6066	0.5164	0.7186
0.2865	15.1765	516	0.5776	0.6283	0.5776	0.7600
0.2865	15.2353	518	0.5703	0.6283	0.5703	0.7552
0.2865	15.2941	520	0.5205	0.6066	0.5205	0.7214
0.2865	15.3529	522	0.4845	0.6118	0.4845	0.6960
0.2865	15.4118	524	0.4798	0.5784	0.4798	0.6926
0.2865	15.4706	526	0.4946	0.4964	0.4946	0.7033
0.2865	15.5294	528	0.4886	0.4964	0.4886	0.6990
0.2865	15.5882	530	0.4733	0.5550	0.4733	0.6880
0.2865	15.6471	532	0.4721	0.5902	0.4721	0.6871
0.2865	15.7059	534	0.4730	0.6301	0.4730	0.6878
0.2865	15.7647	536	0.4658	0.6411	0.4658	0.6825
0.2865	15.8235	538	0.4539	0.5979	0.4539	0.6737
0.2865	15.8824	540	0.4625	0.5687	0.4625	0.6801
0.2865	15.9412	542	0.4545	0.5703	0.4545	0.6741
0.2865	16.0	544	0.4533	0.6267	0.4533	0.6733
0.2865	16.0588	546	0.4561	0.6279	0.4561	0.6754
0.2865	16.1176	548	0.4499	0.5768	0.4499	0.6708
0.2865	16.1765	550	0.4490	0.5846	0.4490	0.6701
0.2865	16.2353	552	0.4641	0.5307	0.4641	0.6812
0.2865	16.2941	554	0.4855	0.5036	0.4855	0.6968
0.2865	16.3529	556	0.4861	0.4774	0.4861	0.6972
0.2865	16.4118	558	0.4633	0.5307	0.4633	0.6806
0.2865	16.4706	560	0.4497	0.5926	0.4497	0.6706
0.2865	16.5294	562	0.4464	0.5926	0.4464	0.6681
0.2865	16.5882	564	0.4511	0.5784	0.4511	0.6717
0.2865	16.6471	566	0.4763	0.5036	0.4763	0.6901
0.2865	16.7059	568	0.4689	0.5131	0.4689	0.6848
0.2865	16.7647	570	0.4523	0.5732	0.4523	0.6725
0.2865	16.8235	572	0.4529	0.5095	0.4529	0.6730
0.2865	16.8824	574	0.4550	0.5095	0.4550	0.6745
0.2865	16.9412	576	0.4596	0.5732	0.4596	0.6779
0.2865	17.0	578	0.4800	0.5386	0.4800	0.6928
0.2865	17.0588	580	0.4978	0.5131	0.4978	0.7055
0.2865	17.1176	582	0.4847	0.5386	0.4847	0.6962
0.2865	17.1765	584	0.4663	0.5550	0.4663	0.6828
0.2865	17.2353	586	0.4661	0.4972	0.4661	0.6827
0.2865	17.2941	588	0.4711	0.4722	0.4711	0.6863
0.2865	17.3529	590	0.4763	0.4788	0.4763	0.6902
0.2865	17.4118	592	0.4755	0.4857	0.4755	0.6896
0.2865	17.4706	594	0.4710	0.4857	0.4710	0.6863

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1