ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k13_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5408
• Qwk: 0.3788
• Mse: 0.5408
• Rmse: 0.7354

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	2.5594	-0.0449	2.5594	1.5998
No log	0.1176	4	1.4126	0.0745	1.4126	1.1885
No log	0.1765	6	1.0381	-0.0970	1.0381	1.0189
No log	0.2353	8	0.8738	-0.0025	0.8738	0.9348
No log	0.2941	10	0.7635	0.0444	0.7635	0.8738
No log	0.3529	12	0.7323	0.1660	0.7323	0.8558
No log	0.4118	14	0.7389	0.2085	0.7389	0.8596
No log	0.4706	16	0.6634	0.2374	0.6634	0.8145
No log	0.5294	18	0.8164	0.2672	0.8164	0.9035
No log	0.5882	20	0.9101	0.1521	0.9101	0.9540
No log	0.6471	22	0.7448	0.2642	0.7448	0.8630
No log	0.7059	24	0.6353	0.2740	0.6353	0.7970
No log	0.7647	26	0.7678	0.2227	0.7678	0.8763
No log	0.8235	28	1.0758	0.0713	1.0758	1.0372
No log	0.8824	30	1.1740	0.0263	1.1740	1.0835
No log	0.9412	32	0.9041	0.1822	0.9041	0.9509
No log	1.0	34	0.8479	0.1373	0.8479	0.9208
No log	1.0588	36	0.9137	0.1501	0.9137	0.9559
No log	1.1176	38	1.2658	0.0688	1.2658	1.1251
No log	1.1765	40	1.3941	-0.0102	1.3941	1.1807
No log	1.2353	42	1.0966	0.1599	1.0966	1.0472
No log	1.2941	44	0.7795	0.1416	0.7795	0.8829
No log	1.3529	46	0.7401	0.2319	0.7401	0.8603
No log	1.4118	48	0.7150	0.3197	0.7150	0.8456
No log	1.4706	50	0.7576	0.1815	0.7576	0.8704
No log	1.5294	52	0.7473	0.2227	0.7473	0.8645
No log	1.5882	54	0.7126	0.2857	0.7126	0.8442
No log	1.6471	56	0.7179	0.2857	0.7179	0.8473
No log	1.7059	58	0.7864	0.2012	0.7864	0.8868
No log	1.7647	60	0.9939	0.2363	0.9939	0.9970
No log	1.8235	62	1.0253	0.1827	1.0253	1.0126
No log	1.8824	64	0.7689	0.3519	0.7689	0.8769
No log	1.9412	66	0.6555	0.4308	0.6555	0.8097
No log	2.0	68	0.6892	0.4283	0.6892	0.8302
No log	2.0588	70	0.6777	0.4234	0.6777	0.8232
No log	2.1176	72	0.5715	0.4265	0.5715	0.7560
No log	2.1765	74	0.7043	0.4404	0.7043	0.8392
No log	2.2353	76	0.7034	0.4328	0.7034	0.8387
No log	2.2941	78	0.5727	0.4808	0.5727	0.7568
No log	2.3529	80	0.6822	0.2853	0.6822	0.8259
No log	2.4118	82	0.6656	0.2886	0.6656	0.8158
No log	2.4706	84	0.5700	0.4019	0.5700	0.7550
No log	2.5294	86	0.6587	0.4576	0.6587	0.8116
No log	2.5882	88	0.7495	0.3822	0.7495	0.8658
No log	2.6471	90	0.6609	0.4576	0.6609	0.8130
No log	2.7059	92	0.5779	0.4701	0.5779	0.7602
No log	2.7647	94	0.6975	0.3402	0.6975	0.8351
No log	2.8235	96	0.7107	0.3941	0.7107	0.8430
No log	2.8824	98	0.6058	0.4972	0.6058	0.7783
No log	2.9412	100	0.6761	0.4409	0.6761	0.8223
No log	3.0	102	0.8333	0.4255	0.8333	0.9129
No log	3.0588	104	0.7381	0.4409	0.7381	0.8591
No log	3.1176	106	0.6812	0.4167	0.6812	0.8253
No log	3.1765	108	0.6351	0.4617	0.6351	0.7969
No log	3.2353	110	0.6972	0.5200	0.6972	0.8350
No log	3.2941	112	0.8106	0.4724	0.8106	0.9003
No log	3.3529	114	0.8025	0.4596	0.8025	0.8958
No log	3.4118	116	0.7718	0.3760	0.7718	0.8785
No log	3.4706	118	0.7436	0.3710	0.7436	0.8623
No log	3.5294	120	0.7155	0.4036	0.7155	0.8458
No log	3.5882	122	0.6147	0.4516	0.6147	0.7840
No log	3.6471	124	0.6805	0.4373	0.6805	0.8249
No log	3.7059	126	0.6564	0.4373	0.6564	0.8102
No log	3.7647	128	0.6117	0.4398	0.6117	0.7821
No log	3.8235	130	0.7010	0.4335	0.7010	0.8372
No log	3.8824	132	0.7199	0.3976	0.7199	0.8485
No log	3.9412	134	0.6022	0.4753	0.6022	0.7760
No log	4.0	136	0.6192	0.4783	0.6192	0.7869
No log	4.0588	138	0.6277	0.4800	0.6277	0.7923
No log	4.1176	140	0.6009	0.4824	0.6009	0.7752
No log	4.1765	142	0.6273	0.4315	0.6273	0.7920
No log	4.2353	144	0.6566	0.5235	0.6566	0.8103
No log	4.2941	146	0.6621	0.5355	0.6621	0.8137
No log	4.3529	148	0.6602	0.5103	0.6602	0.8125
No log	4.4118	150	0.6367	0.5070	0.6367	0.7979
No log	4.4706	152	0.5829	0.4806	0.5829	0.7635
No log	4.5294	154	0.5611	0.4444	0.5611	0.7491
No log	4.5882	156	0.5573	0.4681	0.5573	0.7465
No log	4.6471	158	0.5586	0.4419	0.5586	0.7474
No log	4.7059	160	0.5702	0.4206	0.5702	0.7551
No log	4.7647	162	0.5815	0.4206	0.5815	0.7626
No log	4.8235	164	0.5932	0.4459	0.5932	0.7702
No log	4.8824	166	0.6113	0.4100	0.6113	0.7819
No log	4.9412	168	0.6897	0.4582	0.6897	0.8305
No log	5.0	170	0.6731	0.4602	0.6731	0.8204
No log	5.0588	172	0.6248	0.4721	0.6248	0.7905
No log	5.1176	174	0.6367	0.4721	0.6367	0.7979
No log	5.1765	176	0.6103	0.4724	0.6103	0.7812
No log	5.2353	178	0.5877	0.4493	0.5877	0.7666
No log	5.2941	180	0.5842	0.4493	0.5842	0.7643
No log	5.3529	182	0.5684	0.4828	0.5684	0.7539
No log	5.4118	184	0.5709	0.4234	0.5709	0.7556
No log	5.4706	186	0.5671	0.4234	0.5671	0.7531
No log	5.5294	188	0.5976	0.3918	0.5976	0.7730
No log	5.5882	190	0.5821	0.4190	0.5821	0.7630
No log	5.6471	192	0.6081	0.4190	0.6081	0.7798
No log	5.7059	194	0.5860	0.4081	0.5860	0.7655
No log	5.7647	196	0.5656	0.5725	0.5656	0.7520
No log	5.8235	198	0.6277	0.5471	0.6277	0.7923
No log	5.8824	200	0.6143	0.5471	0.6143	0.7837
No log	5.9412	202	0.5668	0.5434	0.5668	0.7529
No log	6.0	204	0.7552	0.4933	0.7552	0.8690
No log	6.0588	206	0.8146	0.4275	0.8146	0.9025
No log	6.1176	208	0.6215	0.4007	0.6215	0.7883
No log	6.1765	210	0.5865	0.5246	0.5865	0.7658
No log	6.2353	212	0.6045	0.3315	0.6045	0.7775
No log	6.2941	214	0.5711	0.5114	0.5711	0.7557
No log	6.3529	216	0.5512	0.4493	0.5512	0.7425
No log	6.4118	218	0.5240	0.5488	0.5240	0.7239
No log	6.4706	220	0.5631	0.5621	0.5631	0.7504
No log	6.5294	222	0.5587	0.5268	0.5587	0.7474
No log	6.5882	224	0.5230	0.5604	0.5230	0.7232
No log	6.6471	226	0.5382	0.5725	0.5382	0.7337
No log	6.7059	228	0.5779	0.5317	0.5779	0.7602
No log	6.7647	230	0.5754	0.5389	0.5754	0.7585
No log	6.8235	232	0.5850	0.4504	0.5850	0.7649
No log	6.8824	234	0.5898	0.4542	0.5898	0.7680
No log	6.9412	236	0.5546	0.5444	0.5546	0.7447
No log	7.0	238	0.6241	0.4290	0.6241	0.7900
No log	7.0588	240	0.7051	0.4511	0.7051	0.8397
No log	7.1176	242	0.6586	0.4396	0.6586	0.8115
No log	7.1765	244	0.6029	0.4789	0.6029	0.7764
No log	7.2353	246	0.5492	0.4984	0.5492	0.7410
No log	7.2941	248	0.5627	0.5104	0.5627	0.7501
No log	7.3529	250	0.5555	0.5159	0.5555	0.7453
No log	7.4118	252	0.6396	0.4616	0.6396	0.7998
No log	7.4706	254	0.7488	0.4051	0.7488	0.8653
No log	7.5294	256	0.6821	0.4670	0.6821	0.8259
No log	7.5882	258	0.5864	0.5662	0.5864	0.7658
No log	7.6471	260	0.6533	0.4165	0.6533	0.8083
No log	7.7059	262	0.6682	0.3844	0.6682	0.8174
No log	7.7647	264	0.6056	0.4948	0.6056	0.7782
No log	7.8235	266	0.6621	0.4923	0.6621	0.8137
No log	7.8824	268	0.7144	0.4470	0.7144	0.8452
No log	7.9412	270	0.6507	0.4655	0.6507	0.8067
No log	8.0	272	0.5948	0.5101	0.5948	0.7713
No log	8.0588	274	0.5880	0.5647	0.5880	0.7668
No log	8.1176	276	0.5890	0.5101	0.5890	0.7675
No log	8.1765	278	0.6006	0.4599	0.6006	0.7750
No log	8.2353	280	0.6116	0.4806	0.6116	0.7821
No log	8.2941	282	0.5982	0.4719	0.5982	0.7734
No log	8.3529	284	0.6159	0.5016	0.6159	0.7848
No log	8.4118	286	0.6210	0.4769	0.6210	0.7880
No log	8.4706	288	0.6264	0.4769	0.6264	0.7914
No log	8.5294	290	0.6102	0.4639	0.6102	0.7812
No log	8.5882	292	0.6067	0.5195	0.6067	0.7789
No log	8.6471	294	0.6359	0.5016	0.6359	0.7974
No log	8.7059	296	0.6722	0.5140	0.6722	0.8199
No log	8.7647	298	0.6397	0.5601	0.6397	0.7998
No log	8.8235	300	0.6102	0.4692	0.6102	0.7812
No log	8.8824	302	0.6153	0.4997	0.6153	0.7844
No log	8.9412	304	0.5803	0.4841	0.5803	0.7618
No log	9.0	306	0.5496	0.5550	0.5496	0.7414
No log	9.0588	308	0.5608	0.5086	0.5608	0.7489
No log	9.1176	310	0.5463	0.5533	0.5463	0.7391
No log	9.1765	312	0.5425	0.5092	0.5425	0.7365
No log	9.2353	314	0.6034	0.4463	0.6034	0.7768
No log	9.2941	316	0.6257	0.4765	0.6257	0.7910
No log	9.3529	318	0.5910	0.4463	0.5910	0.7688
No log	9.4118	320	0.5300	0.5538	0.5300	0.7280
No log	9.4706	322	0.5202	0.5784	0.5202	0.7213
No log	9.5294	324	0.5299	0.5549	0.5299	0.7280
No log	9.5882	326	0.5406	0.5509	0.5406	0.7352
No log	9.6471	328	0.5468	0.5442	0.5468	0.7394
No log	9.7059	330	0.5362	0.5854	0.5362	0.7323
No log	9.7647	332	0.5350	0.6241	0.5350	0.7314
No log	9.8235	334	0.5403	0.6018	0.5403	0.7351
No log	9.8824	336	0.5559	0.5166	0.5559	0.7456
No log	9.9412	338	0.5251	0.5533	0.5251	0.7246
No log	10.0	340	0.5269	0.6027	0.5269	0.7259
No log	10.0588	342	0.5227	0.6014	0.5227	0.7230
No log	10.1176	344	0.5246	0.5609	0.5246	0.7243
No log	10.1765	346	0.5488	0.5237	0.5488	0.7408
No log	10.2353	348	0.5452	0.5237	0.5452	0.7384
No log	10.2941	350	0.5147	0.5455	0.5147	0.7174
No log	10.3529	352	0.5180	0.5846	0.5180	0.7198
No log	10.4118	354	0.5196	0.5768	0.5196	0.7208
No log	10.4706	356	0.5248	0.5379	0.5248	0.7244
No log	10.5294	358	0.5216	0.5687	0.5216	0.7222
No log	10.5882	360	0.5128	0.5550	0.5128	0.7161
No log	10.6471	362	0.5222	0.5289	0.5222	0.7226
No log	10.7059	364	0.5082	0.5533	0.5082	0.7128
No log	10.7647	366	0.4940	0.5692	0.4940	0.7029
No log	10.8235	368	0.4969	0.6411	0.4969	0.7049
No log	10.8824	370	0.5068	0.6411	0.5068	0.7119
No log	10.9412	372	0.5020	0.6411	0.5020	0.7085
No log	11.0	374	0.4793	0.5692	0.4793	0.6923
No log	11.0588	376	0.4844	0.5455	0.4844	0.6960
No log	11.1176	378	0.5079	0.5104	0.5079	0.7127
No log	11.1765	380	0.4977	0.5379	0.4977	0.7055
No log	11.2353	382	0.5364	0.5368	0.5364	0.7324
No log	11.2941	384	0.5911	0.4562	0.5911	0.7688
No log	11.3529	386	0.5553	0.5061	0.5553	0.7452
No log	11.4118	388	0.5254	0.4945	0.5254	0.7249
No log	11.4706	390	0.5267	0.4945	0.5267	0.7258
No log	11.5294	392	0.5219	0.5421	0.5219	0.7224
No log	11.5882	394	0.5232	0.5625	0.5232	0.7233
No log	11.6471	396	0.5234	0.5492	0.5234	0.7235
No log	11.7059	398	0.5220	0.5797	0.5220	0.7225
No log	11.7647	400	0.5232	0.5092	0.5232	0.7233
No log	11.8235	402	0.5187	0.4923	0.5187	0.7202
No log	11.8824	404	0.5185	0.4945	0.5185	0.7201
No log	11.9412	406	0.5663	0.4835	0.5663	0.7525
No log	12.0	408	0.6243	0.4749	0.6243	0.7901
No log	12.0588	410	0.6691	0.4898	0.6691	0.8180
No log	12.1176	412	0.6179	0.4835	0.6179	0.7861
No log	12.1765	414	0.5204	0.5111	0.5204	0.7214
No log	12.2353	416	0.5279	0.4809	0.5279	0.7266
No log	12.2941	418	0.5663	0.3857	0.5663	0.7525
No log	12.3529	420	0.5545	0.3974	0.5545	0.7446
No log	12.4118	422	0.5514	0.4173	0.5514	0.7426
No log	12.4706	424	0.5780	0.5111	0.5780	0.7603
No log	12.5294	426	0.5882	0.5111	0.5882	0.7669
No log	12.5882	428	0.5541	0.4707	0.5541	0.7444
No log	12.6471	430	0.5405	0.4240	0.5405	0.7352
No log	12.7059	432	0.5698	0.4895	0.5698	0.7549
No log	12.7647	434	0.5587	0.4960	0.5587	0.7474
No log	12.8235	436	0.5340	0.4742	0.5340	0.7307
No log	12.8824	438	0.5518	0.5307	0.5518	0.7428
No log	12.9412	440	0.5635	0.5367	0.5635	0.7507
No log	13.0	442	0.5981	0.4542	0.5981	0.7734
No log	13.0588	444	0.5830	0.4769	0.5830	0.7636
No log	13.1176	446	0.5403	0.4027	0.5403	0.7350
No log	13.1765	448	0.5262	0.3481	0.5262	0.7254
No log	13.2353	450	0.5305	0.3916	0.5305	0.7283
No log	13.2941	452	0.5287	0.3916	0.5287	0.7271
No log	13.3529	454	0.5289	0.4276	0.5289	0.7272
No log	13.4118	456	0.5382	0.4742	0.5382	0.7336
No log	13.4706	458	0.5469	0.4678	0.5469	0.7396
No log	13.5294	460	0.5502	0.4555	0.5502	0.7417
No log	13.5882	462	0.5458	0.4308	0.5458	0.7388
No log	13.6471	464	0.5381	0.5095	0.5381	0.7336
No log	13.7059	466	0.5456	0.4569	0.5456	0.7387
No log	13.7647	468	0.5683	0.4375	0.5683	0.7539
No log	13.8235	470	0.5899	0.4375	0.5899	0.7680
No log	13.8824	472	0.6226	0.4352	0.6226	0.7890
No log	13.9412	474	0.6872	0.4491	0.6872	0.8290
No log	14.0	476	0.7285	0.4409	0.7285	0.8535
No log	14.0588	478	0.7003	0.4409	0.7003	0.8369
No log	14.1176	480	0.6062	0.4352	0.6062	0.7786
No log	14.1765	482	0.5377	0.4463	0.5377	0.7333
No log	14.2353	484	0.5802	0.4789	0.5802	0.7617
No log	14.2941	486	0.6503	0.5065	0.6503	0.8064
No log	14.3529	488	0.6258	0.4986	0.6258	0.7910
No log	14.4118	490	0.5400	0.4980	0.5400	0.7348
No log	14.4706	492	0.5172	0.5344	0.5172	0.7192
No log	14.5294	494	0.5246	0.4984	0.5246	0.7243
No log	14.5882	496	0.5216	0.5648	0.5216	0.7222
No log	14.6471	498	0.5310	0.5452	0.5310	0.7287
0.2827	14.7059	500	0.5502	0.4770	0.5502	0.7418
0.2827	14.7647	502	0.5657	0.4556	0.5657	0.7522
0.2827	14.8235	504	0.5492	0.4980	0.5492	0.7411
0.2827	14.8824	506	0.5394	0.4878	0.5394	0.7344
0.2827	14.9412	508	0.5422	0.4052	0.5422	0.7363
0.2827	15.0	510	0.5481	0.4569	0.5481	0.7404
0.2827	15.0588	512	0.5505	0.4569	0.5505	0.7420
0.2827	15.1176	514	0.5426	0.4617	0.5426	0.7366
0.2827	15.1765	516	0.5327	0.5368	0.5327	0.7299
0.2827	15.2353	518	0.5332	0.4910	0.5332	0.7302
0.2827	15.2941	520	0.5502	0.5337	0.5502	0.7418
0.2827	15.3529	522	0.5287	0.5323	0.5287	0.7271
0.2827	15.4118	524	0.5024	0.5323	0.5024	0.7088
0.2827	15.4706	526	0.4947	0.5396	0.4947	0.7034
0.2827	15.5294	528	0.4802	0.5549	0.4802	0.6930
0.2827	15.5882	530	0.4727	0.5549	0.4727	0.6876
0.2827	15.6471	532	0.4666	0.5549	0.4666	0.6831
0.2827	15.7059	534	0.4632	0.6364	0.4632	0.6806
0.2827	15.7647	536	0.4616	0.6389	0.4616	0.6794
0.2827	15.8235	538	0.4702	0.6305	0.4702	0.6857
0.2827	15.8824	540	0.4566	0.6477	0.4566	0.6758
0.2827	15.9412	542	0.4555	0.5472	0.4555	0.6749
0.2827	16.0	544	0.5114	0.4808	0.5114	0.7151
0.2827	16.0588	546	0.5016	0.5053	0.5016	0.7082
0.2827	16.1176	548	0.4716	0.6105	0.4716	0.6867
0.2827	16.1765	550	0.4762	0.6053	0.4762	0.6901
0.2827	16.2353	552	0.4744	0.5929	0.4744	0.6888
0.2827	16.2941	554	0.4833	0.5625	0.4833	0.6952
0.2827	16.3529	556	0.5610	0.4684	0.5610	0.7490
0.2827	16.4118	558	0.6514	0.5763	0.6514	0.8071
0.2827	16.4706	560	0.6615	0.5956	0.6615	0.8133
0.2827	16.5294	562	0.5839	0.4513	0.5839	0.7641
0.2827	16.5882	564	0.4968	0.4867	0.4968	0.7049
0.2827	16.6471	566	0.4703	0.4701	0.4703	0.6858
0.2827	16.7059	568	0.4675	0.5195	0.4675	0.6837
0.2827	16.7647	570	0.4636	0.5195	0.4636	0.6809
0.2827	16.8235	572	0.4638	0.4914	0.4638	0.6810
0.2827	16.8824	574	0.4945	0.4352	0.4945	0.7032
0.2827	16.9412	576	0.5555	0.5418	0.5555	0.7453
0.2827	17.0	578	0.6679	0.4991	0.6679	0.8173
0.2827	17.0588	580	0.7177	0.4764	0.7177	0.8472
0.2827	17.1176	582	0.6151	0.5449	0.6151	0.7843
0.2827	17.1765	584	0.4921	0.4393	0.4921	0.7015
0.2827	17.2353	586	0.4797	0.5722	0.4797	0.6926
0.2827	17.2941	588	0.5653	0.5268	0.5653	0.7519
0.2827	17.3529	590	0.5905	0.4744	0.5905	0.7684
0.2827	17.4118	592	0.5469	0.5184	0.5469	0.7396
0.2827	17.4706	594	0.5062	0.5522	0.5062	0.7115
0.2827	17.5294	596	0.5292	0.3840	0.5292	0.7275
0.2827	17.5882	598	0.5584	0.4597	0.5584	0.7472
0.2827	17.6471	600	0.5542	0.3840	0.5542	0.7444
0.2827	17.7059	602	0.5379	0.3788	0.5379	0.7334
0.2827	17.7647	604	0.5408	0.3788	0.5408	0.7354

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1