ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5468
• Qwk: 0.6350
• Mse: 0.5468
• Rmse: 0.7394

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	3.9977	-0.0151	3.9977	1.9994
No log	0.1176	4	2.1675	-0.0525	2.1675	1.4722
No log	0.1765	6	1.7576	-0.0595	1.7576	1.3257
No log	0.2353	8	1.4616	0.0056	1.4616	1.2090
No log	0.2941	10	1.2390	0.0496	1.2390	1.1131
No log	0.3529	12	1.1145	0.1549	1.1145	1.0557
No log	0.4118	14	1.0946	0.2441	1.0946	1.0462
No log	0.4706	16	1.1252	0.2441	1.1252	1.0608
No log	0.5294	18	1.0632	0.1799	1.0632	1.0311
No log	0.5882	20	1.0605	0.1771	1.0605	1.0298
No log	0.6471	22	1.0797	0.0919	1.0797	1.0391
No log	0.7059	24	1.0853	0.0385	1.0853	1.0418
No log	0.7647	26	1.0887	0.2391	1.0887	1.0434
No log	0.8235	28	1.0628	0.2643	1.0628	1.0309
No log	0.8824	30	1.0715	0.1330	1.0715	1.0352
No log	0.9412	32	1.1402	0.0762	1.1402	1.0678
No log	1.0	34	1.1104	0.1203	1.1104	1.0537
No log	1.0588	36	1.0230	0.1389	1.0230	1.0114
No log	1.1176	38	0.9922	0.2291	0.9922	0.9961
No log	1.1765	40	1.0692	0.3003	1.0692	1.0340
No log	1.2353	42	1.1217	0.2880	1.1217	1.0591
No log	1.2941	44	1.0542	0.3229	1.0542	1.0267
No log	1.3529	46	0.9995	0.2716	0.9995	0.9997
No log	1.4118	48	1.0600	0.1196	1.0600	1.0296
No log	1.4706	50	1.0961	0.0981	1.0961	1.0469
No log	1.5294	52	1.0568	0.1076	1.0568	1.0280
No log	1.5882	54	0.9990	0.1545	0.9990	0.9995
No log	1.6471	56	0.9550	0.3393	0.9550	0.9772
No log	1.7059	58	1.0176	0.2842	1.0176	1.0088
No log	1.7647	60	1.0994	0.2142	1.0994	1.0485
No log	1.8235	62	1.2389	0.1281	1.2389	1.1130
No log	1.8824	64	1.3146	0.1281	1.3146	1.1466
No log	1.9412	66	1.1951	0.1968	1.1951	1.0932
No log	2.0	68	1.2402	0.1807	1.2402	1.1136
No log	2.0588	70	1.2306	0.2668	1.2306	1.1093
No log	2.1176	72	1.0800	0.3505	1.0800	1.0392
No log	2.1765	74	1.0698	0.2607	1.0698	1.0343
No log	2.2353	76	1.0569	0.2607	1.0569	1.0281
No log	2.2941	78	1.0392	0.3209	1.0392	1.0194
No log	2.3529	80	1.0204	0.3435	1.0204	1.0101
No log	2.4118	82	1.0335	0.2584	1.0335	1.0166
No log	2.4706	84	0.9953	0.3819	0.9953	0.9976
No log	2.5294	86	0.9628	0.3819	0.9628	0.9812
No log	2.5882	88	0.9194	0.3819	0.9194	0.9589
No log	2.6471	90	0.9119	0.4329	0.9119	0.9550
No log	2.7059	92	0.9085	0.4482	0.9085	0.9532
No log	2.7647	94	0.8566	0.5069	0.8566	0.9255
No log	2.8235	96	1.0294	0.4628	1.0294	1.0146
No log	2.8824	98	1.0833	0.4294	1.0833	1.0408
No log	2.9412	100	1.0096	0.4854	1.0096	1.0048
No log	3.0	102	0.7341	0.5388	0.7341	0.8568
No log	3.0588	104	0.7417	0.4456	0.7417	0.8612
No log	3.1176	106	0.7003	0.4610	0.7003	0.8369
No log	3.1765	108	0.6943	0.4862	0.6943	0.8333
No log	3.2353	110	0.6599	0.5509	0.6599	0.8123
No log	3.2941	112	0.6283	0.5640	0.6283	0.7926
No log	3.3529	114	0.6639	0.5425	0.6639	0.8148
No log	3.4118	116	0.6473	0.5185	0.6473	0.8046
No log	3.4706	118	0.5979	0.6475	0.5979	0.7732
No log	3.5294	120	0.6072	0.6349	0.6072	0.7792
No log	3.5882	122	0.6172	0.5426	0.6172	0.7856
No log	3.6471	124	0.6672	0.4554	0.6672	0.8169
No log	3.7059	126	0.6796	0.4427	0.6796	0.8244
No log	3.7647	128	0.6640	0.5063	0.6640	0.8149
No log	3.8235	130	0.6754	0.5542	0.6754	0.8218
No log	3.8824	132	0.7183	0.5516	0.7183	0.8475
No log	3.9412	134	0.9324	0.5082	0.9324	0.9656
No log	4.0	136	0.8614	0.4794	0.8614	0.9281
No log	4.0588	138	0.6888	0.5808	0.6888	0.8300
No log	4.1176	140	0.7215	0.5603	0.7215	0.8494
No log	4.1765	142	0.6868	0.5618	0.6868	0.8287
No log	4.2353	144	0.6925	0.5113	0.6925	0.8321
No log	4.2941	146	0.7481	0.4958	0.7481	0.8649
No log	4.3529	148	0.8993	0.4666	0.8993	0.9483
No log	4.4118	150	0.8583	0.3884	0.8583	0.9264
No log	4.4706	152	0.7721	0.4041	0.7721	0.8787
No log	4.5294	154	0.7865	0.4546	0.7865	0.8868
No log	4.5882	156	0.7236	0.4730	0.7236	0.8506
No log	4.6471	158	0.7058	0.5033	0.7058	0.8401
No log	4.7059	160	0.7070	0.5273	0.7070	0.8408
No log	4.7647	162	0.7066	0.5131	0.7066	0.8406
No log	4.8235	164	0.7405	0.5442	0.7405	0.8605
No log	4.8824	166	0.7724	0.5385	0.7724	0.8789
No log	4.9412	168	0.6995	0.5698	0.6995	0.8364
No log	5.0	170	0.6567	0.5370	0.6567	0.8104
No log	5.0588	172	0.6471	0.5160	0.6471	0.8044
No log	5.1176	174	0.6599	0.5517	0.6599	0.8124
No log	5.1765	176	0.6646	0.5517	0.6646	0.8152
No log	5.2353	178	0.6711	0.5703	0.6711	0.8192
No log	5.2941	180	0.6730	0.5599	0.6730	0.8204
No log	5.3529	182	0.6958	0.5934	0.6958	0.8342
No log	5.4118	184	0.8011	0.5770	0.8011	0.8950
No log	5.4706	186	0.6726	0.5830	0.6726	0.8201
No log	5.5294	188	0.6598	0.5830	0.6598	0.8123
No log	5.5882	190	0.8678	0.4851	0.8678	0.9315
No log	5.6471	192	0.9896	0.4779	0.9896	0.9948
No log	5.7059	194	1.0835	0.4503	1.0835	1.0409
No log	5.7647	196	0.7959	0.4926	0.7959	0.8921
No log	5.8235	198	0.6338	0.5978	0.6338	0.7961
No log	5.8824	200	0.7152	0.5292	0.7152	0.8457
No log	5.9412	202	0.6613	0.5686	0.6613	0.8132
No log	6.0	204	0.6294	0.5359	0.6294	0.7934
No log	6.0588	206	0.6300	0.5585	0.6300	0.7937
No log	6.1176	208	0.6180	0.5590	0.6180	0.7862
No log	6.1765	210	0.6096	0.5735	0.6096	0.7808
No log	6.2353	212	0.6554	0.6090	0.6554	0.8096
No log	6.2941	214	0.6775	0.5953	0.6775	0.8231
No log	6.3529	216	0.7197	0.6622	0.7197	0.8484
No log	6.4118	218	0.6682	0.6249	0.6682	0.8174
No log	6.4706	220	0.6665	0.5919	0.6665	0.8164
No log	6.5294	222	1.0957	0.4485	1.0957	1.0467
No log	6.5882	224	1.1530	0.3640	1.1530	1.0738
No log	6.6471	226	0.8204	0.5690	0.8204	0.9057
No log	6.7059	228	0.6305	0.5939	0.6305	0.7941
No log	6.7647	230	0.6533	0.6370	0.6533	0.8083
No log	6.8235	232	0.7340	0.5810	0.7340	0.8567
No log	6.8824	234	0.7543	0.5598	0.7543	0.8685
No log	6.9412	236	0.7082	0.4697	0.7082	0.8416
No log	7.0	238	0.6334	0.5759	0.6334	0.7959
No log	7.0588	240	0.6319	0.5747	0.6319	0.7949
No log	7.1176	242	0.6376	0.5759	0.6376	0.7985
No log	7.1765	244	0.6760	0.5363	0.6760	0.8222
No log	7.2353	246	0.7310	0.4439	0.7310	0.8550
No log	7.2941	248	0.7610	0.3921	0.7610	0.8723
No log	7.3529	250	0.8707	0.4065	0.8707	0.9331
No log	7.4118	252	0.8781	0.3810	0.8781	0.9371
No log	7.4706	254	0.7524	0.4439	0.7524	0.8674
No log	7.5294	256	0.6873	0.5274	0.6873	0.8290
No log	7.5882	258	0.7044	0.5747	0.7044	0.8393
No log	7.6471	260	0.6926	0.5747	0.6926	0.8322
No log	7.7059	262	0.6814	0.5377	0.6814	0.8255
No log	7.7647	264	0.7823	0.5403	0.7823	0.8845
No log	7.8235	266	0.8164	0.5240	0.8164	0.9036
No log	7.8824	268	0.7335	0.5433	0.7335	0.8565
No log	7.9412	270	0.6483	0.5025	0.6483	0.8052
No log	8.0	272	0.6900	0.5542	0.6900	0.8307
No log	8.0588	274	0.7550	0.5884	0.7550	0.8689
No log	8.1176	276	0.7193	0.5656	0.7193	0.8481
No log	8.1765	278	0.6324	0.5856	0.6324	0.7952
No log	8.2353	280	0.6373	0.5822	0.6373	0.7983
No log	8.2941	282	0.7074	0.5964	0.7074	0.8411
No log	8.3529	284	0.7230	0.4568	0.7230	0.8503
No log	8.4118	286	0.6474	0.5835	0.6474	0.8046
No log	8.4706	288	0.6365	0.5823	0.6365	0.7978
No log	8.5294	290	0.6209	0.5926	0.6209	0.7880
No log	8.5882	292	0.6160	0.5710	0.6160	0.7849
No log	8.6471	294	0.7296	0.5994	0.7296	0.8541
No log	8.7059	296	0.8302	0.5196	0.8302	0.9112
No log	8.7647	298	0.8078	0.6151	0.8078	0.8988
No log	8.8235	300	0.6732	0.6319	0.6732	0.8205
No log	8.8824	302	0.6174	0.6589	0.6174	0.7857
No log	8.9412	304	0.6309	0.5695	0.6309	0.7943
No log	9.0	306	0.6125	0.6649	0.6125	0.7826
No log	9.0588	308	0.6617	0.6137	0.6617	0.8134
No log	9.1176	310	0.7144	0.6278	0.7144	0.8452
No log	9.1765	312	0.7140	0.5387	0.7140	0.8450
No log	9.2353	314	0.6669	0.4713	0.6669	0.8167
No log	9.2941	316	0.6438	0.5490	0.6438	0.8024
No log	9.3529	318	0.6367	0.5835	0.6367	0.7979
No log	9.4118	320	0.6701	0.5833	0.6701	0.8186
No log	9.4706	322	0.6805	0.5833	0.6805	0.8250
No log	9.5294	324	0.6407	0.6360	0.6407	0.8004
No log	9.5882	326	0.6270	0.5932	0.6270	0.7918
No log	9.6471	328	0.6260	0.5960	0.6260	0.7912
No log	9.7059	330	0.6118	0.5960	0.6118	0.7822
No log	9.7647	332	0.5976	0.5972	0.5976	0.7731
No log	9.8235	334	0.5879	0.5747	0.5879	0.7667
No log	9.8824	336	0.5782	0.5747	0.5782	0.7604
No log	9.9412	338	0.5794	0.6067	0.5794	0.7612
No log	10.0	340	0.5699	0.5747	0.5699	0.7549
No log	10.0588	342	0.5894	0.5921	0.5894	0.7678
No log	10.1176	344	0.6293	0.6491	0.6293	0.7933
No log	10.1765	346	0.6408	0.6377	0.6408	0.8005
No log	10.2353	348	0.5922	0.6500	0.5922	0.7696
No log	10.2941	350	0.5710	0.5847	0.5710	0.7556
No log	10.3529	352	0.5898	0.6043	0.5898	0.7680
No log	10.4118	354	0.6641	0.5822	0.6641	0.8150
No log	10.4706	356	0.6449	0.5622	0.6449	0.8031
No log	10.5294	358	0.5935	0.5989	0.5935	0.7704
No log	10.5882	360	0.6139	0.5806	0.6139	0.7835
No log	10.6471	362	0.6313	0.5794	0.6313	0.7945
No log	10.7059	364	0.6024	0.5794	0.6024	0.7761
No log	10.7647	366	0.5709	0.5950	0.5709	0.7556
No log	10.8235	368	0.5869	0.6588	0.5869	0.7661
No log	10.8824	370	0.5859	0.6175	0.5859	0.7655
No log	10.9412	372	0.5841	0.5934	0.5841	0.7642
No log	11.0	374	0.6391	0.6089	0.6391	0.7995
No log	11.0588	376	0.6674	0.5828	0.6674	0.8170
No log	11.1176	378	0.6391	0.5830	0.6391	0.7995
No log	11.1765	380	0.6117	0.6011	0.6117	0.7821
No log	11.2353	382	0.6073	0.5808	0.6073	0.7793
No log	11.2941	384	0.6018	0.5594	0.6018	0.7758
No log	11.3529	386	0.6025	0.5602	0.6025	0.7762
No log	11.4118	388	0.5968	0.5923	0.5968	0.7725
No log	11.4706	390	0.5911	0.5819	0.5911	0.7689
No log	11.5294	392	0.5840	0.5819	0.5840	0.7642
No log	11.5882	394	0.5948	0.6022	0.5948	0.7712
No log	11.6471	396	0.5965	0.6022	0.5965	0.7723
No log	11.7059	398	0.6086	0.5726	0.6086	0.7801
No log	11.7647	400	0.5932	0.5843	0.5932	0.7702
No log	11.8235	402	0.5802	0.5939	0.5802	0.7617
No log	11.8824	404	0.5914	0.5921	0.5914	0.7690
No log	11.9412	406	0.5851	0.5921	0.5851	0.7649
No log	12.0	408	0.5825	0.5856	0.5825	0.7632
No log	12.0588	410	0.5905	0.5747	0.5905	0.7684
No log	12.1176	412	0.6008	0.5638	0.6008	0.7751
No log	12.1765	414	0.5969	0.6022	0.5969	0.7726
No log	12.2353	416	0.6003	0.6124	0.6003	0.7748
No log	12.2941	418	0.5980	0.5808	0.5980	0.7733
No log	12.3529	420	0.5967	0.5724	0.5967	0.7725
No log	12.4118	422	0.5976	0.5480	0.5976	0.7731
No log	12.4706	424	0.6069	0.5516	0.6069	0.7790
No log	12.5294	426	0.6204	0.5288	0.6204	0.7877
No log	12.5882	428	0.6312	0.5542	0.6312	0.7945
No log	12.6471	430	0.6385	0.5523	0.6385	0.7990
No log	12.7059	432	0.6556	0.5647	0.6556	0.8097
No log	12.7647	434	0.6393	0.5149	0.6393	0.7995
No log	12.8235	436	0.6439	0.5811	0.6439	0.8025
No log	12.8824	438	0.6258	0.5797	0.6258	0.7911
No log	12.9412	440	0.6200	0.5505	0.6200	0.7874
No log	13.0	442	0.6863	0.5928	0.6863	0.8284
No log	13.0588	444	0.6707	0.5902	0.6707	0.8190
No log	13.1176	446	0.5984	0.5882	0.5984	0.7736
No log	13.1765	448	0.6062	0.6003	0.6062	0.7786
No log	13.2353	450	0.6772	0.5534	0.6772	0.8229
No log	13.2941	452	0.6797	0.5651	0.6797	0.8245
No log	13.3529	454	0.6410	0.5305	0.6410	0.8006
No log	13.4118	456	0.6042	0.5605	0.6042	0.7773
No log	13.4706	458	0.5897	0.5415	0.5897	0.7679
No log	13.5294	460	0.6123	0.5879	0.6123	0.7825
No log	13.5882	462	0.6069	0.6269	0.6069	0.7791
No log	13.6471	464	0.6061	0.5856	0.6061	0.7785
No log	13.7059	466	0.6099	0.5647	0.6099	0.7810
No log	13.7647	468	0.6421	0.5226	0.6421	0.8013
No log	13.8235	470	0.6526	0.4982	0.6526	0.8078
No log	13.8824	472	0.6371	0.4982	0.6371	0.7982
No log	13.9412	474	0.6284	0.5078	0.6284	0.7927
No log	14.0	476	0.6187	0.5847	0.6187	0.7866
No log	14.0588	478	0.6250	0.6133	0.6250	0.7906
No log	14.1176	480	0.6226	0.5797	0.6226	0.7890
No log	14.1765	482	0.6065	0.5797	0.6065	0.7788
No log	14.2353	484	0.5995	0.6085	0.5995	0.7743
No log	14.2941	486	0.5970	0.6207	0.5970	0.7726
No log	14.3529	488	0.6049	0.6219	0.6049	0.7777
No log	14.4118	490	0.6147	0.6187	0.6147	0.7840
No log	14.4706	492	0.6124	0.6187	0.6124	0.7825
No log	14.5294	494	0.6046	0.6177	0.6046	0.7776
No log	14.5882	496	0.5957	0.6306	0.5957	0.7718
No log	14.6471	498	0.5979	0.6374	0.5979	0.7733
0.2967	14.7059	500	0.6060	0.6555	0.6060	0.7785
0.2967	14.7647	502	0.5933	0.6555	0.5933	0.7703
0.2967	14.8235	504	0.5815	0.6383	0.5815	0.7626
0.2967	14.8824	506	0.5859	0.5759	0.5859	0.7655
0.2967	14.9412	508	0.5721	0.5759	0.5721	0.7564
0.2967	15.0	510	0.5468	0.6350	0.5468	0.7394

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1