ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5840
• Qwk: 0.6240
• Mse: 0.5840
• Rmse: 0.7642

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	4.0880	0.0024	4.0880	2.0219
No log	0.1481	4	2.3282	0.0541	2.3282	1.5258
No log	0.2222	6	2.0560	-0.0450	2.0560	1.4339
No log	0.2963	8	1.4911	0.0294	1.4911	1.2211
No log	0.3704	10	1.1092	0.3003	1.1092	1.0532
No log	0.4444	12	1.0452	0.3625	1.0452	1.0223
No log	0.5185	14	1.0255	0.3521	1.0255	1.0127
No log	0.5926	16	1.0632	0.1764	1.0632	1.0311
No log	0.6667	18	1.1130	0.1764	1.1130	1.0550
No log	0.7407	20	1.0794	0.2981	1.0794	1.0389
No log	0.8148	22	1.0039	0.2108	1.0039	1.0019
No log	0.8889	24	1.0397	0.1516	1.0397	1.0197
No log	0.9630	26	1.0547	0.1137	1.0547	1.0270
No log	1.0370	28	1.2706	0.0814	1.2706	1.1272
No log	1.1111	30	1.3902	0.1487	1.3902	1.1791
No log	1.1852	32	1.0989	0.2441	1.0989	1.0483
No log	1.2593	34	1.0044	0.2265	1.0044	1.0022
No log	1.3333	36	1.1569	0.2293	1.1569	1.0756
No log	1.4074	38	1.3568	-0.0296	1.3568	1.1648
No log	1.4815	40	1.4769	-0.0148	1.4769	1.2153
No log	1.5556	42	1.3959	-0.0148	1.3959	1.1815
No log	1.6296	44	1.3592	0.0	1.3592	1.1658
No log	1.7037	46	1.1966	0.1024	1.1966	1.0939
No log	1.7778	48	1.0175	0.3003	1.0175	1.0087
No log	1.8519	50	0.9568	0.2566	0.9568	0.9782
No log	1.9259	52	0.9354	0.2849	0.9354	0.9672
No log	2.0	54	0.9409	0.1389	0.9409	0.9700
No log	2.0741	56	0.9543	0.1601	0.9543	0.9769
No log	2.1481	58	0.9327	0.2818	0.9327	0.9658
No log	2.2222	60	0.9016	0.4402	0.9016	0.9495
No log	2.2963	62	0.8892	0.4312	0.8892	0.9430
No log	2.3704	64	0.8344	0.4022	0.8344	0.9135
No log	2.4444	66	0.8468	0.3288	0.8468	0.9202
No log	2.5185	68	0.9091	0.2262	0.9091	0.9535
No log	2.5926	70	0.9734	0.1998	0.9734	0.9866
No log	2.6667	72	0.9566	0.1799	0.9566	0.9781
No log	2.7407	74	0.8942	0.3094	0.8942	0.9456
No log	2.8148	76	0.8805	0.4275	0.8805	0.9384
No log	2.8889	78	0.8467	0.4710	0.8467	0.9201
No log	2.9630	80	0.8043	0.4727	0.8043	0.8968
No log	3.0370	82	0.7295	0.4932	0.7295	0.8541
No log	3.1111	84	0.7177	0.5146	0.7177	0.8472
No log	3.1852	86	0.8133	0.3844	0.8133	0.9018
No log	3.2593	88	0.8868	0.4004	0.8868	0.9417
No log	3.3333	90	0.9297	0.2960	0.9297	0.9642
No log	3.4074	92	0.9505	0.3283	0.9505	0.9749
No log	3.4815	94	0.7994	0.4650	0.7994	0.8941
No log	3.5556	96	0.7235	0.5403	0.7235	0.8506
No log	3.6296	98	0.7522	0.5435	0.7522	0.8673
No log	3.7037	100	0.7400	0.5994	0.7400	0.8602
No log	3.7778	102	0.7164	0.6079	0.7164	0.8464
No log	3.8519	104	0.6414	0.6209	0.6414	0.8009
No log	3.9259	106	0.5822	0.6252	0.5822	0.7630
No log	4.0	108	0.5971	0.6032	0.5971	0.7727
No log	4.0741	110	0.7344	0.5916	0.7344	0.8570
No log	4.1481	112	0.8791	0.4681	0.8791	0.9376
No log	4.2222	114	0.8022	0.4902	0.8022	0.8957
No log	4.2963	116	0.6624	0.5923	0.6624	0.8139
No log	4.3704	118	0.5633	0.7049	0.5633	0.7505
No log	4.4444	120	0.5428	0.7018	0.5428	0.7368
No log	4.5185	122	0.5316	0.6931	0.5316	0.7291
No log	4.5926	124	0.5686	0.6324	0.5686	0.7541
No log	4.6667	126	0.5711	0.5840	0.5711	0.7557
No log	4.7407	128	0.5482	0.6301	0.5482	0.7404
No log	4.8148	130	0.5646	0.6634	0.5646	0.7514
No log	4.8889	132	0.5654	0.6419	0.5654	0.7520
No log	4.9630	134	0.5289	0.6324	0.5289	0.7272
No log	5.0370	136	0.7338	0.6539	0.7338	0.8566
No log	5.1111	138	0.7311	0.6539	0.7311	0.8550
No log	5.1852	140	0.5510	0.6324	0.5510	0.7423
No log	5.2593	142	0.6552	0.6080	0.6552	0.8094
No log	5.3333	144	0.6952	0.6275	0.6952	0.8338
No log	5.4074	146	0.5923	0.6215	0.5923	0.7696
No log	5.4815	148	0.6195	0.6314	0.6195	0.7871
No log	5.5556	150	0.6244	0.6700	0.6244	0.7902
No log	5.6296	152	0.5639	0.6796	0.5639	0.7510
No log	5.7037	154	0.5514	0.6690	0.5514	0.7425
No log	5.7778	156	0.5388	0.6164	0.5388	0.7340
No log	5.8519	158	0.5406	0.6455	0.5406	0.7352
No log	5.9259	160	0.6336	0.6160	0.6336	0.7960
No log	6.0	162	0.6442	0.5867	0.6442	0.8026
No log	6.0741	164	0.5525	0.6584	0.5525	0.7433
No log	6.1481	166	0.5500	0.5679	0.5500	0.7416
No log	6.2222	168	0.5491	0.5549	0.5491	0.7410
No log	6.2963	170	0.5427	0.5972	0.5427	0.7367
No log	6.3704	172	0.5573	0.6688	0.5573	0.7465
No log	6.4444	174	0.5321	0.6445	0.5321	0.7294
No log	6.5185	176	0.5078	0.6363	0.5078	0.7126
No log	6.5926	178	0.4864	0.6897	0.4864	0.6974
No log	6.6667	180	0.4975	0.6479	0.4975	0.7053
No log	6.7407	182	0.4970	0.6724	0.4970	0.7050
No log	6.8148	184	0.5176	0.6716	0.5176	0.7194
No log	6.8889	186	0.5581	0.6716	0.5581	0.7470
No log	6.9630	188	0.5332	0.6667	0.5332	0.7302
No log	7.0370	190	0.5906	0.6328	0.5906	0.7685
No log	7.1111	192	0.6818	0.5428	0.6818	0.8257
No log	7.1852	194	0.6710	0.5745	0.6710	0.8191
No log	7.2593	196	0.6045	0.6405	0.6045	0.7775
No log	7.3333	198	0.5832	0.6965	0.5832	0.7637
No log	7.4074	200	0.6029	0.6209	0.6029	0.7765
No log	7.4815	202	0.5794	0.5648	0.5794	0.7612
No log	7.5556	204	0.5597	0.5648	0.5597	0.7481
No log	7.6296	206	0.5553	0.6138	0.5553	0.7452
No log	7.7037	208	0.5312	0.6157	0.5312	0.7288
No log	7.7778	210	0.5198	0.6756	0.5198	0.7210
No log	7.8519	212	0.5204	0.6748	0.5204	0.7214
No log	7.9259	214	0.5258	0.6936	0.5258	0.7251
No log	8.0	216	0.6249	0.6045	0.6249	0.7905
No log	8.0741	218	0.6795	0.6209	0.6795	0.8243
No log	8.1481	220	0.6124	0.6045	0.6124	0.7826
No log	8.2222	222	0.5229	0.6333	0.5229	0.7231
No log	8.2963	224	0.5194	0.7064	0.5194	0.7207
No log	8.3704	226	0.5490	0.6380	0.5490	0.7410
No log	8.4444	228	0.6241	0.6045	0.6241	0.7900
No log	8.5185	230	0.6088	0.6045	0.6088	0.7802
No log	8.5926	232	0.5190	0.7458	0.5190	0.7204
No log	8.6667	234	0.6149	0.5483	0.6149	0.7842
No log	8.7407	236	0.6094	0.5804	0.6094	0.7807
No log	8.8148	238	0.5090	0.7193	0.5090	0.7134
No log	8.8889	240	0.6062	0.6123	0.6062	0.7786
No log	8.9630	242	0.7289	0.5750	0.7289	0.8538
No log	9.0370	244	0.6421	0.5779	0.6421	0.8013
No log	9.1111	246	0.5428	0.6546	0.5428	0.7368
No log	9.1852	248	0.5439	0.6292	0.5439	0.7375
No log	9.2593	250	0.5323	0.6364	0.5323	0.7296
No log	9.3333	252	0.5582	0.6673	0.5582	0.7471
No log	9.4074	254	0.5537	0.6557	0.5537	0.7441
No log	9.4815	256	0.5478	0.6728	0.5478	0.7402
No log	9.5556	258	0.5212	0.6519	0.5212	0.7220
No log	9.6296	260	0.5222	0.6728	0.5222	0.7227
No log	9.7037	262	0.5204	0.6539	0.5204	0.7214
No log	9.7778	264	0.5083	0.6796	0.5083	0.7130
No log	9.8519	266	0.5092	0.6699	0.5092	0.7136
No log	9.9259	268	0.5064	0.6575	0.5064	0.7116
No log	10.0	270	0.5289	0.6841	0.5289	0.7272
No log	10.0741	272	0.5475	0.6687	0.5475	0.7399
No log	10.1481	274	0.5673	0.6502	0.5673	0.7532
No log	10.2222	276	0.5577	0.6664	0.5577	0.7468
No log	10.2963	278	0.5740	0.6519	0.5740	0.7576
No log	10.3704	280	0.5966	0.5809	0.5966	0.7724
No log	10.4444	282	0.5761	0.6167	0.5761	0.7590
No log	10.5185	284	0.5764	0.6507	0.5764	0.7592
No log	10.5926	286	0.6070	0.5402	0.6070	0.7791
No log	10.6667	288	0.6285	0.5837	0.6285	0.7928
No log	10.7407	290	0.6892	0.5036	0.6892	0.8302
No log	10.8148	292	0.6835	0.5515	0.6835	0.8267
No log	10.8889	294	0.6433	0.5786	0.6433	0.8021
No log	10.9630	296	0.6148	0.6470	0.6148	0.7841
No log	11.0370	298	0.6128	0.5950	0.6128	0.7828
No log	11.1111	300	0.6125	0.6249	0.6125	0.7826
No log	11.1852	302	0.6124	0.6537	0.6124	0.7826
No log	11.2593	304	0.6175	0.6389	0.6175	0.7858
No log	11.3333	306	0.6051	0.6407	0.6051	0.7779
No log	11.4074	308	0.5895	0.6407	0.5895	0.7678
No log	11.4815	310	0.6127	0.6677	0.6127	0.7828
No log	11.5556	312	0.6318	0.6278	0.6318	0.7949
No log	11.6296	314	0.5745	0.6728	0.5745	0.7579
No log	11.7037	316	0.5486	0.6364	0.5486	0.7407
No log	11.7778	318	0.5413	0.6364	0.5413	0.7357
No log	11.8519	320	0.5429	0.7122	0.5429	0.7368
No log	11.9259	322	0.5912	0.6395	0.5912	0.7689
No log	12.0	324	0.6342	0.5854	0.6342	0.7964
No log	12.0741	326	0.5699	0.6958	0.5699	0.7549
No log	12.1481	328	0.5031	0.7225	0.5031	0.7093
No log	12.2222	330	0.4901	0.7171	0.4901	0.7001
No log	12.2963	332	0.5173	0.7114	0.5173	0.7193
No log	12.3704	334	0.5451	0.7003	0.5451	0.7383
No log	12.4444	336	0.5842	0.6639	0.5842	0.7643
No log	12.5185	338	0.5514	0.7003	0.5514	0.7426
No log	12.5926	340	0.5270	0.6849	0.5270	0.7259
No log	12.6667	342	0.5423	0.6849	0.5423	0.7364
No log	12.7407	344	0.5982	0.6438	0.5982	0.7734
No log	12.8148	346	0.7794	0.5086	0.7794	0.8828
No log	12.8889	348	0.8274	0.4975	0.8274	0.9096
No log	12.9630	350	0.7503	0.4464	0.7503	0.8662
No log	13.0370	352	0.6556	0.6519	0.6556	0.8097
No log	13.1111	354	0.6460	0.6186	0.6460	0.8037
No log	13.1852	356	0.6715	0.5357	0.6715	0.8194
No log	13.2593	358	0.7469	0.4789	0.7469	0.8642
No log	13.3333	360	0.8357	0.4531	0.8357	0.9141
No log	13.4074	362	0.8190	0.4652	0.8190	0.9050
No log	13.4815	364	0.6820	0.5387	0.6820	0.8258
No log	13.5556	366	0.5847	0.5932	0.5847	0.7647
No log	13.6296	368	0.5622	0.6488	0.5622	0.7498
No log	13.7037	370	0.5733	0.6282	0.5733	0.7572
No log	13.7778	372	0.6337	0.5695	0.6337	0.7960
No log	13.8519	374	0.6525	0.5134	0.6525	0.8078
No log	13.9259	376	0.5781	0.6455	0.5781	0.7603
No log	14.0	378	0.5810	0.6262	0.5810	0.7622
No log	14.0741	380	0.5590	0.6455	0.5590	0.7476
No log	14.1481	382	0.5319	0.6137	0.5319	0.7293
No log	14.2222	384	0.5174	0.6137	0.5174	0.7193
No log	14.2963	386	0.5328	0.6464	0.5328	0.7299
No log	14.3704	388	0.5168	0.6464	0.5168	0.7189
No log	14.4444	390	0.5138	0.6575	0.5138	0.7168
No log	14.5185	392	0.4851	0.6980	0.4851	0.6965
No log	14.5926	394	0.4756	0.6880	0.4756	0.6897
No log	14.6667	396	0.4984	0.6872	0.4984	0.7060
No log	14.7407	398	0.4973	0.7189	0.4973	0.7052
No log	14.8148	400	0.4961	0.7189	0.4961	0.7043
No log	14.8889	402	0.4913	0.7196	0.4913	0.7009
No log	14.9630	404	0.4974	0.7355	0.4974	0.7052
No log	15.0370	406	0.5039	0.7305	0.5039	0.7098
No log	15.1111	408	0.5035	0.7196	0.5035	0.7096
No log	15.1852	410	0.5269	0.6756	0.5269	0.7259
No log	15.2593	412	0.5135	0.6908	0.5135	0.7166
No log	15.3333	414	0.5088	0.7019	0.5088	0.7133
No log	15.4074	416	0.5258	0.7016	0.5258	0.7251
No log	15.4815	418	0.5423	0.6954	0.5423	0.7364
No log	15.5556	420	0.5423	0.6559	0.5423	0.7364
No log	15.6296	422	0.5989	0.5610	0.5989	0.7739
No log	15.7037	424	0.6420	0.5663	0.6420	0.8012
No log	15.7778	426	0.5915	0.5788	0.5915	0.7691
No log	15.8519	428	0.5210	0.6386	0.5210	0.7218
No log	15.9259	430	0.4879	0.7095	0.4879	0.6985
No log	16.0	432	0.4861	0.7573	0.4861	0.6972
No log	16.0741	434	0.4868	0.7095	0.4868	0.6977
No log	16.1481	436	0.5373	0.6386	0.5373	0.7330
No log	16.2222	438	0.6217	0.5867	0.6217	0.7885
No log	16.2963	440	0.6343	0.5867	0.6343	0.7964
No log	16.3704	442	0.5842	0.6099	0.5842	0.7643
No log	16.4444	444	0.5326	0.6446	0.5326	0.7298
No log	16.5185	446	0.5269	0.6911	0.5269	0.7259
No log	16.5926	448	0.5497	0.6133	0.5497	0.7414
No log	16.6667	450	0.6015	0.5822	0.6015	0.7755
No log	16.7407	452	0.6426	0.5033	0.6426	0.8017
No log	16.8148	454	0.6126	0.5602	0.6126	0.7827
No log	16.8889	456	0.5782	0.5700	0.5782	0.7604
No log	16.9630	458	0.5862	0.6313	0.5862	0.7656
No log	17.0370	460	0.6063	0.6441	0.6063	0.7787
No log	17.1111	462	0.5953	0.6324	0.5953	0.7715
No log	17.1852	464	0.5649	0.6733	0.5649	0.7516
No log	17.2593	466	0.5615	0.6370	0.5615	0.7494
No log	17.3333	468	0.5830	0.6082	0.5830	0.7635
No log	17.4074	470	0.5625	0.6003	0.5625	0.7500
No log	17.4815	472	0.5309	0.6397	0.5309	0.7286
No log	17.5556	474	0.5212	0.6706	0.5212	0.7220
No log	17.6296	476	0.5126	0.6894	0.5126	0.7160
No log	17.7037	478	0.5189	0.6894	0.5189	0.7203
No log	17.7778	480	0.5147	0.6724	0.5147	0.7174
No log	17.8519	482	0.5243	0.7025	0.5243	0.7241
No log	17.9259	484	0.5367	0.6175	0.5367	0.7326
No log	18.0	486	0.5476	0.6165	0.5476	0.7400
No log	18.0741	488	0.5417	0.5771	0.5417	0.7360
No log	18.1481	490	0.5519	0.5921	0.5519	0.7429
No log	18.2222	492	0.5917	0.5846	0.5917	0.7692
No log	18.2963	494	0.6553	0.5555	0.6553	0.8095
No log	18.3704	496	0.6272	0.5923	0.6272	0.7919
No log	18.4444	498	0.5568	0.6441	0.5568	0.7462
0.3189	18.5185	500	0.5420	0.6625	0.5420	0.7362
0.3189	18.5926	502	0.5421	0.6276	0.5421	0.7363
0.3189	18.6667	504	0.5421	0.5932	0.5421	0.7363
0.3189	18.7407	506	0.5697	0.6092	0.5697	0.7548
0.3189	18.8148	508	0.6141	0.6004	0.6141	0.7836
0.3189	18.8889	510	0.5840	0.6240	0.5840	0.7642

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1