ArabicNewSplits5_FineTuningAraBERT_run2_AugV5_k10_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4659
• Qwk: 0.3216
• Mse: 0.4659
• Rmse: 0.6826

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	3.1712	0.0	3.1712	1.7808
No log	0.0667	4	1.8288	0.0029	1.8288	1.3523
No log	0.1	6	1.1684	0.0294	1.1684	1.0809
No log	0.1333	8	1.4447	0.0515	1.4447	1.2019
No log	0.1667	10	2.0367	0.1229	2.0367	1.4271
No log	0.2	12	1.6882	0.0588	1.6882	1.2993
No log	0.2333	14	0.9969	0.0745	0.9969	0.9985
No log	0.2667	16	0.6676	0.2281	0.6676	0.8171
No log	0.3	18	0.7094	0.2300	0.7094	0.8422
No log	0.3333	20	0.7060	0.2077	0.7060	0.8402
No log	0.3667	22	0.7498	0.1861	0.7498	0.8659
No log	0.4	24	0.6857	0.2258	0.6857	0.8281
No log	0.4333	26	0.5562	0.1304	0.5562	0.7458
No log	0.4667	28	0.6790	0.1913	0.6790	0.8240
No log	0.5	30	1.4080	0.0833	1.4080	1.1866
No log	0.5333	32	2.7361	0.0324	2.7361	1.6541
No log	0.5667	34	2.2056	0.0074	2.2056	1.4851
No log	0.6	36	1.3454	0.0	1.3454	1.1599
No log	0.6333	38	0.7574	0.2479	0.7574	0.8703
No log	0.6667	40	0.5657	0.0569	0.5657	0.7521
No log	0.7	42	0.5558	0.0569	0.5558	0.7456
No log	0.7333	44	0.5763	0.0476	0.5763	0.7591
No log	0.7667	46	0.9352	0.0476	0.9352	0.9670
No log	0.8	48	1.3500	0.0588	1.3500	1.1619
No log	0.8333	50	1.1050	0.0977	1.1050	1.0512
No log	0.8667	52	0.6177	0.2970	0.6177	0.7860
No log	0.9	54	0.5740	0.0534	0.5740	0.7576
No log	0.9333	56	0.6074	0.1813	0.6074	0.7794
No log	0.9667	58	0.7972	0.1351	0.7972	0.8928
No log	1.0	60	0.8891	0.0769	0.8891	0.9429
No log	1.0333	62	0.6947	0.1746	0.6947	0.8335
No log	1.0667	64	0.7166	0.1746	0.7166	0.8465
No log	1.1	66	0.6076	0.0638	0.6076	0.7795
No log	1.1333	68	0.6145	0.0556	0.6145	0.7839
No log	1.1667	70	0.9200	0.0991	0.9200	0.9592
No log	1.2	72	0.9734	0.0823	0.9734	0.9866
No log	1.2333	74	0.6446	0.0769	0.6446	0.8029
No log	1.2667	76	0.6004	0.0886	0.6004	0.7749
No log	1.3	78	0.7307	0.2653	0.7307	0.8548
No log	1.3333	80	0.7751	0.2523	0.7751	0.8804
No log	1.3667	82	0.5812	0.2000	0.5812	0.7624
No log	1.4	84	0.6713	0.1892	0.6713	0.8193
No log	1.4333	86	0.5750	0.2370	0.5750	0.7583
No log	1.4667	88	0.6176	0.1186	0.6176	0.7859
No log	1.5	90	0.6755	0.1398	0.6755	0.8219
No log	1.5333	92	0.5849	0.2265	0.5849	0.7648
No log	1.5667	94	0.7173	0.2593	0.7173	0.8469
No log	1.6	96	0.6300	0.2994	0.6300	0.7937
No log	1.6333	98	0.7103	0.3607	0.7103	0.8428
No log	1.6667	100	0.6456	0.2464	0.6456	0.8035
No log	1.7	102	0.5464	0.4413	0.5464	0.7392
No log	1.7333	104	0.5767	0.3333	0.5767	0.7594
No log	1.7667	106	0.5523	0.2444	0.5523	0.7432
No log	1.8	108	0.5381	0.2370	0.5381	0.7336
No log	1.8333	110	0.6933	0.2453	0.6933	0.8326
No log	1.8667	112	0.8779	0.2469	0.8779	0.9369
No log	1.9	114	0.7143	0.2372	0.7143	0.8451
No log	1.9333	116	0.6602	0.1269	0.6602	0.8125
No log	1.9667	118	0.5993	0.2251	0.5993	0.7741
No log	2.0	120	0.6113	0.2865	0.6113	0.7819
No log	2.0333	122	0.6117	0.2865	0.6117	0.7821
No log	2.0667	124	0.6405	0.3469	0.6405	0.8003
No log	2.1	126	0.6368	0.3575	0.6368	0.7980
No log	2.1333	128	0.6707	0.2332	0.6707	0.8190
No log	2.1667	130	0.9507	0.1524	0.9507	0.9750
No log	2.2	132	0.7192	0.2744	0.7192	0.8481
No log	2.2333	134	0.6072	0.3149	0.6072	0.7792
No log	2.2667	136	0.6127	0.2432	0.6127	0.7827
No log	2.3	138	0.9462	0.1355	0.9462	0.9727
No log	2.3333	140	1.0160	0.1367	1.0160	1.0080
No log	2.3667	142	0.6081	0.2298	0.6081	0.7798
No log	2.4	144	0.6861	0.2897	0.6861	0.8283
No log	2.4333	146	0.6905	0.2830	0.6905	0.8310
No log	2.4667	148	0.5048	0.2970	0.5048	0.7105
No log	2.5	150	0.8516	0.2618	0.8516	0.9228
No log	2.5333	152	1.0453	0.1419	1.0453	1.0224
No log	2.5667	154	0.8595	0.2863	0.8595	0.9271
No log	2.6	156	0.5499	0.3224	0.5499	0.7415
No log	2.6333	158	0.5421	0.4973	0.5421	0.7363
No log	2.6667	160	0.7580	0.3153	0.7580	0.8706
No log	2.7	162	0.9116	0.2941	0.9116	0.9548
No log	2.7333	164	0.7534	0.2711	0.7534	0.8680
No log	2.7667	166	0.5948	0.3803	0.5948	0.7712
No log	2.8	168	0.5925	0.3623	0.5925	0.7697
No log	2.8333	170	0.6298	0.3607	0.6298	0.7936
No log	2.8667	172	0.5306	0.3369	0.5306	0.7285
No log	2.9	174	0.5351	0.3706	0.5351	0.7315
No log	2.9333	176	0.5291	0.375	0.5291	0.7274
No log	2.9667	178	0.5273	0.3797	0.5273	0.7261
No log	3.0	180	0.5187	0.4286	0.5187	0.7202
No log	3.0333	182	0.5689	0.4118	0.5689	0.7543
No log	3.0667	184	0.5285	0.3814	0.5285	0.7270
No log	3.1	186	0.5291	0.3814	0.5291	0.7274
No log	3.1333	188	0.6031	0.3744	0.6031	0.7766
No log	3.1667	190	0.5189	0.4023	0.5189	0.7204
No log	3.2	192	0.5113	0.4023	0.5113	0.7151
No log	3.2333	194	0.5507	0.3191	0.5507	0.7421
No log	3.2667	196	0.6106	0.2577	0.6106	0.7814
No log	3.3	198	0.5714	0.2513	0.5714	0.7559
No log	3.3333	200	0.5239	0.4091	0.5239	0.7238
No log	3.3667	202	0.5365	0.3295	0.5365	0.7325
No log	3.4	204	0.5611	0.3231	0.5611	0.7490
No log	3.4333	206	0.6005	0.2871	0.6005	0.7749
No log	3.4667	208	0.5066	0.3333	0.5066	0.7118
No log	3.5	210	0.5079	0.3661	0.5079	0.7126
No log	3.5333	212	0.5084	0.3054	0.5084	0.7130
No log	3.5667	214	0.5785	0.2663	0.5785	0.7606
No log	3.6	216	0.5442	0.2683	0.5442	0.7377
No log	3.6333	218	0.4938	0.3735	0.4938	0.7027
No log	3.6667	220	0.5146	0.3121	0.5146	0.7173
No log	3.7	222	0.5896	0.2189	0.5896	0.7678
No log	3.7333	224	0.7008	0.2315	0.7008	0.8371
No log	3.7667	226	0.6427	0.1759	0.6427	0.8017
No log	3.8	228	0.5954	0.3297	0.5954	0.7716
No log	3.8333	230	0.6860	0.2077	0.6860	0.8283
No log	3.8667	232	0.5469	0.3149	0.5469	0.7395
No log	3.9	234	0.5068	0.5111	0.5068	0.7119
No log	3.9333	236	0.5369	0.3258	0.5369	0.7328
No log	3.9667	238	0.8555	0.2782	0.8555	0.9249
No log	4.0	240	1.0768	0.1698	1.0768	1.0377
No log	4.0333	242	0.8572	0.2456	0.8572	0.9258
No log	4.0667	244	0.4948	0.4152	0.4948	0.7034
No log	4.1	246	0.4870	0.5030	0.4870	0.6979
No log	4.1333	248	0.4850	0.4483	0.4850	0.6964
No log	4.1667	250	0.5315	0.3810	0.5315	0.7290
No log	4.2	252	0.5334	0.3810	0.5334	0.7304
No log	4.2333	254	0.5497	0.2471	0.5497	0.7414
No log	4.2667	256	0.5346	0.3333	0.5346	0.7311
No log	4.3	258	0.5110	0.3333	0.5110	0.7149
No log	4.3333	260	0.5859	0.2914	0.5859	0.7654
No log	4.3667	262	0.6772	0.2549	0.6772	0.8229
No log	4.4	264	0.6519	0.2563	0.6519	0.8074
No log	4.4333	266	0.5312	0.3939	0.5312	0.7288
No log	4.4667	268	0.5145	0.2970	0.5145	0.7173
No log	4.5	270	0.5056	0.4217	0.5056	0.7111
No log	4.5333	272	0.5739	0.2558	0.5739	0.7576
No log	4.5667	274	0.5256	0.3412	0.5256	0.7250
No log	4.6	276	0.4901	0.4699	0.4901	0.7001
No log	4.6333	278	0.5036	0.2970	0.5036	0.7097
No log	4.6667	280	0.7713	0.3333	0.7713	0.8782
No log	4.7	282	0.9839	0.1389	0.9839	0.9919
No log	4.7333	284	0.7507	0.3593	0.7507	0.8664
No log	4.7667	286	0.4837	0.4152	0.4837	0.6955
No log	4.8	288	0.4846	0.3508	0.4846	0.6961
No log	4.8333	290	0.4843	0.4545	0.4843	0.6959
No log	4.8667	292	0.6551	0.3917	0.6551	0.8094
No log	4.9	294	0.7105	0.3886	0.7105	0.8429
No log	4.9333	296	0.5630	0.2967	0.5630	0.7503
No log	4.9667	298	0.5469	0.2889	0.5469	0.7395
No log	5.0	300	0.6100	0.2967	0.6100	0.7810
No log	5.0333	302	0.7049	0.2963	0.7049	0.8396
No log	5.0667	304	0.5717	0.3103	0.5717	0.7561
No log	5.1	306	0.5019	0.3054	0.5019	0.7084
No log	5.1333	308	0.5770	0.3591	0.5770	0.7596
No log	5.1667	310	0.5513	0.4083	0.5513	0.7425
No log	5.2	312	0.4874	0.3253	0.4874	0.6981
No log	5.2333	314	0.5454	0.3371	0.5454	0.7385
No log	5.2667	316	0.5569	0.3023	0.5569	0.7463
No log	5.3	318	0.4974	0.3865	0.4974	0.7053
No log	5.3333	320	0.5044	0.2593	0.5044	0.7102
No log	5.3667	322	0.4937	0.2593	0.4937	0.7027
No log	5.4	324	0.4855	0.3333	0.4855	0.6967
No log	5.4333	326	0.5190	0.3757	0.5190	0.7204
No log	5.4667	328	0.5111	0.3757	0.5111	0.7149
No log	5.5	330	0.4722	0.3333	0.4722	0.6872
No log	5.5333	332	0.4626	0.3333	0.4626	0.6801
No log	5.5667	334	0.4726	0.3333	0.4726	0.6875
No log	5.6	336	0.4895	0.3757	0.4895	0.6996
No log	5.6333	338	0.4649	0.4023	0.4649	0.6819
No log	5.6667	340	0.4575	0.4023	0.4575	0.6764
No log	5.7	342	0.4809	0.3913	0.4809	0.6935
No log	5.7333	344	0.5166	0.4404	0.5166	0.7187
No log	5.7667	346	0.4647	0.3953	0.4647	0.6817
No log	5.8	348	0.4612	0.4023	0.4612	0.6791
No log	5.8333	350	0.4682	0.4033	0.4682	0.6843
No log	5.8667	352	0.4641	0.4413	0.4641	0.6813
No log	5.9	354	0.4852	0.4033	0.4852	0.6965
No log	5.9333	356	0.5099	0.3661	0.5099	0.7141
No log	5.9667	358	0.5201	0.3661	0.5201	0.7212
No log	6.0	360	0.4509	0.3636	0.4509	0.6715
No log	6.0333	362	0.4370	0.3735	0.4370	0.6611
No log	6.0667	364	0.4452	0.4884	0.4452	0.6673
No log	6.1	366	0.4410	0.4556	0.4410	0.6641
No log	6.1333	368	0.4513	0.4884	0.4513	0.6718
No log	6.1667	370	0.4418	0.4556	0.4418	0.6647
No log	6.2	372	0.4556	0.3216	0.4556	0.6750
No log	6.2333	374	0.4479	0.3735	0.4479	0.6692
No log	6.2667	376	0.4580	0.3636	0.4580	0.6767
No log	6.3	378	0.4588	0.3636	0.4588	0.6773
No log	6.3333	380	0.5023	0.3412	0.5023	0.7087
No log	6.3667	382	0.6218	0.3367	0.6218	0.7885
No log	6.4	384	0.6220	0.3706	0.6220	0.7886
No log	6.4333	386	0.5257	0.2914	0.5257	0.7251
No log	6.4667	388	0.4580	0.3735	0.4580	0.6768
No log	6.5	390	0.4935	0.5217	0.4935	0.7025
No log	6.5333	392	0.4836	0.5056	0.4836	0.6954
No log	6.5667	394	0.4578	0.3735	0.4578	0.6766
No log	6.6	396	0.5136	0.3412	0.5136	0.7167
No log	6.6333	398	0.5743	0.3446	0.5743	0.7579
No log	6.6667	400	0.5185	0.3412	0.5185	0.7201
No log	6.7	402	0.4665	0.3333	0.4665	0.6830
No log	6.7333	404	0.4483	0.3216	0.4483	0.6695
No log	6.7667	406	0.4471	0.3216	0.4471	0.6687
No log	6.8	408	0.4732	0.3757	0.4732	0.6879
No log	6.8333	410	0.5155	0.3953	0.5155	0.7180
No log	6.8667	412	0.5133	0.3953	0.5133	0.7164
No log	6.9	414	0.5457	0.3846	0.5457	0.7387
No log	6.9333	416	0.5300	0.4350	0.5300	0.7280
No log	6.9667	418	0.4451	0.3333	0.4451	0.6671
No log	7.0	420	0.4494	0.4607	0.4494	0.6704
No log	7.0333	422	0.5198	0.5	0.5198	0.7210
No log	7.0667	424	0.5242	0.4872	0.5242	0.7240
No log	7.1	426	0.4551	0.4475	0.4551	0.6746
No log	7.1333	428	0.4364	0.3216	0.4364	0.6606
No log	7.1667	430	0.4573	0.3757	0.4573	0.6762
No log	7.2	432	0.4435	0.3216	0.4435	0.6660
No log	7.2333	434	0.4445	0.4419	0.4445	0.6667
No log	7.2667	436	0.4558	0.4286	0.4558	0.6751
No log	7.3	438	0.4385	0.3735	0.4385	0.6622
No log	7.3333	440	0.4424	0.3735	0.4424	0.6651
No log	7.3667	442	0.4498	0.4152	0.4498	0.6707
No log	7.4	444	0.4483	0.4152	0.4483	0.6695
No log	7.4333	446	0.4434	0.3735	0.4434	0.6659
No log	7.4667	448	0.4459	0.3735	0.4459	0.6677
No log	7.5	450	0.4498	0.4556	0.4498	0.6707
No log	7.5333	452	0.4594	0.3636	0.4594	0.6778
No log	7.5667	454	0.4623	0.3636	0.4623	0.6799
No log	7.6	456	0.4605	0.4556	0.4605	0.6786
No log	7.6333	458	0.4614	0.4419	0.4614	0.6793
No log	7.6667	460	0.4619	0.4419	0.4619	0.6796
No log	7.7	462	0.4569	0.3216	0.4569	0.6759
No log	7.7333	464	0.4524	0.4023	0.4524	0.6726
No log	7.7667	466	0.4502	0.4556	0.4502	0.6710
No log	7.8	468	0.4473	0.4556	0.4473	0.6688
No log	7.8333	470	0.4504	0.3333	0.4504	0.6711
No log	7.8667	472	0.4610	0.3757	0.4610	0.6790
No log	7.9	474	0.4828	0.3757	0.4828	0.6948
No log	7.9333	476	0.4742	0.3757	0.4742	0.6886
No log	7.9667	478	0.4656	0.3757	0.4656	0.6823
No log	8.0	480	0.4759	0.3757	0.4759	0.6898
No log	8.0333	482	0.4676	0.3757	0.4676	0.6838
No log	8.0667	484	0.4567	0.3216	0.4567	0.6758
No log	8.1	486	0.4549	0.3609	0.4549	0.6745
No log	8.1333	488	0.4584	0.3735	0.4584	0.6771
No log	8.1667	490	0.4698	0.3216	0.4698	0.6854
No log	8.2	492	0.4695	0.3216	0.4695	0.6852
No log	8.2333	494	0.4969	0.3412	0.4969	0.7049
No log	8.2667	496	0.5076	0.3412	0.5076	0.7125
No log	8.3	498	0.4949	0.3412	0.4949	0.7035
0.3586	8.3333	500	0.4654	0.3216	0.4654	0.6822
0.3586	8.3667	502	0.4625	0.3371	0.4625	0.6801
0.3586	8.4	504	0.4654	0.3371	0.4654	0.6822
0.3586	8.4333	506	0.4624	0.3371	0.4624	0.6800
0.3586	8.4667	508	0.4591	0.3609	0.4591	0.6776
0.3586	8.5	510	0.4581	0.3103	0.4581	0.6768
0.3586	8.5333	512	0.4566	0.3103	0.4566	0.6758
0.3586	8.5667	514	0.4547	0.3103	0.4547	0.6743
0.3586	8.6	516	0.4538	0.3103	0.4538	0.6736
0.3586	8.6333	518	0.4606	0.3216	0.4606	0.6787
0.3586	8.6667	520	0.4677	0.3216	0.4677	0.6839
0.3586	8.7	522	0.4845	0.4033	0.4845	0.6961
0.3586	8.7333	524	0.4789	0.3636	0.4789	0.6920
0.3586	8.7667	526	0.4629	0.3216	0.4629	0.6804
0.3586	8.8	528	0.4519	0.3103	0.4519	0.6722
0.3586	8.8333	530	0.4586	0.3488	0.4586	0.6772
0.3586	8.8667	532	0.4715	0.4783	0.4715	0.6867
0.3586	8.9	534	0.4708	0.4783	0.4708	0.6861
0.3586	8.9333	536	0.4644	0.4917	0.4644	0.6815
0.3586	8.9667	538	0.4559	0.3488	0.4559	0.6752
0.3586	9.0	540	0.4535	0.3103	0.4535	0.6734
0.3586	9.0333	542	0.4584	0.3216	0.4584	0.6771
0.3586	9.0667	544	0.4782	0.3636	0.4782	0.6915
0.3586	9.1	546	0.4972	0.4033	0.4972	0.7051
0.3586	9.1333	548	0.5003	0.4033	0.5003	0.7074
0.3586	9.1667	550	0.4894	0.4033	0.4894	0.6996
0.3586	9.2	552	0.4714	0.3216	0.4714	0.6866
0.3586	9.2333	554	0.4595	0.3103	0.4595	0.6779
0.3586	9.2667	556	0.4594	0.2994	0.4594	0.6778
0.3586	9.3	558	0.4604	0.2994	0.4604	0.6785
0.3586	9.3333	560	0.4606	0.3103	0.4606	0.6786
0.3586	9.3667	562	0.4619	0.3103	0.4619	0.6796
0.3586	9.4	564	0.4639	0.3216	0.4639	0.6811
0.3586	9.4333	566	0.4637	0.3216	0.4637	0.6810
0.3586	9.4667	568	0.4635	0.3216	0.4635	0.6808
0.3586	9.5	570	0.4635	0.3216	0.4635	0.6808
0.3586	9.5333	572	0.4632	0.3216	0.4632	0.6806
0.3586	9.5667	574	0.4612	0.3103	0.4612	0.6791
0.3586	9.6	576	0.4598	0.3103	0.4598	0.6781
0.3586	9.6333	578	0.4593	0.3103	0.4593	0.6777
0.3586	9.6667	580	0.4593	0.3103	0.4593	0.6777
0.3586	9.7	582	0.4600	0.3216	0.4600	0.6783
0.3586	9.7333	584	0.4608	0.3216	0.4608	0.6788
0.3586	9.7667	586	0.4621	0.3216	0.4621	0.6798
0.3586	9.8	588	0.4638	0.3216	0.4638	0.6811
0.3586	9.8333	590	0.4652	0.3216	0.4652	0.6821
0.3586	9.8667	592	0.4662	0.3216	0.4662	0.6828
0.3586	9.9	594	0.4666	0.3216	0.4666	0.6831
0.3586	9.9333	596	0.4666	0.3216	0.4666	0.6831
0.3586	9.9667	598	0.4661	0.3216	0.4661	0.6827
0.3586	10.0	600	0.4659	0.3216	0.4659	0.6826

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1